2023-12-17T11:26:22.883 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-17T11:26:22.883 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152 --owner scheduled_rishabh@teuthology --verbose --name rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/orig.config.yaml 2023-12-17T11:26:22.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:26:23.023 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152 branch: rishabh-2023dec11 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7495152' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: rishabh-2023dec11 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a62fda73efba5520d409bb5a21bd8373289dda5d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a62fda73efba5520d409bb5a21bd8373289dda5d kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023dec11 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5791 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: rishabh-2023dec11 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a62fda73efba5520d409bb5a21bd8373289dda5d targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsycvUbnia+XXkIfKBuYRX380QKBeNgeLZxMSxt62N5c2Kn+KDHDLLIu4x9R8LprchiOyf1iPWYew6dSbS2Uq8= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzhAPDhDoCLugXeLkhhliGd0SSmb8SNsKmCliskRa2edTROP4W8MGmkcnE/kwnX+V5hleGkgbcPK4OtJ9wGwC4= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-17_11:19:43 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-17T11:26:23.023 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa; will attempt to use it 2023-12-17T11:26:23.024 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks 2023-12-17T11:26:23.024 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-17T11:26:23.026 INFO:teuthology.task.internal:Checking packages... 2023-12-17T11:26:23.047 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a62fda73efba5520d409bb5a21bd8373289dda5d' 2023-12-17T11:26:23.047 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:26:23.047 INFO:teuthology.packaging:ref: None 2023-12-17T11:26:23.047 INFO:teuthology.packaging:tag: None 2023-12-17T11:26:23.047 INFO:teuthology.packaging:branch: rishabh-2023dec11 2023-12-17T11:26:23.047 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:26:23.047 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023dec11 2023-12-17T11:26:23.213 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-119.ga62fda73 2023-12-17T11:26:23.214 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-17T11:26:23.220 INFO:teuthology.task.internal:no buildpackages task found 2023-12-17T11:26:23.220 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-17T11:26:23.606 INFO:teuthology.task.internal:Saving configuration 2023-12-17T11:26:23.626 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-17T11:26:23.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T11:26:23.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:18.402672', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsycvUbnia+XXkIfKBuYRX380QKBeNgeLZxMSxt62N5c2Kn+KDHDLLIu4x9R8LprchiOyf1iPWYew6dSbS2Uq8='} 2023-12-17T11:26:23.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:18.400272', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzhAPDhDoCLugXeLkhhliGd0SSmb8SNsKmCliskRa2edTROP4W8MGmkcnE/kwnX+V5hleGkgbcPK4OtJ9wGwC4='} 2023-12-17T11:26:23.679 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-17T11:26:23.685 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-17T11:26:23.686 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-17T11:26:23.686 INFO:teuthology.run_tasks:Running task console_log... 2023-12-17T11:26:23.782 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f70087e8dc0>, signals=[15]) 2023-12-17T11:26:23.783 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-17T11:26:23.789 INFO:teuthology.task.internal:Opening connections... 2023-12-17T11:26:23.789 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:26:23.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:23.860 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-12-17T11:26:23.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:26:23.927 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-17T11:26:23.933 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-12-17T11:26:23.956 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-12-17T11:26:23.956 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8" 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8" 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:26:24.017 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-17T11:26:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-12-17T11:26:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-17T11:26:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-12-17T11:26:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:26:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:26:24.018 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-17T11:26:24.018 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-12-17T11:26:24.354 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-12-17T11:26:24.377 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-12-17T11:26:24.377 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-12-17T11:26:24.438 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-12-17T11:26:24.438 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:26:24.439 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-17T11:26:24.440 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-12-17T11:26:24.462 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-17T11:26:24.471 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-17T11:26:24.491 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-17T11:26:24.491 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:26:24.494 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:26:24.514 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-17T11:26:24.562 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-17T11:26:24.562 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:26:24.565 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:26:24.607 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-17T11:26:24.663 INFO:teuthology.run_tasks:Running task kernel... 2023-12-17T11:26:24.678 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-17T11:26:24.678 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-17T11:26:24.678 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:26:24.679 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:26:24.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:26:24.698 DEBUG:teuthology.task.kernel:sha1 for host.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:26:24.699 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:26:24.699 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-12-17T11:26:24.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:26:24.701 DEBUG:teuthology.task.kernel:sha1 for host.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:26:24.701 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:26:24.702 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-12-17T11:26:24.758 INFO:teuthology.orchestra.run.smithi119.stdout:4.18.0-489.el8.x86_64 2023-12-17T11:26:24.758 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:26:24.759 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:26:24.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:26:24.763 INFO:teuthology.orchestra.run.smithi002.stdout:4.18.0-489.el8.x86_64 2023-12-17T11:26:24.763 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:26:24.764 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:26:24.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:26:24.915 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum upgrade -y linux-firmware 2023-12-17T11:26:24.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2023-12-17T11:26:29.398 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - AppStream 18 MB/s | 35 MB 00:01 2023-12-17T11:26:29.410 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - AppStream 17 MB/s | 35 MB 00:02 2023-12-17T11:26:38.190 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 56 MB 00:02 2023-12-17T11:26:46.539 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-12-17T11:26:46.932 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras common packages 32 kB/s | 6.9 kB 00:00 2023-12-17T11:26:47.275 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-12-17T11:26:47.517 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - BaseOS 5.0 MB/s | 56 MB 00:11 2023-12-17T11:26:49.003 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-12-17T11:26:54.084 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 20 kB/s | 24 kB 00:01 2023-12-17T11:26:56.225 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - Extras 111 kB/s | 18 kB 00:00 2023-12-17T11:26:56.551 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - Extras common packages 51 kB/s | 6.9 kB 00:00 2023-12-17T11:26:56.844 INFO:teuthology.orchestra.run.smithi002.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-17T11:26:58.018 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout: linux-firmware noarch 20231121-120.git9552083a.el8 baseos 347 M 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:26:58.019 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 1 Package 2023-12-17T11:26:58.020 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:26:58.020 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 347 M 2023-12-17T11:26:58.020 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:26:59.722 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-12-17T11:27:03.744 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 594 kB/s | 24 kB 00:00 2023-12-17T11:27:07.880 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:27:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:27:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2023-12-17T11:27:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:27:07.881 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2023-12-17T11:27:07.881 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware noarch 20231121-120.git9552083a.el8 baseos 347 M 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 1 Package 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 347 M 2023-12-17T11:27:07.882 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:27:12.392 INFO:teuthology.orchestra.run.smithi119.stdout:linux-firmware-20231121-120.git9552083a.el8.noa 24 MB/s | 347 MB 00:14 2023-12-17T11:27:12.393 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:27:12.393 INFO:teuthology.orchestra.run.smithi119.stdout:Total 24 MB/s | 347 MB 00:14 2023-12-17T11:27:14.447 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:27:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:27:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:27:16.691 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:27:16.724 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:27:26.319 INFO:teuthology.orchestra.run.smithi002.stdout:linux-firmware-20231121-120.git9552083a.el8.noa 20 MB/s | 347 MB 00:17 2023-12-17T11:27:26.319 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:27:26.319 INFO:teuthology.orchestra.run.smithi002.stdout:Total 19 MB/s | 347 MB 00:18 2023-12-17T11:27:28.478 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:27:28.542 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:27:28.542 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:27:30.775 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:27:30.805 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:27:38.944 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:27:39.290 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-17T11:27:39.552 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-17T11:27:39.776 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-17T11:27:39.776 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-17T11:27:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-17T11:27:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:27:40.595 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2023-12-17T11:27:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: linux-firmware-20231121-120.git9552083a.el8.noarch 2023-12-17T11:27:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:27:40.595 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:27:40.778 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.b... 2023-12-17T11:27:40.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:27:40.921 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-17T11:27:40.921 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-17T11:27:40.923 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-12-17T11:27:54.332 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:27:54.675 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-17T11:27:54.883 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-17T11:27:55.148 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-17T11:27:55.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20231121-120.git9552083a.el8.noarch 1/2 2023-12-17T11:27:56.059 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-17T11:27:56.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:27:56.059 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2023-12-17T11:27:56.059 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware-20231121-120.git9552083a.el8.noarch 2023-12-17T11:27:56.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:27:56.060 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:27:56.266 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.a... 2023-12-17T11:27:56.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:27:56.405 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-17T11:27:56.406 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-17T11:27:56.408 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2023-12-17T11:28:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17 11:28:35 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:28:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2023-12-17 11:28:35-- 2023-12-17T11:28:35.156 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 39s 2023-12-17T11:28:35.157 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 365M in 38s (9.57 MB/s) 2023-12-17T11:28:35.160 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.a... 2023-12-17T11:28:35.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:28:36.924 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2023-12-17T11:28:36.969 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2023-12-17T11:28:37.084 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2023-12-17T11:29:17.922 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:29:19.322 INFO:teuthology.orchestra.run.smithi002.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17 11:29:36 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:29:36.073 INFO:teuthology.orchestra.run.smithi119.stderr:FINISHED --2023-12-17 11:29:36-- 2023-12-17T11:29:36.073 INFO:teuthology.orchestra.run.smithi119.stderr:Total wall clock time: 1m 55s 2023-12-17T11:29:36.073 INFO:teuthology.orchestra.run.smithi119.stderr:Downloaded: 1 files, 365M in 1m 55s (3.18 MB/s) 2023-12-17T11:29:36.076 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on host.b... 2023-12-17T11:29:36.076 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:29:37.751 INFO:teuthology.orchestra.run.smithi119.stdout:Verifying... ######################################## 2023-12-17T11:29:37.794 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing... ######################################## 2023-12-17T11:29:37.905 INFO:teuthology.orchestra.run.smithi119.stdout:Updating / installing... 2023-12-17T11:29:41.906 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:29:41.906 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:29:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:29:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:29:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:29:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:29:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:29:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:29:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:29:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:29:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:29:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:29:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:29:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:29:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:29:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:29:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:29:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:29:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:29:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:29:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:29:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:29:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:29:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:29:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:29:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:29:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:29:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:29:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:29:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:29:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:29:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:29:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:29:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:29:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:29:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:29:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:29:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:29:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:29:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:29:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:29:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:29:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:29:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:29:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:29:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:29:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:29:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:29:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:29:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:29:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:29:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:29:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:29:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:29:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:29:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:29:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:29:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:29:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:29:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:29:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:29:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:29:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:29:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:29:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:29:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:29:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:29:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:29:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:29:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:29:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:29:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:29:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:29:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:29:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:29:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:29:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:29:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:29:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:29:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:29:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:29:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:29:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:29:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:29:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:29:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:29:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:29:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:29:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:29:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:29:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:29:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:29:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:29:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:29:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:29:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:29:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:29:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:29:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:29:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:29:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:29:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:29:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:29:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:29:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:29:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:29:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:29:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:29:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:29:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:29:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:29:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:29:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:29:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:29:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:29:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:29:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:29:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:29:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:29:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:29:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:29:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:29:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:29:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:29:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:29:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:29:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:29:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:29:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:29:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:29:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:29:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:29:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:29:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:29:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:29:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:29:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:29:42.099 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:29:42.099 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:29:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:29:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2023-12-17T11:29:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:29:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:29:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:29:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2023-12-17T11:29:42.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2023-12-17T11:29:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2023-12-17T11:29:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2023-12-17T11:29:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.02 2023-12-17T11:29:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 129.el8 2023-12-17T11:29:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2023-12-17T11:29:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Group : System Environment/Base 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 9265586 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Relocations : (not relocatable) 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : CentOS BuildSystem 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:29:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:29:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:29:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:29:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2023-12-17T11:29:42.211 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:29:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:29:42.212 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:29:42.212 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:29:42.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:29:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2023-12-17T11:29:47.525 INFO:teuthology.orchestra.run.smithi002.stderr:done 2023-12-17T11:29:47.527 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2023-12-17T11:29:47.549 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.H0KgEqksWo 2023-12-17T11:29:47.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H0KgEqksWo 2023-12-17T11:29:47.622 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.H0KgEqksWo 2023-12-17T11:29:47.792 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.H0KgEqksWo is 6KB 2023-12-17T11:29:47.841 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.H0KgEqksWo 2023-12-17T11:29:47.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:29:47.925 INFO:teuthology.orchestra.run.smithi002.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-17T11:29:47.925 INFO:teuthology.orchestra.run.smithi002.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-17T11:29:47.926 INFO:teuthology.orchestra.run.smithi002.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-17T11:29:47.926 INFO:teuthology.orchestra.run.smithi002.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:29:47.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d 2023-12-17T11:29:48.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2023-12-17T11:30:16.123 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:30:17.482 INFO:teuthology.orchestra.run.smithi119.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:30:18.109 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-17T11:30:18.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-17T11:30:18.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:30:36.433 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-12-17T11:30:39.101 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:30:39.101 DEBUG:teuthology.orchestra.run.smithi119:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:30:39.157 INFO:teuthology.orchestra.run.smithi119.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:30:39.158 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:30:39.159 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:30:39.160 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:30:39.161 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:30:39.162 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:30:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:30:39.164 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:30:39.165 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:30:39.166 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:30:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:30:39.168 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:30:39.169 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:30:39.170 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:30:39.171 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:30:39.172 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:30:39.173 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:30:39.174 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:30:39.175 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:30:39.176 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:30:39.177 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:30:39.178 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:30:39.179 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:30:39.180 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:30:39.181 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:30:39.182 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:30:39.183 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:30:39.184 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:30:39.185 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:30:39.186 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:30:39.187 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:30:39.188 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:30:39.189 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:30:39.190 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:30:39.191 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:30:39.192 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:30:39.193 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:30:39.194 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:30:39.195 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:30:39.196 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:30:39.197 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:30:39.198 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:30:39.199 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:30:39.200 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:30:39.201 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:30:39.202 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:30:39.203 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:30:39.204 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:30:39.205 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:30:39.206 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:30:39.207 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:30:39.208 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:30:39.209 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:30:39.210 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:30:39.211 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:30:39.212 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:30:39.213 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:30:39.214 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:30:39.215 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:30:39.216 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:30:39.217 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:30:39.218 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:30:39.219 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:30:39.220 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:30:39.221 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:30:39.222 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:30:39.223 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:30:39.224 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:30:39.225 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:30:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:30:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:30:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:30:39.229 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:30:39.230 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:30:39.231 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:30:39.232 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:30:39.233 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:30:39.234 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:30:39.235 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:30:39.236 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:30:39.237 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:30:39.238 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:30:39.239 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:30:39.240 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:30:39.241 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:30:39.242 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:30:39.243 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:30:39.244 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:30:39.245 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:30:39.246 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:30:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:30:39.248 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:30:39.249 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:30:39.252 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:30:39.253 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:30:39.254 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:30:39.255 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:30:39.256 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:30:39.257 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:30:39.258 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:30:39.259 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:30:39.260 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:30:39.261 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:30:39.262 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:30:39.263 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:30:39.264 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:30:39.265 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:30:39.266 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:30:39.267 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:30:39.268 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:30:39.269 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:30:39.270 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:30:39.271 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:30:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:30:39.273 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:30:39.274 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:30:39.275 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:30:39.276 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:30:39.277 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:30:39.278 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:30:39.279 INFO:teuthology.orchestra.run.smithi119.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:30:39.279 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.280 DEBUG:teuthology.orchestra.run.smithi119:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:30:39.305 INFO:teuthology.orchestra.run.smithi119.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:30:39.305 INFO:teuthology.orchestra.run.smithi119.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:30:39.305 INFO:teuthology.orchestra.run.smithi119.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.306 INFO:teuthology.orchestra.run.smithi119.stdout:fi 2023-12-17T11:30:39.307 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2023-12-17T11:30:39.383 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.02 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 129.el8 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Group : System Environment/Base 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 9265586 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-17T11:30:39.384 INFO:teuthology.orchestra.run.smithi119.stdout:Relocations : (not relocatable) 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : CentOS BuildSystem 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:30:39.385 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:30:39.386 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:30:39.386 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:30:39.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:30:43.754 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-12-17T11:30:45.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-17T11:30:45.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:30:46.044 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-12-17T11:30:46.046 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-12-17T11:30:46.068 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.4JDeyzTwih 2023-12-17T11:30:46.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4JDeyzTwih 2023-12-17T11:30:46.142 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.4JDeyzTwih 2023-12-17T11:30:46.323 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.4JDeyzTwih is 6KB 2023-12-17T11:30:46.371 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.4JDeyzTwih 2023-12-17T11:30:46.388 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:30:46.471 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-17T11:30:46.471 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-17T11:30:46.472 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-17T11:30:46.472 INFO:teuthology.orchestra.run.smithi119.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:30:46.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-gcd68252d7b4d 2023-12-17T11:30:46.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2023-12-17T11:31:16.641 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-17T11:31:16.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-17T11:31:16.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:31:35.057 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-17T11:31:44.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-17T11:31:44.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:31:45.437 DEBUG:teuthology.orchestra.remote:timed out 2023-12-17T11:31:47.121 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-12-17T11:31:57.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-17T11:31:57.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:31:57.850 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-12-17T11:31:58.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-17T11:31:58.303 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:31:58.303 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-12-17T11:31:58.349 INFO:teuthology.orchestra.run.smithi002.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:31:58.349 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:31:58.349 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:31:58.349 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-17T11:31:59.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-17T11:31:59.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:31:59.350 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-17T11:31:59.351 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-17T11:31:59.461 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2023-12-17T11:31:59.485 DEBUG:teuthology.parallel:result is None 2023-12-17T11:32:30.999 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-17T11:32:31.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-17T11:32:31.385 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:32:31.385 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-12-17T11:32:31.430 INFO:teuthology.orchestra.run.smithi119.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:32:31.430 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:32:31.430 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:32:31.430 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-17T11:32:32.431 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-17T11:32:32.431 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-17T11:32:32.553 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-12-17T11:32:32.574 DEBUG:teuthology.parallel:result is None 2023-12-17T11:32:32.575 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-17T11:32:32.582 INFO:teuthology.task.internal:Creating test directory... 2023-12-17T11:32:32.582 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:32:32.587 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:32:32.635 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-17T11:32:32.641 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-17T11:32:32.656 INFO:teuthology.task.internal:Creating archive directory... 2023-12-17T11:32:32.656 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:32:32.661 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:32:32.720 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-17T11:32:32.728 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-17T11:32:32.728 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:32:32.733 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:32:32.803 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:32:32.815 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:32:32.830 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:32:32.841 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:32:32.844 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-17T11:32:32.850 INFO:teuthology.task.internal:Configuring sudo... 2023-12-17T11:32:32.851 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:32:32.855 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:32:32.924 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-17T11:32:32.933 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-17T11:32:32.933 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:32:32.938 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:32:32.982 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:32:33.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:32:33.175 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:32:33.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:32:33.318 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:32:33.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:32:33.389 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:32:33.465 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:32:33.536 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:32:33.609 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:32:33.678 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:32:33.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:32:33.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2023-12-17T11:32:33.752 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-12-17T11:32:33.869 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:32:33.912 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:32:34.259 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-17T11:32:34.267 INFO:teuthology.task.internal:Starting timer... 2023-12-17T11:32:34.267 INFO:teuthology.run_tasks:Running task pcp... 2023-12-17T11:32:34.336 INFO:teuthology.run_tasks:Running task selinux... 2023-12-17T11:32:34.344 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-17T11:32:34.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2023-12-17T11:32:34.486 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2023-12-17T11:32:34.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2023-12-17T11:32:34.625 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2023-12-17T11:32:34.628 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-17T11:32:34.628 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2023-12-17T11:32:34.688 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2023-12-17T11:32:34.689 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2023-12-17T11:32:34.743 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2023-12-17T11:32:34.744 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2023-12-17T11:32:34.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:32:34.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:32:34.817 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:32:34.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:32:34.887 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-17T11:32:34.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:32:34.956 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:32:35.026 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-17T11:32:35.036 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-17T11:32:35.036 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-17T11:32:35.067 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-17T11:32:35.068 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-17T11:43:14.420 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-12-17T11:43:14.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-17T11:43:14.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:43:14.513 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-12-17T11:43:14.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-12-17T11:43:14.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-17T11:43:14.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:43:14.721 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-12-17T11:43:14.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-12-17T11:43:14.794 INFO:teuthology.run_tasks:Running task clock... 2023-12-17T11:43:14.804 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-17T11:43:14.805 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:43:14.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:43:14.810 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:43:14.810 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:43:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:43:14.910 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:43:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:43:14.943 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:43:15.011 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2023-12-17T11:43:15.030 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2023-12-17T11:43:15.040 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2023-12-17T11:43:15.058 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2023-12-17T11:43:15.074 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:43:15.089 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:43:15.122 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:43:15.196 INFO:teuthology.orchestra.run.smithi002.stderr:bash: ntpq: command not found 2023-12-17T11:43:15.204 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:43:15.204 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2023-12-17T11:43:15.204 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.204 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.205 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.205 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.207 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-12-17T11:43:15.214 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:43:15.214 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-12-17T11:43:15.214 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.214 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.214 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.214 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:43:15.215 INFO:teuthology.run_tasks:Running task pexec... 2023-12-17T11:43:15.225 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-17T11:43:15.225 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:43:15.225 DEBUG:teuthology.orchestra.run.smithi002:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-17T11:43:15.226 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi119.front.sepia.ceph.com 2023-12-17T11:43:15.226 DEBUG:teuthology.orchestra.run.smithi119:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-17T11:43:16.298 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:12 ago on Sun 17 Dec 2023 11:41:04 AM UTC. 2023-12-17T11:43:16.347 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:03 ago on Sun 17 Dec 2023 11:41:13 AM UTC. 2023-12-17T11:43:18.521 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout:Resetting modules: 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:43:18.522 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:43:18.523 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:18.753 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:43:18.755 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:43:18.755 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2023-12-17T11:43:18.755 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:43:18.755 INFO:teuthology.orchestra.run.smithi002.stdout:Resetting modules: 2023-12-17T11:43:18.756 INFO:teuthology.orchestra.run.smithi002.stdout: container-tools 2023-12-17T11:43:18.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:18.756 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:43:18.756 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:43:18.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:18.791 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:43:19.036 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:43:19.919 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:15 ago on Sun 17 Dec 2023 11:41:04 AM UTC. 2023-12-17T11:43:20.249 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:07 ago on Sun 17 Dec 2023 11:41:13 AM UTC. 2023-12-17T11:43:22.197 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:43:22.392 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:43:22.392 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout:Installing group/module packages: 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-17T11:43:22.393 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout:Installing module profiles: 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools/common 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout:Enabling module streams: 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: container-tools rhel8 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:22.394 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:43:22.395 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:43:22.395 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2023-12-17T11:43:22.395 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:22.395 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 27 M 2023-12-17T11:43:22.395 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 89 M 2023-12-17T11:43:22.395 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:43:22.631 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:43:22.811 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.0 MB/s | 750 kB 00:00 2023-12-17T11:43:22.845 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout:Installing group/module packages: 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:43:22.846 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout:Installing module profiles: 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: container-tools/common 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling module streams: 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: container-tools rhel8 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2023-12-17T11:43:22.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:22.848 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 27 M 2023-12-17T11:43:22.848 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 89 M 2023-12-17T11:43:22.848 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:43:22.895 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.2 MB/s | 1.0 MB 00:00 2023-12-17T11:43:22.945 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 284 kB/s | 38 kB 00:00 2023-12-17T11:43:23.245 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 12 MB/s | 9.6 MB 00:00 2023-12-17T11:43:23.304 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 589 kB/s | 241 kB 00:00 2023-12-17T11:43:23.345 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.3 MB/s | 750 kB 00:00 2023-12-17T11:43:23.378 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.9 MB/s | 1.0 MB 00:00 2023-12-17T11:43:23.446 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 175 kB/s | 25 kB 00:00 2023-12-17T11:43:23.529 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 206 kB/s | 38 kB 00:00 2023-12-17T11:43:23.571 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 6.3 MB/s | 3.9 MB 00:00 2023-12-17T11:43:23.596 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): python3-podman-4.7.0-1.module_el8+712+4 507 kB/s | 178 kB 00:00 2023-12-17T11:43:23.621 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-pyxdg-0.25-16.el8.noarch.rpm 536 kB/s | 94 kB 00:00 2023-12-17T11:43:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 14 MB/s | 9.6 MB 00:00 2023-12-17T11:43:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 703 kB/s | 241 kB 00:00 2023-12-17T11:43:23.755 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 395 kB/s | 53 kB 00:00 2023-12-17T11:43:23.863 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 175 kB/s | 25 kB 00:00 2023-12-17T11:43:23.938 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 223 kB/s | 41 kB 00:00 2023-12-17T11:43:24.030 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 7.8 MB/s | 3.9 MB 00:00 2023-12-17T11:43:24.055 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 488 kB/s | 94 kB 00:00 2023-12-17T11:43:24.072 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-podman-4.7.0-1.module_el8+712+4 473 kB/s | 178 kB 00:00 2023-12-17T11:43:24.172 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 14 MB/s | 8.1 MB 00:00 2023-12-17T11:43:24.222 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 4.0 MB/s | 2.5 MB 00:00 2023-12-17T11:43:24.223 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:43:24.223 INFO:teuthology.orchestra.run.smithi119.stdout:Total 15 MB/s | 27 MB 00:01 2023-12-17T11:43:24.248 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 300 kB/s | 53 kB 00:00 2023-12-17T11:43:24.373 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 328 kB/s | 41 kB 00:00 2023-12-17T11:43:24.615 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 4.5 MB/s | 2.5 MB 00:00 2023-12-17T11:43:24.656 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:43:24.683 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:43:24.683 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:43:24.740 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 11 MB/s | 8.1 MB 00:00 2023-12-17T11:43:24.740 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:43:24.741 INFO:teuthology.orchestra.run.smithi002.stdout:Total 14 MB/s | 27 MB 00:01 2023-12-17T11:43:24.946 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:43:24.949 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:43:25.186 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:43:25.213 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:43:25.214 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:43:25.485 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:43:25.489 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:43:25.663 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:43:25.872 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-17T11:43:26.041 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-17T11:43:26.193 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:43:26.250 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-17T11:43:26.463 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-17T11:43:26.535 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-17T11:43:26.630 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-17T11:43:27.014 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-17T11:43:27.123 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-17T11:43:27.274 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-17T11:43:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-17T11:43:28.133 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-17T11:43:28.375 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-17T11:43:28.606 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-17T11:43:28.879 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-17T11:43:29.021 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-17T11:43:29.266 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-17T11:43:29.298 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-17T11:43:29.500 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-17T11:43:29.760 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-17T11:43:30.238 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-17T11:43:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-17T11:43:30.457 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-17T11:43:30.638 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-17T11:43:31.255 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-17T11:43:31.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-17T11:43:31.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-17T11:43:31.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-17T11:43:31.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-17T11:43:31.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-17T11:43:31.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-17T11:43:31.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-17T11:43:31.693 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-17T11:43:32.226 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-17T11:43:32.226 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-17T11:43:32.227 INFO:teuthology.orchestra.run.smithi119.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-17T11:43:32.228 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:43:32.228 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:43:32.415 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-17T11:43:32.415 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-17T11:43:32.416 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-17T11:43:32.463 DEBUG:teuthology.parallel:result is None 2023-12-17T11:43:33.345 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-17T11:43:33.345 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-17T11:43:33.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:43:33.347 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:43:33.592 DEBUG:teuthology.parallel:result is None 2023-12-17T11:43:33.592 INFO:teuthology.run_tasks:Running task install... 2023-12-17T11:43:33.605 DEBUG:teuthology.task.install:project ceph 2023-12-17T11:43:33.605 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}} 2023-12-17T11:43:33.605 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'} 2023-12-17T11:43:33.605 INFO:teuthology.task.install:Using flavor: default 2023-12-17T11:43:33.611 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-17T11:43:33.611 INFO:teuthology.task.install:extra packages: [] 2023-12-17T11:43:33.612 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:43:33.612 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:43:33.612 INFO:teuthology.packaging:ref: None 2023-12-17T11:43:33.612 INFO:teuthology.packaging:tag: None 2023-12-17T11:43:33.612 INFO:teuthology.packaging:branch: quincy 2023-12-17T11:43:33.612 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:43:33.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-17T11:43:33.618 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:43:33.618 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:43:33.618 INFO:teuthology.packaging:ref: None 2023-12-17T11:43:33.618 INFO:teuthology.packaging:tag: None 2023-12-17T11:43:33.618 INFO:teuthology.packaging:branch: quincy 2023-12-17T11:43:33.619 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:43:33.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-17T11:43:33.942 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-17T11:43:33.943 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-17T11:43:33.960 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/ 2023-12-17T11:43:33.961 INFO:teuthology.task.install.rpm:Package version is 17.2.7-125.g1f2f5510 2023-12-17T11:43:34.117 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:43:34.118 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:43:34.118 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:43:34.130 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:43:34.130 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:43:34.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:43:34.194 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-17T11:43:34.195 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:43:34.195 INFO:teuthology.packaging:ref: None 2023-12-17T11:43:34.195 INFO:teuthology.packaging:tag: None 2023-12-17T11:43:34.195 INFO:teuthology.packaging:branch: quincy 2023-12-17T11:43:34.195 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:43:34.195 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:43:34.201 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-17T11:43:34.201 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:43:34.201 INFO:teuthology.packaging:ref: None 2023-12-17T11:43:34.201 INFO:teuthology.packaging:tag: None 2023-12-17T11:43:34.201 INFO:teuthology.packaging:branch: quincy 2023-12-17T11:43:34.201 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:43:34.201 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:43:34.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:43:34.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:43:34.403 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:43:34.411 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:43:34.473 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2023-12-17T11:43:34.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2023-12-17T11:43:34.481 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2023-12-17T11:43:34.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2023-12-17T11:43:34.825 INFO:teuthology.orchestra.run.smithi119.stdout:76 files removed 2023-12-17T11:43:34.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw 2023-12-17T11:43:34.867 INFO:teuthology.orchestra.run.smithi002.stdout:76 files removed 2023-12-17T11:43:34.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw 2023-12-17T11:43:35.673 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 294 kB/s | 78 kB 00:00 2023-12-17T11:43:35.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 217 kB/s | 78 kB 00:00 2023-12-17T11:43:35.956 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 37 kB/s | 9.1 kB 00:00 2023-12-17T11:43:36.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 29 kB/s | 9.1 kB 00:00 2023-12-17T11:43:36.257 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2023-12-17T11:43:36.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-12-17T11:43:38.357 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - AppStream 17 MB/s | 35 MB 00:02 2023-12-17T11:43:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - AppStream 13 MB/s | 35 MB 00:02 2023-12-17T11:43:51.607 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - BaseOS 8.6 MB/s | 56 MB 00:06 2023-12-17T11:43:52.678 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - BaseOS 9.4 MB/s | 56 MB 00:05 2023-12-17T11:44:00.574 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras 27 kB/s | 18 kB 00:00 2023-12-17T11:44:00.900 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - Extras common packages 50 kB/s | 6.9 kB 00:00 2023-12-17T11:44:01.576 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 8 - PowerTools 13 MB/s | 6.6 MB 00:00 2023-12-17T11:44:02.248 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2023-12-17T11:44:03.169 INFO:teuthology.orchestra.run.smithi119.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-12-17T11:44:03.180 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - Extras common packages 9.4 kB/s | 6.9 kB 00:00 2023-12-17T11:44:04.006 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 8 - PowerTools 10 MB/s | 6.6 MB 00:00 2023-12-17T11:44:04.845 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-17T11:44:05.657 INFO:teuthology.orchestra.run.smithi002.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-17T11:44:09.570 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 415 kB/s | 24 kB 00:00 2023-12-17T11:44:09.594 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 16 MB 00:03 2023-12-17T11:44:14.308 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-17T11:44:14.311 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-17T11:44:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout:Install 21 Packages 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 2 Packages 2023-12-17T11:44:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:44:14.314 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 64 M 2023-12-17T11:44:14.314 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:44:14.483 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 423 kB/s | 24 kB 00:00 2023-12-17T11:44:17.421 INFO:teuthology.orchestra.run.smithi119.stdout:(1/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 1.9 MB/s | 5.2 MB 00:02 2023-12-17T11:44:17.488 INFO:teuthology.orchestra.run.smithi119.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 365 kB/s | 24 kB 00:00 2023-12-17T11:44:17.763 INFO:teuthology.orchestra.run.smithi119.stdout:(3/23): ceph-common-17.2.7-125.g1f2f5510.el8.x8 7.8 MB/s | 23 MB 00:03 2023-12-17T11:44:17.838 INFO:teuthology.orchestra.run.smithi119.stdout:(4/23): libradosstriper1-17.2.7-125.g1f2f5510.e 6.7 MB/s | 509 kB 00:00 2023-12-17T11:44:17.914 INFO:teuthology.orchestra.run.smithi119.stdout:(5/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 1.8 MB/s | 796 kB 00:00 2023-12-17T11:44:17.980 INFO:teuthology.orchestra.run.smithi119.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 673 kB/s | 45 kB 00:00 2023-12-17T11:44:18.048 INFO:teuthology.orchestra.run.smithi119.stdout:(7/23): python3-ceph-common-17.2.7-125.g1f2f551 1.7 MB/s | 115 kB 00:00 2023-12-17T11:44:18.156 INFO:teuthology.orchestra.run.smithi119.stdout:(8/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 1.7 MB/s | 190 kB 00:00 2023-12-17T11:44:18.290 INFO:teuthology.orchestra.run.smithi119.stdout:(9/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_64 12 MB/s | 5.6 MB 00:00 2023-12-17T11:44:18.332 INFO:teuthology.orchestra.run.smithi119.stdout:(10/23): python3-rados-17.2.7-125.g1f2f5510.el8 2.1 MB/s | 371 kB 00:00 2023-12-17T11:44:18.357 INFO:teuthology.orchestra.run.smithi119.stdout:(11/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 5.3 MB/s | 359 kB 00:00 2023-12-17T11:44:18.391 INFO:teuthology.orchestra.run.smithi119.stdout:(12/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 1.8 MB/s | 106 kB 00:00 2023-12-17T11:44:18.716 INFO:teuthology.orchestra.run.smithi119.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 799 kB/s | 259 kB 00:00 2023-12-17T11:44:18.816 INFO:teuthology.orchestra.run.smithi119.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.4 MB/s | 677 kB 00:00 2023-12-17T11:44:18.842 INFO:teuthology.orchestra.run.smithi119.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 350 kB/s | 44 kB 00:00 2023-12-17T11:44:19.167 INFO:teuthology.orchestra.run.smithi119.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 134 kB/s | 47 kB 00:00 2023-12-17T11:44:19.526 INFO:teuthology.orchestra.run.smithi119.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 448 kB/s | 306 kB 00:00 2023-12-17T11:44:19.588 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.6 M 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.2 M 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 23 M 2023-12-17T11:44:19.591 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 24 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 796 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 509 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 5.6 M 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 45 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 115 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 190 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-17T11:44:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 371 k 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 359 k 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 106 k 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout:Install 21 Packages 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2023-12-17T11:44:19.593 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:44:19.594 INFO:teuthology.orchestra.run.smithi119.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 138 kB/s | 59 kB 00:00 2023-12-17T11:44:19.594 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 64 M 2023-12-17T11:44:19.594 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:44:19.626 INFO:teuthology.orchestra.run.smithi119.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 750 kB/s | 75 kB 00:00 2023-12-17T11:44:20.102 INFO:teuthology.orchestra.run.smithi119.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2023-12-17T11:44:20.460 INFO:teuthology.orchestra.run.smithi119.stdout:(21/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 10 MB/s | 3.6 MB 00:00 2023-12-17T11:44:20.735 INFO:teuthology.orchestra.run.smithi119.stdout:(22/23): librados2-17.2.7-125.g1f2f5510.el8.x86 3.1 MB/s | 3.5 MB 00:01 2023-12-17T11:44:20.934 INFO:teuthology.orchestra.run.smithi002.stdout:(1/23): ceph-base-17.2.7-125.g1f2f5510.el8.x86_ 5.9 MB/s | 5.2 MB 00:00 2023-12-17T11:44:21.001 INFO:teuthology.orchestra.run.smithi002.stdout:(2/23): ceph-selinux-17.2.7-125.g1f2f5510.el8.x 367 kB/s | 24 kB 00:00 2023-12-17T11:44:21.109 INFO:teuthology.orchestra.run.smithi002.stdout:(3/23): libcephfs2-17.2.7-125.g1f2f5510.el8.x86 7.2 MB/s | 796 kB 00:00 2023-12-17T11:44:21.193 INFO:teuthology.orchestra.run.smithi002.stdout:(4/23): libradosstriper1-17.2.7-125.g1f2f5510.e 6.0 MB/s | 509 kB 00:00 2023-12-17T11:44:21.194 INFO:teuthology.orchestra.run.smithi119.stdout:(23/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8. 2.6 MB/s | 17 MB 00:06 2023-12-17T11:44:21.198 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:44:21.199 INFO:teuthology.orchestra.run.smithi119.stdout:Total 9.2 MB/s | 64 MB 00:06 2023-12-17T11:44:21.297 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:44:21.348 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:44:21.348 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:44:21.749 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:44:21.752 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:44:21.785 INFO:teuthology.orchestra.run.smithi002.stdout:(5/23): librgw2-17.2.7-125.g1f2f5510.el8.x86_64 9.4 MB/s | 5.6 MB 00:00 2023-12-17T11:44:21.852 INFO:teuthology.orchestra.run.smithi002.stdout:(6/23): python3-ceph-argparse-17.2.7-125.g1f2f5 672 kB/s | 45 kB 00:00 2023-12-17T11:44:21.919 INFO:teuthology.orchestra.run.smithi002.stdout:(7/23): python3-ceph-common-17.2.7-125.g1f2f551 1.7 MB/s | 115 kB 00:00 2023-12-17T11:44:22.003 INFO:teuthology.orchestra.run.smithi002.stdout:(8/23): python3-cephfs-17.2.7-125.g1f2f5510.el8 2.2 MB/s | 190 kB 00:00 2023-12-17T11:44:22.103 INFO:teuthology.orchestra.run.smithi002.stdout:(9/23): python3-rados-17.2.7-125.g1f2f5510.el8. 3.6 MB/s | 371 kB 00:00 2023-12-17T11:44:22.295 INFO:teuthology.orchestra.run.smithi002.stdout:(10/23): ceph-radosgw-17.2.7-125.g1f2f5510.el8. 7.5 MB/s | 17 MB 00:02 2023-12-17T11:44:22.329 INFO:teuthology.orchestra.run.smithi002.stdout:(11/23): python3-rbd-17.2.7-125.g1f2f5510.el8.x 1.6 MB/s | 359 kB 00:00 2023-12-17T11:44:22.370 INFO:teuthology.orchestra.run.smithi002.stdout:(12/23): python3-rgw-17.2.7-125.g1f2f5510.el8.x 1.4 MB/s | 106 kB 00:00 2023-12-17T11:44:22.571 INFO:teuthology.orchestra.run.smithi002.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-12-17T11:44:22.612 INFO:teuthology.orchestra.run.smithi002.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 2.3 MB/s | 677 kB 00:00 2023-12-17T11:44:22.772 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:44:22.880 INFO:teuthology.orchestra.run.smithi002.stdout:(15/23): ceph-common-17.2.7-125.g1f2f5510.el8.x 8.3 MB/s | 23 MB 00:02 2023-12-17T11:44:22.905 INFO:teuthology.orchestra.run.smithi002.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 132 kB/s | 44 kB 00:00 2023-12-17T11:44:22.994 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-17T11:44:23.130 INFO:teuthology.orchestra.run.smithi002.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 91 kB/s | 47 kB 00:00 2023-12-17T11:44:23.154 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-17T11:44:23.239 INFO:teuthology.orchestra.run.smithi002.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 176 kB/s | 59 kB 00:00 2023-12-17T11:44:23.389 INFO:teuthology.orchestra.run.smithi002.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 602 kB/s | 306 kB 00:00 2023-12-17T11:44:23.556 INFO:teuthology.orchestra.run.smithi002.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 176 kB/s | 75 kB 00:00 2023-12-17T11:44:23.583 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-17T11:44:23.756 INFO:teuthology.orchestra.run.smithi002.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 3.4 MB/s | 1.7 MB 00:00 2023-12-17T11:44:23.805 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-17T11:44:23.815 INFO:teuthology.orchestra.run.smithi002.stdout:(22/23): librados2-17.2.7-125.g1f2f5510.el8.x86 8.1 MB/s | 3.5 MB 00:00 2023-12-17T11:44:23.922 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-17T11:44:23.923 INFO:teuthology.orchestra.run.smithi002.stdout:(23/23): librbd1-17.2.7-125.g1f2f5510.el8.x86_6 9.8 MB/s | 3.6 MB 00:00 2023-12-17T11:44:23.926 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:44:23.926 INFO:teuthology.orchestra.run.smithi002.stdout:Total 15 MB/s | 64 MB 00:04 2023-12-17T11:44:24.023 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:44:24.078 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:44:24.078 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:44:24.175 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-17T11:44:24.346 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-17T11:44:24.505 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:44:24.509 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:44:24.816 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-17T11:44:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-17T11:44:25.248 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-17T11:44:25.443 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-17T11:44:25.553 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:44:25.660 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-17T11:44:25.778 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-17T11:44:25.961 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-17T11:44:26.346 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-17T11:44:26.410 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-17T11:44:26.520 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-17T11:44:26.597 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-17T11:44:26.602 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-17T11:44:26.704 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-17T11:44:26.751 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-17T11:44:26.931 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-17T11:44:26.959 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-17T11:44:27.118 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-17T11:44:27.125 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-17T11:44:27.361 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-17T11:44:27.512 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-17T11:44:27.590 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-17T11:44:27.605 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-17T11:44:27.768 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-17T11:44:27.818 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-17T11:44:27.989 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-17T11:44:28.028 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-17T11:44:28.179 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-17T11:44:28.198 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-17T11:44:28.371 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-17T11:44:28.412 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-17T11:44:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/25 2023-12-17T11:44:29.341 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-17T11:44:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-17T11:44:29.565 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 11/25 2023-12-17T11:44:29.770 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-17T11:44:29.983 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-17T11:44:30.211 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 14/25 2023-12-17T11:44:30.343 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-17T11:44:30.434 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 15/25 2023-12-17T11:44:30.626 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-17T11:44:30.795 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-17T11:44:30.988 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-17T11:44:31.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 19/25 2023-12-17T11:44:31.355 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-17T11:44:31.604 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-17T11:44:32.270 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-17T11:44:32.544 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-17T11:44:32.747 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-17T11:44:32.962 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-17T11:44:34.347 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-17T11:44:34.568 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-17T11:44:35.259 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 20/25 2023-12-17T11:44:35.518 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-17T11:44:35.785 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 21/25 2023-12-17T11:44:36.000 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-17T11:44:53.190 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /run 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /dev 2023-12-17T11:44:53.191 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:44:55.024 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-17T11:44:55.123 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-17T11:44:55.124 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-17T11:44:55.330 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-17T11:44:55.330 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-17T11:44:56.320 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-17T11:44:56.321 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-17T11:44:56.322 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-17T11:44:56.322 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-17T11:44:56.322 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-17T11:44:56.322 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /dev 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /run 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /dev 2023-12-17T11:44:57.121 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:44:57.335 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-17T11:44:57.336 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-17T11:44:57.337 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:44:57.338 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:44:57.721 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-test 2023-12-17T11:44:58.795 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:49 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:44:59.006 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-17T11:44:59.105 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 23/25 2023-12-17T11:44:59.106 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-17T11:44:59.327 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-17T11:44:59.328 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-17T11:45:00.286 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 1/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 3/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 4/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 5/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 6/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 7/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x 8/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86 9/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 10/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 11/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 12/25 2023-12-17T11:45:00.287 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 13/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 22/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-17T11:45:00.288 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 24/25 2023-12-17T11:45:00.564 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-17T11:45:00.566 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-17T11:45:00.567 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:00.567 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:45:00.567 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:00.567 INFO:teuthology.orchestra.run.smithi119.stdout:Install 6 Packages 2023-12-17T11:45:00.567 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:00.567 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 53 M 2023-12-17T11:45:00.568 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 234 M 2023-12-17T11:45:00.568 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:45:00.790 INFO:teuthology.orchestra.run.smithi119.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.1 MB/s | 203 kB 00:00 2023-12-17T11:45:00.974 INFO:teuthology.orchestra.run.smithi119.stdout:(2/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 480 kB/s | 174 kB 00:00 2023-12-17T11:45:01.216 INFO:teuthology.orchestra.run.smithi119.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 441 kB/s | 187 kB 00:00 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.308 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-1.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-17T11:45:01.309 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.310 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.310 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:01.310 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-17T11:45:01.310 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:01.310 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:01.358 INFO:teuthology.orchestra.run.smithi119.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 500 kB/s | 71 kB 00:00 2023-12-17T11:45:01.391 INFO:teuthology.orchestra.run.smithi119.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 774 kB/s | 323 kB 00:00 2023-12-17T11:45:01.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-test 2023-12-17T11:45:02.783 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:00:48 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:03.125 INFO:teuthology.orchestra.run.smithi119.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 21 MB/s | 52 MB 00:02 2023-12-17T11:45:03.127 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:03.128 INFO:teuthology.orchestra.run.smithi119.stdout:Total 21 MB/s | 53 MB 00:02 2023-12-17T11:45:03.224 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:45:03.248 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:45:03.249 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:45:03.559 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:45:03.562 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:45:04.059 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:45:04.297 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-17T11:45:04.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-17T11:45:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-17T11:45:04.722 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 52 M 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 174 k 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-17T11:45:04.723 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:04.724 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 53 M 2023-12-17T11:45:04.725 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 234 M 2023-12-17T11:45:04.725 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:45:04.732 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-17T11:45:04.948 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-17T11:45:04.971 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.0 MB/s | 203 kB 00:00 2023-12-17T11:45:05.131 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-17T11:45:05.171 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): libcephsqlite-17.2.7-125.g1f2f5510.el8.x 433 kB/s | 174 kB 00:00 2023-12-17T11:45:05.255 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 661 kB/s | 187 kB 00:00 2023-12-17T11:45:05.455 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 353 kB/s | 71 kB 00:00 2023-12-17T11:45:05.522 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 922 kB/s | 323 kB 00:00 2023-12-17T11:45:07.247 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): ceph-test-17.2.7-125.g1f2f5510.el8.x86_6 21 MB/s | 52 MB 00:02 2023-12-17T11:45:07.249 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:07.249 INFO:teuthology.orchestra.run.smithi002.stdout:Total 21 MB/s | 53 MB 00:02 2023-12-17T11:45:07.352 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:45:07.376 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:45:07.377 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:45:07.706 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:45:07.710 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:45:08.227 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:45:08.439 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-17T11:45:08.618 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-17T11:45:08.762 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-17T11:45:08.864 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-17T11:45:09.055 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-17T11:45:09.237 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-17T11:45:10.522 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-17T11:45:10.796 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-17T11:45:11.176 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-17T11:45:11.176 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-17T11:45:11.176 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-17T11:45:11.177 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-17T11:45:11.177 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-17T11:45:11.177 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-17T11:45:11.977 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-17T11:45:11.977 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:11.978 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:45:11.978 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:11.978 INFO:teuthology.orchestra.run.smithi119.stdout: jq-1.6-8.el8.x86_64 2023-12-17T11:45:11.978 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:11.978 INFO:teuthology.orchestra.run.smithi119.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-17T11:45:11.978 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-17T11:45:11.979 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-17T11:45:11.979 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:11.979 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:12.164 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph 2023-12-17T11:45:13.262 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:04 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:14.937 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 5/6 2023-12-17T11:45:15.002 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:15.005 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:15.005 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:45:15.005 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-17T11:45:15.006 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-17T11:45:15.007 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout:Install 32 Packages 2023-12-17T11:45:15.008 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:15.009 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 28 M 2023-12-17T11:45:15.009 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 110 M 2023-12-17T11:45:15.009 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:45:15.194 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-17T11:45:15.501 INFO:teuthology.orchestra.run.smithi119.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 31 kB/s | 6.4 kB 00:00 2023-12-17T11:45:15.560 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 6/6 2023-12-17T11:45:15.560 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 1/6 2023-12-17T11:45:15.560 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2/6 2023-12-17T11:45:15.560 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-17T11:45:15.560 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-17T11:45:15.560 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-17T11:45:15.676 INFO:teuthology.orchestra.run.smithi119.stdout:(2/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 4.1 MB/s | 1.6 MB 00:00 2023-12-17T11:45:16.168 INFO:teuthology.orchestra.run.smithi119.stdout:(3/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 2.6 MB/s | 2.3 MB 00:00 2023-12-17T11:45:16.302 INFO:teuthology.orchestra.run.smithi119.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 1.7 MB/s | 238 kB 00:00 2023-12-17T11:45:16.390 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-17T11:45:16.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:16.390 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:45:16.392 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:16.392 INFO:teuthology.orchestra.run.smithi002.stdout: jq-1.6-8.el8.x86_64 2023-12-17T11:45:16.393 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:16.393 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-17T11:45:16.393 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-17T11:45:16.393 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-17T11:45:16.393 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:16.393 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:16.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph 2023-12-17T11:45:16.628 INFO:teuthology.orchestra.run.smithi119.stdout:(5/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_6 18 MB/s | 17 MB 00:00 2023-12-17T11:45:16.694 INFO:teuthology.orchestra.run.smithi119.stdout:(6/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_6 3.3 MB/s | 3.9 MB 00:01 2023-12-17T11:45:16.720 INFO:teuthology.orchestra.run.smithi119.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 376 kB/s | 157 kB 00:00 2023-12-17T11:45:16.795 INFO:teuthology.orchestra.run.smithi119.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 232 kB/s | 39 kB 00:00 2023-12-17T11:45:16.895 INFO:teuthology.orchestra.run.smithi119.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 325 kB/s | 57 kB 00:00 2023-12-17T11:45:16.921 INFO:teuthology.orchestra.run.smithi119.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 458 kB/s | 103 kB 00:00 2023-12-17T11:45:17.163 INFO:teuthology.orchestra.run.smithi119.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.2 MB/s | 457 kB 00:00 2023-12-17T11:45:17.396 INFO:teuthology.orchestra.run.smithi119.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 497 kB/s | 249 kB 00:00 2023-12-17T11:45:17.530 INFO:teuthology.orchestra.run.smithi119.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 328 kB/s | 44 kB 00:00 2023-12-17T11:45:17.555 INFO:teuthology.orchestra.run.smithi119.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 1.0 MB/s | 641 kB 00:00 2023-12-17T11:45:17.581 INFO:teuthology.orchestra.run.smithi119.stdout:(15/32): python3-pycparser-2.14-14.el8.noarch.r 261 kB/s | 109 kB 00:00 2023-12-17T11:45:17.606 INFO:teuthology.orchestra.run.smithi119.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.4 MB/s | 185 kB 00:00 2023-12-17T11:45:17.648 INFO:teuthology.orchestra.run.smithi119.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-12-17T11:45:17.690 INFO:teuthology.orchestra.run.smithi119.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2023-12-17T11:45:17.710 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:03 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:17.734 INFO:teuthology.orchestra.run.smithi119.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 206 kB/s | 18 kB 00:00 2023-12-17T11:45:17.765 INFO:teuthology.orchestra.run.smithi119.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 651 kB/s | 49 kB 00:00 2023-12-17T11:45:17.790 INFO:teuthology.orchestra.run.smithi119.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2023-12-17T11:45:17.816 INFO:teuthology.orchestra.run.smithi119.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.6 MB/s | 384 kB 00:00 2023-12-17T11:45:17.841 INFO:teuthology.orchestra.run.smithi119.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-12-17T11:45:17.866 INFO:teuthology.orchestra.run.smithi119.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 372 kB/s | 19 kB 00:00 2023-12-17T11:45:17.892 INFO:teuthology.orchestra.run.smithi119.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 478 kB/s | 24 kB 00:00 2023-12-17T11:45:17.917 INFO:teuthology.orchestra.run.smithi119.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 586 kB/s | 29 kB 00:00 2023-12-17T11:45:17.942 INFO:teuthology.orchestra.run.smithi119.stdout:(27/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-12-17T11:45:17.967 INFO:teuthology.orchestra.run.smithi119.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2023-12-17T11:45:17.984 INFO:teuthology.orchestra.run.smithi119.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.7 MB/s | 255 kB 00:00 2023-12-17T11:45:18.009 INFO:teuthology.orchestra.run.smithi119.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.7 MB/s | 251 kB 00:00 2023-12-17T11:45:18.035 INFO:teuthology.orchestra.run.smithi119.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 457 kB/s | 23 kB 00:00 2023-12-17T11:45:18.060 INFO:teuthology.orchestra.run.smithi119.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 924 kB/s | 85 kB 00:00 2023-12-17T11:45:18.062 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:18.062 INFO:teuthology.orchestra.run.smithi119.stdout:Total 9.3 MB/s | 28 MB 00:03 2023-12-17T11:45:18.254 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:45:18.296 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:45:18.296 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:45:18.619 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:45:18.622 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:45:19.600 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:19.603 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:19.603 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:45:19.603 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 6.4 k 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 2.3 M 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 1.6 M 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 238 k 2023-12-17T11:45:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.9 M 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 17 M 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-17T11:45:19.605 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-17T11:45:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-17T11:45:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-17T11:45:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-17T11:45:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-17T11:45:19.606 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-17T11:45:19.607 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout:Install 32 Packages 2023-12-17T11:45:19.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:19.609 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 28 M 2023-12-17T11:45:19.609 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 110 M 2023-12-17T11:45:19.609 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:45:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:45:19.987 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-17T11:45:20.082 INFO:teuthology.orchestra.run.smithi002.stdout:(1/32): ceph-17.2.7-125.g1f2f5510.el8.x86_64.rp 36 kB/s | 6.4 kB 00:00 2023-12-17T11:45:20.257 INFO:teuthology.orchestra.run.smithi002.stdout:(2/32): ceph-mds-17.2.7-125.g1f2f5510.el8.x86_6 6.5 MB/s | 2.3 MB 00:00 2023-12-17T11:45:20.272 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-17T11:45:20.457 INFO:teuthology.orchestra.run.smithi002.stdout:(3/32): ceph-mgr-17.2.7-125.g1f2f5510.el8.x86_6 2.8 MB/s | 1.6 MB 00:00 2023-12-17T11:45:20.532 INFO:teuthology.orchestra.run.smithi002.stdout:(4/32): ceph-mgr-modules-core-17.2.7-125.g1f2f5 3.1 MB/s | 238 kB 00:00 2023-12-17T11:45:20.550 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-17T11:45:20.741 INFO:teuthology.orchestra.run.smithi002.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 754 kB/s | 157 kB 00:00 2023-12-17T11:45:20.800 INFO:teuthology.orchestra.run.smithi002.stdout:(6/32): ceph-mon-17.2.7-125.g1f2f5510.el8.x86_6 5.5 MB/s | 3.9 MB 00:00 2023-12-17T11:45:20.811 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-17T11:45:20.900 INFO:teuthology.orchestra.run.smithi002.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 245 kB/s | 39 kB 00:00 2023-12-17T11:45:21.000 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-17T11:45:21.026 INFO:teuthology.orchestra.run.smithi002.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 457 kB/s | 57 kB 00:00 2023-12-17T11:45:21.051 INFO:teuthology.orchestra.run.smithi002.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 413 kB/s | 103 kB 00:00 2023-12-17T11:45:21.210 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-17T11:45:21.235 INFO:teuthology.orchestra.run.smithi002.stdout:(10/32): ceph-osd-17.2.7-125.g1f2f5510.el8.x86_ 17 MB/s | 17 MB 00:00 2023-12-17T11:45:21.401 INFO:teuthology.orchestra.run.smithi002.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.2 MB/s | 457 kB 00:00 2023-12-17T11:45:21.433 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-17T11:45:21.619 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-17T11:45:21.710 INFO:teuthology.orchestra.run.smithi002.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 378 kB/s | 249 kB 00:00 2023-12-17T11:45:21.877 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-17T11:45:21.886 INFO:teuthology.orchestra.run.smithi002.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 225 kB/s | 109 kB 00:00 2023-12-17T11:45:21.911 INFO:teuthology.orchestra.run.smithi002.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 217 kB/s | 44 kB 00:00 2023-12-17T11:45:21.938 INFO:teuthology.orchestra.run.smithi002.stdout:(15/32): python3-cryptography-3.2.1-6.el8.x86_6 915 kB/s | 641 kB 00:00 2023-12-17T11:45:22.045 INFO:teuthology.orchestra.run.smithi002.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.1 MB/s | 185 kB 00:00 2023-12-17T11:45:22.096 INFO:teuthology.orchestra.run.smithi002.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-12-17T11:45:22.145 INFO:teuthology.orchestra.run.smithi002.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 354 kB/s | 18 kB 00:00 2023-12-17T11:45:22.162 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-17T11:45:22.187 INFO:teuthology.orchestra.run.smithi002.stdout:(19/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 626 kB/s | 173 kB 00:00 2023-12-17T11:45:22.212 INFO:teuthology.orchestra.run.smithi002.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 730 kB/s | 49 kB 00:00 2023-12-17T11:45:22.246 INFO:teuthology.orchestra.run.smithi002.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.2 MB/s | 384 kB 00:00 2023-12-17T11:45:22.271 INFO:teuthology.orchestra.run.smithi002.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 702 kB/s | 59 kB 00:00 2023-12-17T11:45:22.305 INFO:teuthology.orchestra.run.smithi002.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-12-17T11:45:22.330 INFO:teuthology.orchestra.run.smithi002.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-12-17T11:45:22.356 INFO:teuthology.orchestra.run.smithi002.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 223 kB/s | 19 kB 00:00 2023-12-17T11:45:22.381 INFO:teuthology.orchestra.run.smithi002.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2023-12-17T11:45:22.406 INFO:teuthology.orchestra.run.smithi002.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2023-12-17T11:45:22.417 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-17T11:45:22.431 INFO:teuthology.orchestra.run.smithi002.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 366 kB/s | 27 kB 00:00 2023-12-17T11:45:22.457 INFO:teuthology.orchestra.run.smithi002.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2023-12-17T11:45:22.473 INFO:teuthology.orchestra.run.smithi002.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.7 MB/s | 251 kB 00:00 2023-12-17T11:45:22.507 INFO:teuthology.orchestra.run.smithi002.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2023-12-17T11:45:22.532 INFO:teuthology.orchestra.run.smithi002.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-12-17T11:45:22.534 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:22.534 INFO:teuthology.orchestra.run.smithi002.stdout:Total 9.7 MB/s | 28 MB 00:02 2023-12-17T11:45:22.667 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-17T11:45:22.731 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:45:22.775 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:45:22.775 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:45:23.108 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-17T11:45:23.129 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:45:23.132 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:45:23.368 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-17T11:45:23.546 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-17T11:45:23.814 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-17T11:45:24.081 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-17T11:45:24.242 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:45:24.427 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-17T11:45:24.498 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-17T11:45:24.636 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-17T11:45:24.728 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-17T11:45:24.857 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-17T11:45:24.987 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-17T11:45:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-17T11:45:25.235 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-17T11:45:25.379 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-17T11:45:25.457 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-17T11:45:25.651 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-17T11:45:25.667 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-17T11:45:25.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-17T11:45:25.918 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-17T11:45:26.042 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-17T11:45:26.270 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-17T11:45:26.322 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-17T11:45:26.536 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-17T11:45:26.680 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-17T11:45:26.768 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-17T11:45:26.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-17T11:45:27.457 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-17T11:45:27.751 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-17T11:45:27.935 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-17T11:45:27.953 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-17T11:45:28.160 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-17T11:45:28.206 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-17T11:45:28.463 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-17T11:45:28.815 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-17T11:45:29.035 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-17T11:45:29.206 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-17T11:45:29.391 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-17T11:45:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-17T11:45:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-17T11:45:29.916 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-17T11:45:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-17T11:45:30.204 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-17T11:45:30.430 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-17T11:45:30.624 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-17T11:45:30.669 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-17T11:45:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-17T11:45:31.135 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-17T11:45:31.179 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-17T11:45:31.335 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-17T11:45:31.466 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-17T11:45:31.467 INFO:teuthology.orchestra.run.smithi119.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:45:31.467 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:31.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-17T11:45:32.007 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-17T11:45:32.008 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-17T11:45:32.009 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-17T11:45:32.009 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-17T11:45:32.009 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-17T11:45:32.009 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-17T11:45:32.009 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-17T11:45:32.009 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-17T11:45:32.010 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-17T11:45:32.010 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-17T11:45:32.010 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-17T11:45:32.075 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 27/32 2023-12-17T11:45:32.384 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:33.197 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-17T11:45:33.198 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-2.6-1.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:33.199 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:33.436 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-base 2023-12-17T11:45:34.096 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 28/32 2023-12-17T11:45:34.284 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-17T11:45:34.503 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:25 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:34.766 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 29/32 2023-12-17T11:45:34.975 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-17T11:45:35.247 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 30/32 2023-12-17T11:45:35.450 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-17T11:45:35.496 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 31/32 2023-12-17T11:45:35.634 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-17T11:45:35.734 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 32/32 2023-12-17T11:45:35.734 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:45:35.734 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:35.999 INFO:teuthology.orchestra.run.smithi119.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:45:36.241 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:36.242 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:45:36.243 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 1/32 2023-12-17T11:45:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2/32 2023-12-17T11:45:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 3/32 2023-12-17T11:45:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 4/32 2023-12-17T11:45:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 5/32 2023-12-17T11:45:36.303 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.n 6/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-17T11:45:36.304 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-17T11:45:36.305 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-17T11:45:36.365 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install cephadm 2023-12-17T11:45:37.430 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:28 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:37.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-17T11:45:37.452 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:37.452 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-17T11:45:37.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-2.6-1.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-17T11:45:37.454 INFO:teuthology.orchestra.run.smithi002.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:37.455 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:37.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-base 2023-12-17T11:45:38.832 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:24 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:39.226 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 80 k 2023-12-17T11:45:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 364 k 2023-12-17T11:45:39.228 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:45:39.412 INFO:teuthology.orchestra.run.smithi119.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 438 kB/s | 80 kB 00:00 2023-12-17T11:45:39.412 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:39.413 INFO:teuthology.orchestra.run.smithi119.stdout:Total 435 kB/s | 80 kB 00:00 2023-12-17T11:45:39.413 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:45:39.423 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:45:39.423 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:45:39.427 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:45:39.430 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:45:39.478 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:45:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:40.312 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-base-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:45:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:45:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:40.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install cephadm 2023-12-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:41.327 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:41.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-immutable-object-cache 2023-12-17T11:45:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:27 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:42.617 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:33 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:43.856 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:45:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:45:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 80 k 2023-12-17T11:45:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:45:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:45:43.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 80 k 2023-12-17T11:45:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 364 k 2023-12-17T11:45:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:45:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm-17.2.7-125.g1f2f5510.el8.noarch.rpm 254 kB/s | 80 kB 00:00 2023-12-17T11:45:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:Total 253 kB/s | 80 kB 00:00 2023-12-17T11:45:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:45:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:45:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:45:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:45:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:45:44.239 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:45:44.396 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:44.396 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:44.396 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2023-12-17T11:45:44.396 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:45:44.397 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:44.398 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 161 k 2023-12-17T11:45:44.398 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 490 k 2023-12-17T11:45:44.398 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:45:44.725 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 493 kB/s | 161 kB 00:00 2023-12-17T11:45:44.726 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:44.726 INFO:teuthology.orchestra.run.smithi119.stdout:Total 491 kB/s | 161 kB 00:00 2023-12-17T11:45:44.727 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:45:44.740 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:45:44.740 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:45:44.793 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:45:44.796 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:45:44.863 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:44.916 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:45:45.070 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:45.125 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-17T11:45:45.378 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:45.776 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-17T11:45:46.124 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/1 2023-12-17T11:45:46.124 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:46.124 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:45:46.124 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:46.125 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:46.125 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:46.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-immutable-object-cache 2023-12-17T11:45:46.515 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-17T11:45:46.515 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:46.515 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:45:46.515 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:46.515 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:46.515 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:46.751 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr 2023-12-17T11:45:47.467 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:33 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:47.818 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:38 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:49.352 INFO:teuthology.orchestra.run.smithi119.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:45:49.366 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:49.366 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:49.366 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2023-12-17T11:45:49.366 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 161 k 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:49.367 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 161 k 2023-12-17T11:45:49.368 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 490 k 2023-12-17T11:45:49.368 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:45:49.599 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:49.599 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:45:49.599 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:49.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-immutable-object-cache-17.2.7-125.g1f2f551 492 kB/s | 161 kB 00:00 2023-12-17T11:45:49.697 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:49.697 INFO:teuthology.orchestra.run.smithi002.stdout:Total 490 kB/s | 161 kB 00:00 2023-12-17T11:45:49.697 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:45:49.712 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:45:49.712 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:45:49.728 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-dashboard 2023-12-17T11:45:49.770 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:45:49.773 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:45:49.895 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:45:50.056 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-17T11:45:50.739 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-17T11:45:50.794 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:41 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:51.509 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.e 1/1 2023-12-17T11:45:51.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:51.509 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:45:51.509 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:45:51.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:51.509 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:51.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr 2023-12-17T11:45:52.594 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-17T11:45:52.595 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout:Install 6 Packages 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:52.596 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 2.0 M 2023-12-17T11:45:52.597 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 8.0 M 2023-12-17T11:45:52.597 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:45:52.876 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:38 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:53.195 INFO:teuthology.orchestra.run.smithi119.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 107 kB/s | 23 kB 00:00 2023-12-17T11:45:53.220 INFO:teuthology.orchestra.run.smithi119.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 60 kB/s | 14 kB 00:00 2023-12-17T11:45:53.487 INFO:teuthology.orchestra.run.smithi119.stdout:(3/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 3.3 MB/s | 1.7 MB 00:00 2023-12-17T11:45:53.521 INFO:teuthology.orchestra.run.smithi119.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 112 kB/s | 34 kB 00:00 2023-12-17T11:45:53.554 INFO:teuthology.orchestra.run.smithi119.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 119 kB/s | 43 kB 00:00 2023-12-17T11:45:54.046 INFO:teuthology.orchestra.run.smithi119.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 352 kB/s | 196 kB 00:00 2023-12-17T11:45:54.048 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:54.048 INFO:teuthology.orchestra.run.smithi119.stdout:Total 1.4 MB/s | 2.0 MB 00:01 2023-12-17T11:45:54.073 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:45:54.085 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:45:54.086 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:45:54.183 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:45:54.186 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:45:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:45:54.511 INFO:teuthology.orchestra.run.smithi002.stdout:Package ceph-mgr-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:45:54.771 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:54.772 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:45:54.772 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:45:54.876 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-17T11:45:54.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-dashboard 2023-12-17T11:45:55.137 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-17T11:45:55.334 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-17T11:45:55.448 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-17T11:45:55.808 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-17T11:45:56.016 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:42 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:45:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-17T11:45:56.364 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-17T11:45:56.364 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-17T11:45:56.364 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-17T11:45:56.364 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-17T11:45:56.364 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-17T11:45:56.364 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-17T11:45:57.108 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:45:57.109 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:45:57.286 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-17T11:45:57.899 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 1.7 M 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 23 k 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 14 k 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-17T11:45:57.901 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout:Install 6 Packages 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 2.0 M 2023-12-17T11:45:57.903 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 8.0 M 2023-12-17T11:45:57.903 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:45:58.349 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:49 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:45:58.476 INFO:teuthology.orchestra.run.smithi002.stdout:(1/6): ceph-grafana-dashboards-17.2.7-125.g1f2f 164 kB/s | 23 kB 00:00 2023-12-17T11:45:58.601 INFO:teuthology.orchestra.run.smithi002.stdout:(2/6): ceph-prometheus-alerts-17.2.7-125.g1f2f5 54 kB/s | 14 kB 00:00 2023-12-17T11:45:58.835 INFO:teuthology.orchestra.run.smithi002.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 119 kB/s | 43 kB 00:00 2023-12-17T11:45:58.968 INFO:teuthology.orchestra.run.smithi002.stdout:(4/6): ceph-mgr-dashboard-17.2.7-125.g1f2f5510. 2.7 MB/s | 1.7 MB 00:00 2023-12-17T11:45:59.593 INFO:teuthology.orchestra.run.smithi002.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 34 kB/s | 34 kB 00:00 2023-12-17T11:46:00.076 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================================ 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================================ 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-17T11:46:00.078 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================================ 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout:Install 8 Packages 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:00.079 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 36 M 2023-12-17T11:46:00.080 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 210 M 2023-12-17T11:46:00.080 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:46:00.318 INFO:teuthology.orchestra.run.smithi002.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 133 kB/s | 196 kB 00:01 2023-12-17T11:46:00.322 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:00.322 INFO:teuthology.orchestra.run.smithi002.stdout:Total 845 kB/s | 2.0 MB 00:02 2023-12-17T11:46:00.350 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:46:00.364 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:46:00.365 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:46:00.471 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:46:00.475 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:46:00.766 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:46:00.884 INFO:teuthology.orchestra.run.smithi119.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 8.8 MB/s | 4.7 MB 00:00 2023-12-17T11:46:00.968 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-17T11:46:01.130 INFO:teuthology.orchestra.run.smithi119.stdout:(2/8): ceph-mgr-diskprediction-local-17.2.7-125 9.5 MB/s | 7.4 MB 00:00 2023-12-17T11:46:01.205 INFO:teuthology.orchestra.run.smithi119.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.7 MB/s | 4.9 MB 00:00 2023-12-17T11:46:01.220 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-17T11:46:01.405 INFO:teuthology.orchestra.run.smithi119.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 7.2 MB/s | 3.7 MB 00:00 2023-12-17T11:46:01.440 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-17T11:46:01.481 INFO:teuthology.orchestra.run.smithi119.stdout:(5/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 642 kB/s | 225 kB 00:00 2023-12-17T11:46:01.555 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 4/6 2023-12-17T11:46:01.873 INFO:teuthology.orchestra.run.smithi119.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 21 MB/s | 14 MB 00:00 2023-12-17T11:46:01.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 5/6 2023-12-17T11:46:02.137 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-17T11:46:02.173 INFO:teuthology.orchestra.run.smithi119.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 249 kB/s | 172 kB 00:00 2023-12-17T11:46:02.198 INFO:teuthology.orchestra.run.smithi119.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 815 kB/s | 645 kB 00:00 2023-12-17T11:46:02.199 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:02.199 INFO:teuthology.orchestra.run.smithi119.stdout:Total 17 MB/s | 36 MB 00:02 2023-12-17T11:46:02.495 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 6/6 2023-12-17T11:46:02.495 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.n 1/6 2023-12-17T11:46:02.495 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2/6 2023-12-17T11:46:02.495 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.no 3/6 2023-12-17T11:46:02.495 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-17T11:46:02.495 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-17T11:46:02.529 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:46:02.552 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:46:02.552 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:46:02.970 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:46:02.974 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:46:03.561 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:46:03.705 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-17T11:46:03.851 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-17T11:46:03.870 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:03.871 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:46:03.997 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-17T11:46:04.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-17T11:46:04.658 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-17T11:46:04.821 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-17T11:46:05.160 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:01:51 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:46:05.509 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-17T11:46:05.646 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-17T11:46:06.458 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-17T11:46:06.812 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-17T11:46:07.088 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-17T11:46:07.113 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 7.4 M 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-17T11:46:07.115 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout:Install 8 Packages 2023-12-17T11:46:07.116 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:07.117 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 36 M 2023-12-17T11:46:07.117 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 210 M 2023-12-17T11:46:07.117 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:46:07.976 INFO:teuthology.orchestra.run.smithi002.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 6.1 MB/s | 4.7 MB 00:00 2023-12-17T11:46:08.118 INFO:teuthology.orchestra.run.smithi002.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 5.3 MB/s | 4.9 MB 00:00 2023-12-17T11:46:08.333 INFO:teuthology.orchestra.run.smithi002.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.0 MB/s | 225 kB 00:00 2023-12-17T11:46:08.852 INFO:teuthology.orchestra.run.smithi002.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 4.3 MB/s | 3.7 MB 00:00 2023-12-17T11:46:09.120 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-17T11:46:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.7-125 3.5 MB/s | 7.4 MB 00:02 2023-12-17T11:46:09.527 INFO:teuthology.orchestra.run.smithi002.stdout:(6/8): libgfortran-8.5.0-21.el8.x86_64.rpm 956 kB/s | 645 kB 00:00 2023-12-17T11:46:09.836 INFO:teuthology.orchestra.run.smithi002.stdout:(7/8): python3-scipy-1.0.0-21.module_el8+762+77 9.4 MB/s | 14 MB 00:01 2023-12-17T11:46:09.861 INFO:teuthology.orchestra.run.smithi002.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 309 kB/s | 172 kB 00:00 2023-12-17T11:46:09.862 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:09.862 INFO:teuthology.orchestra.run.smithi002.stdout:Total 13 MB/s | 36 MB 00:02 2023-12-17T11:46:10.200 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:46:10.224 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:46:10.224 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:46:10.466 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-17T11:46:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:46:10.668 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:46:10.720 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-17T11:46:11.139 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-17T11:46:11.139 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-17T11:46:11.139 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-17T11:46:11.140 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-17T11:46:11.140 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-17T11:46:11.140 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-17T11:46:11.140 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-17T11:46:11.140 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-17T11:46:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:46:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-17T11:46:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-17T11:46:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-17T11:46:11.893 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-17T11:46:11.894 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-17T11:46:11.895 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:11.895 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:46:12.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-rook 2023-12-17T11:46:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-17T11:46:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-17T11:46:13.169 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:04 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:46:13.331 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-17T11:46:13.460 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-17T11:46:14.328 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-17T11:46:14.691 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-17T11:46:14.923 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:14.924 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-17T11:46:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2023-12-17T11:46:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:14.927 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 1.9 M 2023-12-17T11:46:14.927 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 25 M 2023-12-17T11:46:14.927 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:46:14.927 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-17T11:46:15.345 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 245 kB/s | 27 kB 00:00 2023-12-17T11:46:15.370 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 149 kB/s | 20 kB 00:00 2023-12-17T11:46:15.395 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 298 kB/s | 47 kB 00:00 2023-12-17T11:46:15.537 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 658 kB/s | 126 kB 00:00 2023-12-17T11:46:15.563 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 572 kB/s | 110 kB 00:00 2023-12-17T11:46:15.755 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 172 kB/s | 33 kB 00:00 2023-12-17T11:46:15.797 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 386 kB/s | 155 kB 00:00 2023-12-17T11:46:15.822 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 244 kB/s | 16 kB 00:00 2023-12-17T11:46:15.864 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-requests-oauthlib-1.0.0-1.el8.n 131 kB/s | 43 kB 00:00 2023-12-17T11:46:15.981 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 441 kB/s | 81 kB 00:00 2023-12-17T11:46:16.023 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): python3-kubernetes-11.0.0-6.el8.noarch 5.8 MB/s | 1.2 MB 00:00 2023-12-17T11:46:16.048 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 922 kB/s | 61 kB 00:00 2023-12-17T11:46:16.073 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): python3-rsa-4.9-2.el8.noarch.rpm 308 kB/s | 64 kB 00:00 2023-12-17T11:46:16.076 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:16.076 INFO:teuthology.orchestra.run.smithi119.stdout:Total 1.7 MB/s | 1.9 MB 00:01 2023-12-17T11:46:16.212 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:46:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:46:16.232 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:46:16.337 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:46:16.341 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:46:16.905 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:46:17.092 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-17T11:46:17.146 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-17T11:46:17.349 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-17T11:46:17.577 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-17T11:46:17.811 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-17T11:46:18.011 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-17T11:46:18.298 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-17T11:46:18.498 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2023-12-17T11:46:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-17T11:46:18.802 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-17T11:46:18.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 8/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510 1/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-17T11:46:19.341 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2023-12-17T11:46:19.342 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-17T11:46:20.053 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-17T11:46:20.132 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2023-12-17T11:46:20.133 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:20.133 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:46:20.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-rook 2023-12-17T11:46:20.318 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-17T11:46:20.519 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-17T11:46:20.724 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-17T11:46:20.919 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-17T11:46:21.300 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-17T11:46:21.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-17T11:46:21.301 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-17T11:46:21.450 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:07 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-17T11:46:22.090 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:22.091 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:46:22.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-cephadm 2023-12-17T11:46:23.313 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:14 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:46:23.349 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:46:23.351 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 47 k 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-17T11:46:23.352 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout:Install 13 Packages 2023-12-17T11:46:23.353 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 1.9 M 2023-12-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 25 M 2023-12-17T11:46:23.354 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:46:23.836 INFO:teuthology.orchestra.run.smithi002.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 167 kB/s | 20 kB 00:00 2023-12-17T11:46:23.861 INFO:teuthology.orchestra.run.smithi002.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 183 kB/s | 27 kB 00:00 2023-12-17T11:46:23.886 INFO:teuthology.orchestra.run.smithi002.stdout:(3/13): ceph-mgr-rook-17.2.7-125.g1f2f5510.el8. 279 kB/s | 47 kB 00:00 2023-12-17T11:46:24.037 INFO:teuthology.orchestra.run.smithi002.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 628 kB/s | 110 kB 00:00 2023-12-17T11:46:24.103 INFO:teuthology.orchestra.run.smithi002.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 473 kB/s | 126 kB 00:00 2023-12-17T11:46:24.354 INFO:teuthology.orchestra.run.smithi002.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 132 kB/s | 33 kB 00:00 2023-12-17T11:46:24.379 INFO:teuthology.orchestra.run.smithi002.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 125 kB/s | 43 kB 00:00 2023-12-17T11:46:24.404 INFO:teuthology.orchestra.run.smithi002.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 299 kB/s | 155 kB 00:00 2023-12-17T11:46:24.438 INFO:teuthology.orchestra.run.smithi002.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 194 kB/s | 16 kB 00:00 2023-12-17T11:46:24.589 INFO:teuthology.orchestra.run.smithi002.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 443 kB/s | 64 kB 00:00 2023-12-17T11:46:24.680 INFO:teuthology.orchestra.run.smithi002.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 670 kB/s | 61 kB 00:00 2023-12-17T11:46:24.706 INFO:teuthology.orchestra.run.smithi002.stdout:(12/13): python3-google-auth-1.1.1-10.el8.noarc 249 kB/s | 81 kB 00:00 2023-12-17T11:46:24.922 INFO:teuthology.orchestra.run.smithi002.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 2.3 MB/s | 1.2 MB 00:00 2023-12-17T11:46:24.925 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:24.926 INFO:teuthology.orchestra.run.smithi002.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2023-12-17T11:46:25.070 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-17T11:46:25.073 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout:Install 5 Packages 2023-12-17T11:46:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:25.075 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 6.0 M 2023-12-17T11:46:25.075 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 26 M 2023-12-17T11:46:25.075 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:46:25.091 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:46:25.091 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:46:25.209 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:46:25.212 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:46:25.798 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:46:25.897 INFO:teuthology.orchestra.run.smithi119.stdout:(1/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 431 kB/s | 121 kB 00:00 2023-12-17T11:46:26.023 INFO:teuthology.orchestra.run.smithi119.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.3 MB/s | 538 kB 00:00 2023-12-17T11:46:26.023 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-17T11:46:26.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-17T11:46:26.315 INFO:teuthology.orchestra.run.smithi119.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 207 kB/s | 60 kB 00:00 2023-12-17T11:46:26.348 INFO:teuthology.orchestra.run.smithi119.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.0 MB/s | 476 kB 00:00 2023-12-17T11:46:26.440 INFO:teuthology.orchestra.run.smithi119.stdout:(5/5): python3-babel-2.5.1-7.el8.noarch.rpm 5.8 MB/s | 4.8 MB 00:00 2023-12-17T11:46:26.443 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:26.443 INFO:teuthology.orchestra.run.smithi119.stdout:Total 4.4 MB/s | 6.0 MB 00:01 2023-12-17T11:46:26.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-17T11:46:26.525 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:46:26.540 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:46:26.540 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:46:26.665 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:46:26.668 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:46:26.735 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-17T11:46:26.957 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:46:26.979 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-17T11:46:27.239 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-17T11:46:27.319 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-17T11:46:27.568 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-17T11:46:27.779 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-17T11:46:28.366 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-17T11:46:28.759 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-17T11:46:29.084 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-17T11:46:29.197 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-17T11:46:29.300 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-17T11:46:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-17T11:46:29.650 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-17T11:46:29.650 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-17T11:46:29.650 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-17T11:46:29.650 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-17T11:46:29.650 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-17T11:46:29.659 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-17T11:46:29.890 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-17T11:46:30.108 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-17T11:46:30.377 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-17T11:46:30.377 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:30.378 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 13/13 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 1/13 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-17T11:46:30.505 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-17T11:46:30.506 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-17T11:46:30.506 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-17T11:46:30.506 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-17T11:46:30.506 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-17T11:46:30.506 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-17T11:46:30.506 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-17T11:46:30.541 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-fuse 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-17T11:46:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:31.456 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:46:31.599 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:22 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:46:31.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-mgr-cephadm 2023-12-17T11:46:32.741 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:18 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:46:33.466 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:33.467 INFO:teuthology.orchestra.run.smithi119.stdout:Install 2 Packages 2023-12-17T11:46:33.468 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:33.468 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 958 k 2023-12-17T11:46:33.468 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 3.0 M 2023-12-17T11:46:33.468 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:46:34.006 INFO:teuthology.orchestra.run.smithi119.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 246 kB/s | 83 kB 00:00 2023-12-17T11:46:34.256 INFO:teuthology.orchestra.run.smithi119.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 1.5 MB/s | 875 kB 00:00 2023-12-17T11:46:34.257 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:34.257 INFO:teuthology.orchestra.run.smithi119.stdout:Total 1.2 MB/s | 958 kB 00:00 2023-12-17T11:46:34.282 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:46:34.308 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:46:34.308 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:46:34.413 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:46:34.417 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:46:34.610 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:46:34.666 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:17.2.7-125.g1f2f5510.el8 ceph-noarch 121 k 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:46:34.667 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout:Install 5 Packages 2023-12-17T11:46:34.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:34.669 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 6.0 M 2023-12-17T11:46:34.669 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 26 M 2023-12-17T11:46:34.669 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:46:34.920 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-17T11:46:35.150 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-17T11:46:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 2.0 MB/s | 538 kB 00:00 2023-12-17T11:46:35.672 INFO:teuthology.orchestra.run.smithi002.stdout:(2/5): ceph-mgr-cephadm-17.2.7-125.g1f2f5510.el 267 kB/s | 121 kB 00:00 2023-12-17T11:46:35.760 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-17T11:46:35.760 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-17T11:46:36.118 INFO:teuthology.orchestra.run.smithi002.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 5.3 MB/s | 4.8 MB 00:00 2023-12-17T11:46:36.147 INFO:teuthology.orchestra.run.smithi002.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 127 kB/s | 60 kB 00:00 2023-12-17T11:46:36.297 INFO:teuthology.orchestra.run.smithi002.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 582 kB/s | 476 kB 00:00 2023-12-17T11:46:36.298 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Total 3.7 MB/s | 6.0 MB 00:01 2023-12-17T11:46:36.385 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:46:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:46:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:46:36.525 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:46:36.529 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:46:36.830 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:46:37.196 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-17T11:46:37.620 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-17T11:46:37.621 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:37.621 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:46:37.621 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-17T11:46:37.621 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:37.621 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:46:37.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librados-devel 2023-12-17T11:46:38.329 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-17T11:46:38.741 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-17T11:46:38.959 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:29 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:46:39.033 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-17T11:46:39.273 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-17T11:46:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 5/5 2023-12-17T11:46:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 1/5 2023-12-17T11:46:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-17T11:46:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-17T11:46:39.626 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-17T11:46:40.399 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-17T11:46:40.399 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:46:40.399 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:17.2.7-125.g1f2f5510.el8.noarch 2023-12-17T11:46:40.399 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-17T11:46:40.400 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-17T11:46:40.400 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-17T11:46:40.400 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-17T11:46:40.400 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:46:40.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-fuse 2023-12-17T11:46:40.705 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:40.706 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:46:40.707 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:40.707 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 130 k 2023-12-17T11:46:40.707 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 464 k 2023-12-17T11:46:40.707 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:46:41.195 INFO:teuthology.orchestra.run.smithi119.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 266 kB/s | 130 kB 00:00 2023-12-17T11:46:41.196 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:41.196 INFO:teuthology.orchestra.run.smithi119.stdout:Total 265 kB/s | 130 kB 00:00 2023-12-17T11:46:41.196 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:46:41.204 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:46:41.204 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:46:41.262 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:46:41.265 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:46:41.386 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:46:41.648 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:46:41.694 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:27 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:46:42.028 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:46:43.501 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:46:43.501 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:43.501 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:46:43.501 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:46:43.501 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:43.501 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:46:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:46:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-12-17T11:46:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 875 k 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:Install 2 Packages 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 958 k 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 3.0 M 2023-12-17T11:46:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:46:43.751 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install libcephfs2 2023-12-17T11:46:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 203 kB/s | 83 kB 00:00 2023-12-17T11:46:44.830 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:35 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:46:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:(2/2): ceph-fuse-17.2.7-125.g1f2f5510.el8.x86_6 660 kB/s | 875 kB 00:01 2023-12-17T11:46:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:Total 699 kB/s | 958 kB 00:01 2023-12-17T11:46:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:46:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:46:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:46:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:46:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:46:45.353 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:46:45.667 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-17T11:46:45.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-17T11:46:46.322 INFO:teuthology.orchestra.run.smithi119.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:46:46.569 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:46.570 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:46:46.570 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:46:46.583 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2/2 2023-12-17T11:46:46.583 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/2 2023-12-17T11:46:46.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install libcephfs-devel 2023-12-17T11:46:47.355 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-17T11:46:47.356 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:47.356 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:46:47.356 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-17T11:46:47.356 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:47.356 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:46:47.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados-devel 2023-12-17T11:46:47.747 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:38 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:46:48.754 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:34 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:46:49.486 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:46:49.486 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:49.486 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:46:49.487 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:46:49.488 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 25 k 2023-12-17T11:46:49.488 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 109 k 2023-12-17T11:46:49.488 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:46:50.656 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:46:50.657 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:50.657 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2023-12-17T11:46:50.657 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:50.657 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 130 k 2023-12-17T11:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:50.659 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 130 k 2023-12-17T11:46:50.659 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 464 k 2023-12-17T11:46:50.659 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:46:58.113 INFO:teuthology.orchestra.run.smithi002.stdout:librados-devel-17.2.7-125.g1f2f5510.el8.x86_64. 17 kB/s | 130 kB 00:07 2023-12-17T11:46:58.114 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:46:58.114 INFO:teuthology.orchestra.run.smithi002.stdout:Total 17 kB/s | 130 kB 00:07 2023-12-17T11:46:58.114 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:46:58.124 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:46:58.124 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:46:58.189 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:46:58.193 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:46:58.317 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:46:58.595 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:46:58.981 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:46:59.733 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:46:59.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:59.733 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:46:59.733 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:46:59.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:46:59.733 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:46:59.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs2 2023-12-17T11:47:01.106 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:47 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:02.736 INFO:teuthology.orchestra.run.smithi002.stdout:Package libcephfs2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:02.997 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:02.998 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:02.998 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:03.003 INFO:teuthology.orchestra.run.smithi119.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 1.8 kB/s | 25 kB 00:13 2023-12-17T11:47:03.004 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:03.005 INFO:teuthology.orchestra.run.smithi119.stdout:Total 1.8 kB/s | 25 kB 00:13 2023-12-17T11:47:03.005 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:47:03.011 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:47:03.011 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:47:03.016 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:47:03.019 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:47:03.079 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:47:03.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install libcephfs-devel 2023-12-17T11:47:03.436 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:03.752 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:04.270 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:50 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:04.414 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:04.414 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:04.414 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:47:04.414 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:04.414 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:04.414 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:04.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librados2 2023-12-17T11:47:05.616 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:56 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:06.326 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 25 k 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:47:06.327 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:06.328 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 25 k 2023-12-17T11:47:06.328 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 109 k 2023-12-17T11:47:06.328 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:47:07.182 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:07.425 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:07.426 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:47:07.426 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:07.546 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librbd1 2023-12-17T11:47:08.629 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:59 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:09.852 INFO:teuthology.orchestra.run.smithi002.stdout:libcephfs-devel-17.2.7-125.g1f2f5510.el8.x86_64 7.0 kB/s | 25 kB 00:03 2023-12-17T11:47:09.853 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:09.853 INFO:teuthology.orchestra.run.smithi002.stdout:Total 7.0 kB/s | 25 kB 00:03 2023-12-17T11:47:09.854 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:47:09.860 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:47:09.860 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:47:09.865 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:47:09.869 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:47:09.923 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:47:10.141 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:10.152 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:10.381 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:10.382 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:47:10.382 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:10.465 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:10.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rados 2023-12-17T11:47:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:11.139 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:47:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:11.139 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:11.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librados2 2023-12-17T11:47:11.568 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:02 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:12.500 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:02:58 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:13.173 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:13.417 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:13.418 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:47:13.418 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:13.534 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rgw 2023-12-17T11:47:14.128 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:14.390 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:14.391 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:14.391 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:14.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install librbd1 2023-12-17T11:47:14.598 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:05 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:15.645 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:01 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:16.085 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:16.330 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:16.331 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:47:16.331 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:16.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-cephfs 2023-12-17T11:47:17.282 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:17.520 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:08 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:17.545 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:17.546 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:17.546 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:17.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rados 2023-12-17T11:47:18.805 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:04 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:19.025 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:19.269 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:19.270 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:47:19.270 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:19.386 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rbd 2023-12-17T11:47:20.439 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rados-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:20.460 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:11 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:20.700 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:20.701 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:20.701 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:20.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rgw 2023-12-17T11:47:21.953 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:07 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:21.977 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:22.219 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:22.220 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2023-12-17T11:47:22.220 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:22.341 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-fuse 2023-12-17T11:47:23.398 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:14 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rgw-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:23.903 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:23.905 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:23.905 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:24.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-cephfs 2023-12-17T11:47:25.164 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:11 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:25.165 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:47:25.166 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:25.167 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:47:25.167 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:25.167 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 90 k 2023-12-17T11:47:25.167 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 264 k 2023-12-17T11:47:25.167 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:47:25.472 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 296 kB/s | 90 kB 00:00 2023-12-17T11:47:25.473 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:25.473 INFO:teuthology.orchestra.run.smithi119.stdout:Total 295 kB/s | 90 kB 00:00 2023-12-17T11:47:25.473 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:47:25.486 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:47:25.486 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:47:25.542 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:47:25.546 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:47:25.667 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:47:25.866 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:26.240 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:26.789 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-cephfs-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:26.996 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:26.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:26.996 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:47:26.996 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:26.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:26.996 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:27.051 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:27.052 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:27.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install python3-rbd 2023-12-17T11:47:27.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-mirror 2023-12-17T11:47:28.290 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:19 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:28.322 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:14 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:29.940 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-rbd-2:17.2.7-125.g1f2f5510.el8.x86_64 is already installed. 2023-12-17T11:47:30.188 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:30.189 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 3.5 M 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 16 M 2023-12-17T11:47:30.190 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:47:30.202 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:30.203 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2023-12-17T11:47:30.203 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:30.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-fuse 2023-12-17T11:47:30.766 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 6.0 MB/s | 3.5 MB 00:00 2023-12-17T11:47:30.767 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:30.767 INFO:teuthology.orchestra.run.smithi119.stdout:Total 6.0 MB/s | 3.5 MB 00:00 2023-12-17T11:47:30.768 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:47:30.782 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:47:30.782 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:47:30.852 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:47:30.856 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:47:31.346 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:47:31.454 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:17 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:31.524 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:32.186 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:32.943 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:32.943 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:32.943 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:47:32.943 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:32.943 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:32.943 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:33.181 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-nbd 2023-12-17T11:47:33.348 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 90 k 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:33.349 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:47:33.350 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:33.350 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:47:33.350 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:33.350 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 90 k 2023-12-17T11:47:33.350 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 264 k 2023-12-17T11:47:33.350 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:47:33.538 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-fuse-17.2.7-125.g1f2f5510.el8.x86_64.rpm 482 kB/s | 90 kB 00:00 2023-12-17T11:47:33.539 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:33.539 INFO:teuthology.orchestra.run.smithi002.stdout:Total 478 kB/s | 90 kB 00:00 2023-12-17T11:47:33.539 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:47:33.552 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:47:33.553 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:47:33.613 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:47:33.616 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:47:33.740 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:47:33.922 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:34.275 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:03:25 ago on Sun 17 Dec 2023 11:44:09 AM UTC. 2023-12-17T11:47:34.310 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:35.056 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:35.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:35.056 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:47:35.056 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:35.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:35.057 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:35.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-mirror 2023-12-17T11:47:36.038 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2023-12-17T11:47:36.038 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:36.038 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2023-12-17T11:47:36.038 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 173 k 2023-12-17T11:47:36.039 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 552 k 2023-12-17T11:47:36.040 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2023-12-17T11:47:36.252 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 812 kB/s | 173 kB 00:00 2023-12-17T11:47:36.253 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:36.253 INFO:teuthology.orchestra.run.smithi119.stdout:Total 807 kB/s | 173 kB 00:00 2023-12-17T11:47:36.254 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2023-12-17T11:47:36.267 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2023-12-17T11:47:36.267 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2023-12-17T11:47:36.324 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2023-12-17T11:47:36.327 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2023-12-17T11:47:36.413 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:22 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:36.456 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2023-12-17T11:47:36.655 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:37.029 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:37.771 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:37.772 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:37.772 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2023-12-17T11:47:37.772 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:37.772 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:47:37.772 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2023-12-17T11:47:37.983 DEBUG:teuthology.parallel:result is None 2023-12-17T11:47:38.324 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repo Size 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 3.5 M 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:38.325 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:47:38.326 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:38.326 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 3.5 M 2023-12-17T11:47:38.326 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 16 M 2023-12-17T11:47:38.326 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:47:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-mirror-17.2.7-125.g1f2f5510.el8.x86_64.rpm 2.8 MB/s | 3.5 MB 00:01 2023-12-17T11:47:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:Total 2.7 MB/s | 3.5 MB 00:01 2023-12-17T11:47:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:47:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:47:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:47:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:47:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:47:40.202 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:47:40.372 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:41.058 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:41.875 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:41.875 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:47:41.875 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:41.875 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:42.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install rbd-nbd 2023-12-17T11:47:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:29 ago on Sun 17 Dec 2023 11:44:14 AM UTC. 2023-12-17T11:47:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-12-17T11:47:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:17.2.7-125.g1f2f5510.el8 ceph 173 k 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-12-17T11:47:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-12-17T11:47:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:Install 1 Package 2023-12-17T11:47:45.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 173 k 2023-12-17T11:47:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 552 k 2023-12-17T11:47:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-12-17T11:47:45.493 INFO:teuthology.orchestra.run.smithi002.stdout:rbd-nbd-17.2.7-125.g1f2f5510.el8.x86_64.rpm 525 kB/s | 173 kB 00:00 2023-12-17T11:47:45.494 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:47:45.494 INFO:teuthology.orchestra.run.smithi002.stdout:Total 523 kB/s | 173 kB 00:00 2023-12-17T11:47:45.494 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-12-17T11:47:45.509 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-12-17T11:47:45.509 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-12-17T11:47:45.571 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-12-17T11:47:45.574 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-12-17T11:47:45.704 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-12-17T11:47:45.912 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:46.297 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:47.033 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 1/1 2023-12-17T11:47:47.034 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-12-17T11:47:47.034 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:17.2.7-125.g1f2f5510.el8.x86_64 2023-12-17T11:47:47.034 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:47:47.034 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-12-17T11:47:47.282 DEBUG:teuthology.parallel:result is None 2023-12-17T11:47:47.282 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:47:47.282 INFO:teuthology.packaging:ref: None 2023-12-17T11:47:47.283 INFO:teuthology.packaging:tag: None 2023-12-17T11:47:47.283 INFO:teuthology.packaging:branch: quincy 2023-12-17T11:47:47.283 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:47:47.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-17T11:47:47.598 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:47:47.654 INFO:teuthology.orchestra.run.smithi002.stdout:17.2.7-125.g1f2f5510.el8 2023-12-17T11:47:47.655 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-17T11:47:47.655 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-17T11:47:47.656 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:47:47.657 INFO:teuthology.packaging:ref: None 2023-12-17T11:47:47.657 INFO:teuthology.packaging:tag: None 2023-12-17T11:47:47.657 INFO:teuthology.packaging:branch: quincy 2023-12-17T11:47:47.657 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:47:47.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-17T11:47:47.864 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:47:47.924 INFO:teuthology.orchestra.run.smithi119.stdout:17.2.7-125.g1f2f5510.el8 2023-12-17T11:47:47.924 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-125.g1f2f5510.el8 2023-12-17T11:47:47.924 INFO:teuthology.task.install:The correct ceph version 17.2.7-125.g1f2f5510 is installed. 2023-12-17T11:47:47.926 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-17T11:47:47.926 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:47:47.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:47:47.999 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:47:47.999 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:47:48.074 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-17T11:47:48.074 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:47:48.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:47:48.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:47:48.255 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:47:48.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:47:48.326 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:47:48.435 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-17T11:47:48.435 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:47:48.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:47:48.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:47:48.615 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:47:48.615 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:47:48.684 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:47:48.794 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-17T11:47:48.794 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:47:48.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:47:48.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:47:48.975 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:47:48.975 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:47:49.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:47:49.153 INFO:teuthology.run_tasks:Running task print... 2023-12-17T11:47:49.168 INFO:teuthology.task.print:**** done install task... 2023-12-17T11:47:49.168 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-17T11:47:49.254 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'} 2023-12-17T11:47:49.254 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-17T11:47:49.255 INFO:tasks.cephadm:Cluster fsid is 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:47:49.255 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-17T11:47:49.255 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-17T11:47:49.255 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi002': '172.21.15.2', 'mon.smithi119': '172.21.15.119'} 2023-12-17T11:47:49.255 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-17T11:47:49.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2023-12-17T11:47:49.328 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2023-12-17T11:47:49.400 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-17T11:47:49.400 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-17T11:47:49.669 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 17 11:47 /home/ubuntu/cephtest/cephadm 2023-12-17T11:47:49.669 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-17T11:47:49.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 17 11:47 /home/ubuntu/cephtest/cephadm 2023-12-17T11:47:49.875 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-17T11:47:49.926 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-17T11:47:49.991 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-17T11:47:49.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-17T11:47:49.996 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-17T11:47:51.196 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-17T11:47:51.208 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-17T11:48:42.731 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-12-17T11:48:42.733 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-17T11:48:42.733 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-17T11:48:42.733 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2023-12-17T11:48:42.733 INFO:teuthology.orchestra.run.smithi119.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-17T11:48:42.733 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2023-12-17T11:48:42.733 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)", 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5", 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:7a1644eb327b921af6e6cf30118d696e8368bd632346b48049fba15207e60112" 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-12-17T11:48:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:48:43.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2023-12-17T11:48:43.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2023-12-17T11:48:43.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2023-12-17T11:48:43.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2023-12-17T11:48:43.480 INFO:tasks.cephadm:Writing seed config... 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-17T11:48:43.482 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-17T11:48:43.483 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-17T11:48:43.484 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-17T11:48:43.485 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:48:43.485 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-17T11:48:43.531 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1a404768-9cd2-11ee-95a5-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-17T11:48:43.531 DEBUG:teuthology.orchestra.run.smithi002:mon.smithi002> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service 2023-12-17T11:48:43.575 INFO:tasks.cephadm:Bootstrapping... 2023-12-17T11:48:43.575 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-17T11:48:43.645 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:-- Logs begin at Sun 2023-12-17 11:31:09 UTC. -- 2023-12-17T11:48:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:48:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '1a404768-9cd2-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2023-12-17T11:48:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 4.6.1 2023-12-17T11:48:43.929 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-17T11:48:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2023-12-17T11:48:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 4.6.1 2023-12-17T11:48:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2023-12-17T11:48:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2023-12-17T11:48:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-17T11:48:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-17T11:48:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-17T11:48:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2023-12-17T11:48:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2023-12-17T11:48:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2023-12-17T11:48:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2023-12-17T11:48:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2023-12-17T11:48:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 4.6.1 2023-12-17T11:48:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-17T11:48:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2023-12-17T11:48:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2023-12-17T11:48:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-17T11:48:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-17T11:48:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-17T11:48:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2023-12-17T11:48:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140224954477032 on /run/cephadm/1a404768-9cd2-11ee-95a5-87774f69a715.lock 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140224954477032 acquired on /run/cephadm/1a404768-9cd2-11ee-95a5-87774f69a715.lock 2023-12-17T11:48:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2023-12-17T11:48:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2023-12-17T11:48:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2023-12-17T11:48:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2023-12-17T11:48:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2023-12-17T11:48:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-17T11:48:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-17T11:48:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2023-12-17T11:48:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-17T11:48:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-17T11:48:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-17T11:48:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-17T11:48:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-12-17T11:48:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-17T11:48:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2023-12-17T11:48:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2023-12-17T11:48:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-17T11:48:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-17T11:48:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:3c21fa6304a567e69d15522c48775b11468df75d53cc353263c55c753e1a9b4e 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:60cc83a9c8f10fdde41a08d59bce905c1a01fc7389b91726758c2505caa3f0c5 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-17T11:48:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-17T11:48:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable) 2023-12-17T11:48:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2023-12-17T11:48:45.788 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2023-12-17T11:48:45.788 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2023-12-17T11:48:46.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAe4H5lEbF8AxAAS1AEXIcl8w8iL+KB6Sdv6w== 2023-12-17T11:48:46.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAe4H5lm+tGJRAACoTAs+3z+XElEBXkMZuoxw== 2023-12-17T11:48:47.531 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQAf4H5l6yhgDRAA5IHxnHYojQ3//7TMR14ihg== 2023-12-17T11:48:47.532 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2023-12-17T11:48:48.113 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-17T11:48:48.113 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-17T11:48:48.113 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:48.113 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-17T11:48:48.113 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for smithi002 [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-17T11:48:48.113 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = octopus 2023-12-17T11:48:48.114 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:48.114 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-17T11:48:48.114 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:48:48.114 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2023-12-17T11:48:48.716 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.smithi002 on 2023-12-17T11:48:48.932 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-17T11:48:49.127 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-17T11:48:49.337 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1a404768-9cd2-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-1a404768-9cd2-11ee-95a5-87774f69a715.target. 2023-12-17T11:48:49.337 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1a404768-9cd2-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-1a404768-9cd2-11ee-95a5-87774f69a715.target. 2023-12-17T11:48:49.657 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002 2023-12-17T11:48:49.657 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service: Unit ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service not loaded. 2023-12-17T11:48:49.871 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1a404768-9cd2-11ee-95a5-87774f69a715.target.wants/ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service → /etc/systemd/system/ceph-1a404768-9cd2-11ee-95a5-87774f69a715@.service. 2023-12-17T11:48:49.972 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:49 smithi002 systemd[1]: Starting Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:48:50.416 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:48:50.416 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2023-12-17T11:48:50.435 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:48:50.435 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2023-12-17T11:48:50.435 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2023-12-17T11:48:50.435 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2023-12-17T11:48:50.436 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2023-12-17T11:48:50.436 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2023-12-17T11:48:50.655 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:50 smithi002 bash[106607]: 9040164cb2d181aca6d5807c767490a0618118d5443717144dc9ba04cfe5a187 2023-12-17T11:48:50.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:50 smithi002 systemd[1]: Started Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:48:50.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:50 smithi002 ceph-mon[106645]: mkfs 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:50.656 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:50 smithi002 ceph-mon[106645]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2023-12-17T11:48:51.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2023-12-17T11:48:51.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:51.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi002 (age 0.555571s) 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.884+0000 7f7e72f44700 1 Processor -- start 2023-12-17T11:48:51.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.884+0000 7f7e72f44700 1 -- start start 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.884+0000 7f7e72f44700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.884+0000 7f7e72f44700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c102c20 con 0x7f7e6c1022d0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.885+0000 7f7e70ce0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.885+0000 7f7e70ce0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50912/0 (socket says 172.21.15.2:50912) 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.885+0000 7f7e70ce0700 1 -- 172.21.15.2:0/3029673111 learned_addr learned my addr 172.21.15.2:0/3029673111 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.885+0000 7f7e70ce0700 1 -- 172.21.15.2:0/3029673111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c102d60 con 0x7f7e6c1022d0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.886+0000 7f7e70ce0700 1 --2- 172.21.15.2:0/3029673111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c1026e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7e600098e0 tx=0x7f7e60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a79457c15d061a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.886+0000 7f7e6b7fe700 1 -- 172.21.15.2:0/3029673111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e6000b860 con 0x7f7e6c1022d0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.886+0000 7f7e6b7fe700 1 -- 172.21.15.2:0/3029673111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000b9c0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.886+0000 7f7e6b7fe700 1 -- 172.21.15.2:0/3029673111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e6000bc90 con 0x7f7e6c1022d0 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.886+0000 7f7e72f44700 1 -- 172.21.15.2:0/3029673111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 msgr2=0x7f7e6c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.886+0000 7f7e72f44700 1 --2- 172.21.15.2:0/3029673111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c1026e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7e600098e0 tx=0x7f7e60009250 comp rx=0 tx=0).stop 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.887+0000 7f7e72f44700 1 -- 172.21.15.2:0/3029673111 shutdown_connections 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.887+0000 7f7e72f44700 1 --2- 172.21.15.2:0/3029673111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c1026e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.887+0000 7f7e72f44700 1 -- 172.21.15.2:0/3029673111 >> 172.21.15.2:0/3029673111 conn(0x7f7e6c0fda50 msgr2=0x7f7e6c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.887+0000 7f7e72f44700 1 -- 172.21.15.2:0/3029673111 shutdown_connections 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.887+0000 7f7e72f44700 1 -- 172.21.15.2:0/3029673111 wait complete. 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.887+0000 7f7e72f44700 1 Processor -- start 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.888+0000 7f7e72f44700 1 -- start start 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.888+0000 7f7e72f44700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c110960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.888+0000 7f7e72f44700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c110ea0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.888+0000 7f7e70ce0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c110960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.888+0000 7f7e70ce0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c110960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50916/0 (socket says 172.21.15.2:50916) 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.888+0000 7f7e70ce0700 1 -- 172.21.15.2:0/3541526390 learned_addr learned my addr 172.21.15.2:0/3541526390 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e70ce0700 1 -- 172.21.15.2:0/3541526390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e600094f0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e70ce0700 1 --2- 172.21.15.2:0/3541526390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c110960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e60003080 tx=0x7f7e60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e6001c5c0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6001c720 con 0x7f7e6c1022d0 2023-12-17T11:48:51.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c1110a0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e6001ca30 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c1114b0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.889+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7e6001a450 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.890+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7e6002e790 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.890+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c04bb80 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.893+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7e6001a890 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.970+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7e6c109bb0 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.971+0000 7f7e697fa700 1 -- 172.21.15.2:0/3541526390 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f7e6001aa30 con 0x7f7e6c1022d0 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 msgr2=0x7f7e6c110960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 --2- 172.21.15.2:0/3541526390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c110960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e60003080 tx=0x7f7e60016000 comp rx=0 tx=0).stop 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 shutdown_connections 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 --2- 172.21.15.2:0/3541526390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6c1022d0 0x7f7e6c110960 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 >> 172.21.15.2:0/3541526390 conn(0x7f7e6c0fda50 msgr2=0x7f7e6c105030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:51.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 shutdown_connections 2023-12-17T11:48:51.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:50.972+0000 7f7e72f44700 1 -- 172.21.15.2:0/3541526390 wait complete. 2023-12-17T11:48:51.310 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2023-12-17T11:48:51.310 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2023-12-17T11:48:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:51 smithi002 ceph-mon[106645]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2023-12-17T11:48:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:51 smithi002 ceph-mon[106645]: monmap e1: 1 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:48:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:51 smithi002 ceph-mon[106645]: fsmap 2023-12-17T11:48:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:51 smithi002 ceph-mon[106645]: osdmap e1: 0 total, 0 up, 0 in 2023-12-17T11:48:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:51 smithi002 ceph-mon[106645]: mgrmap e1: no daemons active 2023-12-17T11:48:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:51 smithi002 ceph-mon[106645]: from='client.? 172.21.15.2:0/3541526390' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:52.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.747+0000 7f76adb56700 1 Processor -- start 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.747+0000 7f76adb56700 1 -- start start 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.747+0000 7f76adb56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a81026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.747+0000 7f76adb56700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8102c20 con 0x7f76a81022d0 2023-12-17T11:48:52.185 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.748+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a81026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.748+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a81026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50922/0 (socket says 172.21.15.2:50922) 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.748+0000 7f76a77fe700 1 -- 172.21.15.2:0/595215323 learned_addr learned my addr 172.21.15.2:0/595215323 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.748+0000 7f76a77fe700 1 -- 172.21.15.2:0/595215323 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8102d60 con 0x7f76a81022d0 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.748+0000 7f76a77fe700 1 --2- 172.21.15.2:0/595215323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a81026e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f76980098e0 tx=0x7f7698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295089f127dee057 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76a67fc700 1 -- 172.21.15.2:0/595215323 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f769800b860 con 0x7f76a81022d0 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76a67fc700 1 -- 172.21.15.2:0/595215323 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800b9c0 con 0x7f76a81022d0 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76a67fc700 1 -- 172.21.15.2:0/595215323 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f769800bc90 con 0x7f76a81022d0 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 -- 172.21.15.2:0/595215323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 msgr2=0x7f76a81026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 --2- 172.21.15.2:0/595215323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a81026e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f76980098e0 tx=0x7f7698009250 comp rx=0 tx=0).stop 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 -- 172.21.15.2:0/595215323 shutdown_connections 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 --2- 172.21.15.2:0/595215323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a81026e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 -- 172.21.15.2:0/595215323 >> 172.21.15.2:0/595215323 conn(0x7f76a80fda50 msgr2=0x7f76a80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 -- 172.21.15.2:0/595215323 shutdown_connections 2023-12-17T11:48:52.186 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.749+0000 7f76adb56700 1 -- 172.21.15.2:0/595215323 wait complete. 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.751+0000 7f76adb56700 1 Processor -- start 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.751+0000 7f76adb56700 1 -- start start 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.751+0000 7f76adb56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a8110960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.751+0000 7f76adb56700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8110ea0 con 0x7f76a81022d0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.752+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a8110960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.752+0000 7f76a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a8110960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50928/0 (socket says 172.21.15.2:50928) 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.752+0000 7f76a77fe700 1 -- 172.21.15.2:0/2480838512 learned_addr learned my addr 172.21.15.2:0/2480838512 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.752+0000 7f76a77fe700 1 -- 172.21.15.2:0/2480838512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76980094f0 con 0x7f76a81022d0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.752+0000 7f76a77fe700 1 --2- 172.21.15.2:0/2480838512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a8110960 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7698003080 tx=0x7f7698016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f769801c5c0 con 0x7f76a81022d0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769801c720 con 0x7f76a81022d0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f769801ca30 con 0x7f76a81022d0 2023-12-17T11:48:52.187 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a81110a0 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a81114b0 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f769801a450 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.753+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f769802e790 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.754+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a804bb80 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.757+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f769801a890 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.830+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f76a8103640 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.835+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f769802edc0 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.835+0000 7f768ffff700 1 -- 172.21.15.2:0/2480838512 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f769801b6c0 con 0x7f76a81022d0 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 msgr2=0x7f76a8110960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 --2- 172.21.15.2:0/2480838512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a8110960 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7698003080 tx=0x7f7698016000 comp rx=0 tx=0).stop 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 shutdown_connections 2023-12-17T11:48:52.188 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 --2- 172.21.15.2:0/2480838512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76a81022d0 0x7f76a8110960 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 >> 172.21.15.2:0/2480838512 conn(0x7f76a80fda50 msgr2=0x7f76a8105030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:52.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 shutdown_connections 2023-12-17T11:48:52.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:51.836+0000 7f76adb56700 1 -- 172.21.15.2:0/2480838512 wait complete. 2023-12-17T11:48:52.189 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2023-12-17T11:48:52.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:52 smithi002 ceph-mon[106645]: from='client.? 172.21.15.2:0/2480838512' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-17T11:48:52.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:52 smithi002 ceph-mon[106645]: from='client.? 172.21.15.2:0/2480838512' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-17T11:48:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.679+0000 7f930551b700 1 Processor -- start 2023-12-17T11:48:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.679+0000 7f930551b700 1 -- start start 2023-12-17T11:48:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.679+0000 7f930551b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f9300076120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.679+0000 7f930551b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300078020 con 0x7f9300077c10 2023-12-17T11:48:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.680+0000 7f92feffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f9300076120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.680+0000 7f92feffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f9300076120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50940/0 (socket says 172.21.15.2:50940) 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.680+0000 7f92feffd700 1 -- 172.21.15.2:0/174070076 learned_addr learned my addr 172.21.15.2:0/174070076 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.680+0000 7f92feffd700 1 -- 172.21.15.2:0/174070076 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9300076660 con 0x7f9300077c10 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.680+0000 7f92feffd700 1 --2- 172.21.15.2:0/174070076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f9300076120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f92f00098e0 tx=0x7f92f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f8ab31c37d2034 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f92fdffb700 1 -- 172.21.15.2:0/174070076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f000b860 con 0x7f9300077c10 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f92fdffb700 1 -- 172.21.15.2:0/174070076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f92f000be30 con 0x7f9300077c10 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f92fdffb700 1 -- 172.21.15.2:0/174070076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f0010380 con 0x7f9300077c10 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 -- 172.21.15.2:0/174070076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 msgr2=0x7f9300076120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 --2- 172.21.15.2:0/174070076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f9300076120 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f92f00098e0 tx=0x7f92f0009250 comp rx=0 tx=0).stop 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 -- 172.21.15.2:0/174070076 shutdown_connections 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 --2- 172.21.15.2:0/174070076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f9300076120 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 -- 172.21.15.2:0/174070076 >> 172.21.15.2:0/174070076 conn(0x7f93000fda50 msgr2=0x7f93000ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 -- 172.21.15.2:0/174070076 shutdown_connections 2023-12-17T11:48:53.087 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.681+0000 7f930551b700 1 -- 172.21.15.2:0/174070076 wait complete. 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.682+0000 7f930551b700 1 Processor -- start 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.682+0000 7f930551b700 1 -- start start 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.683+0000 7f930551b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f93001133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.683+0000 7f930551b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300113910 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.683+0000 7f92feffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f93001133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.683+0000 7f92feffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f93001133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50950/0 (socket says 172.21.15.2:50950) 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.683+0000 7f92feffd700 1 -- 172.21.15.2:0/1470217465 learned_addr learned my addr 172.21.15.2:0/1470217465 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.683+0000 7f92feffd700 1 -- 172.21.15.2:0/1470217465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00094f0 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f92feffd700 1 --2- 172.21.15.2:0/1470217465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f93001133d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f92f000b440 tx=0x7f92f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f00107a0 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f92f0010d70 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f92f001adc0 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9300113b10 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9300113f20 con 0x7f9300077c10 2023-12-17T11:48:53.088 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f92f0024670 con 0x7f9300077c10 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.684+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f92f00197f0 con 0x7f9300077c10 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.685+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930004bb80 con 0x7f9300077c10 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.688+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f92f0029060 con 0x7f9300077c10 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.763+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f930010cdb0 con 0x7f9300077c10 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.763+0000 7f92e77fe700 1 -- 172.21.15.2:0/1470217465 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f92f001a5f0 con 0x7f9300077c10 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 msgr2=0x7f93001133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 --2- 172.21.15.2:0/1470217465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f93001133d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f92f000b440 tx=0x7f92f0009250 comp rx=0 tx=0).stop 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 shutdown_connections 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 --2- 172.21.15.2:0/1470217465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9300077c10 0x7f93001133d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 >> 172.21.15.2:0/1470217465 conn(0x7f93000fda50 msgr2=0x7f93000ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 shutdown_connections 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:52.764+0000 7f930551b700 1 -- 172.21.15.2:0/1470217465 wait complete. 2023-12-17T11:48:53.089 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2023-12-17T11:48:53.355 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:48:53.614 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[106622]: 2023-12-17T11:48:53.352+0000 7fd940c99700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T11:48:53.614 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[106622]: 2023-12-17T11:48:53.352+0000 7fd940c99700 -1 mon.smithi002@0(leader) e1 *** Got Signal Terminated *** 2023-12-17T11:48:53.939 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 bash[106972]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002 2023-12-17T11:48:54.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service: Succeeded. 2023-12-17T11:48:54.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:48:54.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:53 smithi002 systemd[1]: Starting Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:48:54.387 INFO:teuthology.orchestra.run.smithi002.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 bash[107093]: bfbcbd865f4d375984c8a586fbac8a7b7dc798140de0ac34ed77316d52cb6941 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 systemd[1]: Started Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: set uid:gid to 167:167 (ceph:ceph) 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: pidfile_write: ignore empty --pid-file 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: load: jerasure load: lrc 2023-12-17T11:48:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: RocksDB version: 6.15.5 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Compile date Dec 13 2023 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: DB SUMMARY 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: DB Session ID: Q459YBLMC0SD9XV6E2WT 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: CURRENT file: CURRENT 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: IDENTITY file: IDENTITY 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi002/store.db dir, Total Num: 1, files: 000008.sst 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi002/store.db: 000010.log size: 95338 ; 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.error_if_exists: 0 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.create_if_missing: 0 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.paranoid_checks: 1 2023-12-17T11:48:54.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.env: 0x5579dd8a2a80 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.fs: Posix File System 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.info_log: 0x5579dee4c780 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_file_opening_threads: 16 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.statistics: (nil) 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.use_fsync: 0 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_log_file_size: 0 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.keep_log_file_num: 1000 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.recycle_log_file_num: 0 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.allow_fallocate: 1 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.allow_mmap_reads: 0 2023-12-17T11:48:54.728 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.allow_mmap_writes: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.use_direct_reads: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.create_missing_column_families: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.db_log_dir: 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi002/store.db 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.advise_random_on_open: 1 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.db_write_buffer_size: 0 2023-12-17T11:48:54.729 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.write_buffer_manager: 0x5579dfbbc9f0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.rate_limiter: (nil) 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.wal_recovery_mode: 2 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.enable_thread_tracking: 0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.enable_pipelined_write: 0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.unordered_write: 0 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.row_cache: None 2023-12-17T11:48:54.730 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.wal_filter: None 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.allow_ingest_behind: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.preserve_deletes: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.two_write_queues: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.manual_wal_flush: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.atomic_flush: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.log_readahead_size: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.best_efforts_recovery: 0 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-17T11:48:54.731 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.allow_data_in_errors: 0 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.db_host_id: __hostname__ 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_background_jobs: 2 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_background_compactions: -1 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_subcompactions: 1 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_total_wal_size: 0 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-17T11:48:54.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_open_files: -1 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bytes_per_sync: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_readahead_size: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_background_flushes: -1 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Compression algorithms supported: 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kZSTD supported: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kXpressCompression supported: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kLZ4HCCompression supported: 1 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kZlibCompression supported: 1 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kSnappyCompression supported: 1 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kLZ4Compression supported: 1 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: kBZip2Compression supported: 0 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-17T11:48:54.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000009 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.merge_operator: 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_filter: None 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_filter_factory: None 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.sst_partitioner_factory: None 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5579dee9cf90) 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks: 1 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_top_level_index_and_filter: 1 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_type: 0 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_index_type: 0 2023-12-17T11:48:54.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_shortening: 1 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: hash_index_allow_collision: 1 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: checksum: 1 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: no_block_cache: 0 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache: 0x5579deecf090 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_name: BinnedLRUCache 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_options: 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: capacity : 536870912 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_shard_bits : 4 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: strict_capacity_limit : 0 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: high_pri_pool_ratio: 0.000 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_compressed: (nil) 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: persistent_cache: (nil) 2023-12-17T11:48:54.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size: 4096 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size_deviation: 10 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_restart_interval: 16 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_block_restart_interval: 1 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_block_size: 4096 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: partition_filters: 0 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: use_delta_encoding: 1 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: whole_key_filtering: 1 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: verify_compression: 0 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: read_amp_bytes_per_bit: 0 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: format_version: 4 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_index_compression: 1 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_align: 0 2023-12-17T11:48:54.737 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.write_buffer_size: 33554432 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_write_buffer_number: 2 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression: NoCompression 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression: Disabled 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.prefix_extractor: nullptr 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.num_levels: 7 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:48:54.738 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.level: 32767 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.strategy: 0 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compression_opts.enabled: false 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.target_file_size_base: 67108864 2023-12-17T11:48:54.739 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.arena_block_size: 4194304 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-17T11:48:54.740 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.disable_auto_compactions: 0 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-17T11:48:54.741 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.table_properties_collectors: 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.inplace_update_support: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.bloom_locality: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.max_successive_merges: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.paranoid_file_checks: 0 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.force_consistency_checks: 1 2023-12-17T11:48:54.742 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.report_bg_io_stats: 0 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.ttl: 2592000 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.enable_blob_files: false 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.min_blob_size: 0 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.blob_file_size: 268435456 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702813734408799, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-17T11:48:54.743 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702813734410136, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90864, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88959, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81737, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702813734, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "4ce51f7a-71e7-4e1a-8d64-a635108d085d", "db_session_id": "Q459YBLMC0SD9XV6E2WT"}} 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702813734410743, "job": 1, "event": "recovery_finished"} 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi002/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5579dee63180 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: DB pointer 0x5579def38000 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** DB Stats ** 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-17T11:48:54.744 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:48:54.745 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 12.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 12.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 2/0 90.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 90.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.746 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 110.5 0.00 0.00 1 0.001 0 0 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 12.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:48:54.747 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: starting mon.smithi002 rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi002 fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???) e1 preinit fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).mds e1 new map 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).mds e1 print_map 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: e1 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: legacy client fscid: -1 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: No filesystems configured 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:48:54.748 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:48:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-17T11:48:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mon.smithi002 is new leader, mons smithi002 in quorum (ranks 0) 2023-12-17T11:48:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: monmap e1: 1 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:48:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: fsmap 2023-12-17T11:48:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: osdmap e1: 0 total, 0 up, 0 in 2023-12-17T11:48:54.749 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:54 smithi002 ceph-mon[107131]: mgrmap e1: no daemons active 2023-12-17T11:48:55.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.810+0000 7f48896f2700 1 Processor -- start 2023-12-17T11:48:55.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.810+0000 7f48896f2700 1 -- start start 2023-12-17T11:48:55.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.811+0000 7f48896f2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f48840760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.242 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.811+0000 7f48896f2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884077fe0 con 0x7f4884077bd0 2023-12-17T11:48:55.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.811+0000 7f4882ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f48840760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.811+0000 7f4882ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f48840760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50952/0 (socket says 172.21.15.2:50952) 2023-12-17T11:48:55.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.811+0000 7f4882ffd700 1 -- 172.21.15.2:0/161408491 learned_addr learned my addr 172.21.15.2:0/161408491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:55.243 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.812+0000 7f4882ffd700 1 -- 172.21.15.2:0/161408491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884076620 con 0x7f4884077bd0 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.812+0000 7f4882ffd700 1 --2- 172.21.15.2:0/161408491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f48840760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f48740098e0 tx=0x7f4874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505ef94ed508d6e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.812+0000 7f4881ffb700 1 -- 172.21.15.2:0/161408491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487400b860 con 0x7f4884077bd0 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.812+0000 7f4881ffb700 1 -- 172.21.15.2:0/161408491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f487400be30 con 0x7f4884077bd0 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.812+0000 7f4881ffb700 1 -- 172.21.15.2:0/161408491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4874010380 con 0x7f4884077bd0 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 -- 172.21.15.2:0/161408491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 msgr2=0x7f48840760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 --2- 172.21.15.2:0/161408491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f48840760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f48740098e0 tx=0x7f4874009250 comp rx=0 tx=0).stop 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 -- 172.21.15.2:0/161408491 shutdown_connections 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 --2- 172.21.15.2:0/161408491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f48840760e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 -- 172.21.15.2:0/161408491 >> 172.21.15.2:0/161408491 conn(0x7f48840fda50 msgr2=0x7f48840ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 -- 172.21.15.2:0/161408491 shutdown_connections 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.813+0000 7f48896f2700 1 -- 172.21.15.2:0/161408491 wait complete. 2023-12-17T11:48:55.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.814+0000 7f48896f2700 1 Processor -- start 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.814+0000 7f48896f2700 1 -- start start 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.814+0000 7f48896f2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f4884113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.814+0000 7f48896f2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48841138b0 con 0x7f4884077bd0 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.815+0000 7f4882ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f4884113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.815+0000 7f4882ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f4884113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50968/0 (socket says 172.21.15.2:50968) 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.815+0000 7f4882ffd700 1 -- 172.21.15.2:0/51968968 learned_addr learned my addr 172.21.15.2:0/51968968 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.815+0000 7f4882ffd700 1 -- 172.21.15.2:0/51968968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740094f0 con 0x7f4884077bd0 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.815+0000 7f4882ffd700 1 --2- 172.21.15.2:0/51968968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f4884113370 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4874006fd0 tx=0x7f4874009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4874010750 con 0x7f4884077bd0 2023-12-17T11:48:55.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f4874010d20 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f487401ada0 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4884113ab0 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4884113ec0 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4874024680 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.816+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f48740198e0 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.817+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488404bb80 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.820+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4874029060 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.893+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4884108540 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.896+0000 7f486b7fe700 1 -- 172.21.15.2:0/51968968 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4884108540 con 0x7f4884077bd0 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 msgr2=0x7f4884113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 --2- 172.21.15.2:0/51968968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f4884113370 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4874006fd0 tx=0x7f4874009250 comp rx=0 tx=0).stop 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 shutdown_connections 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 --2- 172.21.15.2:0/51968968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4884077bd0 0x7f4884113370 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 >> 172.21.15.2:0/51968968 conn(0x7f48840fda50 msgr2=0x7f48840ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 shutdown_connections 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:54.897+0000 7f48896f2700 1 -- 172.21.15.2:0/51968968 wait complete. 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2023-12-17T11:48:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 9283 ... 2023-12-17T11:48:55.531 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mgr.smithi002.cqnuqs 2023-12-17T11:48:55.531 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mgr.smithi002.cqnuqs.service: Unit ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mgr.smithi002.cqnuqs.service not loaded. 2023-12-17T11:48:55.743 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1a404768-9cd2-11ee-95a5-87774f69a715.target.wants/ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mgr.smithi002.cqnuqs.service → /etc/systemd/system/ceph-1a404768-9cd2-11ee-95a5-87774f69a715@.service. 2023-12-17T11:48:56.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:55 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/51968968' entity='client.admin' 2023-12-17T11:48:56.296 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:48:56.297 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2023-12-17T11:48:56.315 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:48:56.315 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2023-12-17T11:48:56.315 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2023-12-17T11:48:56.315 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2023-12-17T11:48:56.333 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:48:56.334 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2023-12-17T11:48:56.352 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:48:56.352 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2023-12-17T11:48:56.352 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2023-12-17T11:48:56.352 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-17T11:48:56.352 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2023-12-17T11:48:56.352 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2023-12-17T11:48:57.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:48:56 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/678671075' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:48:57.232 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "1a404768-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:48:57.244 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:48:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.246 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.247 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:48:50.418341+0000", 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.795+0000 7fdae0038700 1 Processor -- start 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.795+0000 7fdae0038700 1 -- start start 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.795+0000 7fdae0038700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.795+0000 7fdae0038700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad8077fc0 con 0x7fdad8077bb0 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.796+0000 7fdadddd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.796+0000 7fdadddd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50996/0 (socket says 172.21.15.2:50996) 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.796+0000 7fdadddd4700 1 -- 172.21.15.2:0/1996160614 learned_addr learned my addr 172.21.15.2:0/1996160614 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:57.248 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.796+0000 7fdadddd4700 1 -- 172.21.15.2:0/1996160614 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad8076600 con 0x7fdad8077bb0 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.797+0000 7fdadddd4700 1 --2- 172.21.15.2:0/1996160614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad80760c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdad40098e0 tx=0x7fdad4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef6dfb347d6ec65 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.797+0000 7fdadcdd2700 1 -- 172.21.15.2:0/1996160614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdad400b860 con 0x7fdad8077bb0 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.797+0000 7fdadcdd2700 1 -- 172.21.15.2:0/1996160614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdad400be30 con 0x7fdad8077bb0 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.797+0000 7fdadcdd2700 1 -- 172.21.15.2:0/1996160614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdad4010380 con 0x7fdad8077bb0 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 -- 172.21.15.2:0/1996160614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 msgr2=0x7fdad80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 --2- 172.21.15.2:0/1996160614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad80760c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdad40098e0 tx=0x7fdad4009250 comp rx=0 tx=0).stop 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 -- 172.21.15.2:0/1996160614 shutdown_connections 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 --2- 172.21.15.2:0/1996160614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad80760c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 -- 172.21.15.2:0/1996160614 >> 172.21.15.2:0/1996160614 conn(0x7fdad80fda50 msgr2=0x7fdad80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 -- 172.21.15.2:0/1996160614 shutdown_connections 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.798+0000 7fdae0038700 1 -- 172.21.15.2:0/1996160614 wait complete. 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdae0038700 1 Processor -- start 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdae0038700 1 -- start start 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdae0038700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:57.249 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdae0038700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad8113910 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdadddd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdadddd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50998/0 (socket says 172.21.15.2:50998) 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.799+0000 7fdadddd4700 1 -- 172.21.15.2:0/678671075 learned_addr learned my addr 172.21.15.2:0/678671075 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdadddd4700 1 -- 172.21.15.2:0/678671075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40094f0 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdadddd4700 1 --2- 172.21.15.2:0/678671075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad81133d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdad4006fd0 tx=0x7fdad4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdad4010750 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdad4010d20 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdae0038700 1 -- 172.21.15.2:0/678671075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad8113b10 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdad401ada0 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.800+0000 7fdae0038700 1 -- 172.21.15.2:0/678671075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad8113f20 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.801+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdad4024680 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.801+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdad40199d0 con 0x7fdad8077bb0 2023-12-17T11:48:57.250 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.802+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab80052b0 con 0x7fdad8077bb0 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.806+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdad4029060 con 0x7fdad8077bb0 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.884+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdab8005830 con 0x7fdad8077bb0 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.885+0000 7fdace7fc700 1 -- 172.21.15.2:0/678671075 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fdad4020070 con 0x7fdad8077bb0 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 msgr2=0x7fdad81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 --2- 172.21.15.2:0/678671075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad81133d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdad4006fd0 tx=0x7fdad4009250 comp rx=0 tx=0).stop 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 shutdown_connections 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 --2- 172.21.15.2:0/678671075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdad8077bb0 0x7fdad81133d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 >> 172.21.15.2:0/678671075 conn(0x7fdad80fda50 msgr2=0x7fdad80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 shutdown_connections 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:56.886+0000 7fdac3fff700 1 -- 172.21.15.2:0/678671075 wait complete. 2023-12-17T11:48:57.251 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "1a404768-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:49:00.108 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.109 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:49:00.110 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:00.110 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:49:00.110 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:49:00.110 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:49:00.117 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.118 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:48:50.418341+0000", 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.679+0000 7f1919f8a700 1 Processor -- start 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.679+0000 7f1919f8a700 1 -- start start 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.679+0000 7f1919f8a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f19141026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.679+0000 7f1919f8a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914102c20 con 0x7f19141022d0 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.680+0000 7f19137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f19141026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.680+0000 7f19137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f19141026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50494/0 (socket says 172.21.15.2:50494) 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.680+0000 7f19137fe700 1 -- 172.21.15.2:0/3615877058 learned_addr learned my addr 172.21.15.2:0/3615877058 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.680+0000 7f19137fe700 1 -- 172.21.15.2:0/3615877058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914102d60 con 0x7f19141022d0 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.680+0000 7f19137fe700 1 --2- 172.21.15.2:0/3615877058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f19141026e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f19040098e0 tx=0x7f1904009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23085241627fb105 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f19127fc700 1 -- 172.21.15.2:0/3615877058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f190400b860 con 0x7f19141022d0 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f19127fc700 1 -- 172.21.15.2:0/3615877058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f190400be30 con 0x7f19141022d0 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f19127fc700 1 -- 172.21.15.2:0/3615877058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1904010380 con 0x7f19141022d0 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f1919f8a700 1 -- 172.21.15.2:0/3615877058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 msgr2=0x7f19141026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f1919f8a700 1 --2- 172.21.15.2:0/3615877058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f19141026e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f19040098e0 tx=0x7f1904009250 comp rx=0 tx=0).stop 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f1919f8a700 1 -- 172.21.15.2:0/3615877058 shutdown_connections 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f1919f8a700 1 --2- 172.21.15.2:0/3615877058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f19141026e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.681+0000 7f1919f8a700 1 -- 172.21.15.2:0/3615877058 >> 172.21.15.2:0/3615877058 conn(0x7f19140fda50 msgr2=0x7f19140ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.682+0000 7f1919f8a700 1 -- 172.21.15.2:0/3615877058 shutdown_connections 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.682+0000 7f1919f8a700 1 -- 172.21.15.2:0/3615877058 wait complete. 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.683+0000 7f1919f8a700 1 Processor -- start 2023-12-17T11:49:00.121 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.683+0000 7f1919f8a700 1 -- start start 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.683+0000 7f1919f8a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f1914077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.683+0000 7f1919f8a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914076080 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.684+0000 7f19137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f1914077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.684+0000 7f19137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f1914077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50510/0 (socket says 172.21.15.2:50510) 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.684+0000 7f19137fe700 1 -- 172.21.15.2:0/201088263 learned_addr learned my addr 172.21.15.2:0/201088263 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.684+0000 7f19137fe700 1 -- 172.21.15.2:0/201088263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040094f0 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.684+0000 7f19137fe700 1 --2- 172.21.15.2:0/201088263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f1914077c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1904000c00 tx=0x7f1904009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1904010a80 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f190401a430 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19040245b0 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914076280 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914076690 con 0x7f19141022d0 2023-12-17T11:49:00.122 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1904024a20 con 0x7f19141022d0 2023-12-17T11:49:00.123 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.685+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f190402e7b0 con 0x7f19141022d0 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.686+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191404bb80 con 0x7f19141022d0 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.689+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f190401a960 con 0x7f19141022d0 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.766+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f19141041d0 con 0x7f19141022d0 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.767+0000 7f18fbfff700 1 -- 172.21.15.2:0/201088263 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f190401a5a0 con 0x7f19141022d0 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 msgr2=0x7f1914077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 --2- 172.21.15.2:0/201088263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f1914077c00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1904000c00 tx=0x7f1904009250 comp rx=0 tx=0).stop 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 shutdown_connections 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 --2- 172.21.15.2:0/201088263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19141022d0 0x7f1914077c00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 >> 172.21.15.2:0/201088263 conn(0x7f19140fda50 msgr2=0x7f19140ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 shutdown_connections 2023-12-17T11:49:00.125 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:48:59.768+0000 7f1919f8a700 1 -- 172.21.15.2:0/201088263 wait complete. 2023-12-17T11:49:00.126 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2023-12-17T11:49:00.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:00 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/201088263' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:49:02.938 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:02 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/50293003' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:49:02.948 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "1a404768-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:02.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:49:02.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:02.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:49:02.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:48:50.418341+0000", 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.528+0000 7fde90978700 1 Processor -- start 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.528+0000 7fde90978700 1 -- start start 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.529+0000 7fde90978700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.529+0000 7fde90978700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c077fe0 con 0x7fde8c077bd0 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.529+0000 7fde8a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:02.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.529+0000 7fde8a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50526/0 (socket says 172.21.15.2:50526) 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.529+0000 7fde8a59c700 1 -- 172.21.15.2:0/354988392 learned_addr learned my addr 172.21.15.2:0/354988392 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.529+0000 7fde8a59c700 1 -- 172.21.15.2:0/354988392 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c076620 con 0x7fde8c077bd0 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.530+0000 7fde8a59c700 1 --2- 172.21.15.2:0/354988392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c0760e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0098e0 tx=0x7fde7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d2ccea37ccfd6a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.530+0000 7fde8959a700 1 -- 172.21.15.2:0/354988392 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7c00b860 con 0x7fde8c077bd0 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.530+0000 7fde8959a700 1 -- 172.21.15.2:0/354988392 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fde7c00be30 con 0x7fde8c077bd0 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.530+0000 7fde8959a700 1 -- 172.21.15.2:0/354988392 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7c010380 con 0x7fde8c077bd0 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 -- 172.21.15.2:0/354988392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 msgr2=0x7fde8c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 --2- 172.21.15.2:0/354988392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c0760e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0098e0 tx=0x7fde7c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 -- 172.21.15.2:0/354988392 shutdown_connections 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 --2- 172.21.15.2:0/354988392 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c0760e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 -- 172.21.15.2:0/354988392 >> 172.21.15.2:0/354988392 conn(0x7fde8c0fda50 msgr2=0x7fde8c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 -- 172.21.15.2:0/354988392 shutdown_connections 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.531+0000 7fde90978700 1 -- 172.21.15.2:0/354988392 wait complete. 2023-12-17T11:49:02.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.532+0000 7fde90978700 1 Processor -- start 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.532+0000 7fde90978700 1 -- start start 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.533+0000 7fde90978700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.533+0000 7fde90978700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c113900 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.533+0000 7fde8a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.533+0000 7fde8a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50532/0 (socket says 172.21.15.2:50532) 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.533+0000 7fde8a59c700 1 -- 172.21.15.2:0/50293003 learned_addr learned my addr 172.21.15.2:0/50293003 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.533+0000 7fde8a59c700 1 -- 172.21.15.2:0/50293003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0094f0 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.534+0000 7fde8a59c700 1 --2- 172.21.15.2:0/50293003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c1133c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006fd0 tx=0x7fde7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.534+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7c010750 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.534+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fde7c010d20 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.534+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c113b00 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.534+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde7c01ada0 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.534+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c113f10 con 0x7fde8c077bd0 2023-12-17T11:49:02.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.535+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fde7c024680 con 0x7fde8c077bd0 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.535+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fde7c019890 con 0x7fde8c077bd0 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.535+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c04bb80 con 0x7fde8c077bd0 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.538+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fde7c029060 con 0x7fde8c077bd0 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.616+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fde8c10cda0 con 0x7fde8c077bd0 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.617+0000 7fde7affd700 1 -- 172.21.15.2:0/50293003 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fde7c020070 con 0x7fde8c077bd0 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 msgr2=0x7fde8c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 --2- 172.21.15.2:0/50293003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c1133c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006fd0 tx=0x7fde7c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 shutdown_connections 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 --2- 172.21.15.2:0/50293003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde8c077bd0 0x7fde8c1133c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 >> 172.21.15.2:0/50293003 conn(0x7fde8c0fda50 msgr2=0x7fde8c0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 shutdown_connections 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:02.618+0000 7fde90978700 1 -- 172.21.15.2:0/50293003 wait complete. 2023-12-17T11:49:02.956 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (3/15)... 2023-12-17T11:49:05.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: mgrmap e2: smithi002.cqnuqs(active, starting, since 0.00475737s) 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:05 smithi002 ceph-mon[107131]: from='mgr.14100 172.21.15.2:0/707438640' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:05.778 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "1a404768-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2023-12-17T11:49:05.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:49:05.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:05.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:48:50.418341+0000", 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d1e6cc700 1 Processor -- start 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d1e6cc700 1 -- start start 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d1e6cc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d180760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d1e6cc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d18077fa0 con 0x7f6d18077b90 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d17fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d180760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d17fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d180760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50608/0 (socket says 172.21.15.2:50608) 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d17fff700 1 -- 172.21.15.2:0/3925712951 learned_addr learned my addr 172.21.15.2:0/3925712951 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.361+0000 7f6d17fff700 1 -- 172.21.15.2:0/3925712951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180765e0 con 0x7f6d18077b90 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d17fff700 1 --2- 172.21.15.2:0/3925712951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d180760a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d080098e0 tx=0x7f6d08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254abcae86287f7e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d16ffd700 1 -- 172.21.15.2:0/3925712951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0800b860 con 0x7f6d18077b90 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d16ffd700 1 -- 172.21.15.2:0/3925712951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6d0800be30 con 0x7f6d18077b90 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d16ffd700 1 -- 172.21.15.2:0/3925712951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d08010380 con 0x7f6d18077b90 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/3925712951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 msgr2=0x7f6d180760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d1e6cc700 1 --2- 172.21.15.2:0/3925712951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d180760a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6d080098e0 tx=0x7f6d08009250 comp rx=0 tx=0).stop 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/3925712951 shutdown_connections 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d1e6cc700 1 --2- 172.21.15.2:0/3925712951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d180760a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.362+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/3925712951 >> 172.21.15.2:0/3925712951 conn(0x7f6d180fda50 msgr2=0x7f6d180ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.363+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/3925712951 shutdown_connections 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.363+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/3925712951 wait complete. 2023-12-17T11:49:05.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.363+0000 7f6d1e6cc700 1 Processor -- start 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.364+0000 7f6d1e6cc700 1 -- start start 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.364+0000 7f6d1e6cc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d18113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.364+0000 7f6d1e6cc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d181138c0 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.364+0000 7f6d17fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d18113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.364+0000 7f6d17fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d18113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50618/0 (socket says 172.21.15.2:50618) 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.364+0000 7f6d17fff700 1 -- 172.21.15.2:0/2497842177 learned_addr learned my addr 172.21.15.2:0/2497842177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d17fff700 1 -- 172.21.15.2:0/2497842177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080094f0 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d17fff700 1 --2- 172.21.15.2:0/2497842177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d18113380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d08006d40 tx=0x7f6d08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d080109b0 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6d08024440 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0801a5f0 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d18113ac0 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.365+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d18113ed0 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.366+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1804bb80 con 0x7f6d18077b90 2023-12-17T11:49:05.792 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.366+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 2) v1 ==== 43037+0+0 (secure 0 0 0) 0x7f6d08024970 con 0x7f6d18077b90 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.368+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6d0804a010 con 0x7f6d18077b90 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.370+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6d08023580 con 0x7f6d18077b90 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.447+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6d1810d140 con 0x7f6d18077b90 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.448+0000 7f6d14ff9700 1 -- 172.21.15.2:0/2497842177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f6d080233a0 con 0x7f6d18077b90 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 msgr2=0x7f6d18113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 --2- 172.21.15.2:0/2497842177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d18113380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6d08006d40 tx=0x7f6d08009250 comp rx=0 tx=0).stop 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 shutdown_connections 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 --2- 172.21.15.2:0/2497842177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d18077b90 0x7f6d18113380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 >> 172.21.15.2:0/2497842177 conn(0x7f6d180fda50 msgr2=0x7f6d180ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 shutdown_connections 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:05.449+0000 7f6d1e6cc700 1 -- 172.21.15.2:0/2497842177 wait complete. 2023-12-17T11:49:05.793 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (4/15)... 2023-12-17T11:49:06.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:06 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2497842177' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:49:06.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:06 smithi002 ceph-mon[107131]: mgrmap e3: smithi002.cqnuqs(active, since 1.00825s) 2023-12-17T11:49:08.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:08 smithi002 ceph-mon[107131]: mgrmap e4: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:49:13.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:13 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3231219906' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "1a404768-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:49:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "smithi002" 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:13.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:49:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:49:13.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:48:50.418341+0000", 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.830+0000 7f9251251700 1 Processor -- start 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.830+0000 7f9251251700 1 -- start start 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.831+0000 7f9251251700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.831+0000 7f9251251700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c102c20 con 0x7f924c1022d0 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.831+0000 7f924ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.831+0000 7f924ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42572/0 (socket says 172.21.15.2:42572) 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.831+0000 7f924ad9d700 1 -- 172.21.15.2:0/1919276660 learned_addr learned my addr 172.21.15.2:0/1919276660 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.831+0000 7f924ad9d700 1 -- 172.21.15.2:0/1919276660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c102d60 con 0x7f924c1022d0 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f924ad9d700 1 --2- 172.21.15.2:0/1919276660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c1026e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f923c0098e0 tx=0x7f923c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e5996fc9e30ecc server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9249d9b700 1 -- 172.21.15.2:0/1919276660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f923c00b860 con 0x7f924c1022d0 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9249d9b700 1 -- 172.21.15.2:0/1919276660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f923c00be30 con 0x7f924c1022d0 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9249d9b700 1 -- 172.21.15.2:0/1919276660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f923c010380 con 0x7f924c1022d0 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9251251700 1 -- 172.21.15.2:0/1919276660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 msgr2=0x7f924c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9251251700 1 --2- 172.21.15.2:0/1919276660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c1026e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f923c0098e0 tx=0x7f923c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9251251700 1 -- 172.21.15.2:0/1919276660 shutdown_connections 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9251251700 1 --2- 172.21.15.2:0/1919276660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c1026e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.832+0000 7f9251251700 1 -- 172.21.15.2:0/1919276660 >> 172.21.15.2:0/1919276660 conn(0x7f924c0fda50 msgr2=0x7f924c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.833+0000 7f9251251700 1 -- 172.21.15.2:0/1919276660 shutdown_connections 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.833+0000 7f9251251700 1 -- 172.21.15.2:0/1919276660 wait complete. 2023-12-17T11:49:13.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.833+0000 7f9251251700 1 Processor -- start 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f9251251700 1 -- start start 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f9251251700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f9251251700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c111680 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f924ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f924ad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42584/0 (socket says 172.21.15.2:42584) 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f924ad9d700 1 -- 172.21.15.2:0/3231219906 learned_addr learned my addr 172.21.15.2:0/3231219906 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.834+0000 7f924ad9d700 1 -- 172.21.15.2:0/3231219906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0094f0 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.835+0000 7f924ad9d700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c111140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f923c000c00 tx=0x7f923c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.835+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f923c010a80 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.835+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f923c01a430 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.835+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c111880 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.835+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f923c0245b0 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.835+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c111c90 con 0x7f924c1022d0 2023-12-17T11:49:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.836+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f923c01a5a0 con 0x7f924c1022d0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.836+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c04bb80 con 0x7f924c1022d0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.837+0000 7f92337fe700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f9234036640 0x7f9234038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.837+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f923c04aaa0 con 0x7f924c1022d0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.837+0000 7f924a59c700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f9234036640 0x7f9234038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.838+0000 7f924a59c700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f9234036640 0x7f9234038af0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9240009990 tx=0x7f9240006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:12.842+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f923c023df0 con 0x7f924c1022d0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.128+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f924c10af50 con 0x7f924c1022d0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.129+0000 7f92337fe700 1 -- 172.21.15.2:0/3231219906 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f923c023390 con 0x7f924c1022d0 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f9234036640 msgr2=0x7f9234038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f9234036640 0x7f9234038af0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9240009990 tx=0x7f9240006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 msgr2=0x7f924c111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c111140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f923c000c00 tx=0x7f923c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 shutdown_connections 2023-12-17T11:49:13.729 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f9234036640 0x7f9234038af0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.730 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 --2- 172.21.15.2:0/3231219906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f924c1022d0 0x7f924c111140 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.730 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 >> 172.21.15.2:0/3231219906 conn(0x7f924c0fda50 msgr2=0x7f924c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:13.730 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 shutdown_connections 2023-12-17T11:49:13.730 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:13.131+0000 7f9251251700 1 -- 172.21.15.2:0/3231219906 wait complete. 2023-12-17T11:49:13.730 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2023-12-17T11:49:14.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:14.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2023-12-17T11:49:14.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:49:14.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-17T11:49:14.651 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-17T11:49:14.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-17T11:49:14.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-17T11:49:14.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:14.652 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-17T11:49:14.652 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:14 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1686602056' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-17T11:49:14.658 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-17T11:49:14.658 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2023-12-17T11:49:14.658 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2023-12-17T11:49:14.658 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.118+0000 7f503e74c700 1 Processor -- start 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.118+0000 7f503e74c700 1 -- start start 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.119+0000 7f503e74c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50380760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.119+0000 7f503e74c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038077fc0 con 0x7f5038077bb0 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.119+0000 7f5037fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50380760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.119+0000 7f5037fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50380760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42600/0 (socket says 172.21.15.2:42600) 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.119+0000 7f5037fff700 1 -- 172.21.15.2:0/513049338 learned_addr learned my addr 172.21.15.2:0/513049338 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.120+0000 7f5037fff700 1 -- 172.21.15.2:0/513049338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038076600 con 0x7f5038077bb0 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.120+0000 7f5037fff700 1 --2- 172.21.15.2:0/513049338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50380760c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50280098e0 tx=0x7f5028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a56dc256ff562c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.120+0000 7f5036ffd700 1 -- 172.21.15.2:0/513049338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502800b860 con 0x7f5038077bb0 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.120+0000 7f5036ffd700 1 -- 172.21.15.2:0/513049338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f502800be30 con 0x7f5038077bb0 2023-12-17T11:49:14.659 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.120+0000 7f5036ffd700 1 -- 172.21.15.2:0/513049338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5028010380 con 0x7f5038077bb0 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 -- 172.21.15.2:0/513049338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 msgr2=0x7f50380760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 --2- 172.21.15.2:0/513049338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50380760c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50280098e0 tx=0x7f5028009250 comp rx=0 tx=0).stop 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 -- 172.21.15.2:0/513049338 shutdown_connections 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 --2- 172.21.15.2:0/513049338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50380760c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 -- 172.21.15.2:0/513049338 >> 172.21.15.2:0/513049338 conn(0x7f50380fda50 msgr2=0x7f50380ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 -- 172.21.15.2:0/513049338 shutdown_connections 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.121+0000 7f503e74c700 1 -- 172.21.15.2:0/513049338 wait complete. 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f503e74c700 1 Processor -- start 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f503e74c700 1 -- start start 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f503e74c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50381133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f503e74c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038113910 con 0x7f5038077bb0 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f5037fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50381133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f5037fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50381133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42616/0 (socket says 172.21.15.2:42616) 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.122+0000 7f5037fff700 1 -- 172.21.15.2:0/1686602056 learned_addr learned my addr 172.21.15.2:0/1686602056 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:14.660 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f5037fff700 1 -- 172.21.15.2:0/1686602056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280094f0 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f5037fff700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50381133d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5028006fd0 tx=0x7f5028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5028010750 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5028010d20 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f502801ada0 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5038113b10 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.123+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5038113f20 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.124+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f50280108b0 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.124+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503804bb80 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.125+0000 7f5034ff9700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f50200365a0 0x7f5020038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.125+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5028049b10 con 0x7f5038077bb0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.125+0000 7f50377fe700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f50200365a0 0x7f5020038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.126+0000 7f50377fe700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f50200365a0 0x7f5020038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f502c009990 tx=0x7f502c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.130+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f502802c350 con 0x7f5038077bb0 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.334+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f503810cff0 con 0x7f5038077bb0 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.335+0000 7f5034ff9700 1 -- 172.21.15.2:0/1686602056 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f5028020030 con 0x7f5038077bb0 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f50200365a0 msgr2=0x7f5020038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f50200365a0 0x7f5020038a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f502c009990 tx=0x7f502c006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 msgr2=0x7f50381133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50381133d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5028006fd0 tx=0x7f5028009250 comp rx=0 tx=0).stop 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 shutdown_connections 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f50200365a0 0x7f5020038a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 --2- 172.21.15.2:0/1686602056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5038077bb0 0x7f50381133d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 >> 172.21.15.2:0/1686602056 conn(0x7f50380fda50 msgr2=0x7f50380ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.337+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 shutdown_connections 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:14.338+0000 7f503e74c700 1 -- 172.21.15.2:0/1686602056 wait complete. 2023-12-17T11:49:14.662 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2023-12-17T11:49:15.690 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:15 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/462100885' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-17T11:49:15.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.071+0000 7fdaec375700 1 Processor -- start 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.071+0000 7fdaec375700 1 -- start start 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.071+0000 7fdaec375700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4104bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.071+0000 7fdaec375700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae41050f0 con 0x7fdae41047a0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.072+0000 7fdaea111700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4104bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.072+0000 7fdaea111700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4104bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42620/0 (socket says 172.21.15.2:42620) 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.072+0000 7fdaea111700 1 -- 172.21.15.2:0/4174136551 learned_addr learned my addr 172.21.15.2:0/4174136551 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.072+0000 7fdaea111700 1 -- 172.21.15.2:0/4174136551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4105230 con 0x7fdae41047a0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.072+0000 7fdaea111700 1 --2- 172.21.15.2:0/4174136551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4104bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdae00098e0 tx=0x7fdae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93a9d9a699b5f88 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdae910f700 1 -- 172.21.15.2:0/4174136551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae000b8f0 con 0x7fdae41047a0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdae910f700 1 -- 172.21.15.2:0/4174136551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdae0011420 con 0x7fdae41047a0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdae910f700 1 -- 172.21.15.2:0/4174136551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae0010540 con 0x7fdae41047a0 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 -- 172.21.15.2:0/4174136551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 msgr2=0x7fdae4104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 --2- 172.21.15.2:0/4174136551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4104bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdae00098e0 tx=0x7fdae0009250 comp rx=0 tx=0).stop 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 -- 172.21.15.2:0/4174136551 shutdown_connections 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 --2- 172.21.15.2:0/4174136551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4104bb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 -- 172.21.15.2:0/4174136551 >> 172.21.15.2:0/4174136551 conn(0x7fdae4077a80 msgr2=0x7fdae4077e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 -- 172.21.15.2:0/4174136551 shutdown_connections 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.073+0000 7fdaec375700 1 -- 172.21.15.2:0/4174136551 wait complete. 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.074+0000 7fdaec375700 1 Processor -- start 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.074+0000 7fdaec375700 1 -- start start 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaec375700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4113400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaec375700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4113940 con 0x7fdae41047a0 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaea111700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4113400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaea111700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4113400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42626/0 (socket says 172.21.15.2:42626) 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaea111700 1 -- 172.21.15.2:0/462100885 learned_addr learned my addr 172.21.15.2:0/462100885 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:15.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaea111700 1 -- 172.21.15.2:0/462100885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00094f0 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.075+0000 7fdaea111700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4113400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdae0011d20 tx=0x7fdae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.076+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae0010910 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.076+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdae0010ee0 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.076+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae4113b40 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.076+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdae001ae00 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.076+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae4113f50 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.077+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fdae001a630 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.077+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae404bb80 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.077+0000 7fdadaffd700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7fdad00365f0 0x7fdad0038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.077+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdae004a170 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.078+0000 7fdae9910700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7fdad00365f0 0x7fdad0038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.078+0000 7fdae9910700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7fdad00365f0 0x7fdad0038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009990 tx=0x7fdad4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.082+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdae002b8e0 con 0x7fdae41047a0 2023-12-17T11:49:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.344+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fdae410d160 con 0x7fdae41047a0 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.428+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdae0018c70 con 0x7fdae41047a0 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.430+0000 7fdadaffd700 1 -- 172.21.15.2:0/462100885 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fdae000e260 con 0x7fdae41047a0 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7fdad00365f0 msgr2=0x7fdad0038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7fdad00365f0 0x7fdad0038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009990 tx=0x7fdad4006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 msgr2=0x7fdae4113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4113400 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdae0011d20 tx=0x7fdae0009250 comp rx=0 tx=0).stop 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 shutdown_connections 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7fdad00365f0 0x7fdad0038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 --2- 172.21.15.2:0/462100885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdae41047a0 0x7fdae4113400 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.432+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 >> 172.21.15.2:0/462100885 conn(0x7fdae4077a80 msgr2=0x7fdae4103200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.433+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 shutdown_connections 2023-12-17T11:49:15.786 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:15.433+0000 7fdaec375700 1 -- 172.21.15.2:0/462100885 wait complete. 2023-12-17T11:49:16.700 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:16 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/462100885' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-17T11:49:16.700 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:16 smithi002 ceph-mon[107131]: mgrmap e5: smithi002.cqnuqs(active, since 10s) 2023-12-17T11:49:16.839 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "smithi002.cqnuqs", 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.219+0000 7f17b26d0700 1 Processor -- start 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.219+0000 7f17b26d0700 1 -- start start 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.220+0000 7f17b26d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac101430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.220+0000 7f17b26d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac101970 con 0x7f17ac101020 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.220+0000 7f17b16ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.840 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.220+0000 7f17b16ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42664/0 (socket says 172.21.15.2:42664) 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.220+0000 7f17b16ce700 1 -- 172.21.15.2:0/1218874869 learned_addr learned my addr 172.21.15.2:0/1218874869 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.221+0000 7f17b16ce700 1 -- 172.21.15.2:0/1218874869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac101ab0 con 0x7f17ac101020 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.221+0000 7f17b16ce700 1 --2- 172.21.15.2:0/1218874869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac101430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f17a800bb80 tx=0x7f17a800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ffd6a8c6ceed42 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.221+0000 7f17a3fff700 1 -- 172.21.15.2:0/1218874869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17a800dd00 con 0x7f17ac101020 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.221+0000 7f17a3fff700 1 -- 172.21.15.2:0/1218874869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f17a800de60 con 0x7f17ac101020 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.221+0000 7f17a3fff700 1 -- 172.21.15.2:0/1218874869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17a8018840 con 0x7f17ac101020 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 -- 172.21.15.2:0/1218874869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 msgr2=0x7f17ac101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 --2- 172.21.15.2:0/1218874869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac101430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f17a800bb80 tx=0x7f17a800b4f0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 -- 172.21.15.2:0/1218874869 shutdown_connections 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 --2- 172.21.15.2:0/1218874869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac101430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 -- 172.21.15.2:0/1218874869 >> 172.21.15.2:0/1218874869 conn(0x7f17ac0fc760 msgr2=0x7f17ac0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 -- 172.21.15.2:0/1218874869 shutdown_connections 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.222+0000 7f17b26d0700 1 -- 172.21.15.2:0/1218874869 wait complete. 2023-12-17T11:49:16.841 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.223+0000 7f17b26d0700 1 Processor -- start 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.223+0000 7f17b26d0700 1 -- start start 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.223+0000 7f17b26d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.223+0000 7f17b26d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac1136a0 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.224+0000 7f17b16ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.224+0000 7f17b16ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42670/0 (socket says 172.21.15.2:42670) 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.224+0000 7f17b16ce700 1 -- 172.21.15.2:0/3280709499 learned_addr learned my addr 172.21.15.2:0/3280709499 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.224+0000 7f17b16ce700 1 -- 172.21.15.2:0/3280709499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a800b790 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.224+0000 7f17b16ce700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac113160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17a8000c00 tx=0x7f17a800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.225+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17a80109c0 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.225+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f17a8010b20 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.225+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17a8021390 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.225+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac1138a0 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.225+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac113cb0 con 0x7f17ac101020 2023-12-17T11:49:16.842 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.226+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f17a80223f0 con 0x7f17ac101020 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.226+0000 7f17a1ffb700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 0x7f1798038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.226+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f17a8014070 con 0x7f17ac101020 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.226+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac04bb80 con 0x7f17ac101020 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.226+0000 7f17b0ecd700 1 -- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 msgr2=0x7f1798038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.226+0000 7f17b0ecd700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 0x7f1798038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.235+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f17a8026070 con 0x7f17ac101020 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.427+0000 7f17b0ecd700 1 -- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 msgr2=0x7f1798038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.427+0000 7f17b0ecd700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 0x7f1798038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.508+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f17ac10cc20 con 0x7f17ac101020 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.508+0000 7f17a1ffb700 1 -- 172.21.15.2:0/3280709499 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f17a8048070 con 0x7f17ac101020 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 msgr2=0x7f1798038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 0x7f1798038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 msgr2=0x7f17ac113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.843 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac113160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f17a8000c00 tx=0x7f17a800b4f0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 shutdown_connections 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f17980365f0 0x7f1798038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 --2- 172.21.15.2:0/3280709499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17ac101020 0x7f17ac113160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 >> 172.21.15.2:0/3280709499 conn(0x7f17ac0fc760 msgr2=0x7f17ac10a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 shutdown_connections 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:16.511+0000 7f17b26d0700 1 -- 172.21.15.2:0/3280709499 wait complete. 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2023-12-17T11:49:16.844 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2023-12-17T11:49:17.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:17 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3280709499' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: osdmap e2: 0 total, 0 up, 0 in 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: mgrmap e6: smithi002.cqnuqs(active, starting, since 0.00413842s) 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:49:24.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:49:24.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:49:24.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:24.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:24.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:24.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:24 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:25.416 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:25.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-17T11:49:25.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-17T11:49:25.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:25.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.267+0000 7f86dd540700 1 Processor -- start 2023-12-17T11:49:25.417 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.267+0000 7f86dd540700 1 -- start start 2023-12-17T11:49:25.417 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:25 smithi002 ceph-mon[107131]: Found migration_current of "None". Setting to last migration. 2023-12-17T11:49:25.417 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:25 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:25.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:25 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:49:25.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:25 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:49:25.418 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:25 smithi002 ceph-mon[107131]: mgrmap e7: smithi002.cqnuqs(active, since 1.00639s) 2023-12-17T11:49:25.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.267+0000 7f86dd540700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.267+0000 7f86dd540700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8077fc0 con 0x7f86d8077bb0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.268+0000 7f86d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.268+0000 7f86d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42676/0 (socket says 172.21.15.2:42676) 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.268+0000 7f86d6ffd700 1 -- 172.21.15.2:0/2654252674 learned_addr learned my addr 172.21.15.2:0/2654252674 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.268+0000 7f86d6ffd700 1 -- 172.21.15.2:0/2654252674 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8076600 con 0x7f86d8077bb0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.268+0000 7f86d6ffd700 1 --2- 172.21.15.2:0/2654252674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d80760c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098e0 tx=0x7f86c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f610c5e1b61fa7de server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.269+0000 7f86d5ffb700 1 -- 172.21.15.2:0/2654252674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c800b860 con 0x7f86d8077bb0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.269+0000 7f86d5ffb700 1 -- 172.21.15.2:0/2654252674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f86c800be30 con 0x7f86d8077bb0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.269+0000 7f86d5ffb700 1 -- 172.21.15.2:0/2654252674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c8010380 con 0x7f86d8077bb0 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.269+0000 7f86dd540700 1 -- 172.21.15.2:0/2654252674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 msgr2=0x7f86d80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.269+0000 7f86dd540700 1 --2- 172.21.15.2:0/2654252674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d80760c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86c80098e0 tx=0x7f86c8009250 comp rx=0 tx=0).stop 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.270+0000 7f86dd540700 1 -- 172.21.15.2:0/2654252674 shutdown_connections 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.270+0000 7f86dd540700 1 --2- 172.21.15.2:0/2654252674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d80760c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.270+0000 7f86dd540700 1 -- 172.21.15.2:0/2654252674 >> 172.21.15.2:0/2654252674 conn(0x7f86d80fda50 msgr2=0x7f86d80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.270+0000 7f86dd540700 1 -- 172.21.15.2:0/2654252674 shutdown_connections 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.270+0000 7f86dd540700 1 -- 172.21.15.2:0/2654252674 wait complete. 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.270+0000 7f86dd540700 1 Processor -- start 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.271+0000 7f86dd540700 1 -- start start 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.271+0000 7f86dd540700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.271+0000 7f86dd540700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8113910 con 0x7f86d8077bb0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.271+0000 7f86d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.271+0000 7f86d6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42688/0 (socket says 172.21.15.2:42688) 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.271+0000 7f86d6ffd700 1 -- 172.21.15.2:0/791874454 learned_addr learned my addr 172.21.15.2:0/791874454 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86d6ffd700 1 -- 172.21.15.2:0/791874454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80094f0 con 0x7f86d8077bb0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86d6ffd700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d81133d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86c8006fd0 tx=0x7f86c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c8010750 con 0x7f86d8077bb0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f86c8010d20 con 0x7f86d8077bb0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8113b10 con 0x7f86d8077bb0 2023-12-17T11:49:25.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86c801ada0 con 0x7f86d8077bb0 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.272+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d8113f20 con 0x7f86d8077bb0 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.274+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f86c80108b0 con 0x7f86d8077bb0 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.274+0000 7f86bf7fe700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.274+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 --> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86c0039200 con 0x7f86c0036640 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.274+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f86c8049b10 con 0x7f86d8077bb0 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.274+0000 7f86d67fc700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.274+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.475+0000 7f86d67fc700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.475+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.876+0000 7f86d67fc700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:17.876+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:18.677+0000 7f86d67fc700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:18.677+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-17T11:49:25.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:20.278+0000 7f86d67fc700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:20.278+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:23.481+0000 7f86d67fc700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2381631525 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:23.481+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:24.086+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f86c802a260 con 0x7f86d8077bb0 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:24.086+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 msgr2=0x7f86c0038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:24.086+0000 7f86bf7fe700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.088+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f86c8029520 con 0x7f86d8077bb0 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.088+0000 7f86bf7fe700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f86c0039f60 0x7f86c003c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.088+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86c0039200 con 0x7f86c0039f60 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.089+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f86c0039f60 0x7f86c003c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.091+0000 7f86d67fc700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f86c0039f60 0x7f86c003c340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0039d0 tx=0x7f86cc009350 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.092+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f86c0039200 con 0x7f86c0039f60 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.098+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f86d804bb80 con 0x7f86c0039f60 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.098+0000 7f86bf7fe700 1 -- 172.21.15.2:0/791874454 <== mgr.14122 v2:172.21.15.2:6800/444501898 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f86d804bb80 con 0x7f86c0039f60 2023-12-17T11:49:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f86c0039f60 msgr2=0x7f86c003c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f86c0039f60 0x7f86c003c340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0039d0 tx=0x7f86cc009350 comp rx=0 tx=0).stop 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 msgr2=0x7f86d81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d81133d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86c8006fd0 tx=0x7f86c8009250 comp rx=0 tx=0).stop 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 shutdown_connections 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f86c0039f60 0x7f86c003c340 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86d8077bb0 0x7f86d81133d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 --2- 172.21.15.2:0/791874454 >> [v2:172.21.15.2:6800/2381631525,v1:172.21.15.2:6801/2381631525] conn(0x7f86c0036640 0x7f86c0038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 >> 172.21.15.2:0/791874454 conn(0x7f86d80fda50 msgr2=0x7f86d80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 shutdown_connections 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.099+0000 7f86dd540700 1 -- 172.21.15.2:0/791874454 wait complete. 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2023-12-17T11:49:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2023-12-17T11:49:26.384 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:26 smithi002 ceph-mon[107131]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-17T11:49:26.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:26 smithi002 ceph-mon[107131]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-17T11:49:26.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:26 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:26.385 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:26 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.802+0000 7f69948a8700 1 Processor -- start 2023-12-17T11:49:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.802+0000 7f69948a8700 1 -- start start 2023-12-17T11:49:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.802+0000 7f69948a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.802+0000 7f69948a8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69901053e0 con 0x7f6990071000 2023-12-17T11:49:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.803+0000 7f698e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.390 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.803+0000 7f698e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48004/0 (socket says 172.21.15.2:48004) 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.803+0000 7f698e59c700 1 -- 172.21.15.2:0/4140683232 learned_addr learned my addr 172.21.15.2:0/4140683232 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.803+0000 7f698e59c700 1 -- 172.21.15.2:0/4140683232 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990105520 con 0x7f6990071000 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.804+0000 7f698e59c700 1 --2- 172.21.15.2:0/4140683232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990104ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f69800098e0 tx=0x7f6980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a815980fa6729c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.804+0000 7f698d59a700 1 -- 172.21.15.2:0/4140683232 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f698000b860 con 0x7f6990071000 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.804+0000 7f698d59a700 1 -- 172.21.15.2:0/4140683232 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f698000be30 con 0x7f6990071000 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.804+0000 7f698d59a700 1 -- 172.21.15.2:0/4140683232 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6980010380 con 0x7f6990071000 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.804+0000 7f69948a8700 1 -- 172.21.15.2:0/4140683232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 msgr2=0x7f6990104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.804+0000 7f69948a8700 1 --2- 172.21.15.2:0/4140683232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990104ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f69800098e0 tx=0x7f6980009250 comp rx=0 tx=0).stop 2023-12-17T11:49:26.391 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.805+0000 7f69948a8700 1 -- 172.21.15.2:0/4140683232 shutdown_connections 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.805+0000 7f69948a8700 1 --2- 172.21.15.2:0/4140683232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990104ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.805+0000 7f69948a8700 1 -- 172.21.15.2:0/4140683232 >> 172.21.15.2:0/4140683232 conn(0x7f69900fc970 msgr2=0x7f69900fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.805+0000 7f69948a8700 1 -- 172.21.15.2:0/4140683232 shutdown_connections 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.805+0000 7f69948a8700 1 -- 172.21.15.2:0/4140683232 wait complete. 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f69948a8700 1 Processor -- start 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f69948a8700 1 -- start start 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f69948a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f69948a8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69901138c0 con 0x7f6990071000 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f698e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f698e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48018/0 (socket says 172.21.15.2:48018) 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.806+0000 7f698e59c700 1 -- 172.21.15.2:0/2815937274 learned_addr learned my addr 172.21.15.2:0/2815937274 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f698e59c700 1 -- 172.21.15.2:0/2815937274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800094f0 con 0x7f6990071000 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f698e59c700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990113380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6980006b00 tx=0x7f6980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:26.392 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6980010a80 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f698001a430 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69800245b0 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990113ac0 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.807+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6990113ed0 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.809+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f698001a9a0 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.809+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699004bb80 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.809+0000 7f697effd700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f6978036570 0x7f6978038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.809+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f698004a9c0 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.809+0000 7f698dd9b700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f6978036570 0x7f6978038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.810+0000 7f698dd9b700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f6978036570 0x7f6978038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6984009990 tx=0x7f6984006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:25.814+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f698001a780 con 0x7f6990071000 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.035+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f699010d3b0 con 0x7f6978036570 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.041+0000 7f697effd700 1 -- 172.21.15.2:0/2815937274 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f699010d3b0 con 0x7f6978036570 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f6978036570 msgr2=0x7f6978038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.393 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f6978036570 0x7f6978038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6984009990 tx=0x7f6984006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 msgr2=0x7f6990113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990113380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6980006b00 tx=0x7f6980009250 comp rx=0 tx=0).stop 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 shutdown_connections 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f6978036570 0x7f6978038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 --2- 172.21.15.2:0/2815937274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6990071000 0x7f6990113380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 >> 172.21.15.2:0/2815937274 conn(0x7f69900fc970 msgr2=0x7f69900fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.044+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 shutdown_connections 2023-12-17T11:49:26.394 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.045+0000 7f69948a8700 1 -- 172.21.15.2:0/2815937274 wait complete. 2023-12-17T11:49:27.311 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.768+0000 7ff9e0eaf700 1 Processor -- start 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.768+0000 7ff9e0eaf700 1 -- start start 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.769+0000 7ff9e0eaf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.769+0000 7ff9e0eaf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc102c20 con 0x7ff9dc1022d0 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.769+0000 7ff9da59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.769+0000 7ff9da59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48028/0 (socket says 172.21.15.2:48028) 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.769+0000 7ff9da59c700 1 -- 172.21.15.2:0/4264707742 learned_addr learned my addr 172.21.15.2:0/4264707742 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.769+0000 7ff9da59c700 1 -- 172.21.15.2:0/4264707742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc102d60 con 0x7ff9dc1022d0 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9da59c700 1 --2- 172.21.15.2:0/4264707742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc1026e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0098e0 tx=0x7ff9cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bafd2f5f9c841c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9d959a700 1 -- 172.21.15.2:0/4264707742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc00b860 con 0x7ff9dc1022d0 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9d959a700 1 -- 172.21.15.2:0/4264707742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff9cc00be30 con 0x7ff9dc1022d0 2023-12-17T11:49:27.312 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9d959a700 1 -- 172.21.15.2:0/4264707742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc010380 con 0x7ff9dc1022d0 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/4264707742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 msgr2=0x7ff9dc1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9e0eaf700 1 --2- 172.21.15.2:0/4264707742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc1026e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0098e0 tx=0x7ff9cc009250 comp rx=0 tx=0).stop 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/4264707742 shutdown_connections 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.770+0000 7ff9e0eaf700 1 --2- 172.21.15.2:0/4264707742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc1026e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.771+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/4264707742 >> 172.21.15.2:0/4264707742 conn(0x7ff9dc0fda50 msgr2=0x7ff9dc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.771+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/4264707742 shutdown_connections 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.771+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/4264707742 wait complete. 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.771+0000 7ff9e0eaf700 1 Processor -- start 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9e0eaf700 1 -- start start 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9e0eaf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc113360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9e0eaf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc1138a0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9da59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc113360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9da59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc113360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48044/0 (socket says 172.21.15.2:48044) 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9da59c700 1 -- 172.21.15.2:0/418215298 learned_addr learned my addr 172.21.15.2:0/418215298 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:27.313 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.772+0000 7ff9da59c700 1 -- 172.21.15.2:0/418215298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0094f0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.773+0000 7ff9da59c700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc113360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc000c00 tx=0x7ff9cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.773+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc010a80 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.773+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7ff9cc01a430 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.773+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9cc0245b0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.773+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc113aa0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.773+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc113eb0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.774+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7ff9cc01a5a0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.774+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc04bb80 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.775+0000 7ff9caffd700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff9c4036510 0x7ff9c40389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.775+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff9cc04a9c0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.775+0000 7ff9d9d9b700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff9c4036510 0x7ff9c40389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.775+0000 7ff9d9d9b700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff9c4036510 0x7ff9c40389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009990 tx=0x7ff9d0006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.779+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9cc023df0 con 0x7ff9dc1022d0 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.987+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9dc0008d0 con 0x7ff9c4036510 2023-12-17T11:49:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.987+0000 7ff9caffd700 1 -- 172.21.15.2:0/418215298 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ff9dc0008d0 con 0x7ff9c4036510 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff9c4036510 msgr2=0x7ff9c40389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff9c4036510 0x7ff9c40389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009990 tx=0x7ff9d0006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 msgr2=0x7ff9dc113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc113360 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc000c00 tx=0x7ff9cc009250 comp rx=0 tx=0).stop 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 shutdown_connections 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff9c4036510 0x7ff9c40389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 --2- 172.21.15.2:0/418215298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc1022d0 0x7ff9dc113360 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 >> 172.21.15.2:0/418215298 conn(0x7ff9dc0fda50 msgr2=0x7ff9dc0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 shutdown_connections 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:26.990+0000 7ff9e0eaf700 1 -- 172.21.15.2:0/418215298 wait complete. 2023-12-17T11:49:27.315 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2023-12-17T11:49:27.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:27.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: [17/Dec/2023:11:49:26] ENGINE Bus STARTING 2023-12-17T11:49:27.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: [17/Dec/2023:11:49:26] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T11:49:27.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: [17/Dec/2023:11:49:26] ENGINE Bus STARTED 2023-12-17T11:49:27.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:27.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:27.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:27 smithi002 ceph-mon[107131]: mgrmap e8: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:49:28.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.716+0000 7f1f7b18f700 1 Processor -- start 2023-12-17T11:49:28.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.716+0000 7f1f7b18f700 1 -- start start 2023-12-17T11:49:28.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.716+0000 7f1f7b18f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f740760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.716+0000 7f1f7b18f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74077fe0 con 0x7f1f74077bd0 2023-12-17T11:49:28.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.716+0000 7f1f78f2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f740760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.408 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f78f2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f740760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48048/0 (socket says 172.21.15.2:48048) 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f78f2b700 1 -- 172.21.15.2:0/1725283697 learned_addr learned my addr 172.21.15.2:0/1725283697 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f78f2b700 1 -- 172.21.15.2:0/1725283697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74076620 con 0x7f1f74077bd0 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f78f2b700 1 --2- 172.21.15.2:0/1725283697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f740760e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f680098e0 tx=0x7f1f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986adc663dae9104 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f737fe700 1 -- 172.21.15.2:0/1725283697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f6800b860 con 0x7f1f74077bd0 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f737fe700 1 -- 172.21.15.2:0/1725283697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1f6800be30 con 0x7f1f74077bd0 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.717+0000 7f1f737fe700 1 -- 172.21.15.2:0/1725283697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f68010380 con 0x7f1f74077bd0 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 -- 172.21.15.2:0/1725283697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 msgr2=0x7f1f740760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 --2- 172.21.15.2:0/1725283697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f740760e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f680098e0 tx=0x7f1f68009250 comp rx=0 tx=0).stop 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 -- 172.21.15.2:0/1725283697 shutdown_connections 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 --2- 172.21.15.2:0/1725283697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f740760e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 -- 172.21.15.2:0/1725283697 >> 172.21.15.2:0/1725283697 conn(0x7f1f740fda50 msgr2=0x7f1f740ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 -- 172.21.15.2:0/1725283697 shutdown_connections 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.718+0000 7f1f7b18f700 1 -- 172.21.15.2:0/1725283697 wait complete. 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.719+0000 7f1f7b18f700 1 Processor -- start 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.719+0000 7f1f7b18f700 1 -- start start 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.719+0000 7f1f7b18f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f741133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.719+0000 7f1f7b18f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74113900 con 0x7f1f74077bd0 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.720+0000 7f1f78f2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f741133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.720+0000 7f1f78f2b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f741133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48050/0 (socket says 172.21.15.2:48050) 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.720+0000 7f1f78f2b700 1 -- 172.21.15.2:0/3135939946 learned_addr learned my addr 172.21.15.2:0/3135939946 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:28.411 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.720+0000 7f1f78f2b700 1 -- 172.21.15.2:0/3135939946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680094f0 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.720+0000 7f1f78f2b700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f741133c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f68006fd0 tx=0x7f1f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.720+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f68010750 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.721+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1f68010d20 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.721+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f6801ada0 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.721+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f74113b00 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.721+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74113f10 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.722+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7404bb80 con 0x7f1f74077bd0 2023-12-17T11:49:28.412 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.722+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f1f680108b0 con 0x7f1f74077bd0 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.722+0000 7f1f717fa700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f1f64036640 0x7f1f64038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.722+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1f68049bc0 con 0x7f1f74077bd0 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.723+0000 7f1f73fff700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f1f64036640 0x7f1f64038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.723+0000 7f1f73fff700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f1f64036640 0x7f1f64038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009990 tx=0x7f1f60006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.727+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1f6802c350 con 0x7f1f74077bd0 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:27.935+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f740008d0 con 0x7f1f64036640 2023-12-17T11:49:28.413 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.073+0000 7f1f717fa700 1 -- 172.21.15.2:0/3135939946 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1f740008d0 con 0x7f1f64036640 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.075+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f1f64036640 msgr2=0x7f1f64038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.075+0000 7f1f7b18f700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f1f64036640 0x7f1f64038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009990 tx=0x7f1f60006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.075+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 msgr2=0x7f1f741133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.075+0000 7f1f7b18f700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f741133c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f68006fd0 tx=0x7f1f68009250 comp rx=0 tx=0).stop 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.076+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 shutdown_connections 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.076+0000 7f1f7b18f700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f1f64036640 0x7f1f64038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.076+0000 7f1f7b18f700 1 --2- 172.21.15.2:0/3135939946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f74077bd0 0x7f1f741133c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.414 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.076+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 >> 172.21.15.2:0/3135939946 conn(0x7f1f740fda50 msgr2=0x7f1f740ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:28.415 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.076+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 shutdown_connections 2023-12-17T11:49:28.415 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.076+0000 7f1f7b18f700 1 -- 172.21.15.2:0/3135939946 wait complete. 2023-12-17T11:49:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:28 smithi002 ceph-mon[107131]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:28 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:28 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrRsYz9cWVhjSgpdirFv8p9bzte0e28rhRlwppULnut5dlx/k1tB6nfpesg3CjanuKwp/AeaBBGoJOzzRQXDcQzRRfl98npoF+X9JRQruhzXbDr/cU47L1YG+H4Re9rwY6LUg2PdaWBXLiurn/S0qhhA0bTsfF4NujcW4g3s12h7d4pOaFxwK6TcvUoA+yo28xEqxfduvrNgI3nZg39Zog/DWBcPtjxt7vwywCBmplRQS11Qy0peRTpOnYVzxtdHO8NebbGnmtfaUdd1uXPGH5ZI0j5EA5V+wP95bASvzE69dMgdXQK5ZR57pYxbj+avz7opC93lIEPiyD/vXN3EYR1vob6MJODLHEJ/WHz0X1MOtwHBQwBxCGGvXfpVdlrDsr1ydrjZeGAQwr2iURN5sIahtPsm34c7TkAlo3dBAXygasHULJEjv59mgjNmPKqPj4zxcuLjC2fM734DKiT8d0Y+cdjUSnlxhbZsCJSzdh4b714jJdvzPB1u1BWvM7js= ceph-1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.786+0000 7f596ac8a700 1 Processor -- start 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.786+0000 7f596ac8a700 1 -- start start 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.787+0000 7f596ac8a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.787+0000 7f596ac8a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964078000 con 0x7f5964077bf0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.787+0000 7f5968a26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.787+0000 7f5968a26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48058/0 (socket says 172.21.15.2:48058) 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.787+0000 7f5968a26700 1 -- 172.21.15.2:0/287271566 learned_addr learned my addr 172.21.15.2:0/287271566 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.788+0000 7f5968a26700 1 -- 172.21.15.2:0/287271566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5964076640 con 0x7f5964077bf0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.788+0000 7f5968a26700 1 --2- 172.21.15.2:0/287271566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964076100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f5958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0b9281dd539c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.788+0000 7f59637fe700 1 -- 172.21.15.2:0/287271566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f595800b860 con 0x7f5964077bf0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.788+0000 7f59637fe700 1 -- 172.21.15.2:0/287271566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f595800be30 con 0x7f5964077bf0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.788+0000 7f59637fe700 1 -- 172.21.15.2:0/287271566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5958010380 con 0x7f5964077bf0 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 -- 172.21.15.2:0/287271566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 msgr2=0x7f5964076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 --2- 172.21.15.2:0/287271566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964076100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f5958009250 comp rx=0 tx=0).stop 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 -- 172.21.15.2:0/287271566 shutdown_connections 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 --2- 172.21.15.2:0/287271566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964076100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 -- 172.21.15.2:0/287271566 >> 172.21.15.2:0/287271566 conn(0x7f59640fda50 msgr2=0x7f59640ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 -- 172.21.15.2:0/287271566 shutdown_connections 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.789+0000 7f596ac8a700 1 -- 172.21.15.2:0/287271566 wait complete. 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.790+0000 7f596ac8a700 1 Processor -- start 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.790+0000 7f596ac8a700 1 -- start start 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.790+0000 7f596ac8a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.790+0000 7f596ac8a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59641138c0 con 0x7f5964077bf0 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.790+0000 7f5968a26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f5968a26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48060/0 (socket says 172.21.15.2:48060) 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f5968a26700 1 -- 172.21.15.2:0/1739424192 learned_addr learned my addr 172.21.15.2:0/1739424192 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:29.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f5968a26700 1 -- 172.21.15.2:0/1739424192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580094f0 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f5968a26700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964113380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5958006b00 tx=0x7f5958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5958010a80 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f595801a430 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5964113ac0 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.791+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59580245b0 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.792+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964113ed0 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.792+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596404bb80 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.793+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5958010be0 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.793+0000 7f59617fa700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5954036640 0x7f5954038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.793+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f595804ab70 con 0x7f5964077bf0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.794+0000 7f5963fff700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5954036640 0x7f5954038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.794+0000 7f5963fff700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5954036640 0x7f5954038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5950009990 tx=0x7f5950006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.340 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:28.798+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f595801a5a0 con 0x7f5964077bf0 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.005+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f59640008d0 con 0x7f5954036640 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.005+0000 7f59617fa700 1 -- 172.21.15.2:0/1739424192 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f59640008d0 con 0x7f5954036640 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5954036640 msgr2=0x7f5954038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5954036640 0x7f5954038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5950009990 tx=0x7f5950006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 msgr2=0x7f5964113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964113380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5958006b00 tx=0x7f5958009250 comp rx=0 tx=0).stop 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 shutdown_connections 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5954036640 0x7f5954038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 --2- 172.21.15.2:0/1739424192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5964077bf0 0x7f5964113380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 >> 172.21.15.2:0/1739424192 conn(0x7f59640fda50 msgr2=0x7f59640ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 shutdown_connections 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.008+0000 7f596ac8a700 1 -- 172.21.15.2:0/1739424192 wait complete. 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-17T11:49:29.341 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2023-12-17T11:49:29.342 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2023-12-17T11:49:29.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:29 smithi002 ceph-mon[107131]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:29.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:29 smithi002 ceph-mon[107131]: Generating ssh key... 2023-12-17T11:49:30.645 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:30 smithi002 ceph-mon[107131]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:31.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:31 smithi002 ceph-mon[107131]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:32.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:32 smithi002 ceph-mon[107131]: Deploying cephadm binary to smithi002 2023-12-17T11:49:32.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2023-12-17T11:49:32.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.736+0000 7f5c74fb6700 1 Processor -- start 2023-12-17T11:49:32.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.736+0000 7f5c74fb6700 1 -- start start 2023-12-17T11:49:32.875 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.737+0000 7f5c74fb6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c700760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.737+0000 7f5c74fb6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70077fc0 con 0x7f5c70077bb0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.737+0000 7f5c6e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c700760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.737+0000 7f5c6e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c700760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50202/0 (socket says 172.21.15.2:50202) 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.737+0000 7f5c6e59c700 1 -- 172.21.15.2:0/3301958310 learned_addr learned my addr 172.21.15.2:0/3301958310 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c6e59c700 1 -- 172.21.15.2:0/3301958310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70076600 con 0x7f5c70077bb0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c6e59c700 1 --2- 172.21.15.2:0/3301958310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c700760c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c600098e0 tx=0x7f5c60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3834930b271c26 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c6d59a700 1 -- 172.21.15.2:0/3301958310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6000b860 con 0x7f5c70077bb0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c6d59a700 1 -- 172.21.15.2:0/3301958310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5c6000be30 con 0x7f5c70077bb0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c6d59a700 1 -- 172.21.15.2:0/3301958310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c60010380 con 0x7f5c70077bb0 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c74fb6700 1 -- 172.21.15.2:0/3301958310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 msgr2=0x7f5c700760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.738+0000 7f5c74fb6700 1 --2- 172.21.15.2:0/3301958310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c700760c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c600098e0 tx=0x7f5c60009250 comp rx=0 tx=0).stop 2023-12-17T11:49:32.876 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.739+0000 7f5c74fb6700 1 -- 172.21.15.2:0/3301958310 shutdown_connections 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.739+0000 7f5c74fb6700 1 --2- 172.21.15.2:0/3301958310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c700760c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.739+0000 7f5c74fb6700 1 -- 172.21.15.2:0/3301958310 >> 172.21.15.2:0/3301958310 conn(0x7f5c700fda50 msgr2=0x7f5c700ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.739+0000 7f5c74fb6700 1 -- 172.21.15.2:0/3301958310 shutdown_connections 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.739+0000 7f5c74fb6700 1 -- 172.21.15.2:0/3301958310 wait complete. 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c74fb6700 1 Processor -- start 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c74fb6700 1 -- start start 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c74fb6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c701133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c74fb6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701138e0 con 0x7f5c70077bb0 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c6e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c701133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c6e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c701133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50214/0 (socket says 172.21.15.2:50214) 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.740+0000 7f5c6e59c700 1 -- 172.21.15.2:0/1363337604 learned_addr learned my addr 172.21.15.2:0/1363337604 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c6e59c700 1 -- 172.21.15.2:0/1363337604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600094f0 con 0x7f5c70077bb0 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c6e59c700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c701133a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c60010750 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f5c60010d20 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c70113ae0 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c6001ada0 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.741+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70113ef0 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.742+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f5c600108b0 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.742+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7004bb80 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.743+0000 7f5c5effd700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5c58036640 0x7f5c58038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.743+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5c60049be0 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.743+0000 7f5c6dd9b700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5c58036640 0x7f5c58038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.744+0000 7f5c6dd9b700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5c58036640 0x7f5c58038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009990 tx=0x7f5c64006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.748+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5c6002c350 con 0x7f5c70077bb0 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:29.956+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c700008d0 con 0x7f5c58036640 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.550+0000 7f5c5effd700 1 -- 172.21.15.2:0/1363337604 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5c700008d0 con 0x7f5c58036640 2023-12-17T11:49:32.878 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5c58036640 msgr2=0x7f5c58038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5c58036640 0x7f5c58038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009990 tx=0x7f5c64006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 msgr2=0x7f5c701133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c701133a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60009250 comp rx=0 tx=0).stop 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 shutdown_connections 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f5c58036640 0x7f5c58038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 --2- 172.21.15.2:0/1363337604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c70077bb0 0x7f5c701133a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 >> 172.21.15.2:0/1363337604 conn(0x7f5c700fda50 msgr2=0x7f5c700ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.553+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 shutdown_connections 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:32.554+0000 7f5c74fb6700 1 -- 172.21.15.2:0/1363337604 wait complete. 2023-12-17T11:49:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying mon service with default placement... 2023-12-17T11:49:33.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:33 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:33.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:33 smithi002 ceph-mon[107131]: Added host smithi002 2023-12-17T11:49:33.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:33 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:33.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:33 smithi002 ceph-mon[107131]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:33.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:33 smithi002 ceph-mon[107131]: Saving service mon spec with placement count:5 2023-12-17T11:49:33.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:33 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-17T11:49:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.270+0000 7f8677f21700 1 Processor -- start 2023-12-17T11:49:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.271+0000 7f8677f21700 1 -- start start 2023-12-17T11:49:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.271+0000 7f8677f21700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f86701026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.271+0000 7f8677f21700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670102c20 con 0x7f86701022d0 2023-12-17T11:49:34.032 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.271+0000 7f8675cbd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f86701026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.271+0000 7f8675cbd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f86701026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50222/0 (socket says 172.21.15.2:50222) 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.271+0000 7f8675cbd700 1 -- 172.21.15.2:0/4221427590 learned_addr learned my addr 172.21.15.2:0/4221427590 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.272+0000 7f8675cbd700 1 -- 172.21.15.2:0/4221427590 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670102d60 con 0x7f86701022d0 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.272+0000 7f8675cbd700 1 --2- 172.21.15.2:0/4221427590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f86701026e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f866c0098e0 tx=0x7f866c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca08869ac3981e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.272+0000 7f8674cbb700 1 -- 172.21.15.2:0/4221427590 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f866c00b860 con 0x7f86701022d0 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.272+0000 7f8674cbb700 1 -- 172.21.15.2:0/4221427590 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f866c00be30 con 0x7f86701022d0 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.272+0000 7f8674cbb700 1 -- 172.21.15.2:0/4221427590 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f866c010380 con 0x7f86701022d0 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 -- 172.21.15.2:0/4221427590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 msgr2=0x7f86701026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 --2- 172.21.15.2:0/4221427590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f86701026e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f866c0098e0 tx=0x7f866c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 -- 172.21.15.2:0/4221427590 shutdown_connections 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 --2- 172.21.15.2:0/4221427590 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f86701026e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 -- 172.21.15.2:0/4221427590 >> 172.21.15.2:0/4221427590 conn(0x7f86700fda50 msgr2=0x7f86700ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:34.033 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 -- 172.21.15.2:0/4221427590 shutdown_connections 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.273+0000 7f8677f21700 1 -- 172.21.15.2:0/4221427590 wait complete. 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.274+0000 7f8677f21700 1 Processor -- start 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.274+0000 7f8677f21700 1 -- start start 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.275+0000 7f8677f21700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f8670111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.275+0000 7f8677f21700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670111680 con 0x7f86701022d0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.275+0000 7f8675cbd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f8670111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.275+0000 7f8675cbd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f8670111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50226/0 (socket says 172.21.15.2:50226) 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.275+0000 7f8675cbd700 1 -- 172.21.15.2:0/2523867690 learned_addr learned my addr 172.21.15.2:0/2523867690 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.275+0000 7f8675cbd700 1 -- 172.21.15.2:0/2523867690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0094f0 con 0x7f86701022d0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.276+0000 7f8675cbd700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f8670111140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f866c006b00 tx=0x7f866c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.276+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f866c0109b0 con 0x7f86701022d0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.276+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f866c024440 con 0x7f86701022d0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.276+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f866c01a5f0 con 0x7f86701022d0 2023-12-17T11:49:34.034 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.276+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670111880 con 0x7f86701022d0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.276+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8670111c90 con 0x7f86701022d0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.277+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f866c024990 con 0x7f86701022d0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.277+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867004bb80 con 0x7f86701022d0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.278+0000 7f86667fc700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f865c036640 0x7f865c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.278+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f866c04a5f0 con 0x7f86701022d0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.278+0000 7f86754bc700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f865c036640 0x7f865c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.279+0000 7f86754bc700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f865c036640 0x7f865c038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8660009990 tx=0x7f8660006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.283+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f866c006d70 con 0x7f86701022d0 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.510+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f867010afc0 con 0x7f865c036640 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.515+0000 7f86667fc700 1 -- 172.21.15.2:0/2523867690 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f867010afc0 con 0x7f865c036640 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f865c036640 msgr2=0x7f865c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f865c036640 0x7f865c038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8660009990 tx=0x7f8660006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 msgr2=0x7f8670111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.035 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f8670111140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f866c006b00 tx=0x7f866c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 shutdown_connections 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f865c036640 0x7f865c038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 --2- 172.21.15.2:0/2523867690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86701022d0 0x7f8670111140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 >> 172.21.15.2:0/2523867690 conn(0x7f86700fda50 msgr2=0x7f86700ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.517+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 shutdown_connections 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:33.518+0000 7f8677f21700 1 -- 172.21.15.2:0/2523867690 wait complete. 2023-12-17T11:49:34.036 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying mgr service with default placement... 2023-12-17T11:49:35.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.645+0000 7fa519fe2700 1 Processor -- start 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.645+0000 7fa519fe2700 1 -- start start 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.645+0000 7fa519fe2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5140760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.645+0000 7fa519fe2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514077fa0 con 0x7fa514077b90 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.646+0000 7fa5137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5140760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.646+0000 7fa5137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5140760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50232/0 (socket says 172.21.15.2:50232) 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.646+0000 7fa5137fe700 1 -- 172.21.15.2:0/2213621991 learned_addr learned my addr 172.21.15.2:0/2213621991 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.646+0000 7fa5137fe700 1 -- 172.21.15.2:0/2213621991 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5140765e0 con 0x7fa514077b90 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.646+0000 7fa5137fe700 1 --2- 172.21.15.2:0/2213621991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5140760a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5040098e0 tx=0x7fa504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770fb982767b2998 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.646+0000 7fa5127fc700 1 -- 172.21.15.2:0/2213621991 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa50400b860 con 0x7fa514077b90 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa5127fc700 1 -- 172.21.15.2:0/2213621991 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa50400be70 con 0x7fa514077b90 2023-12-17T11:49:35.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa5127fc700 1 -- 172.21.15.2:0/2213621991 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa504010380 con 0x7fa514077b90 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 -- 172.21.15.2:0/2213621991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 msgr2=0x7fa5140760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 --2- 172.21.15.2:0/2213621991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5140760a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5040098e0 tx=0x7fa504009250 comp rx=0 tx=0).stop 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 -- 172.21.15.2:0/2213621991 shutdown_connections 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 --2- 172.21.15.2:0/2213621991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5140760a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 -- 172.21.15.2:0/2213621991 >> 172.21.15.2:0/2213621991 conn(0x7fa5140fda50 msgr2=0x7fa5140ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 -- 172.21.15.2:0/2213621991 shutdown_connections 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.647+0000 7fa519fe2700 1 -- 172.21.15.2:0/2213621991 wait complete. 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.648+0000 7fa519fe2700 1 Processor -- start 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.648+0000 7fa519fe2700 1 -- start start 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa519fe2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5141133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa519fe2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514113900 con 0x7fa514077b90 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa5137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5141133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa5137fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5141133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50234/0 (socket says 172.21.15.2:50234) 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa5137fe700 1 -- 172.21.15.2:0/845005001 learned_addr learned my addr 172.21.15.2:0/845005001 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:35.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa5137fe700 1 -- 172.21.15.2:0/845005001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040094f0 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.649+0000 7fa5137fe700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5141133c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa504006d40 tx=0x7fa504009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.650+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa504010960 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.650+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa50401a430 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.650+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa514113b00 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.650+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5040245b0 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.650+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa514113f10 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.651+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa50401a9f0 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.651+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51404bb80 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.652+0000 7fa4fbfff700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fa4fc036640 0x7fa4fc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.652+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa50404a150 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.652+0000 7fa512ffd700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fa4fc036640 0x7fa4fc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.653+0000 7fa512ffd700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fa4fc036640 0x7fa4fc038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa508009990 tx=0x7fa508006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.657+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa50402b8c0 con 0x7fa514077b90 2023-12-17T11:49:35.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.878+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5140008d0 con 0x7fa4fc036640 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.883+0000 7fa4fbfff700 1 -- 172.21.15.2:0/845005001 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa5140008d0 con 0x7fa4fc036640 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fa4fc036640 msgr2=0x7fa4fc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fa4fc036640 0x7fa4fc038af0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa508009990 tx=0x7fa508006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 msgr2=0x7fa5141133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5141133c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa504006d40 tx=0x7fa504009250 comp rx=0 tx=0).stop 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 shutdown_connections 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fa4fc036640 0x7fa4fc038af0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 --2- 172.21.15.2:0/845005001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa514077b90 0x7fa5141133c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 >> 172.21.15.2:0/845005001 conn(0x7fa5140fda50 msgr2=0x7fa5140ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 shutdown_connections 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:34.886+0000 7fa519fe2700 1 -- 172.21.15.2:0/845005001 wait complete. 2023-12-17T11:49:35.214 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying crash service with default placement... 2023-12-17T11:49:35.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:35 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:35.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:35 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:35.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:35 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:36.323 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.627+0000 7f7fc185d700 1 Processor -- start 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.627+0000 7f7fc185d700 1 -- start start 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.628+0000 7f7fc185d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.628+0000 7f7fc185d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc077fa0 con 0x7f7fbc077b90 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.628+0000 7f7fbaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.628+0000 7f7fbaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50246/0 (socket says 172.21.15.2:50246) 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.628+0000 7f7fbaffd700 1 -- 172.21.15.2:0/3378864286 learned_addr learned my addr 172.21.15.2:0/3378864286 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:36.324 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.628+0000 7f7fbaffd700 1 -- 172.21.15.2:0/3378864286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0765e0 con 0x7f7fbc077b90 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.629+0000 7f7fbaffd700 1 --2- 172.21.15.2:0/3378864286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc0760a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40098e0 tx=0x7f7fa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dc52b0b203a14c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.629+0000 7f7fb9ffb700 1 -- 172.21.15.2:0/3378864286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa400b860 con 0x7f7fbc077b90 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.629+0000 7f7fb9ffb700 1 -- 172.21.15.2:0/3378864286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fa400be70 con 0x7f7fbc077b90 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.629+0000 7f7fb9ffb700 1 -- 172.21.15.2:0/3378864286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4010380 con 0x7f7fbc077b90 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 -- 172.21.15.2:0/3378864286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 msgr2=0x7f7fbc0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 --2- 172.21.15.2:0/3378864286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc0760a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40098e0 tx=0x7f7fa4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 -- 172.21.15.2:0/3378864286 shutdown_connections 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 --2- 172.21.15.2:0/3378864286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc0760a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 -- 172.21.15.2:0/3378864286 >> 172.21.15.2:0/3378864286 conn(0x7f7fbc0fda50 msgr2=0x7f7fbc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 -- 172.21.15.2:0/3378864286 shutdown_connections 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.630+0000 7f7fc185d700 1 -- 172.21.15.2:0/3378864286 wait complete. 2023-12-17T11:49:36.325 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.631+0000 7f7fc185d700 1 Processor -- start 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.631+0000 7f7fc185d700 1 -- start start 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.632+0000 7f7fc185d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc102210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.632+0000 7f7fc185d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc102750 con 0x7f7fbc077b90 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.632+0000 7f7fbaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc102210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.632+0000 7f7fbaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc102210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50260/0 (socket says 172.21.15.2:50260) 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.632+0000 7f7fbaffd700 1 -- 172.21.15.2:0/4220042138 learned_addr learned my addr 172.21.15.2:0/4220042138 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.632+0000 7f7fbaffd700 1 -- 172.21.15.2:0/4220042138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40094f0 con 0x7f7fbc077b90 2023-12-17T11:49:36.326 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.633+0000 7f7fbaffd700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc102210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4006d40 tx=0x7f7fa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.633+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa4010960 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.633+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fa401a430 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.633+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa40245b0 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.633+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc102950 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.633+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc102d60 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.635+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f7fa401a9f0 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.636+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc04bb80 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.636+0000 7f7fb37fe700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f7fa8036640 0x7f7fa8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.636+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7fa404a5f0 con 0x7f7fbc077b90 2023-12-17T11:49:36.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.636+0000 7f7fba7fc700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f7fa8036640 0x7f7fa8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.637+0000 7f7fba7fc700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f7fa8036640 0x7f7fa8038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009990 tx=0x7f7fac006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.641+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7fa4018bd0 con 0x7f7fbc077b90 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.886+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fbc10d1e0 con 0x7f7fa8036640 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.892+0000 7f7fb37fe700 1 -- 172.21.15.2:0/4220042138 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f7fbc10d1e0 con 0x7f7fa8036640 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f7fa8036640 msgr2=0x7f7fa8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f7fa8036640 0x7f7fa8038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009990 tx=0x7f7fac006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 msgr2=0x7f7fbc102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc102210 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4006d40 tx=0x7f7fa4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 shutdown_connections 2023-12-17T11:49:36.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f7fa8036640 0x7f7fa8038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 --2- 172.21.15.2:0/4220042138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fbc077b90 0x7f7fbc102210 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 >> 172.21.15.2:0/4220042138 conn(0x7f7fbc0fda50 msgr2=0x7f7fbc0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:36.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 shutdown_connections 2023-12-17T11:49:36.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:35.896+0000 7f7fc185d700 1 -- 172.21.15.2:0/4220042138 wait complete. 2023-12-17T11:49:36.329 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying prometheus service with default placement... 2023-12-17T11:49:36.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:36 smithi002 ceph-mon[107131]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:36.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:36 smithi002 ceph-mon[107131]: Saving service mgr spec with placement count:2 2023-12-17T11:49:36.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:36 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:37.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-17T11:49:37.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.753+0000 7f006480d700 1 Processor -- start 2023-12-17T11:49:37.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.753+0000 7f006480d700 1 -- start start 2023-12-17T11:49:37.322 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.754+0000 7f006480d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00600760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.323 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.754+0000 7f006480d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060077fc0 con 0x7f0060077bb0 2023-12-17T11:49:37.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.754+0000 7f005e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00600760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.327 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.754+0000 7f005e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00600760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50264/0 (socket says 172.21.15.2:50264) 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.754+0000 7f005e59c700 1 -- 172.21.15.2:0/237022676 learned_addr learned my addr 172.21.15.2:0/237022676 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.754+0000 7f005e59c700 1 -- 172.21.15.2:0/237022676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060076600 con 0x7f0060077bb0 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.755+0000 7f005e59c700 1 --2- 172.21.15.2:0/237022676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00600760c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00500098e0 tx=0x7f0050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17ac2493eeadb0d server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.755+0000 7f005d59a700 1 -- 172.21.15.2:0/237022676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f005000b860 con 0x7f0060077bb0 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.755+0000 7f005d59a700 1 -- 172.21.15.2:0/237022676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f005000be70 con 0x7f0060077bb0 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.755+0000 7f005d59a700 1 -- 172.21.15.2:0/237022676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0050010380 con 0x7f0060077bb0 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 -- 172.21.15.2:0/237022676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 msgr2=0x7f00600760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 --2- 172.21.15.2:0/237022676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00600760c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00500098e0 tx=0x7f0050009250 comp rx=0 tx=0).stop 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 -- 172.21.15.2:0/237022676 shutdown_connections 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 --2- 172.21.15.2:0/237022676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00600760c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 -- 172.21.15.2:0/237022676 >> 172.21.15.2:0/237022676 conn(0x7f00600fda50 msgr2=0x7f00600ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 -- 172.21.15.2:0/237022676 shutdown_connections 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.756+0000 7f006480d700 1 -- 172.21.15.2:0/237022676 wait complete. 2023-12-17T11:49:37.328 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.757+0000 7f006480d700 1 Processor -- start 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.757+0000 7f006480d700 1 -- start start 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.758+0000 7f006480d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00601133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.758+0000 7f006480d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060113910 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.758+0000 7f005e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00601133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.758+0000 7f005e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00601133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50266/0 (socket says 172.21.15.2:50266) 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.758+0000 7f005e59c700 1 -- 172.21.15.2:0/2003338186 learned_addr learned my addr 172.21.15.2:0/2003338186 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.758+0000 7f005e59c700 1 -- 172.21.15.2:0/2003338186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500094f0 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.759+0000 7f005e59c700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00601133d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00500094c0 tx=0x7f0050009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.759+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0050010850 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.759+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0050010e60 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.759+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0060113b10 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.759+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f005001a430 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.759+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060113f20 con 0x7f0060077bb0 2023-12-17T11:49:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.760+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f00500247b0 con 0x7f0060077bb0 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.760+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006004bb80 con 0x7f0060077bb0 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.761+0000 7f004effd700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0048036640 0x7f0048038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.761+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f005004a3b0 con 0x7f0060077bb0 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.761+0000 7f005dd9b700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0048036640 0x7f0048038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.762+0000 7f005dd9b700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0048036640 0x7f0048038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0054009990 tx=0x7f0054006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.766+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0050024440 con 0x7f0060077bb0 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.991+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f006010d200 con 0x7f0048036640 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.996+0000 7f004effd700 1 -- 172.21.15.2:0/2003338186 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f006010d200 con 0x7f0048036640 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0048036640 msgr2=0x7f0048038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0048036640 0x7f0048038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0054009990 tx=0x7f0054006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 msgr2=0x7f00601133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00601133d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f00500094c0 tx=0x7f0050009250 comp rx=0 tx=0).stop 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 shutdown_connections 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0048036640 0x7f0048038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 --2- 172.21.15.2:0/2003338186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0060077bb0 0x7f00601133d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 >> 172.21.15.2:0/2003338186 conn(0x7f00600fda50 msgr2=0x7f00600ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:37.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 shutdown_connections 2023-12-17T11:49:37.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:36.999+0000 7f006480d700 1 -- 172.21.15.2:0/2003338186 wait complete. 2023-12-17T11:49:37.331 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying grafana service with default placement... 2023-12-17T11:49:37.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:37 smithi002 ceph-mon[107131]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:37.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:37 smithi002 ceph-mon[107131]: Saving service crash spec with placement * 2023-12-17T11:49:37.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:37 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:37.473 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:37 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.749+0000 7f0b734af700 1 Processor -- start 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.749+0000 7f0b734af700 1 -- start start 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.749+0000 7f0b734af700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.749+0000 7f0b734af700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c102c20 con 0x7f0b6c1022d0 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.750+0000 7f0b7124b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.750+0000 7f0b7124b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50270/0 (socket says 172.21.15.2:50270) 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.750+0000 7f0b7124b700 1 -- 172.21.15.2:0/335217188 learned_addr learned my addr 172.21.15.2:0/335217188 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:38.334 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.750+0000 7f0b7124b700 1 -- 172.21.15.2:0/335217188 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c102d60 con 0x7f0b6c1022d0 2023-12-17T11:49:38.335 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.750+0000 7f0b7124b700 1 --2- 172.21.15.2:0/335217188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c1026e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009e50 tx=0x7f0b68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465b5ca716d38c0a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.335 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.750+0000 7f0b63fff700 1 -- 172.21.15.2:0/335217188 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b680092e0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.335 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b63fff700 1 -- 172.21.15.2:0/335217188 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b68012430 con 0x7f0b6c1022d0 2023-12-17T11:49:38.335 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b63fff700 1 -- 172.21.15.2:0/335217188 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b680075c0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 -- 172.21.15.2:0/335217188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 msgr2=0x7f0b6c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 --2- 172.21.15.2:0/335217188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c1026e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009e50 tx=0x7f0b68009840 comp rx=0 tx=0).stop 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 -- 172.21.15.2:0/335217188 shutdown_connections 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 --2- 172.21.15.2:0/335217188 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c1026e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 -- 172.21.15.2:0/335217188 >> 172.21.15.2:0/335217188 conn(0x7f0b6c0fda50 msgr2=0x7f0b6c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 -- 172.21.15.2:0/335217188 shutdown_connections 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.751+0000 7f0b734af700 1 -- 172.21.15.2:0/335217188 wait complete. 2023-12-17T11:49:38.336 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.752+0000 7f0b734af700 1 Processor -- start 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.752+0000 7f0b734af700 1 -- start start 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.752+0000 7f0b734af700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.752+0000 7f0b734af700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1138c0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.753+0000 7f0b7124b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.753+0000 7f0b7124b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50280/0 (socket says 172.21.15.2:50280) 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.753+0000 7f0b7124b700 1 -- 172.21.15.2:0/3887849698 learned_addr learned my addr 172.21.15.2:0/3887849698 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.753+0000 7f0b7124b700 1 -- 172.21.15.2:0/3887849698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68009ae0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.753+0000 7f0b7124b700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c113380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009fd0 tx=0x7f0b68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.754+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b680092e0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.754+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b68012920 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.754+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c113ac0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.754+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b680258e0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.754+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c113ed0 con 0x7f0b6c1022d0 2023-12-17T11:49:38.337 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.755+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f0b68019050 con 0x7f0b6c1022d0 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.755+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c04bb80 con 0x7f0b6c1022d0 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.755+0000 7f0b61ffb700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0b58036640 0x7f0b58038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.755+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0b68049f90 con 0x7f0b6c1022d0 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.755+0000 7f0b70a4a700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0b58036640 0x7f0b58038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.756+0000 7f0b70a4a700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0b58036640 0x7f0b58038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009990 tx=0x7f0b5c006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.760+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0b68023320 con 0x7f0b6c1022d0 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.977+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b6c10d400 con 0x7f0b58036640 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.982+0000 7f0b61ffb700 1 -- 172.21.15.2:0/3887849698 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f0b6c10d400 con 0x7f0b58036640 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0b58036640 msgr2=0x7f0b58038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0b58036640 0x7f0b58038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009990 tx=0x7f0b5c006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 msgr2=0x7f0b6c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c113380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009fd0 tx=0x7f0b68009840 comp rx=0 tx=0).stop 2023-12-17T11:49:38.338 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 shutdown_connections 2023-12-17T11:49:38.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f0b58036640 0x7f0b58038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 --2- 172.21.15.2:0/3887849698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b6c1022d0 0x7f0b6c113380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 >> 172.21.15.2:0/3887849698 conn(0x7f0b6c0fda50 msgr2=0x7f0b6c0ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:38.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 shutdown_connections 2023-12-17T11:49:38.339 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:37.984+0000 7f0b734af700 1 -- 172.21.15.2:0/3887849698 wait complete. 2023-12-17T11:49:38.339 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying node-exporter service with default placement... 2023-12-17T11:49:38.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:38 smithi002 ceph-mon[107131]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:38.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:38 smithi002 ceph-mon[107131]: Saving service prometheus spec with placement count:1 2023-12-17T11:49:38.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:38 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:38.587 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:38 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-17T11:49:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.774+0000 7f19cf810700 1 Processor -- start 2023-12-17T11:49:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.775+0000 7f19cf810700 1 -- start start 2023-12-17T11:49:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.775+0000 7f19cf810700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.775+0000 7f19cf810700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8077fc0 con 0x7f19c8077bb0 2023-12-17T11:49:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.775+0000 7f19cd5ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.775+0000 7f19cd5ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50290/0 (socket says 172.21.15.2:50290) 2023-12-17T11:49:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.775+0000 7f19cd5ac700 1 -- 172.21.15.2:0/2007067638 learned_addr learned my addr 172.21.15.2:0/2007067638 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.776+0000 7f19cd5ac700 1 -- 172.21.15.2:0/2007067638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8076600 con 0x7f19c8077bb0 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.776+0000 7f19cd5ac700 1 --2- 172.21.15.2:0/2007067638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c80760c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19c40098e0 tx=0x7f19c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5bb324b32e187d server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.776+0000 7f19bffff700 1 -- 172.21.15.2:0/2007067638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c400b860 con 0x7f19c8077bb0 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.776+0000 7f19bffff700 1 -- 172.21.15.2:0/2007067638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c400be70 con 0x7f19c8077bb0 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.776+0000 7f19bffff700 1 -- 172.21.15.2:0/2007067638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c4010380 con 0x7f19c8077bb0 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 -- 172.21.15.2:0/2007067638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 msgr2=0x7f19c80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 --2- 172.21.15.2:0/2007067638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c80760c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19c40098e0 tx=0x7f19c4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 -- 172.21.15.2:0/2007067638 shutdown_connections 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 --2- 172.21.15.2:0/2007067638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c80760c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 -- 172.21.15.2:0/2007067638 >> 172.21.15.2:0/2007067638 conn(0x7f19c80fda50 msgr2=0x7f19c80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 -- 172.21.15.2:0/2007067638 shutdown_connections 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.777+0000 7f19cf810700 1 -- 172.21.15.2:0/2007067638 wait complete. 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.778+0000 7f19cf810700 1 Processor -- start 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.778+0000 7f19cf810700 1 -- start start 2023-12-17T11:49:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.779+0000 7f19cf810700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.779+0000 7f19cf810700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8113910 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.779+0000 7f19cd5ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.779+0000 7f19cd5ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50296/0 (socket says 172.21.15.2:50296) 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.779+0000 7f19cd5ac700 1 -- 172.21.15.2:0/725605491 learned_addr learned my addr 172.21.15.2:0/725605491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.779+0000 7f19cd5ac700 1 -- 172.21.15.2:0/725605491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40094f0 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.780+0000 7f19cd5ac700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c81133d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006d40 tx=0x7f19c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.780+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c4010960 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.780+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c401a430 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.780+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c8113b10 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.780+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19c40245b0 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.780+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8113f20 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.781+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f19c402d3f0 con 0x7f19c8077bb0 2023-12-17T11:49:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.781+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c804bb80 con 0x7f19c8077bb0 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.782+0000 7f19bdffb700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f19b4036640 0x7f19b4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.782+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f19c404a3b0 con 0x7f19c8077bb0 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.782+0000 7f19ccdab700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f19b4036640 0x7f19b4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.783+0000 7f19ccdab700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f19b4036640 0x7f19b4038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009990 tx=0x7f19b8006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:38.787+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f19c402b8e0 con 0x7f19c8077bb0 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.005+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f19c80008d0 con 0x7f19b4036640 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.010+0000 7f19bdffb700 1 -- 172.21.15.2:0/725605491 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f19c80008d0 con 0x7f19b4036640 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f19b4036640 msgr2=0x7f19b4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f19b4036640 0x7f19b4038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f19b8009990 tx=0x7f19b8006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 msgr2=0x7f19c81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c81133d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19c4006d40 tx=0x7f19c4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 shutdown_connections 2023-12-17T11:49:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f19b4036640 0x7f19b4038af0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 --2- 172.21.15.2:0/725605491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19c8077bb0 0x7f19c81133d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.012+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 >> 172.21.15.2:0/725605491 conn(0x7f19c80fda50 msgr2=0x7f19c80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.013+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 shutdown_connections 2023-12-17T11:49:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.013+0000 7f19cf810700 1 -- 172.21.15.2:0/725605491 wait complete. 2023-12-17T11:49:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying alertmanager service with default placement... 2023-12-17T11:49:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:39 smithi002 ceph-mon[107131]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:39 smithi002 ceph-mon[107131]: Saving service grafana spec with placement count:1 2023-12-17T11:49:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:39 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.758+0000 7fdb8c8f0700 1 Processor -- start 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.758+0000 7fdb8c8f0700 1 -- start start 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.758+0000 7fdb8c8f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb881026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.758+0000 7fdb8c8f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb88102c20 con 0x7fdb881022d0 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.759+0000 7fdb8659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb881026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.759+0000 7fdb8659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb881026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42420/0 (socket says 172.21.15.2:42420) 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.759+0000 7fdb8659c700 1 -- 172.21.15.2:0/1871059905 learned_addr learned my addr 172.21.15.2:0/1871059905 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.759+0000 7fdb8659c700 1 -- 172.21.15.2:0/1871059905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb88102d60 con 0x7fdb881022d0 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.759+0000 7fdb8659c700 1 --2- 172.21.15.2:0/1871059905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb881026e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098e0 tx=0x7fdb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827166e1bc6f7307 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8559a700 1 -- 172.21.15.2:0/1871059905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb7800b860 con 0x7fdb881022d0 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8559a700 1 -- 172.21.15.2:0/1871059905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb7800be70 con 0x7fdb881022d0 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8559a700 1 -- 172.21.15.2:0/1871059905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb78010380 con 0x7fdb881022d0 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1871059905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 msgr2=0x7fdb881026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 --2- 172.21.15.2:0/1871059905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb881026e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb780098e0 tx=0x7fdb78009250 comp rx=0 tx=0).stop 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1871059905 shutdown_connections 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 --2- 172.21.15.2:0/1871059905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb881026e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1871059905 >> 172.21.15.2:0/1871059905 conn(0x7fdb880fda50 msgr2=0x7fdb880ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1871059905 shutdown_connections 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.760+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1871059905 wait complete. 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.762+0000 7fdb8c8f0700 1 Processor -- start 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.762+0000 7fdb8c8f0700 1 -- start start 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.762+0000 7fdb8c8f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb88111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.762+0000 7fdb8c8f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881116c0 con 0x7fdb881022d0 2023-12-17T11:49:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.762+0000 7fdb8659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb88111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb8659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb88111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42434/0 (socket says 172.21.15.2:42434) 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb8659c700 1 -- 172.21.15.2:0/1161496762 learned_addr learned my addr 172.21.15.2:0/1161496762 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb8659c700 1 -- 172.21.15.2:0/1161496762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780094f0 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb8659c700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb88111180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c010 tx=0x7fdb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb78010960 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb7801a430 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb881118c0 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.763+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb78019580 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.764+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb88111cd0 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.764+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdb7801a980 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.765+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8804bb80 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.765+0000 7fdb76ffd700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb70036640 0x7fdb70038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.765+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdb7804a420 con 0x7fdb881022d0 2023-12-17T11:49:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.765+0000 7fdb85d9b700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb70036640 0x7fdb70038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.766+0000 7fdb85d9b700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb70036640 0x7fdb70038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009990 tx=0x7fdb7c006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.770+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdb7802bb30 con 0x7fdb881022d0 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.990+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb8810b000 con 0x7fdb70036640 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.995+0000 7fdb76ffd700 1 -- 172.21.15.2:0/1161496762 <== mgr.14122 v2:172.21.15.2:6800/444501898 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fdb8810b000 con 0x7fdb70036640 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb70036640 msgr2=0x7fdb70038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb70036640 0x7fdb70038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009990 tx=0x7fdb7c006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 msgr2=0x7fdb88111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb88111180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c010 tx=0x7fdb78009250 comp rx=0 tx=0).stop 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 shutdown_connections 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb70036640 0x7fdb70038af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 --2- 172.21.15.2:0/1161496762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb881022d0 0x7fdb88111180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 >> 172.21.15.2:0/1161496762 conn(0x7fdb880fda50 msgr2=0x7fdb880ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 shutdown_connections 2023-12-17T11:49:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:39.997+0000 7fdb8c8f0700 1 -- 172.21.15.2:0/1161496762 wait complete. 2023-12-17T11:49:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:40 smithi002 ceph-mon[107131]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:40 smithi002 ceph-mon[107131]: Saving service node-exporter spec with placement * 2023-12-17T11:49:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:40 smithi002 ceph-mon[107131]: from='mgr.14122 172.21.15.2:0/1384382616' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.743+0000 7f15c0099700 1 Processor -- start 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.744+0000 7f15c0099700 1 -- start start 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.744+0000 7f15c0099700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.744+0000 7f15c0099700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8077fc0 con 0x7f15b8077bb0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.744+0000 7f15bde35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.744+0000 7f15bde35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42436/0 (socket says 172.21.15.2:42436) 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.744+0000 7f15bde35700 1 -- 172.21.15.2:0/1205600508 learned_addr learned my addr 172.21.15.2:0/1205600508 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.745+0000 7f15bde35700 1 -- 172.21.15.2:0/1205600508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8076600 con 0x7f15b8077bb0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.745+0000 7f15bde35700 1 --2- 172.21.15.2:0/1205600508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b80760c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15b40098e0 tx=0x7f15b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec0afa49d97ba16 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.745+0000 7f15bce33700 1 -- 172.21.15.2:0/1205600508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15b400b860 con 0x7f15b8077bb0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.745+0000 7f15bce33700 1 -- 172.21.15.2:0/1205600508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15b400be70 con 0x7f15b8077bb0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.745+0000 7f15bce33700 1 -- 172.21.15.2:0/1205600508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15b4010380 con 0x7f15b8077bb0 2023-12-17T11:49:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 -- 172.21.15.2:0/1205600508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 msgr2=0x7f15b80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 --2- 172.21.15.2:0/1205600508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b80760c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15b40098e0 tx=0x7f15b4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 -- 172.21.15.2:0/1205600508 shutdown_connections 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 --2- 172.21.15.2:0/1205600508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b80760c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 -- 172.21.15.2:0/1205600508 >> 172.21.15.2:0/1205600508 conn(0x7f15b80fda50 msgr2=0x7f15b80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 -- 172.21.15.2:0/1205600508 shutdown_connections 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.746+0000 7f15c0099700 1 -- 172.21.15.2:0/1205600508 wait complete. 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.747+0000 7f15c0099700 1 Processor -- start 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.747+0000 7f15c0099700 1 -- start start 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.748+0000 7f15c0099700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.748+0000 7f15c0099700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8113910 con 0x7f15b8077bb0 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.748+0000 7f15bde35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.748+0000 7f15bde35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42452/0 (socket says 172.21.15.2:42452) 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.748+0000 7f15bde35700 1 -- 172.21.15.2:0/4239513246 learned_addr learned my addr 172.21.15.2:0/4239513246 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.748+0000 7f15bde35700 1 -- 172.21.15.2:0/4239513246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094f0 con 0x7f15b8077bb0 2023-12-17T11:49:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.749+0000 7f15bde35700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b81133d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f15b40094c0 tx=0x7f15b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.749+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15b4010850 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.749+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15b4010e60 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.749+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15b401a430 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.749+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b8113b10 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.749+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b8113f20 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.750+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f15b40247b0 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.750+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b804bb80 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.750+0000 7f15ae7fc700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f15a4036640 0x7f15a4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.751+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f15b404a4b0 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.751+0000 7f15bd634700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f15a4036640 0x7f15a4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.751+0000 7f15bd634700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f15a4036640 0x7f15a4038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009990 tx=0x7f15a8006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.756+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f15b4022520 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.963+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f15b8108550 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.966+0000 7f15ae7fc700 1 -- 172.21.15.2:0/4239513246 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f15b4022340 con 0x7f15b8077bb0 2023-12-17T11:49:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f15a4036640 msgr2=0x7f15a4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f15a4036640 0x7f15a4038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009990 tx=0x7f15a8006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 msgr2=0x7f15b81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b81133d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f15b40094c0 tx=0x7f15b4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 shutdown_connections 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f15a4036640 0x7f15a4038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 --2- 172.21.15.2:0/4239513246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15b8077bb0 0x7f15b81133d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 >> 172.21.15.2:0/4239513246 conn(0x7f15b80fda50 msgr2=0x7f15b80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.969+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 shutdown_connections 2023-12-17T11:49:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:40.970+0000 7f15c0099700 1 -- 172.21.15.2:0/4239513246 wait complete. 2023-12-17T11:49:41.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:41 smithi002 ceph-mon[107131]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:41.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:41 smithi002 ceph-mon[107131]: Saving service alertmanager spec with placement count:1 2023-12-17T11:49:41.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:41 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4239513246' entity='client.admin' 2023-12-17T11:49:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.701+0000 7ff2f6b0a700 1 Processor -- start 2023-12-17T11:49:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.701+0000 7ff2f6b0a700 1 -- start start 2023-12-17T11:49:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.701+0000 7ff2f6b0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f01026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.701+0000 7ff2f6b0a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0102c20 con 0x7ff2f01022d0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.702+0000 7ff2f48a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f01026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.702+0000 7ff2f48a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f01026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42462/0 (socket says 172.21.15.2:42462) 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.702+0000 7ff2f48a6700 1 -- 172.21.15.2:0/1413361970 learned_addr learned my addr 172.21.15.2:0/1413361970 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.702+0000 7ff2f48a6700 1 -- 172.21.15.2:0/1413361970 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0102d60 con 0x7ff2f01022d0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.702+0000 7ff2f48a6700 1 --2- 172.21.15.2:0/1413361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f01026e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40098e0 tx=0x7ff2e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55bdddaef17f986 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2ef7fe700 1 -- 172.21.15.2:0/1413361970 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2e400b860 con 0x7ff2f01022d0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2ef7fe700 1 -- 172.21.15.2:0/1413361970 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2e400be70 con 0x7ff2f01022d0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2ef7fe700 1 -- 172.21.15.2:0/1413361970 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2e4010380 con 0x7ff2f01022d0 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/1413361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 msgr2=0x7ff2f01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2f6b0a700 1 --2- 172.21.15.2:0/1413361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f01026e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40098e0 tx=0x7ff2e4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/1413361970 shutdown_connections 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2f6b0a700 1 --2- 172.21.15.2:0/1413361970 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f01026e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.703+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/1413361970 >> 172.21.15.2:0/1413361970 conn(0x7ff2f00fda50 msgr2=0x7ff2f00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.704+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/1413361970 shutdown_connections 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.704+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/1413361970 wait complete. 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.704+0000 7ff2f6b0a700 1 Processor -- start 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f6b0a700 1 -- start start 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f6b0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f0077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f6b0a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0076080 con 0x7ff2f01022d0 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f48a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f0077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f48a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f0077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42466/0 (socket says 172.21.15.2:42466) 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f48a6700 1 -- 172.21.15.2:0/304045843 learned_addr learned my addr 172.21.15.2:0/304045843 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.705+0000 7ff2f48a6700 1 -- 172.21.15.2:0/304045843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40094f0 con 0x7ff2f01022d0 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.706+0000 7ff2f48a6700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f0077c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c010 tx=0x7ff2e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.706+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2e4010960 con 0x7ff2f01022d0 2023-12-17T11:49:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.706+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2e401a430 con 0x7ff2f01022d0 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.706+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f0076280 con 0x7ff2f01022d0 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.706+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff2e4019580 con 0x7ff2f01022d0 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.706+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f0076690 con 0x7ff2f01022d0 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.707+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7ff2e4010ac0 con 0x7ff2f01022d0 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.707+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f004bb80 con 0x7ff2f01022d0 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.707+0000 7ff2ed7fa700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff2e0036640 0x7ff2e0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.707+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff2e404a3b0 con 0x7ff2f01022d0 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.708+0000 7ff2effff700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff2e0036640 0x7ff2e0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.708+0000 7ff2effff700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff2e0036640 0x7ff2e0038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009990 tx=0x7ff2dc006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.712+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff2e402bcd0 con 0x7ff2f01022d0 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.915+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7ff2f01040b0 con 0x7ff2f01022d0 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.919+0000 7ff2ed7fa700 1 -- 172.21.15.2:0/304045843 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7ff2e4018350 con 0x7ff2f01022d0 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff2e0036640 msgr2=0x7ff2e0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff2e0036640 0x7ff2e0038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009990 tx=0x7ff2dc006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 msgr2=0x7ff2f0077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f0077c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c010 tx=0x7ff2e4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 shutdown_connections 2023-12-17T11:49:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7ff2e0036640 0x7ff2e0038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 --2- 172.21.15.2:0/304045843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f01022d0 0x7ff2f0077c00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.921+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 >> 172.21.15.2:0/304045843 conn(0x7ff2f00fda50 msgr2=0x7ff2f00ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.922+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 shutdown_connections 2023-12-17T11:49:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:41.922+0000 7ff2f6b0a700 1 -- 172.21.15.2:0/304045843 wait complete. 2023-12-17T11:49:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2023-12-17T11:49:43.211 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:42 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/304045843' entity='client.admin' 2023-12-17T11:49:43.211 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:42 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4186526237' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-17T11:49:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.624+0000 7fac2ce64700 1 Processor -- start 2023-12-17T11:49:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.625+0000 7fac2ce64700 1 -- start start 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.625+0000 7fac2ce64700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac280760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.625+0000 7fac2ce64700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28077fc0 con 0x7fac28077bb0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.625+0000 7fac2659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac280760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.625+0000 7fac2659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac280760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42468/0 (socket says 172.21.15.2:42468) 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.625+0000 7fac2659c700 1 -- 172.21.15.2:0/368408662 learned_addr learned my addr 172.21.15.2:0/368408662 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.626+0000 7fac2659c700 1 -- 172.21.15.2:0/368408662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28076600 con 0x7fac28077bb0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.626+0000 7fac2659c700 1 --2- 172.21.15.2:0/368408662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac280760c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac180098e0 tx=0x7fac18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f44e8b28d01ae3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.626+0000 7fac25d9b700 1 -- 172.21.15.2:0/368408662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac1800b860 con 0x7fac28077bb0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.626+0000 7fac25d9b700 1 -- 172.21.15.2:0/368408662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac1800be70 con 0x7fac28077bb0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.626+0000 7fac25d9b700 1 -- 172.21.15.2:0/368408662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac18010380 con 0x7fac28077bb0 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 -- 172.21.15.2:0/368408662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 msgr2=0x7fac280760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 --2- 172.21.15.2:0/368408662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac280760c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fac180098e0 tx=0x7fac18009250 comp rx=0 tx=0).stop 2023-12-17T11:49:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 -- 172.21.15.2:0/368408662 shutdown_connections 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 --2- 172.21.15.2:0/368408662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac280760c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 -- 172.21.15.2:0/368408662 >> 172.21.15.2:0/368408662 conn(0x7fac280fda50 msgr2=0x7fac280ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 -- 172.21.15.2:0/368408662 shutdown_connections 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.627+0000 7fac2ce64700 1 -- 172.21.15.2:0/368408662 wait complete. 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2ce64700 1 Processor -- start 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2ce64700 1 -- start start 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2ce64700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac281133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2ce64700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281138e0 con 0x7fac28077bb0 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac281133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac281133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42480/0 (socket says 172.21.15.2:42480) 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.628+0000 7fac2659c700 1 -- 172.21.15.2:0/4186526237 learned_addr learned my addr 172.21.15.2:0/4186526237 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac2659c700 1 -- 172.21.15.2:0/4186526237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180094f0 con 0x7fac28077bb0 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac2659c700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac281133a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac18006d40 tx=0x7fac18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac18010960 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac1801a430 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac180245b0 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac28113ae0 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.629+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac28113ef0 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.630+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fac1801a9f0 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.631+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2804bb80 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.631+0000 7fac1effd700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fac14036640 0x7fac14038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.631+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fac1804a150 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.631+0000 7fac1ffff700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fac14036640 0x7fac14038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.632+0000 7fac1ffff700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fac14036640 0x7fac14038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac10009990 tx=0x7fac10006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.636+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fac1802b8c0 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.902+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fac2810d190 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.919+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fac1801a660 con 0x7fac28077bb0 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.921+0000 7fac1effd700 1 -- 172.21.15.2:0/4186526237 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fac1800fd30 con 0x7fac28077bb0 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fac14036640 msgr2=0x7fac14038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fac14036640 0x7fac14038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac10009990 tx=0x7fac10006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 msgr2=0x7fac281133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac281133a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac18006d40 tx=0x7fac18009250 comp rx=0 tx=0).stop 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 shutdown_connections 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fac14036640 0x7fac14038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 --2- 172.21.15.2:0/4186526237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac28077bb0 0x7fac281133a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 >> 172.21.15.2:0/4186526237 conn(0x7fac280fda50 msgr2=0x7fac280ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 shutdown_connections 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:42.924+0000 7fac2ce64700 1 -- 172.21.15.2:0/4186526237 wait complete. 2023-12-17T11:49:44.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:43 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4186526237' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-17T11:49:44.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:43 smithi002 ceph-mon[107131]: mgrmap e9: smithi002.cqnuqs(active, since 18s) 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "smithi002.cqnuqs", 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.726+0000 7fdba0fc7700 1 Processor -- start 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.726+0000 7fdba0fc7700 1 -- start start 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.726+0000 7fdba0fc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.726+0000 7fdba0fc7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1053e0 con 0x7fdb9c071000 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.726+0000 7fdb9a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.727+0000 7fdb9a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42500/0 (socket says 172.21.15.2:42500) 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.727+0000 7fdb9a59c700 1 -- 172.21.15.2:0/2081342172 learned_addr learned my addr 172.21.15.2:0/2081342172 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.727+0000 7fdb9a59c700 1 -- 172.21.15.2:0/2081342172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c105520 con 0x7fdb9c071000 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.727+0000 7fdb9a59c700 1 --2- 172.21.15.2:0/2081342172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c104ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0098e0 tx=0x7fdb8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9350f7c1045a899 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.727+0000 7fdb9959a700 1 -- 172.21.15.2:0/2081342172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb8c00b860 con 0x7fdb9c071000 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.727+0000 7fdb9959a700 1 -- 172.21.15.2:0/2081342172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb8c00be70 con 0x7fdb9c071000 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdb9959a700 1 -- 172.21.15.2:0/2081342172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb8c010380 con 0x7fdb9c071000 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2081342172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 msgr2=0x7fdb9c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 --2- 172.21.15.2:0/2081342172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c104ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0098e0 tx=0x7fdb8c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2081342172 shutdown_connections 2023-12-17T11:49:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 --2- 172.21.15.2:0/2081342172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c104ea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2081342172 >> 172.21.15.2:0/2081342172 conn(0x7fdb9c0fc970 msgr2=0x7fdb9c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2081342172 shutdown_connections 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.728+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2081342172 wait complete. 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.729+0000 7fdba0fc7700 1 Processor -- start 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.729+0000 7fdba0fc7700 1 -- start start 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.730+0000 7fdba0fc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.730+0000 7fdba0fc7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1138c0 con 0x7fdb9c071000 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.730+0000 7fdb9a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.730+0000 7fdb9a59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42512/0 (socket says 172.21.15.2:42512) 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.730+0000 7fdb9a59c700 1 -- 172.21.15.2:0/2492179948 learned_addr learned my addr 172.21.15.2:0/2492179948 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.730+0000 7fdb9a59c700 1 -- 172.21.15.2:0/2492179948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0094f0 con 0x7fdb9c071000 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.731+0000 7fdb9a59c700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c113380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0094c0 tx=0x7fdb8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.731+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb8c010850 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.731+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c113ac0 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.731+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb8c010e60 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.731+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb8c01a430 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.731+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c113ed0 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.732+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fdb8c0109b0 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.732+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c04bb80 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.733+0000 7fdb8affd700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 0x7fdb84038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.733+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdb8c04a550 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.733+0000 7fdb99d9b700 1 -- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 msgr2=0x7fdb84038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.733+0000 7fdb99d9b700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 0x7fdb84038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.738+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdb8c022990 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.934+0000 7fdb99d9b700 1 -- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 msgr2=0x7fdb84038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.934+0000 7fdb99d9b700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 0x7fdb84038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:43.999+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fdb9c10d380 con 0x7fdb9c071000 2023-12-17T11:49:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.000+0000 7fdb8affd700 1 -- 172.21.15.2:0/2492179948 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fdb8c022340 con 0x7fdb9c071000 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 msgr2=0x7fdb84038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 0x7fdb84038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 msgr2=0x7fdb9c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c113380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0094c0 tx=0x7fdb8c009250 comp rx=0 tx=0).stop 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 shutdown_connections 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7fdb84036640 0x7fdb84038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 --2- 172.21.15.2:0/2492179948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb9c071000 0x7fdb9c113380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 >> 172.21.15.2:0/2492179948 conn(0x7fdb9c0fc970 msgr2=0x7fdb9c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.002+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 shutdown_connections 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.003+0000 7fdba0fc7700 1 -- 172.21.15.2:0/2492179948 wait complete. 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2023-12-17T11:49:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2023-12-17T11:49:45.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:44 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2492179948' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-17T11:49:51.795 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: osdmap e3: 0 total, 0 up, 0 in 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: mgrmap e10: smithi002.cqnuqs(active, starting, since 0.00368439s) 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:51.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:51 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:49:52.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:52 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:49:52.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:52 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:49:52.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:52 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:52.970 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:52 smithi002 ceph-mon[107131]: mgrmap e11: smithi002.cqnuqs(active, since 1.00828s) 2023-12-17T11:49:53.197 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.833+0000 7f9e4956a700 1 Processor -- start 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.833+0000 7f9e4956a700 1 -- start start 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.834+0000 7f9e4956a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e440760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.834+0000 7f9e4956a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44077fc0 con 0x7f9e44077bb0 2023-12-17T11:49:53.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.834+0000 7f9e42ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e440760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.834+0000 7f9e42ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e440760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42514/0 (socket says 172.21.15.2:42514) 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.834+0000 7f9e42ffd700 1 -- 172.21.15.2:0/3460921067 learned_addr learned my addr 172.21.15.2:0/3460921067 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.835+0000 7f9e42ffd700 1 -- 172.21.15.2:0/3460921067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44076600 con 0x7f9e44077bb0 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.835+0000 7f9e42ffd700 1 --2- 172.21.15.2:0/3460921067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e440760c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e340098e0 tx=0x7f9e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c891105838dd7c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.835+0000 7f9e41ffb700 1 -- 172.21.15.2:0/3460921067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e3400b860 con 0x7f9e44077bb0 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.835+0000 7f9e41ffb700 1 -- 172.21.15.2:0/3460921067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e3400be70 con 0x7f9e44077bb0 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.835+0000 7f9e41ffb700 1 -- 172.21.15.2:0/3460921067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e34010380 con 0x7f9e44077bb0 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 -- 172.21.15.2:0/3460921067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 msgr2=0x7f9e440760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 --2- 172.21.15.2:0/3460921067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e440760c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9e340098e0 tx=0x7f9e34009250 comp rx=0 tx=0).stop 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 -- 172.21.15.2:0/3460921067 shutdown_connections 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 --2- 172.21.15.2:0/3460921067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e440760c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 -- 172.21.15.2:0/3460921067 >> 172.21.15.2:0/3460921067 conn(0x7f9e440fda50 msgr2=0x7f9e440ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:53.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 -- 172.21.15.2:0/3460921067 shutdown_connections 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.836+0000 7f9e4956a700 1 -- 172.21.15.2:0/3460921067 wait complete. 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e4956a700 1 Processor -- start 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e4956a700 1 -- start start 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e4956a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e441133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e4956a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44113910 con 0x7f9e44077bb0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e42ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e441133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e42ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e441133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42516/0 (socket says 172.21.15.2:42516) 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.837+0000 7f9e42ffd700 1 -- 172.21.15.2:0/1084541788 learned_addr learned my addr 172.21.15.2:0/1084541788 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.838+0000 7f9e42ffd700 1 -- 172.21.15.2:0/1084541788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340094f0 con 0x7f9e44077bb0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.838+0000 7f9e42ffd700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e441133d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e34006d40 tx=0x7f9e34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.838+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e34010960 con 0x7f9e44077bb0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.838+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e44113b10 con 0x7f9e44077bb0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.838+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e3401a430 con 0x7f9e44077bb0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.838+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e340245b0 con 0x7f9e44077bb0 2023-12-17T11:49:53.208 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.839+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e44113f20 con 0x7f9e44077bb0 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.840+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f9e3402d3f0 con 0x7f9e44077bb0 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.840+0000 7f9e2b7fe700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.840+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 --> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e2c039200 con 0x7f9e2c036640 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.840+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9e3404a370 con 0x7f9e44077bb0 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.840+0000 7f9e427fc700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:44.840+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:45.041+0000 7f9e427fc700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:45.041+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:45.442+0000 7f9e427fc700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:45.442+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:46.243+0000 7f9e427fc700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:53.209 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:46.243+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:47.845+0000 7f9e427fc700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:47.845+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:51.048+0000 7f9e427fc700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/444501898 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:51.048+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:51.670+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f9e3401a610 con 0x7f9e44077bb0 2023-12-17T11:49:53.211 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:51.670+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 msgr2=0x7f9e2c038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:51.670+0000 7f9e2b7fe700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.673+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f9e3401a9f0 con 0x7f9e44077bb0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.673+0000 7f9e2b7fe700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f9e2c039fb0 0x7f9e2c03c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.673+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e2c039200 con 0x7f9e2c039fb0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.674+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f9e2c039fb0 0x7f9e2c03c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.675+0000 7f9e427fc700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f9e2c039fb0 0x7f9e2c03c390 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9e380039d0 tx=0x7f9e380092f0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.676+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f9e2c039200 con 0x7f9e2c039fb0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9e4404bb80 con 0x7f9e2c039fb0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e2b7fe700 1 -- 172.21.15.2:0/1084541788 <== mgr.14164 v2:172.21.15.2:6800/832159067 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f9e4404bb80 con 0x7f9e2c039fb0 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f9e2c039fb0 msgr2=0x7f9e2c03c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f9e2c039fb0 0x7f9e2c03c390 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9e380039d0 tx=0x7f9e380092f0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 msgr2=0x7f9e441133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e441133d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e34006d40 tx=0x7f9e34009250 comp rx=0 tx=0).stop 2023-12-17T11:49:53.212 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 shutdown_connections 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f9e2c039fb0 0x7f9e2c03c390 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e44077bb0 0x7f9e441133d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.683+0000 7f9e4956a700 1 --2- 172.21.15.2:0/1084541788 >> [v2:172.21.15.2:6800/444501898,v1:172.21.15.2:6801/444501898] conn(0x7f9e2c036640 0x7f9e2c038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.684+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 >> 172.21.15.2:0/1084541788 conn(0x7f9e440fda50 msgr2=0x7f9e440ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.684+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 shutdown_connections 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:52.684+0000 7f9e4956a700 1 -- 172.21.15.2:0/1084541788 wait complete. 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2023-12-17T11:49:53.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:53 smithi002 ceph-mon[107131]: [17/Dec/2023:11:49:52] ENGINE Bus STARTING 2023-12-17T11:49:53.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:53 smithi002 ceph-mon[107131]: [17/Dec/2023:11:49:52] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T11:49:53.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:53 smithi002 ceph-mon[107131]: [17/Dec/2023:11:49:52] ENGINE Bus STARTED 2023-12-17T11:49:53.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:53 smithi002 ceph-mon[107131]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-17T11:49:53.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:53 smithi002 ceph-mon[107131]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-17T11:49:53.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:53 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:54.305 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.624+0000 7fb755bc1700 1 Processor -- start 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.624+0000 7fb755bc1700 1 -- start start 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.624+0000 7fb755bc1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb750104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.624+0000 7fb755bc1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501053e0 con 0x7fb750071000 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.625+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb750104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.625+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb750104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34204/0 (socket says 172.21.15.2:34204) 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.625+0000 7fb74f7fe700 1 -- 172.21.15.2:0/982188149 learned_addr learned my addr 172.21.15.2:0/982188149 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:54.306 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.625+0000 7fb74f7fe700 1 -- 172.21.15.2:0/982188149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb750105520 con 0x7fb750071000 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.625+0000 7fb74f7fe700 1 --2- 172.21.15.2:0/982188149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb750104ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098e0 tx=0x7fb740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37049a5f425439d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb74e7fc700 1 -- 172.21.15.2:0/982188149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb74000b860 con 0x7fb750071000 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb74e7fc700 1 -- 172.21.15.2:0/982188149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb74000be70 con 0x7fb750071000 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb74e7fc700 1 -- 172.21.15.2:0/982188149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb740010380 con 0x7fb750071000 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb755bc1700 1 -- 172.21.15.2:0/982188149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 msgr2=0x7fb750104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb755bc1700 1 --2- 172.21.15.2:0/982188149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb750104ea0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098e0 tx=0x7fb740009250 comp rx=0 tx=0).stop 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb755bc1700 1 -- 172.21.15.2:0/982188149 shutdown_connections 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb755bc1700 1 --2- 172.21.15.2:0/982188149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb750104ea0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.626+0000 7fb755bc1700 1 -- 172.21.15.2:0/982188149 >> 172.21.15.2:0/982188149 conn(0x7fb7500fc970 msgr2=0x7fb7500fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.627+0000 7fb755bc1700 1 -- 172.21.15.2:0/982188149 shutdown_connections 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.627+0000 7fb755bc1700 1 -- 172.21.15.2:0/982188149 wait complete. 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.628+0000 7fb755bc1700 1 Processor -- start 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.628+0000 7fb755bc1700 1 -- start start 2023-12-17T11:49:54.307 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.628+0000 7fb755bc1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb7501111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.628+0000 7fb755bc1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7501116e0 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.629+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb7501111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.629+0000 7fb74f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb7501111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34212/0 (socket says 172.21.15.2:34212) 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.629+0000 7fb74f7fe700 1 -- 172.21.15.2:0/55153786 learned_addr learned my addr 172.21.15.2:0/55153786 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.629+0000 7fb74f7fe700 1 -- 172.21.15.2:0/55153786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400094f0 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.629+0000 7fb74f7fe700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb7501111a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb740006d40 tx=0x7fb740009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.630+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb740010960 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.630+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7501118e0 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.630+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb750111cf0 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.630+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb74001a430 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.630+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7400245b0 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.631+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7fb74001a9d0 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.631+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75004bb80 con 0x7fb750071000 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.632+0000 7fb737fff700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fb738036570 0x7fb738038a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.632+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb74004a490 con 0x7fb750071000 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.632+0000 7fb74effd700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fb738036570 0x7fb738038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.632+0000 7fb74effd700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fb738036570 0x7fb738038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb744009990 tx=0x7fb744006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.637+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb74002c930 con 0x7fb750071000 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.849+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75010b050 con 0x7fb738036570 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.956+0000 7fb737fff700 1 -- 172.21.15.2:0/55153786 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fb75010b050 con 0x7fb738036570 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fb738036570 msgr2=0x7fb738038a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fb738036570 0x7fb738038a20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb744009990 tx=0x7fb744006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 msgr2=0x7fb7501111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb7501111a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb740006d40 tx=0x7fb740009250 comp rx=0 tx=0).stop 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 shutdown_connections 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fb738036570 0x7fb738038a20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 --2- 172.21.15.2:0/55153786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb750071000 0x7fb7501111a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 >> 172.21.15.2:0/55153786 conn(0x7fb7500fc970 msgr2=0x7fb7500fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:54.309 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.958+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 shutdown_connections 2023-12-17T11:49:54.310 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:53.959+0000 7fb755bc1700 1 -- 172.21.15.2:0/55153786 wait complete. 2023-12-17T11:49:54.310 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2023-12-17T11:49:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:54 smithi002 ceph-mon[107131]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:54 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:54 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:54 smithi002 ceph-mon[107131]: mgrmap e12: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:49:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:54 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Lz6ELfrC79EokG6PmA2KEuQbRCgaF8MABbBuR9P10jEPDFqqCW9AK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702813795, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.721+0000 7f9009984700 1 Processor -- start 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.721+0000 7f9009984700 1 -- start start 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.722+0000 7f9009984700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90040760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.722+0000 7f9009984700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004077fc0 con 0x7f9004077bb0 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.722+0000 7f9002ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90040760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.914 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.722+0000 7f9002ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90040760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34224/0 (socket says 172.21.15.2:34224) 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.722+0000 7f9002ffd700 1 -- 172.21.15.2:0/184622974 learned_addr learned my addr 172.21.15.2:0/184622974 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.723+0000 7f9002ffd700 1 -- 172.21.15.2:0/184622974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004076600 con 0x7f9004077bb0 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.723+0000 7f9002ffd700 1 --2- 172.21.15.2:0/184622974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90040760c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40098e0 tx=0x7f8ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1870d9934ff5b9dc server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.723+0000 7f9001ffb700 1 -- 172.21.15.2:0/184622974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ff400b860 con 0x7f9004077bb0 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.723+0000 7f9001ffb700 1 -- 172.21.15.2:0/184622974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ff400be70 con 0x7f9004077bb0 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.723+0000 7f9001ffb700 1 -- 172.21.15.2:0/184622974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ff4010380 con 0x7f9004077bb0 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 -- 172.21.15.2:0/184622974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 msgr2=0x7f90040760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 --2- 172.21.15.2:0/184622974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90040760c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40098e0 tx=0x7f8ff4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 -- 172.21.15.2:0/184622974 shutdown_connections 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 --2- 172.21.15.2:0/184622974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90040760c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 -- 172.21.15.2:0/184622974 >> 172.21.15.2:0/184622974 conn(0x7f90040fda50 msgr2=0x7f90040ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 -- 172.21.15.2:0/184622974 shutdown_connections 2023-12-17T11:49:55.915 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.724+0000 7f9009984700 1 -- 172.21.15.2:0/184622974 wait complete. 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.725+0000 7f9009984700 1 Processor -- start 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.725+0000 7f9009984700 1 -- start start 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.725+0000 7f9009984700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90041133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.725+0000 7f9009984700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004113910 con 0x7f9004077bb0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.726+0000 7f9002ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90041133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.726+0000 7f9002ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90041133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34234/0 (socket says 172.21.15.2:34234) 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.726+0000 7f9002ffd700 1 -- 172.21.15.2:0/521118270 learned_addr learned my addr 172.21.15.2:0/521118270 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.726+0000 7f9002ffd700 1 -- 172.21.15.2:0/521118270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff40094f0 con 0x7f9004077bb0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.726+0000 7f9002ffd700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90041133d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4006d40 tx=0x7f8ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.726+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ff4010960 con 0x7f9004077bb0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.727+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9004113b10 con 0x7f9004077bb0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.727+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ff401a430 con 0x7f9004077bb0 2023-12-17T11:49:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.727+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ff40245b0 con 0x7f9004077bb0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.727+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9004113f20 con 0x7f9004077bb0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.728+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f8ff401a9f0 con 0x7f9004077bb0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.728+0000 7f8feb7fe700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f8fec036640 0x7f8fec038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.728+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8ff404a270 con 0x7f9004077bb0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.728+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900404bb80 con 0x7f9004077bb0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.728+0000 7f90027fc700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f8fec036640 0x7f8fec038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.729+0000 7f90027fc700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f8fec036640 0x7f8fec038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009990 tx=0x7f8ff8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.734+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8ff402b8e0 con 0x7f9004077bb0 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:54.969+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9004108550 con 0x7f8fec036640 2023-12-17T11:49:55.917 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.218+0000 7f8feb7fe700 1 -- 172.21.15.2:0/521118270 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f9004108550 con 0x7f8fec036640 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f8fec036640 msgr2=0x7f8fec038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f8fec036640 0x7f8fec038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009990 tx=0x7f8ff8006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 msgr2=0x7f90041133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90041133d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4006d40 tx=0x7f8ff4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 shutdown_connections 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f8fec036640 0x7f8fec038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 --2- 172.21.15.2:0/521118270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9004077bb0 0x7f90041133d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.221+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 >> 172.21.15.2:0/521118270 conn(0x7f90040fda50 msgr2=0x7f90040ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.222+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 shutdown_connections 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:55.222+0000 7f9009984700 1 -- 172.21.15.2:0/521118270 wait complete. 2023-12-17T11:49:55.918 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2023-12-17T11:49:56.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:55 smithi002 ceph-mon[107131]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:49:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:55 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:49:56.890 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.322+0000 7f41e51f1700 1 Processor -- start 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.322+0000 7f41e51f1700 1 -- start start 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.323+0000 7f41e51f1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e00760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.323+0000 7f41e51f1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0077fc0 con 0x7f41e0077bb0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.323+0000 7f41ded9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e00760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.323+0000 7f41ded9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e00760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34250/0 (socket says 172.21.15.2:34250) 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.323+0000 7f41ded9d700 1 -- 172.21.15.2:0/4088254059 learned_addr learned my addr 172.21.15.2:0/4088254059 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.323+0000 7f41ded9d700 1 -- 172.21.15.2:0/4088254059 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0076600 con 0x7f41e0077bb0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.324+0000 7f41ded9d700 1 --2- 172.21.15.2:0/4088254059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e00760c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f41d00098e0 tx=0x7f41d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d307a8efebad0e54 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.324+0000 7f41ddd9b700 1 -- 172.21.15.2:0/4088254059 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d000b860 con 0x7f41e0077bb0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.324+0000 7f41ddd9b700 1 -- 172.21.15.2:0/4088254059 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f41d000be70 con 0x7f41e0077bb0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.324+0000 7f41ddd9b700 1 -- 172.21.15.2:0/4088254059 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d0010380 con 0x7f41e0077bb0 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.324+0000 7f41e51f1700 1 -- 172.21.15.2:0/4088254059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 msgr2=0x7f41e00760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.324+0000 7f41e51f1700 1 --2- 172.21.15.2:0/4088254059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e00760c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f41d00098e0 tx=0x7f41d0009250 comp rx=0 tx=0).stop 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.325+0000 7f41e51f1700 1 -- 172.21.15.2:0/4088254059 shutdown_connections 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.325+0000 7f41e51f1700 1 --2- 172.21.15.2:0/4088254059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e00760c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.325+0000 7f41e51f1700 1 -- 172.21.15.2:0/4088254059 >> 172.21.15.2:0/4088254059 conn(0x7f41e00fda50 msgr2=0x7f41e00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.325+0000 7f41e51f1700 1 -- 172.21.15.2:0/4088254059 shutdown_connections 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.325+0000 7f41e51f1700 1 -- 172.21.15.2:0/4088254059 wait complete. 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41e51f1700 1 Processor -- start 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41e51f1700 1 -- start start 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41e51f1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e01133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41e51f1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01138e0 con 0x7f41e0077bb0 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41ded9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e01133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41ded9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e01133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34252/0 (socket says 172.21.15.2:34252) 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.326+0000 7f41ded9d700 1 -- 172.21.15.2:0/379267370 learned_addr learned my addr 172.21.15.2:0/379267370 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41ded9d700 1 -- 172.21.15.2:0/379267370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00094f0 con 0x7f41e0077bb0 2023-12-17T11:49:56.892 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41ded9d700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e01133a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006d40 tx=0x7f41d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d0010960 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f41d001a430 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41d00245b0 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e0113ae0 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.327+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e0113ef0 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.329+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f41d001a9f0 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.329+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e004bb80 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.329+0000 7f41c77fe700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f41c8036640 0x7f41c8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.329+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f41d004a330 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.329+0000 7f41de59c700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f41c8036640 0x7f41c8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.330+0000 7f41de59c700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f41c8036640 0x7f41c8038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009990 tx=0x7f41d4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.334+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f41d002b8e0 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.538+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f41e0108550 con 0x7f41e0077bb0 2023-12-17T11:49:56.893 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.539+0000 7f41c77fe700 1 -- 172.21.15.2:0/379267370 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f41d002b2f0 con 0x7f41e0077bb0 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f41c8036640 msgr2=0x7f41c8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f41c8036640 0x7f41c8038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009990 tx=0x7f41d4006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 msgr2=0x7f41e01133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e01133a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41d0006d40 tx=0x7f41d0009250 comp rx=0 tx=0).stop 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 shutdown_connections 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f41c8036640 0x7f41c8038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 --2- 172.21.15.2:0/379267370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e0077bb0 0x7f41e01133a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 >> 172.21.15.2:0/379267370 conn(0x7f41e00fda50 msgr2=0x7f41e00ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 shutdown_connections 2023-12-17T11:49:56.894 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:56.541+0000 7f41e51f1700 1 -- 172.21.15.2:0/379267370 wait complete. 2023-12-17T11:49:56.909 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:49:56.909 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2023-12-17T11:49:56.928 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:49:56.928 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2023-12-17T11:49:56.928 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2023-12-17T11:49:56.928 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-17T11:49:56.930 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2023-12-17T11:49:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2023-12-17T11:49:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2023-12-17T11:49:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: Password: xq7mfr7el0 2023-12-17T11:49:56.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:56.931 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config directory 2023-12-17T11:49:56.931 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling autotune for osd_memory_target 2023-12-17T11:49:57.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:56 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/379267370' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-17T11:49:57.818 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.324+0000 7fac0d782700 1 Processor -- start 2023-12-17T11:49:57.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.324+0000 7fac0d782700 1 -- start start 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.324+0000 7fac0d782700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac080760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.324+0000 7fac0d782700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08077fe0 con 0x7fac08077bd0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.325+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac080760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.325+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac080760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34266/0 (socket says 172.21.15.2:34266) 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.325+0000 7fac06ffd700 1 -- 172.21.15.2:0/3278566289 learned_addr learned my addr 172.21.15.2:0/3278566289 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.325+0000 7fac06ffd700 1 -- 172.21.15.2:0/3278566289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08076620 con 0x7fac08077bd0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.325+0000 7fac06ffd700 1 --2- 172.21.15.2:0/3278566289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac080760e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098e0 tx=0x7fabf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b855a4bb1facd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac05ffb700 1 -- 172.21.15.2:0/3278566289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf800b860 con 0x7fac08077bd0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac05ffb700 1 -- 172.21.15.2:0/3278566289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabf800be70 con 0x7fac08077bd0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac05ffb700 1 -- 172.21.15.2:0/3278566289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf8010380 con 0x7fac08077bd0 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 -- 172.21.15.2:0/3278566289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 msgr2=0x7fac080760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 --2- 172.21.15.2:0/3278566289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac080760e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fabf80098e0 tx=0x7fabf8009250 comp rx=0 tx=0).stop 2023-12-17T11:49:57.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 -- 172.21.15.2:0/3278566289 shutdown_connections 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 --2- 172.21.15.2:0/3278566289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac080760e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 -- 172.21.15.2:0/3278566289 >> 172.21.15.2:0/3278566289 conn(0x7fac080fda50 msgr2=0x7fac080ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 -- 172.21.15.2:0/3278566289 shutdown_connections 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.326+0000 7fac0d782700 1 -- 172.21.15.2:0/3278566289 wait complete. 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.327+0000 7fac0d782700 1 Processor -- start 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.327+0000 7fac0d782700 1 -- start start 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac0d782700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac08113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac0d782700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081138b0 con 0x7fac08077bd0 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac08113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac06ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac08113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34268/0 (socket says 172.21.15.2:34268) 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac06ffd700 1 -- 172.21.15.2:0/3873071776 learned_addr learned my addr 172.21.15.2:0/3873071776 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac06ffd700 1 -- 172.21.15.2:0/3873071776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf80094f0 con 0x7fac08077bd0 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.328+0000 7fac06ffd700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac08113370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabf8006d40 tx=0x7fabf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.329+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf8010960 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.329+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabf801a430 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.329+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fabf80245b0 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.329+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08113ab0 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.329+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08113ec0 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.330+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0804bb80 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.330+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fabf801a9f0 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.330+0000 7fabef7fe700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fabf0036690 0x7fabf0038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.330+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fabf804a300 con 0x7fac08077bd0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.331+0000 7fac067fc700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fabf0036690 0x7fabf0038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.331+0000 7fac067fc700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fabf0036690 0x7fabf0038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009990 tx=0x7fabfc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.335+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fabf802b8c0 con 0x7fac08077bd0 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.537+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fac08108540 con 0x7fac08077bd0 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.538+0000 7fabef7fe700 1 -- 172.21.15.2:0/3873071776 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fabf802b2f0 con 0x7fac08077bd0 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fabf0036690 msgr2=0x7fabf0038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fabf0036690 0x7fabf0038b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009990 tx=0x7fabfc006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 msgr2=0x7fac08113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac08113370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fabf8006d40 tx=0x7fabf8009250 comp rx=0 tx=0).stop 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 shutdown_connections 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fabf0036690 0x7fabf0038b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 --2- 172.21.15.2:0/3873071776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac08077bd0 0x7fac08113370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 >> 172.21.15.2:0/3873071776 conn(0x7fac080fda50 msgr2=0x7fac080ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 shutdown_connections 2023-12-17T11:49:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:57.540+0000 7fac0d782700 1 -- 172.21.15.2:0/3873071776 wait complete. 2023-12-17T11:49:58.923 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.232+0000 7f350a847700 1 Processor -- start 2023-12-17T11:49:58.923 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.232+0000 7f350a847700 1 -- start start 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.232+0000 7f350a847700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f3504076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.232+0000 7f350a847700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504078000 con 0x7f3504077bf0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.233+0000 7f3503fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f3504076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.233+0000 7f3503fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f3504076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34270/0 (socket says 172.21.15.2:34270) 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.233+0000 7f3503fff700 1 -- 172.21.15.2:0/2753052603 learned_addr learned my addr 172.21.15.2:0/2753052603 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.233+0000 7f3503fff700 1 -- 172.21.15.2:0/2753052603 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504076640 con 0x7f3504077bf0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.233+0000 7f3503fff700 1 --2- 172.21.15.2:0/2753052603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f3504076100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098e0 tx=0x7f34f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc4ce27a464e176 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f35037fe700 1 -- 172.21.15.2:0/2753052603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f400b860 con 0x7f3504077bf0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f35037fe700 1 -- 172.21.15.2:0/2753052603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34f400be70 con 0x7f3504077bf0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f35037fe700 1 -- 172.21.15.2:0/2753052603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f4010380 con 0x7f3504077bf0 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 -- 172.21.15.2:0/2753052603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 msgr2=0x7f3504076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 --2- 172.21.15.2:0/2753052603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f3504076100 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098e0 tx=0x7f34f4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 -- 172.21.15.2:0/2753052603 shutdown_connections 2023-12-17T11:49:58.924 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 --2- 172.21.15.2:0/2753052603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f3504076100 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 -- 172.21.15.2:0/2753052603 >> 172.21.15.2:0/2753052603 conn(0x7f35040fda50 msgr2=0x7f35040ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 -- 172.21.15.2:0/2753052603 shutdown_connections 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.234+0000 7f350a847700 1 -- 172.21.15.2:0/2753052603 wait complete. 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.235+0000 7f350a847700 1 Processor -- start 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.235+0000 7f350a847700 1 -- start start 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.236+0000 7f350a847700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f35041133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.236+0000 7f350a847700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504113920 con 0x7f3504077bf0 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.236+0000 7f3503fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f35041133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.236+0000 7f3503fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f35041133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34276/0 (socket says 172.21.15.2:34276) 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.236+0000 7f3503fff700 1 -- 172.21.15.2:0/1810058001 learned_addr learned my addr 172.21.15.2:0/1810058001 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.236+0000 7f3503fff700 1 -- 172.21.15.2:0/1810058001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40094f0 con 0x7f3504077bf0 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.237+0000 7f3503fff700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f35041133e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34f4006d40 tx=0x7f34f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.237+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f4010960 con 0x7f3504077bf0 2023-12-17T11:49:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.237+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34f401a430 con 0x7f3504077bf0 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.237+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34f40245b0 con 0x7f3504077bf0 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.237+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3504113b20 con 0x7f3504077bf0 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.237+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3504113f30 con 0x7f3504077bf0 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.238+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f34f401a9f0 con 0x7f3504077bf0 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.238+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350404bb80 con 0x7f3504077bf0 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.239+0000 7f35017fa700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f34f0036730 0x7f34f0038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.926 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.239+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f34f404a340 con 0x7f3504077bf0 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.239+0000 7f34fbfff700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f34f0036730 0x7f34f0038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.239+0000 7f34fbfff700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f34f0036730 0x7f34f0038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009990 tx=0x7f34ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.243+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f34f402b8c0 con 0x7f3504077bf0 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.558+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f3504108570 con 0x7f3504077bf0 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.561+0000 7f35017fa700 1 -- 172.21.15.2:0/1810058001 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f34f402b2f0 con 0x7f3504077bf0 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f34f0036730 msgr2=0x7f34f0038be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f34f0036730 0x7f34f0038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009990 tx=0x7f34ec006e40 comp rx=0 tx=0).stop 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 msgr2=0x7f35041133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f35041133e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34f4006d40 tx=0x7f34f4009250 comp rx=0 tx=0).stop 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 shutdown_connections 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f34f0036730 0x7f34f0038be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 --2- 172.21.15.2:0/1810058001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3504077bf0 0x7f35041133e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 >> 172.21.15.2:0/1810058001 conn(0x7f35040fda50 msgr2=0x7f35040ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 shutdown_connections 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2023-12-17T11:49:58.563+0000 7f350a847700 1 -- 172.21.15.2:0/1810058001 wait complete. 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.928 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2023-12-17T11:49:58.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.930 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2023-12-17T11:49:58.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.930 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-17T11:49:58.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:49:58.930 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2023-12-17T11:49:58.981 INFO:tasks.cephadm:Fetching config... 2023-12-17T11:49:58.981 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:49:58.981 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-17T11:49:59.029 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-17T11:49:59.029 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:49:59.029 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-17T11:49:59.117 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-17T11:49:59.118 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:49:59.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/keyring of=/dev/stdout 2023-12-17T11:49:59.186 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:58 smithi002 ceph-mon[107131]: mgrmap e13: smithi002.cqnuqs(active, since 6s) 2023-12-17T11:49:59.187 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:49:58 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1810058001' entity='client.admin' 2023-12-17T11:49:59.244 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-17T11:49:59.245 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:49:59.245 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-17T11:49:59.335 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-17T11:49:59.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrRsYz9cWVhjSgpdirFv8p9bzte0e28rhRlwppULnut5dlx/k1tB6nfpesg3CjanuKwp/AeaBBGoJOzzRQXDcQzRRfl98npoF+X9JRQruhzXbDr/cU47L1YG+H4Re9rwY6LUg2PdaWBXLiurn/S0qhhA0bTsfF4NujcW4g3s12h7d4pOaFxwK6TcvUoA+yo28xEqxfduvrNgI3nZg39Zog/DWBcPtjxt7vwywCBmplRQS11Qy0peRTpOnYVzxtdHO8NebbGnmtfaUdd1uXPGH5ZI0j5EA5V+wP95bASvzE69dMgdXQK5ZR57pYxbj+avz7opC93lIEPiyD/vXN3EYR1vob6MJODLHEJ/WHz0X1MOtwHBQwBxCGGvXfpVdlrDsr1ydrjZeGAQwr2iURN5sIahtPsm34c7TkAlo3dBAXygasHULJEjv59mgjNmPKqPj4zxcuLjC2fM734DKiT8d0Y+cdjUSnlxhbZsCJSzdh4b714jJdvzPB1u1BWvM7js= ceph-1a404768-9cd2-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-17T11:49:59.440 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrRsYz9cWVhjSgpdirFv8p9bzte0e28rhRlwppULnut5dlx/k1tB6nfpesg3CjanuKwp/AeaBBGoJOzzRQXDcQzRRfl98npoF+X9JRQruhzXbDr/cU47L1YG+H4Re9rwY6LUg2PdaWBXLiurn/S0qhhA0bTsfF4NujcW4g3s12h7d4pOaFxwK6TcvUoA+yo28xEqxfduvrNgI3nZg39Zog/DWBcPtjxt7vwywCBmplRQS11Qy0peRTpOnYVzxtdHO8NebbGnmtfaUdd1uXPGH5ZI0j5EA5V+wP95bASvzE69dMgdXQK5ZR57pYxbj+avz7opC93lIEPiyD/vXN3EYR1vob6MJODLHEJ/WHz0X1MOtwHBQwBxCGGvXfpVdlrDsr1ydrjZeGAQwr2iURN5sIahtPsm34c7TkAlo3dBAXygasHULJEjv59mgjNmPKqPj4zxcuLjC2fM734DKiT8d0Y+cdjUSnlxhbZsCJSzdh4b714jJdvzPB1u1BWvM7js= ceph-1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:49:59.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrRsYz9cWVhjSgpdirFv8p9bzte0e28rhRlwppULnut5dlx/k1tB6nfpesg3CjanuKwp/AeaBBGoJOzzRQXDcQzRRfl98npoF+X9JRQruhzXbDr/cU47L1YG+H4Re9rwY6LUg2PdaWBXLiurn/S0qhhA0bTsfF4NujcW4g3s12h7d4pOaFxwK6TcvUoA+yo28xEqxfduvrNgI3nZg39Zog/DWBcPtjxt7vwywCBmplRQS11Qy0peRTpOnYVzxtdHO8NebbGnmtfaUdd1uXPGH5ZI0j5EA5V+wP95bASvzE69dMgdXQK5ZR57pYxbj+avz7opC93lIEPiyD/vXN3EYR1vob6MJODLHEJ/WHz0X1MOtwHBQwBxCGGvXfpVdlrDsr1ydrjZeGAQwr2iURN5sIahtPsm34c7TkAlo3dBAXygasHULJEjv59mgjNmPKqPj4zxcuLjC2fM734DKiT8d0Y+cdjUSnlxhbZsCJSzdh4b714jJdvzPB1u1BWvM7js= ceph-1a404768-9cd2-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-17T11:49:59.579 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrRsYz9cWVhjSgpdirFv8p9bzte0e28rhRlwppULnut5dlx/k1tB6nfpesg3CjanuKwp/AeaBBGoJOzzRQXDcQzRRfl98npoF+X9JRQruhzXbDr/cU47L1YG+H4Re9rwY6LUg2PdaWBXLiurn/S0qhhA0bTsfF4NujcW4g3s12h7d4pOaFxwK6TcvUoA+yo28xEqxfduvrNgI3nZg39Zog/DWBcPtjxt7vwywCBmplRQS11Qy0peRTpOnYVzxtdHO8NebbGnmtfaUdd1uXPGH5ZI0j5EA5V+wP95bASvzE69dMgdXQK5ZR57pYxbj+avz7opC93lIEPiyD/vXN3EYR1vob6MJODLHEJ/WHz0X1MOtwHBQwBxCGGvXfpVdlrDsr1ydrjZeGAQwr2iURN5sIahtPsm34c7TkAlo3dBAXygasHULJEjv59mgjNmPKqPj4zxcuLjC2fM734DKiT8d0Y+cdjUSnlxhbZsCJSzdh4b714jJdvzPB1u1BWvM7js= ceph-1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:49:59.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-17T11:50:00.060 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 -- 172.21.15.2:0/2415231980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 msgr2=0x7f42780fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 --2- 172.21.15.2:0/2415231980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f42780fcc80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42740048c0 tx=0x7f4274009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 -- 172.21.15.2:0/2415231980 shutdown_connections 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 --2- 172.21.15.2:0/2415231980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f42780fcc80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 -- 172.21.15.2:0/2415231980 >> 172.21.15.2:0/2415231980 conn(0x7f42780f7f50 msgr2=0x7f42780fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 -- 172.21.15.2:0/2415231980 shutdown_connections 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.160+0000 7f42802cd700 1 -- 172.21.15.2:0/2415231980 wait complete. 2023-12-17T11:50:01.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.161+0000 7f42802cd700 1 Processor -- start 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.161+0000 7f42802cd700 1 -- start start 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.161+0000 7f42802cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f4278071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.161+0000 7f42802cd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427806ff90 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f427e069700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f4278071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f427e069700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f4278071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43582/0 (socket says 172.21.15.2:43582) 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f427e069700 1 -- 172.21.15.2:0/4106928060 learned_addr learned my addr 172.21.15.2:0/4106928060 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f427e069700 1 -- 172.21.15.2:0/4106928060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274005040 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f427e069700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f4278071b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f427400b690 tx=0x7f4274009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4274009650 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.162+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42740097b0 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.163+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f427401c5d0 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.163+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4278070190 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.163+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4278070680 con 0x7f42780fc870 2023-12-17T11:50:01.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.164+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f42740139d0 con 0x7f42780fc870 2023-12-17T11:50:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.164+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4278106500 con 0x7f42780fc870 2023-12-17T11:50:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.164+0000 7f426effd700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4264036720 0x7f4264038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.164+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4274049920 con 0x7f42780fc870 2023-12-17T11:50:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.164+0000 7f427d868700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4264036720 0x7f4264038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.165+0000 7f427d868700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4264036720 0x7f4264038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4268009990 tx=0x7f4268006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:01.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.170+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4274025400 con 0x7f42780fc870 2023-12-17T11:50:01.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.383+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f42781024f0 con 0x7f42780fc870 2023-12-17T11:50:01.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.387+0000 7f426effd700 1 -- 172.21.15.2:0/4106928060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4274011b60 con 0x7f42780fc870 2023-12-17T11:50:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4264036720 msgr2=0x7f4264038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4264036720 0x7f4264038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4268009990 tx=0x7f4268006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 msgr2=0x7f4278071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:01.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f4278071b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f427400b690 tx=0x7f4274009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 shutdown_connections 2023-12-17T11:50:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4264036720 0x7f4264038bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 --2- 172.21.15.2:0/4106928060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42780fc870 0x7f4278071b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.389+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 >> 172.21.15.2:0/4106928060 conn(0x7f42780f7f50 msgr2=0x7f42780f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.390+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 shutdown_connections 2023-12-17T11:50:01.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:01.390+0000 7f42802cd700 1 -- 172.21.15.2:0/4106928060 wait complete. 2023-12-17T11:50:01.883 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-17T11:50:01.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-17T11:50:02.310 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:50:02.643 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:02 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4106928060' entity='client.admin' 2023-12-17T11:50:03.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 -- 172.21.15.2:0/3643657874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 msgr2=0x7f4a38070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 --2- 172.21.15.2:0/3643657874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a38070030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a340048c0 tx=0x7f4a34009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 -- 172.21.15.2:0/3643657874 shutdown_connections 2023-12-17T11:50:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 --2- 172.21.15.2:0/3643657874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a38070030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 -- 172.21.15.2:0/3643657874 >> 172.21.15.2:0/3643657874 conn(0x7f4a380f7f50 msgr2=0x7f4a380fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 -- 172.21.15.2:0/3643657874 shutdown_connections 2023-12-17T11:50:03.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.635+0000 7f4a407b0700 1 -- 172.21.15.2:0/3643657874 wait complete. 2023-12-17T11:50:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.636+0000 7f4a407b0700 1 Processor -- start 2023-12-17T11:50:03.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.636+0000 7f4a407b0700 1 -- start start 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.636+0000 7f4a407b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a3810ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.636+0000 7f4a407b0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3810f250 con 0x7f4a38071bc0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.636+0000 7f4a3e54c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a3810ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a3e54c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a3810ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43600/0 (socket says 172.21.15.2:43600) 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a3e54c700 1 -- 172.21.15.2:0/3881355948 learned_addr learned my addr 172.21.15.2:0/3881355948 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a3e54c700 1 -- 172.21.15.2:0/3881355948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34005040 con 0x7f4a38071bc0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a3e54c700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a3810ed10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400b690 tx=0x7f4a34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a34009650 con 0x7f4a38071bc0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a340097b0 con 0x7f4a38071bc0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a3401c5b0 con 0x7f4a38071bc0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.637+0000 7f4a407b0700 1 -- 172.21.15.2:0/3881355948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3810f450 con 0x7f4a38071bc0 2023-12-17T11:50:03.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.638+0000 7f4a407b0700 1 -- 172.21.15.2:0/3881355948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3810ffb0 con 0x7f4a38071bc0 2023-12-17T11:50:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.639+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f4a3401c820 con 0x7f4a38071bc0 2023-12-17T11:50:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.639+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200052b0 con 0x7f4a38071bc0 2023-12-17T11:50:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.639+0000 7f4a2effd700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4a24036720 0x7f4a24038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.639+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4a340499d0 con 0x7f4a38071bc0 2023-12-17T11:50:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.639+0000 7f4a3dd4b700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4a24036720 0x7f4a24038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.640+0000 7f4a3dd4b700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4a24036720 0x7f4a24038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009990 tx=0x7f4a28006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.644+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4a34023300 con 0x7f4a38071bc0 2023-12-17T11:50:03.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.859+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a20000bc0 con 0x7f4a24036720 2023-12-17T11:50:03.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.863+0000 7f4a2effd700 1 -- 172.21.15.2:0/3881355948 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4a20000bc0 con 0x7f4a24036720 2023-12-17T11:50:03.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4a24036720 msgr2=0x7f4a24038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4a24036720 0x7f4a24038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009990 tx=0x7f4a28006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 msgr2=0x7f4a3810ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a3810ed10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400b690 tx=0x7f4a34009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 shutdown_connections 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f4a24036720 0x7f4a24038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 --2- 172.21.15.2:0/3881355948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a38071bc0 0x7f4a3810ed10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.865+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 >> 172.21.15.2:0/3881355948 conn(0x7f4a380f7f50 msgr2=0x7f4a380f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.866+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 shutdown_connections 2023-12-17T11:50:03.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:03.866+0000 7f4a2cff9700 1 -- 172.21.15.2:0/3881355948 wait complete. 2023-12-17T11:50:04.219 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2023-12-17T11:50:04.220 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:50:04.220 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2023-12-17T11:50:04.270 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:50:04.270 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:50:04.358 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2023-12-17T11:50:04.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch host add smithi119 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: Deploying daemon crash.smithi002 on smithi002 2023-12-17T11:50:04.735 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:50:04.736 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:04 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:04.992 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:50:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1650419913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 msgr2=0x7fdac0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:06.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 --2- 172.21.15.2:0/1650419913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0070030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdab40048c0 tx=0x7fdab4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1650419913 shutdown_connections 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 --2- 172.21.15.2:0/1650419913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0070030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1650419913 >> 172.21.15.2:0/1650419913 conn(0x7fdac00f7f50 msgr2=0x7fdac00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1650419913 shutdown_connections 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.580+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1650419913 wait complete. 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.581+0000 7fdac6bfb700 1 Processor -- start 2023-12-17T11:50:06.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.581+0000 7fdac6bfb700 1 -- start start 2023-12-17T11:50:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.582+0000 7fdac6bfb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.582+0000 7fdac6bfb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0113580 con 0x7fdac0071bc0 2023-12-17T11:50:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.582+0000 7fdac4997700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.582+0000 7fdac4997700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43632/0 (socket says 172.21.15.2:43632) 2023-12-17T11:50:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.582+0000 7fdac4997700 1 -- 172.21.15.2:0/1734748382 learned_addr learned my addr 172.21.15.2:0/1734748382 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:50:06.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.582+0000 7fdac4997700 1 -- 172.21.15.2:0/1734748382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4005040 con 0x7fdac0071bc0 2023-12-17T11:50:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.583+0000 7fdac4997700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0113040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009040 tx=0x7fdab4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.583+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdab4009620 con 0x7fdac0071bc0 2023-12-17T11:50:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.583+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdab4009780 con 0x7fdac0071bc0 2023-12-17T11:50:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.583+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac0113780 con 0x7fdac0071bc0 2023-12-17T11:50:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.583+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdab401c5b0 con 0x7fdac0071bc0 2023-12-17T11:50:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.583+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac0114420 con 0x7fdac0071bc0 2023-12-17T11:50:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.584+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7fdab4013420 con 0x7fdac0071bc0 2023-12-17T11:50:06.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.584+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac005f270 con 0x7fdac0071bc0 2023-12-17T11:50:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.585+0000 7fdabd7fa700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fdab0036720 0x7fdab0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.585+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdab4049840 con 0x7fdac0071bc0 2023-12-17T11:50:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.585+0000 7fdabffff700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fdab0036720 0x7fdab0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.586+0000 7fdabffff700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fdab0036720 0x7fdab0038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009990 tx=0x7fdaac006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.590+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdab40119c0 con 0x7fdac0071bc0 2023-12-17T11:50:06.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:06.802+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}) v1 -- 0x7fdac0115000 con 0x7fdab0036720 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: Deploying daemon node-exporter.smithi002 on smithi002 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:07.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:07 smithi002 ceph-mon[107131]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:50:08.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:08 smithi002 ceph-mon[107131]: Deploying cephadm binary to smithi119 2023-12-17T11:50:09.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.539+0000 7fdabd7fa700 1 -- 172.21.15.2:0/1734748382 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fdac0115000 con 0x7fdab0036720 2023-12-17T11:50:09.543 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi119' with addr '172.21.15.119' 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fdab0036720 msgr2=0x7fdab0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fdab0036720 0x7fdab0038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009990 tx=0x7fdaac006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 msgr2=0x7fdac0113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0113040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009040 tx=0x7fdab4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 shutdown_connections 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fdab0036720 0x7fdab0038bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 --2- 172.21.15.2:0/1734748382 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdac0071bc0 0x7fdac0113040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 >> 172.21.15.2:0/1734748382 conn(0x7fdac00f7f50 msgr2=0x7fdac00f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 shutdown_connections 2023-12-17T11:50:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:09.542+0000 7fdac6bfb700 1 -- 172.21.15.2:0/1734748382 wait complete. 2023-12-17T11:50:10.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-17T11:50:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:50:10.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:10 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:10.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:10 smithi002 ceph-mon[107131]: Added host smithi119 2023-12-17T11:50:11.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 -- 172.21.15.2:0/1555880105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 msgr2=0x7f71a8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:11.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 --2- 172.21.15.2:0/1555880105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a8070030 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71a40048c0 tx=0x7f71a4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 -- 172.21.15.2:0/1555880105 shutdown_connections 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 --2- 172.21.15.2:0/1555880105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a8070030 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 -- 172.21.15.2:0/1555880105 >> 172.21.15.2:0/1555880105 conn(0x7f71a80f7f50 msgr2=0x7f71a80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 -- 172.21.15.2:0/1555880105 shutdown_connections 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.759+0000 7f71b05cf700 1 -- 172.21.15.2:0/1555880105 wait complete. 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.760+0000 7f71b05cf700 1 Processor -- start 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.760+0000 7f71b05cf700 1 -- start start 2023-12-17T11:50:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71b05cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a810ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71b05cf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a810f210 con 0x7f71a8071bc0 2023-12-17T11:50:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71ae36b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a810ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71ae36b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a810ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34842/0 (socket says 172.21.15.2:34842) 2023-12-17T11:50:11.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71ae36b700 1 -- 172.21.15.2:0/1125617482 learned_addr learned my addr 172.21.15.2:0/1125617482 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:50:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71ae36b700 1 -- 172.21.15.2:0/1125617482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4005040 con 0x7f71a8071bc0 2023-12-17T11:50:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.761+0000 7f71ae36b700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a810ecd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009040 tx=0x7f71a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.762+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a4009620 con 0x7f71a8071bc0 2023-12-17T11:50:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.762+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71a4009780 con 0x7f71a8071bc0 2023-12-17T11:50:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.762+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71a401c5b0 con 0x7f71a8071bc0 2023-12-17T11:50:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.762+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a810f410 con 0x7f71a8071bc0 2023-12-17T11:50:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.762+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a810ff70 con 0x7f71a8071bc0 2023-12-17T11:50:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.763+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a805f270 con 0x7f71a8071bc0 2023-12-17T11:50:11.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.763+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f71a4013a60 con 0x7f71a8071bc0 2023-12-17T11:50:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.764+0000 7f719effd700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f7194036720 0x7f7194038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.764+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f71a4049880 con 0x7f71a8071bc0 2023-12-17T11:50:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.764+0000 7f71adb6a700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f7194036720 0x7f7194038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:11.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.765+0000 7f71adb6a700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f7194036720 0x7f7194038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7198009990 tx=0x7f7198006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:11.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.769+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f71a4011dd0 con 0x7f71a8071bc0 2023-12-17T11:50:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:11 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:11 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:11 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:11 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:11.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:11 smithi002 ceph-mon[107131]: Deploying daemon alertmanager.smithi002 on smithi002 2023-12-17T11:50:11.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.986+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71a8110bd0 con 0x7f7194036720 2023-12-17T11:50:11.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.987+0000 7f719effd700 1 -- 172.21.15.2:0/1125617482 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f71a8110bd0 con 0x7f7194036720 2023-12-17T11:50:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:50:11.989 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f7194036720 msgr2=0x7f7194038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f7194036720 0x7f7194038bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7198009990 tx=0x7f7198006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 msgr2=0x7f71a810ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a810ecd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009040 tx=0x7f71a4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 shutdown_connections 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f7194036720 0x7f7194038bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 --2- 172.21.15.2:0/1125617482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71a8071bc0 0x7f71a810ecd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.989+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 >> 172.21.15.2:0/1125617482 conn(0x7f71a80f7f50 msgr2=0x7f71a80f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.990+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 shutdown_connections 2023-12-17T11:50:11.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:11.990+0000 7f71b05cf700 1 -- 172.21.15.2:0/1125617482 wait complete. 2023-12-17T11:50:12.715 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-17T11:50:12.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-17T11:50:12.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:12 smithi002 ceph-mon[107131]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:12.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:12 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:12.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:12 smithi002 ceph-mon[107131]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:50:13.221 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:50:15.010 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:14 smithi002 ceph-mon[107131]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 -- 172.21.15.2:0/499115235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 msgr2=0x7ff4500fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 --2- 172.21.15.2:0/499115235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff4500fcc80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff4400048c0 tx=0x7ff440009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 -- 172.21.15.2:0/499115235 shutdown_connections 2023-12-17T11:50:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 --2- 172.21.15.2:0/499115235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff4500fcc80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 -- 172.21.15.2:0/499115235 >> 172.21.15.2:0/499115235 conn(0x7ff4500f7f50 msgr2=0x7ff4500fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 -- 172.21.15.2:0/499115235 shutdown_connections 2023-12-17T11:50:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.223+0000 7ff45678b700 1 -- 172.21.15.2:0/499115235 wait complete. 2023-12-17T11:50:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.224+0000 7ff45678b700 1 Processor -- start 2023-12-17T11:50:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.224+0000 7ff45678b700 1 -- start start 2023-12-17T11:50:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.224+0000 7ff45678b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff450071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.224+0000 7ff45678b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45006ff90 con 0x7ff4500fc870 2023-12-17T11:50:15.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.225+0000 7ff44ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff450071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.225+0000 7ff44ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff450071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34852/0 (socket says 172.21.15.2:34852) 2023-12-17T11:50:15.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.225+0000 7ff44ffff700 1 -- 172.21.15.2:0/3051558798 learned_addr learned my addr 172.21.15.2:0/3051558798 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:50:15.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.225+0000 7ff44ffff700 1 -- 172.21.15.2:0/3051558798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440005040 con 0x7ff4500fc870 2023-12-17T11:50:15.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.225+0000 7ff44ffff700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff450071b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b690 tx=0x7ff440009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.225+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff440009650 con 0x7ff4500fc870 2023-12-17T11:50:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.226+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff4400097b0 con 0x7ff4500fc870 2023-12-17T11:50:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.226+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff44001c5d0 con 0x7ff4500fc870 2023-12-17T11:50:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.226+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff450070190 con 0x7ff4500fc870 2023-12-17T11:50:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.226+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff450070680 con 0x7ff4500fc870 2023-12-17T11:50:15.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.227+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7ff4400139d0 con 0x7ff4500fc870 2023-12-17T11:50:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.227+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff450106500 con 0x7ff4500fc870 2023-12-17T11:50:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.227+0000 7ff44cff9700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7ff438036720 0x7ff438038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.227+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff4400498e0 con 0x7ff4500fc870 2023-12-17T11:50:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.228+0000 7ff44f7fe700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7ff438036720 0x7ff438038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.228+0000 7ff44f7fe700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7ff438036720 0x7ff438038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff444009990 tx=0x7ff444006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.232+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff440025400 con 0x7ff4500fc870 2023-12-17T11:50:15.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.450+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff45005f270 con 0x7ff4500fc870 2023-12-17T11:50:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.735+0000 7ff44cff9700 1 -- 172.21.15.2:0/3051558798 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff440011b60 con 0x7ff4500fc870 2023-12-17T11:50:15.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7ff438036720 msgr2=0x7ff438038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7ff438036720 0x7ff438038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff444009990 tx=0x7ff444006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 msgr2=0x7ff450071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff450071b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b690 tx=0x7ff440009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 shutdown_connections 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7ff438036720 0x7ff438038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 --2- 172.21.15.2:0/3051558798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4500fc870 0x7ff450071b10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.737+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 >> 172.21.15.2:0/3051558798 conn(0x7ff4500f7f50 msgr2=0x7ff4500f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.738+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 shutdown_connections 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:50:15.738+0000 7ff45678b700 1 -- 172.21.15.2:0/3051558798 wait complete. 2023-12-17T11:50:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2023-12-17T11:50:16.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:15 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3051558798' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-17T11:50:16.231 INFO:tasks.cephadm:Adding mon.smithi002 on smithi002 2023-12-17T11:50:16.231 INFO:tasks.cephadm:Adding mon.smithi119 on smithi119 2023-12-17T11:50:16.231 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch apply mon '2;smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119' 2023-12-17T11:50:16.641 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:16.729 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:16.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:16 smithi002 ceph-mon[107131]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:16.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:16 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3051558798' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-17T11:50:16.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:16 smithi002 ceph-mon[107131]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:50:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 -- 172.21.15.119:0/944140824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 msgr2=0x7fe9e80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 --2- 172.21.15.119:0/944140824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e80fcc80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40048c0 tx=0x7fe9e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 -- 172.21.15.119:0/944140824 shutdown_connections 2023-12-17T11:50:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 --2- 172.21.15.119:0/944140824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e80fcc80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 -- 172.21.15.119:0/944140824 >> 172.21.15.119:0/944140824 conn(0x7fe9e80f7f50 msgr2=0x7fe9e80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:18.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 -- 172.21.15.119:0/944140824 shutdown_connections 2023-12-17T11:50:18.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.166+0000 7fe9efd4e700 1 -- 172.21.15.119:0/944140824 wait complete. 2023-12-17T11:50:18.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.167+0000 7fe9efd4e700 1 Processor -- start 2023-12-17T11:50:18.170 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.167+0000 7fe9efd4e700 1 -- start start 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9efd4e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e8071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9efd4e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e806ff90 con 0x7fe9e80fc870 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9edaea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e8071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9edaea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e8071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:41836/0 (socket says 172.21.15.119:41836) 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9edaea700 1 -- 172.21.15.119:0/438828882 learned_addr learned my addr 172.21.15.119:0/438828882 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9edaea700 1 -- 172.21.15.119:0/438828882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4005040 con 0x7fe9e80fc870 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.168+0000 7fe9edaea700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e8071b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400b690 tx=0x7fe9e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.169+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9e4009650 con 0x7fe9e80fc870 2023-12-17T11:50:18.171 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.169+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9e40097b0 con 0x7fe9e80fc870 2023-12-17T11:50:18.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.169+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e8070190 con 0x7fe9e80fc870 2023-12-17T11:50:18.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.169+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9e401c5d0 con 0x7fe9e80fc870 2023-12-17T11:50:18.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.169+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e8070680 con 0x7fe9e80fc870 2023-12-17T11:50:18.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.170+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e8106500 con 0x7fe9e80fc870 2023-12-17T11:50:18.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.170+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7fe9e40139d0 con 0x7fe9e80fc870 2023-12-17T11:50:18.172 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.170+0000 7fe9de7fc700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fe9d40366d0 0x7fe9d4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:18.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.170+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe9e4049a20 con 0x7fe9e80fc870 2023-12-17T11:50:18.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.171+0000 7fe9ed2e9700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fe9d40366d0 0x7fe9d4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:18.173 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.171+0000 7fe9ed2e9700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fe9d40366d0 0x7fe9d4038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009990 tx=0x7fe9d8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:18.181 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.179+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe9e4025400 con 0x7fe9e80fc870 2023-12-17T11:50:18.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.381+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 --> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9e802b250 con 0x7fe9d40366d0 2023-12-17T11:50:18.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.387+0000 7fe9de7fc700 1 -- 172.21.15.119:0/438828882 <== mgr.14164 v2:172.21.15.2:6800/832159067 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe9e802b250 con 0x7fe9d40366d0 2023-12-17T11:50:18.389 INFO:teuthology.orchestra.run.smithi119.stdout:Scheduled mon update... 2023-12-17T11:50:18.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fe9d40366d0 msgr2=0x7fe9d4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fe9d40366d0 0x7fe9d4038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009990 tx=0x7fe9d8006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 msgr2=0x7fe9e8071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e8071b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400b690 tx=0x7fe9e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 shutdown_connections 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fe9d40366d0 0x7fe9d4038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 --2- 172.21.15.119:0/438828882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe9e80fc870 0x7fe9e8071b10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 >> 172.21.15.119:0/438828882 conn(0x7fe9e80f7f50 msgr2=0x7fe9e80f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.389+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 shutdown_connections 2023-12-17T11:50:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:18.390+0000 7fe9efd4e700 1 -- 172.21.15.119:0/438828882 wait complete. 2023-12-17T11:50:18.779 DEBUG:teuthology.orchestra.run.smithi119:mon.smithi119> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi119.service 2023-12-17T11:50:18.784 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:18.784 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:18.854 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:-- Logs begin at Sun 2023-12-17 11:32:10 UTC. -- 2023-12-17T11:50:19.217 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:19.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:19.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-17T11:50:19.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:18 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:19.305 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:19.997 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:19 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-17T11:50:19.997 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:19 smithi002 ceph-mon[107131]: Deploying daemon grafana.smithi002 on smithi002 2023-12-17T11:50:19.997 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:19 smithi002 ceph-mon[107131]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:50:19.998 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:19 smithi002 ceph-mon[107131]: Saving service mon spec with placement smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119;count:2 2023-12-17T11:50:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.351+0000 7f38df096700 1 -- 172.21.15.119:0/2932283642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 msgr2=0x7f38d80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.351+0000 7f38df096700 1 --2- 172.21.15.119:0/2932283642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d80fcc80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0048c0 tx=0x7f38cc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.351+0000 7f38df096700 1 -- 172.21.15.119:0/2932283642 shutdown_connections 2023-12-17T11:50:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.351+0000 7f38df096700 1 --2- 172.21.15.119:0/2932283642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d80fcc80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:20.354 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.351+0000 7f38df096700 1 -- 172.21.15.119:0/2932283642 >> 172.21.15.119:0/2932283642 conn(0x7f38d80f7f50 msgr2=0x7f38d80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.352+0000 7f38df096700 1 -- 172.21.15.119:0/2932283642 shutdown_connections 2023-12-17T11:50:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.352+0000 7f38df096700 1 -- 172.21.15.119:0/2932283642 wait complete. 2023-12-17T11:50:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.353+0000 7f38df096700 1 Processor -- start 2023-12-17T11:50:20.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.353+0000 7f38df096700 1 -- start start 2023-12-17T11:50:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.353+0000 7f38df096700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.353+0000 7f38df096700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d810f270 con 0x7f38d80fc870 2023-12-17T11:50:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.354+0000 7f38dce32700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.354+0000 7f38dce32700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:45350/0 (socket says 172.21.15.119:45350) 2023-12-17T11:50:20.356 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.354+0000 7f38dce32700 1 -- 172.21.15.119:0/76864656 learned_addr learned my addr 172.21.15.119:0/76864656 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.354+0000 7f38dce32700 1 -- 172.21.15.119:0/76864656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc005040 con 0x7f38d80fc870 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.354+0000 7f38dce32700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d810ed30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00b690 tx=0x7f38cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.355+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38cc009650 con 0x7f38d80fc870 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.355+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f38cc0097b0 con 0x7f38d80fc870 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.355+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d810f470 con 0x7f38d80fc870 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.355+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38cc01c5d0 con 0x7f38d80fc870 2023-12-17T11:50:20.357 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.355+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d810ffd0 con 0x7f38d80fc870 2023-12-17T11:50:20.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.356+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d805f270 con 0x7f38d80fc870 2023-12-17T11:50:20.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.356+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f38cc0139d0 con 0x7f38d80fc870 2023-12-17T11:50:20.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.357+0000 7f38d57fa700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f38c8036720 0x7f38c8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:20.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.357+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f38cc049960 con 0x7f38d80fc870 2023-12-17T11:50:20.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.357+0000 7f38d7fff700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f38c8036720 0x7f38c8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:20.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.358+0000 7f38d7fff700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f38c8036720 0x7f38c8038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009990 tx=0x7f38c4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:20.364 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.362+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f38cc025400 con 0x7f38d80fc870 2023-12-17T11:50:20.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.641+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f38d804bb80 con 0x7f38d80fc870 2023-12-17T11:50:20.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.641+0000 7f38d57fa700 1 -- 172.21.15.119:0/76864656 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f38cc011b60 con 0x7f38d80fc870 2023-12-17T11:50:20.644 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:20.644 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f38c8036720 msgr2=0x7f38c8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f38c8036720 0x7f38c8038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009990 tx=0x7f38c4006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 msgr2=0x7f38d810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d810ed30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00b690 tx=0x7f38cc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 shutdown_connections 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f38c8036720 0x7f38c8038bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 --2- 172.21.15.119:0/76864656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38d80fc870 0x7f38d810ed30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 >> 172.21.15.119:0/76864656 conn(0x7f38d80f7f50 msgr2=0x7f38d806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 shutdown_connections 2023-12-17T11:50:20.646 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:20.644+0000 7f38df096700 1 -- 172.21.15.119:0/76864656 wait complete. 2023-12-17T11:50:20.647 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:20 smithi002 ceph-mon[107131]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:20 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/76864656' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:22.049 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:22.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:22.455 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:22.543 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:23.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:22 smithi002 ceph-mon[107131]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:23.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:22 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 -- 172.21.15.119:0/3412306244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 msgr2=0x7fce180fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 --2- 172.21.15.119:0/3412306244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce180fcc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fce080048c0 tx=0x7fce08009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 -- 172.21.15.119:0/3412306244 shutdown_connections 2023-12-17T11:50:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 --2- 172.21.15.119:0/3412306244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce180fcc80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 -- 172.21.15.119:0/3412306244 >> 172.21.15.119:0/3412306244 conn(0x7fce180f7f50 msgr2=0x7fce180fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:23.573 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 -- 172.21.15.119:0/3412306244 shutdown_connections 2023-12-17T11:50:23.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.570+0000 7fce1e9d5700 1 -- 172.21.15.119:0/3412306244 wait complete. 2023-12-17T11:50:23.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.571+0000 7fce1e9d5700 1 Processor -- start 2023-12-17T11:50:23.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.571+0000 7fce1e9d5700 1 -- start start 2023-12-17T11:50:23.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.571+0000 7fce1e9d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce1810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:23.574 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.571+0000 7fce1e9d5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1810f270 con 0x7fce180fc870 2023-12-17T11:50:23.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.571+0000 7fce17fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce1810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:23.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce17fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce1810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:45366/0 (socket says 172.21.15.119:45366) 2023-12-17T11:50:23.575 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce17fff700 1 -- 172.21.15.119:0/396916159 learned_addr learned my addr 172.21.15.119:0/396916159 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce17fff700 1 -- 172.21.15.119:0/396916159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08005040 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce17fff700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce1810ed30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce0800b690 tx=0x7fce08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce08009650 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce080097b0 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce0801c5d0 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1810f470 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.572+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1810ffd0 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.573+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7fce080139d0 con 0x7fce180fc870 2023-12-17T11:50:23.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.574+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1805f270 con 0x7fce180fc870 2023-12-17T11:50:23.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.574+0000 7fce157fa700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fce04036720 0x7fce04038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:23.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.574+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fce080499a0 con 0x7fce180fc870 2023-12-17T11:50:23.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.574+0000 7fce0ffff700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fce04036720 0x7fce04038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:23.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.575+0000 7fce0ffff700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fce04036720 0x7fce04038bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fce00009990 tx=0x7fce00006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:23.581 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.579+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fce08025400 con 0x7fce180fc870 2023-12-17T11:50:23.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.847+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fce1804bb80 con 0x7fce180fc870 2023-12-17T11:50:23.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.848+0000 7fce157fa700 1 -- 172.21.15.119:0/396916159 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fce08011b60 con 0x7fce180fc870 2023-12-17T11:50:23.850 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:23.850 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:23.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fce04036720 msgr2=0x7fce04038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:23.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fce04036720 0x7fce04038bd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fce00009990 tx=0x7fce00006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:23.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 msgr2=0x7fce1810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:23.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce1810ed30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce0800b690 tx=0x7fce08009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 shutdown_connections 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fce04036720 0x7fce04038bd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 --2- 172.21.15.119:0/396916159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce180fc870 0x7fce1810ed30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 >> 172.21.15.119:0/396916159 conn(0x7fce180f7f50 msgr2=0x7fce1806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 shutdown_connections 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:23.850+0000 7fce1e9d5700 1 -- 172.21.15.119:0/396916159 wait complete. 2023-12-17T11:50:23.853 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:25.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:24 smithi002 ceph-mon[107131]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:25.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:24 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/396916159' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:25.230 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:25.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:25.636 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:25.723 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:26.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 -- 172.21.15.119:0/2737203919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 msgr2=0x7f0fec070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:26.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 --2- 172.21.15.119:0/2737203919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec070030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0048c0 tx=0x7f0fdc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:26.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 -- 172.21.15.119:0/2737203919 shutdown_connections 2023-12-17T11:50:26.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 --2- 172.21.15.119:0/2737203919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec070030 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:26.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 -- 172.21.15.119:0/2737203919 >> 172.21.15.119:0/2737203919 conn(0x7f0fec0f7f50 msgr2=0x7f0fec0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:26.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 -- 172.21.15.119:0/2737203919 shutdown_connections 2023-12-17T11:50:26.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.767+0000 7f0ff281f700 1 -- 172.21.15.119:0/2737203919 wait complete. 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.768+0000 7f0ff281f700 1 Processor -- start 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.768+0000 7f0ff281f700 1 -- start start 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.768+0000 7f0ff281f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.768+0000 7f0ff281f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec113580 con 0x7f0fec071bc0 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0febfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0febfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:45396/0 (socket says 172.21.15.119:45396) 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0febfff700 1 -- 172.21.15.119:0/1183323884 learned_addr learned my addr 172.21.15.119:0/1183323884 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0febfff700 1 -- 172.21.15.119:0/1183323884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc005040 con 0x7f0fec071bc0 2023-12-17T11:50:26.771 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0febfff700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec113040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009040 tx=0x7f0fdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:26.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fdc009620 con 0x7f0fec071bc0 2023-12-17T11:50:26.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0fdc009780 con 0x7f0fec071bc0 2023-12-17T11:50:26.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec113780 con 0x7f0fec071bc0 2023-12-17T11:50:26.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.769+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fdc01c5b0 con 0x7f0fec071bc0 2023-12-17T11:50:26.772 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.770+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec114420 con 0x7f0fec071bc0 2023-12-17T11:50:26.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.771+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f0fdc013a60 con 0x7f0fec071bc0 2023-12-17T11:50:26.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.771+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec05f270 con 0x7f0fec071bc0 2023-12-17T11:50:26.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.772+0000 7f0fe8ff9700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0fd4036720 0x7f0fd4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:26.773 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.772+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0fdc049170 con 0x7f0fec071bc0 2023-12-17T11:50:26.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.772+0000 7f0feb7fe700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0fd4036720 0x7f0fd4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:26.774 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.772+0000 7f0feb7fe700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0fd4036720 0x7f0fd4038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009990 tx=0x7f0fe0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:26.779 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:26.777+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0fdc011550 con 0x7f0fec071bc0 2023-12-17T11:50:27.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.047+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0fec114f70 con 0x7f0fec071bc0 2023-12-17T11:50:27.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.048+0000 7f0fe8ff9700 1 -- 172.21.15.119:0/1183323884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f0fdc011370 con 0x7f0fec071bc0 2023-12-17T11:50:27.050 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:27.050 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0fd4036720 msgr2=0x7f0fd4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0fd4036720 0x7f0fd4038bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009990 tx=0x7f0fe0006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 msgr2=0x7f0fec113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec113040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009040 tx=0x7f0fdc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 shutdown_connections 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0fd4036720 0x7f0fd4038bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:27.052 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 --2- 172.21.15.119:0/1183323884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fec071bc0 0x7f0fec113040 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:27.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 >> 172.21.15.119:0/1183323884 conn(0x7f0fec0f7f50 msgr2=0x7f0fec0f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:27.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 shutdown_connections 2023-12-17T11:50:27.053 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:27.050+0000 7f0ff281f700 1 -- 172.21.15.119:0/1183323884 wait complete. 2023-12-17T11:50:27.053 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:27.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:26 smithi002 ceph-mon[107131]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:27.999 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:27 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/1183323884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:28.437 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:28.437 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:28.845 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:28.933 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:29.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:28 smithi002 ceph-mon[107131]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.075+0000 7faec75ae700 1 -- 172.21.15.119:0/911745272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 msgr2=0x7faec00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.075+0000 7faec75ae700 1 --2- 172.21.15.119:0/911745272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec00fcc80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faebc0048c0 tx=0x7faebc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.075+0000 7faec75ae700 1 -- 172.21.15.119:0/911745272 shutdown_connections 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.075+0000 7faec75ae700 1 --2- 172.21.15.119:0/911745272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec00fcc80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.075+0000 7faec75ae700 1 -- 172.21.15.119:0/911745272 >> 172.21.15.119:0/911745272 conn(0x7faec00f7f50 msgr2=0x7faec00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.076+0000 7faec75ae700 1 -- 172.21.15.119:0/911745272 shutdown_connections 2023-12-17T11:50:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.076+0000 7faec75ae700 1 -- 172.21.15.119:0/911745272 wait complete. 2023-12-17T11:50:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.076+0000 7faec75ae700 1 Processor -- start 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.077+0000 7faec75ae700 1 -- start start 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.077+0000 7faec75ae700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec010ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.077+0000 7faec75ae700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec010f270 con 0x7faec00fc870 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.077+0000 7faec534a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec010ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.077+0000 7faec534a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec010ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:37186/0 (socket says 172.21.15.119:37186) 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.077+0000 7faec534a700 1 -- 172.21.15.119:0/2693544868 learned_addr learned my addr 172.21.15.119:0/2693544868 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faec534a700 1 -- 172.21.15.119:0/2693544868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc005040 con 0x7faec00fc870 2023-12-17T11:50:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faec534a700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec010ed30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faebc009330 tx=0x7faebc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faebc0096b0 con 0x7faec00fc870 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faebc009810 con 0x7faec00fc870 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec010f470 con 0x7faec00fc870 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faebc01c5b0 con 0x7faec00fc870 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.078+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec010ffd0 con 0x7faec00fc870 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.079+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7faebc013420 con 0x7faec00fc870 2023-12-17T11:50:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.079+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec004bb80 con 0x7faec00fc870 2023-12-17T11:50:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.080+0000 7faeb5ffb700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faeac036720 0x7faeac038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.080+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faebc049a70 con 0x7faec00fc870 2023-12-17T11:50:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.080+0000 7faec4b49700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faeac036720 0x7faeac038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.081+0000 7faec4b49700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faeac036720 0x7faeac038bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009990 tx=0x7faeb0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.085+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faebc011db0 con 0x7faec00fc870 2023-12-17T11:50:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.352+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faec0110160 con 0x7faec00fc870 2023-12-17T11:50:30.355 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.353+0000 7faeb5ffb700 1 -- 172.21.15.119:0/2693544868 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7faebc011370 con 0x7faec00fc870 2023-12-17T11:50:30.355 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:30.356 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faeac036720 msgr2=0x7faeac038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faeac036720 0x7faeac038bd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009990 tx=0x7faeb0006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 msgr2=0x7faec010ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec010ed30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faebc009330 tx=0x7faebc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 shutdown_connections 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faeac036720 0x7faeac038bd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 --2- 172.21.15.119:0/2693544868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec00fc870 0x7faec010ed30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:30.358 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.355+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 >> 172.21.15.119:0/2693544868 conn(0x7faec00f7f50 msgr2=0x7faec006feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:30.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.356+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 shutdown_connections 2023-12-17T11:50:30.359 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:30.356+0000 7faec75ae700 1 -- 172.21.15.119:0/2693544868 wait complete. 2023-12-17T11:50:30.359 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:30.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:30 smithi002 ceph-mon[107131]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:30.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:30 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2693544868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:31.713 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:31.713 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:32.117 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:33.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:32 smithi002 ceph-mon[107131]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:33.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 -- 172.21.15.119:0/3041109181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 msgr2=0x7fc3f40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:33.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 --2- 172.21.15.119:0/3041109181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f40fcc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00048c0 tx=0x7fc3f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:33.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 -- 172.21.15.119:0/3041109181 shutdown_connections 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 --2- 172.21.15.119:0/3041109181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f40fcc80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 -- 172.21.15.119:0/3041109181 >> 172.21.15.119:0/3041109181 conn(0x7fc3f40f7f50 msgr2=0x7fc3f40fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 -- 172.21.15.119:0/3041109181 shutdown_connections 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.272+0000 7fc3fb85e700 1 -- 172.21.15.119:0/3041109181 wait complete. 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.273+0000 7fc3fb85e700 1 Processor -- start 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.273+0000 7fc3fb85e700 1 -- start start 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.274+0000 7fc3fb85e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f410ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:33.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.274+0000 7fc3fb85e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f410cfd0 con 0x7fc3f40fc870 2023-12-17T11:50:33.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.274+0000 7fc3f95fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f410ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:33.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.274+0000 7fc3f95fa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f410ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:37200/0 (socket says 172.21.15.119:37200) 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.274+0000 7fc3f95fa700 1 -- 172.21.15.119:0/927396805 learned_addr learned my addr 172.21.15.119:0/927396805 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.274+0000 7fc3f95fa700 1 -- 172.21.15.119:0/927396805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0005040 con 0x7fc3f40fc870 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.275+0000 7fc3f95fa700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f410ca90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009330 tx=0x7fc3f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.275+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3f00096b0 con 0x7fc3f40fc870 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.275+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f410d1d0 con 0x7fc3f40fc870 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.275+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3f0009810 con 0x7fc3f40fc870 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.275+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3f001c5b0 con 0x7fc3f40fc870 2023-12-17T11:50:33.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.275+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f410de70 con 0x7fc3f40fc870 2023-12-17T11:50:33.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.276+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f405f270 con 0x7fc3f40fc870 2023-12-17T11:50:33.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.276+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7fc3f0013420 con 0x7fc3f40fc870 2023-12-17T11:50:33.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.276+0000 7fc3e9ffb700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fc3e00366d0 0x7fc3e0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:33.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.277+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc3f0049a10 con 0x7fc3f40fc870 2023-12-17T11:50:33.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.277+0000 7fc3f8df9700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fc3e00366d0 0x7fc3e0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:33.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.277+0000 7fc3f8df9700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fc3e00366d0 0x7fc3e0038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009990 tx=0x7fc3e4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:33.285 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.282+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc3f00119c0 con 0x7fc3f40fc870 2023-12-17T11:50:33.554 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.552+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc3f410e9c0 con 0x7fc3f40fc870 2023-12-17T11:50:33.555 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.553+0000 7fc3e9ffb700 1 -- 172.21.15.119:0/927396805 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fc3f0011370 con 0x7fc3f40fc870 2023-12-17T11:50:33.555 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:33.555 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:33.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fc3e00366d0 msgr2=0x7fc3e0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:33.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fc3e00366d0 0x7fc3e0038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009990 tx=0x7fc3e4006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:33.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 msgr2=0x7fc3f410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:33.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f410ca90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009330 tx=0x7fc3f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:33.557 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 shutdown_connections 2023-12-17T11:50:33.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fc3e00366d0 0x7fc3e0038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:33.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 --2- 172.21.15.119:0/927396805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3f40fc870 0x7fc3f410ca90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:33.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 >> 172.21.15.119:0/927396805 conn(0x7fc3f40f7f50 msgr2=0x7fc3f40f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:33.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 shutdown_connections 2023-12-17T11:50:33.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:33.555+0000 7fc3fb85e700 1 -- 172.21.15.119:0/927396805 wait complete. 2023-12-17T11:50:33.558 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:34.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:33 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/927396805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:34.919 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:34.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:35.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:34 smithi002 ceph-mon[107131]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:35.328 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:35.415 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.590+0000 7f61d1064700 1 -- 172.21.15.119:0/640741418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 msgr2=0x7f61cc0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.591+0000 7f61d1064700 1 --2- 172.21.15.119:0/640741418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc0fcc80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0048c0 tx=0x7f61bc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.591+0000 7f61d1064700 1 -- 172.21.15.119:0/640741418 shutdown_connections 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.591+0000 7f61d1064700 1 --2- 172.21.15.119:0/640741418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc0fcc80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.591+0000 7f61d1064700 1 -- 172.21.15.119:0/640741418 >> 172.21.15.119:0/640741418 conn(0x7f61cc0f7f50 msgr2=0x7f61cc0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.591+0000 7f61d1064700 1 -- 172.21.15.119:0/640741418 shutdown_connections 2023-12-17T11:50:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.591+0000 7f61d1064700 1 -- 172.21.15.119:0/640741418 wait complete. 2023-12-17T11:50:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61d1064700 1 Processor -- start 2023-12-17T11:50:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61d1064700 1 -- start start 2023-12-17T11:50:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61d1064700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc10ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61d1064700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc10f280 con 0x7f61cc0fc870 2023-12-17T11:50:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61cad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc10ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61cad9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc10ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:37218/0 (socket says 172.21.15.119:37218) 2023-12-17T11:50:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.592+0000 7f61cad9d700 1 -- 172.21.15.119:0/2223803588 learned_addr learned my addr 172.21.15.119:0/2223803588 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61cad9d700 1 -- 172.21.15.119:0/2223803588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc005040 con 0x7f61cc0fc870 2023-12-17T11:50:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61cad9d700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc10ed40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00b690 tx=0x7f61bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61bc009650 con 0x7f61cc0fc870 2023-12-17T11:50:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61bc0097b0 con 0x7f61cc0fc870 2023-12-17T11:50:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc10f480 con 0x7f61cc0fc870 2023-12-17T11:50:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61bc01c5d0 con 0x7f61cc0fc870 2023-12-17T11:50:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.593+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc10ffe0 con 0x7f61cc0fc870 2023-12-17T11:50:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.594+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc04bb80 con 0x7f61cc0fc870 2023-12-17T11:50:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.594+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f61bc0139d0 con 0x7f61cc0fc870 2023-12-17T11:50:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.595+0000 7f61b37fe700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f61b40366d0 0x7f61b4038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.595+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f61bc0499e0 con 0x7f61cc0fc870 2023-12-17T11:50:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.595+0000 7f61ca59c700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f61b40366d0 0x7f61b4038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.596+0000 7f61ca59c700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f61b40366d0 0x7f61b4038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009990 tx=0x7f61c0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.603+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f61bc025400 con 0x7f61cc0fc870 2023-12-17T11:50:36.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.871+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f61cc110170 con 0x7f61cc0fc870 2023-12-17T11:50:36.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.872+0000 7f61b37fe700 1 -- 172.21.15.119:0/2223803588 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f61bc011b60 con 0x7f61cc0fc870 2023-12-17T11:50:36.874 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:36.874 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:36.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f61b40366d0 msgr2=0x7f61b4038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:36.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f61b40366d0 0x7f61b4038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009990 tx=0x7f61c0006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:36.878 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 msgr2=0x7f61cc10ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc10ed40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00b690 tx=0x7f61bc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 shutdown_connections 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f61b40366d0 0x7f61b4038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 --2- 172.21.15.119:0/2223803588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61cc0fc870 0x7f61cc10ed40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 >> 172.21.15.119:0/2223803588 conn(0x7f61cc0f7f50 msgr2=0x7f61cc06fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 shutdown_connections 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:36.874+0000 7f61d1064700 1 -- 172.21.15.119:0/2223803588 wait complete. 2023-12-17T11:50:36.879 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:37.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:36 smithi002 ceph-mon[107131]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:38.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:37 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2223803588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:38.256 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:38.256 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:38.666 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:38.752 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:39.000 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:38 smithi002 ceph-mon[107131]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:39.867 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 -- 172.21.15.119:0/3887424998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 msgr2=0x7f26340fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 --2- 172.21.15.119:0/3887424998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f26340fcc80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f26300048c0 tx=0x7f2630009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 -- 172.21.15.119:0/3887424998 shutdown_connections 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 --2- 172.21.15.119:0/3887424998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f26340fcc80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 -- 172.21.15.119:0/3887424998 >> 172.21.15.119:0/3887424998 conn(0x7f26340f7f50 msgr2=0x7f26340fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 -- 172.21.15.119:0/3887424998 shutdown_connections 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 -- 172.21.15.119:0/3887424998 wait complete. 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.865+0000 7f263b773700 1 Processor -- start 2023-12-17T11:50:39.868 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.866+0000 7f263b773700 1 -- start start 2023-12-17T11:50:39.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.866+0000 7f263b773700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f263410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:39.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.866+0000 7f263b773700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263410f280 con 0x7f26340fc870 2023-12-17T11:50:39.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.866+0000 7f263950f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f263410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:39.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.866+0000 7f263950f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f263410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:34188/0 (socket says 172.21.15.119:34188) 2023-12-17T11:50:39.869 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.866+0000 7f263950f700 1 -- 172.21.15.119:0/659689069 learned_addr learned my addr 172.21.15.119:0/659689069 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f263950f700 1 -- 172.21.15.119:0/659689069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630005040 con 0x7f26340fc870 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f263950f700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f263410ed40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f263000b690 tx=0x7f2630009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2630009650 con 0x7f26340fc870 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263410f480 con 0x7f26340fc870 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26300097b0 con 0x7f26340fc870 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f263001c5d0 con 0x7f26340fc870 2023-12-17T11:50:39.870 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.867+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263410ffe0 con 0x7f26340fc870 2023-12-17T11:50:39.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.868+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f26300139d0 con 0x7f26340fc870 2023-12-17T11:50:39.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.868+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263404bb80 con 0x7f26340fc870 2023-12-17T11:50:39.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.869+0000 7f2629ffb700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f26200366d0 0x7f2620038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:39.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.869+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2630049a20 con 0x7f26340fc870 2023-12-17T11:50:39.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.869+0000 7f2638d0e700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f26200366d0 0x7f2620038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:39.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.870+0000 7f2638d0e700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f26200366d0 0x7f2620038b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2624009990 tx=0x7f2624006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:39.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:39.875+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2630025400 con 0x7f26340fc870 2023-12-17T11:50:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.141+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2634110e60 con 0x7f26340fc870 2023-12-17T11:50:40.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.141+0000 7f2629ffb700 1 -- 172.21.15.119:0/659689069 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f2630011b60 con 0x7f26340fc870 2023-12-17T11:50:40.143 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:40.144 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f26200366d0 msgr2=0x7f2620038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f26200366d0 0x7f2620038b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2624009990 tx=0x7f2624006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 msgr2=0x7f263410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f263410ed40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f263000b690 tx=0x7f2630009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 shutdown_connections 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f26200366d0 0x7f2620038b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 --2- 172.21.15.119:0/659689069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26340fc870 0x7f263410ed40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 >> 172.21.15.119:0/659689069 conn(0x7f26340f7f50 msgr2=0x7f26340f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 shutdown_connections 2023-12-17T11:50:40.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:40.143+0000 7f263b773700 1 -- 172.21.15.119:0/659689069 wait complete. 2023-12-17T11:50:40.147 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:40 smithi002 ceph-mon[107131]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:40 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/659689069' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:41.511 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:41.512 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:41.919 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:42.007 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:42.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:42.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:42.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: Deploying daemon prometheus.smithi002 on smithi002 2023-12-17T11:50:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:42 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:43.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 -- 172.21.15.119:0/1975038359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 msgr2=0x7f69080fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:43.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 --2- 172.21.15.119:0/1975038359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f69080fcc80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f68f80048c0 tx=0x7f68f8009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:43.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 -- 172.21.15.119:0/1975038359 shutdown_connections 2023-12-17T11:50:43.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 --2- 172.21.15.119:0/1975038359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f69080fcc80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:43.134 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 -- 172.21.15.119:0/1975038359 >> 172.21.15.119:0/1975038359 conn(0x7f69080f7f50 msgr2=0x7f69080fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:43.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 -- 172.21.15.119:0/1975038359 shutdown_connections 2023-12-17T11:50:43.135 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.131+0000 7f690d855700 1 -- 172.21.15.119:0/1975038359 wait complete. 2023-12-17T11:50:43.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.132+0000 7f690d855700 1 Processor -- start 2023-12-17T11:50:43.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.132+0000 7f690d855700 1 -- start start 2023-12-17T11:50:43.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.133+0000 7f690d855700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f690810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:43.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.133+0000 7f690d855700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690810f270 con 0x7f69080fc870 2023-12-17T11:50:43.137 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.133+0000 7f6906ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f690810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:43.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.133+0000 7f6906ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f690810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:34208/0 (socket says 172.21.15.119:34208) 2023-12-17T11:50:43.138 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.133+0000 7f6906ffd700 1 -- 172.21.15.119:0/666809668 learned_addr learned my addr 172.21.15.119:0/666809668 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.133+0000 7f6906ffd700 1 -- 172.21.15.119:0/666809668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f8005040 con 0x7f69080fc870 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.134+0000 7f6906ffd700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f690810ed30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68f800b690 tx=0x7f68f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.134+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68f8009650 con 0x7f69080fc870 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.134+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68f80097b0 con 0x7f69080fc870 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.134+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690810f470 con 0x7f69080fc870 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.134+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68f801c5d0 con 0x7f69080fc870 2023-12-17T11:50:43.139 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.134+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690810ffd0 con 0x7f69080fc870 2023-12-17T11:50:43.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.135+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f68f80139d0 con 0x7f69080fc870 2023-12-17T11:50:43.140 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.135+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690805f270 con 0x7f69080fc870 2023-12-17T11:50:43.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.136+0000 7f68ef7fe700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f68f0036720 0x7f68f0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:43.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.136+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f68f80498e0 con 0x7f69080fc870 2023-12-17T11:50:43.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.136+0000 7f69067fc700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f68f0036720 0x7f68f0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:43.141 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.137+0000 7f69067fc700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f68f0036720 0x7f68f0038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009990 tx=0x7f68fc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:43.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.141+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68f8025400 con 0x7f69080fc870 2023-12-17T11:50:43.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.411+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f690804bb80 con 0x7f69080fc870 2023-12-17T11:50:43.413 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.411+0000 7f68ef7fe700 1 -- 172.21.15.119:0/666809668 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f68f8011b60 con 0x7f69080fc870 2023-12-17T11:50:43.413 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:43.414 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f68f0036720 msgr2=0x7f68f0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f68f0036720 0x7f68f0038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009990 tx=0x7f68fc006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 msgr2=0x7f690810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f690810ed30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68f800b690 tx=0x7f68f8009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 shutdown_connections 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f68f0036720 0x7f68f0038bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 --2- 172.21.15.119:0/666809668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69080fc870 0x7f690810ed30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 >> 172.21.15.119:0/666809668 conn(0x7f69080f7f50 msgr2=0x7f690806fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 shutdown_connections 2023-12-17T11:50:43.416 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:43.414+0000 7f690d855700 1 -- 172.21.15.119:0/666809668 wait complete. 2023-12-17T11:50:43.417 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:43.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:43 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/666809668' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:44.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:44 smithi002 ceph-mon[107131]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:44.776 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:44.776 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:45.180 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:45.268 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:46.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.421+0000 7f0d1a648700 1 -- 172.21.15.119:0/3052493673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 msgr2=0x7f0d1406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:46.424 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.421+0000 7f0d1a648700 1 --2- 172.21.15.119:0/3052493673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1406ffd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0d040048c0 tx=0x7f0d04009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.421+0000 7f0d1a648700 1 -- 172.21.15.119:0/3052493673 shutdown_connections 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.421+0000 7f0d1a648700 1 --2- 172.21.15.119:0/3052493673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1406ffd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.421+0000 7f0d1a648700 1 -- 172.21.15.119:0/3052493673 >> 172.21.15.119:0/3052493673 conn(0x7f0d140f7f50 msgr2=0x7f0d140fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.422+0000 7f0d1a648700 1 -- 172.21.15.119:0/3052493673 shutdown_connections 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.422+0000 7f0d1a648700 1 -- 172.21.15.119:0/3052493673 wait complete. 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.422+0000 7f0d1a648700 1 Processor -- start 2023-12-17T11:50:46.425 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.423+0000 7f0d1a648700 1 -- start start 2023-12-17T11:50:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.423+0000 7f0d1a648700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1410ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.423+0000 7f0d1a648700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1410f240 con 0x7f0d14071b60 2023-12-17T11:50:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.423+0000 7f0d13fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1410ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.423+0000 7f0d13fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1410ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:34232/0 (socket says 172.21.15.119:34232) 2023-12-17T11:50:46.426 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.423+0000 7f0d13fff700 1 -- 172.21.15.119:0/1179625933 learned_addr learned my addr 172.21.15.119:0/1179625933 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d13fff700 1 -- 172.21.15.119:0/1179625933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d04005040 con 0x7f0d14071b60 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d13fff700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1410ed00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400b690 tx=0x7f0d04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d04009650 con 0x7f0d14071b60 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d040097b0 con 0x7f0d14071b60 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1410f440 con 0x7f0d14071b60 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d0401c5b0 con 0x7f0d14071b60 2023-12-17T11:50:46.427 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.424+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1410ffa0 con 0x7f0d14071b60 2023-12-17T11:50:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.425+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7f0d0401c870 con 0x7f0d14071b60 2023-12-17T11:50:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.425+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1404bb80 con 0x7f0d14071b60 2023-12-17T11:50:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.426+0000 7f0d10ff9700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0cfc0366d0 0x7f0cfc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.426+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0d04049920 con 0x7f0d14071b60 2023-12-17T11:50:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.426+0000 7f0d137fe700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0cfc0366d0 0x7f0cfc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:46.428 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.427+0000 7f0d137fe700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0cfc0366d0 0x7f0cfc038b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009990 tx=0x7f0d08006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:46.433 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.431+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0d04011db0 con 0x7f0d14071b60 2023-12-17T11:50:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.699+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0d14110e20 con 0x7f0d14071b60 2023-12-17T11:50:46.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.699+0000 7f0d10ff9700 1 -- 172.21.15.119:0/1179625933 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f0d04023990 con 0x7f0d14071b60 2023-12-17T11:50:46.701 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:46.701 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.701+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0cfc0366d0 msgr2=0x7f0cfc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.701+0000 7f0d1a648700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0cfc0366d0 0x7f0cfc038b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009990 tx=0x7f0d08006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.701+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 msgr2=0x7f0d1410ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.701+0000 7f0d1a648700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1410ed00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400b690 tx=0x7f0d04009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.702+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 shutdown_connections 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.702+0000 7f0d1a648700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f0cfc0366d0 0x7f0cfc038b80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.702+0000 7f0d1a648700 1 --2- 172.21.15.119:0/1179625933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d14071b60 0x7f0d1410ed00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.702+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 >> 172.21.15.119:0/1179625933 conn(0x7f0d140f7f50 msgr2=0x7f0d140f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.702+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 shutdown_connections 2023-12-17T11:50:46.704 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:46.702+0000 7f0d1a648700 1 -- 172.21.15.119:0/1179625933 wait complete. 2023-12-17T11:50:46.705 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:46 smithi002 ceph-mon[107131]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:46 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/1179625933' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:48.101 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:48.102 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:48.505 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:48.594 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:48.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:48 smithi002 ceph-mon[107131]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:49.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 -- 172.21.15.119:0/569568327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 msgr2=0x7fda080fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:49.717 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 --2- 172.21.15.119:0/569568327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda080fcc80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda040048c0 tx=0x7fda04009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:49.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 -- 172.21.15.119:0/569568327 shutdown_connections 2023-12-17T11:50:49.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 --2- 172.21.15.119:0/569568327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda080fcc80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:49.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 -- 172.21.15.119:0/569568327 >> 172.21.15.119:0/569568327 conn(0x7fda080f7f50 msgr2=0x7fda080fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:49.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 -- 172.21.15.119:0/569568327 shutdown_connections 2023-12-17T11:50:49.718 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.715+0000 7fda0feac700 1 -- 172.21.15.119:0/569568327 wait complete. 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.716+0000 7fda0feac700 1 Processor -- start 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.716+0000 7fda0feac700 1 -- start start 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.716+0000 7fda0feac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda0810ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.716+0000 7fda0feac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0810f280 con 0x7fda080fc870 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.717+0000 7fda0dc48700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda0810ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.717+0000 7fda0dc48700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda0810ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:34260/0 (socket says 172.21.15.119:34260) 2023-12-17T11:50:49.719 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.717+0000 7fda0dc48700 1 -- 172.21.15.119:0/884874625 learned_addr learned my addr 172.21.15.119:0/884874625 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.717+0000 7fda0dc48700 1 -- 172.21.15.119:0/884874625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04005040 con 0x7fda080fc870 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.717+0000 7fda0dc48700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda0810ed40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda0400b690 tx=0x7fda04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.717+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda04009650 con 0x7fda080fc870 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.718+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda040097b0 con 0x7fda080fc870 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.718+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda0401c5d0 con 0x7fda080fc870 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.718+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0810f480 con 0x7fda080fc870 2023-12-17T11:50:49.720 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.718+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0810ffe0 con 0x7fda080fc870 2023-12-17T11:50:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.719+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0805f270 con 0x7fda080fc870 2023-12-17T11:50:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.719+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) v1 ==== 43336+0+0 (secure 0 0 0) 0x7fda040139d0 con 0x7fda080fc870 2023-12-17T11:50:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.719+0000 7fd9fe7fc700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fd9f4036720 0x7fd9f4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.719+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fda040499a0 con 0x7fda080fc870 2023-12-17T11:50:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.719+0000 7fda0d447700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fd9f4036720 0x7fd9f4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:49.722 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.720+0000 7fda0d447700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fd9f4036720 0x7fd9f4038bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009990 tx=0x7fd9f8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:49.728 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.726+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fda04025400 con 0x7fda080fc870 2023-12-17T11:50:49.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.993+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fda0804bb80 con 0x7fda080fc870 2023-12-17T11:50:49.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.994+0000 7fd9fe7fc700 1 -- 172.21.15.119:0/884874625 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fda04011b60 con 0x7fda080fc870 2023-12-17T11:50:49.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:49.996 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.996+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fd9f4036720 msgr2=0x7fd9f4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.996+0000 7fda0feac700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fd9f4036720 0x7fd9f4038bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009990 tx=0x7fd9f8006e40 comp rx=0 tx=0).stop 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.996+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 msgr2=0x7fda0810ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.996+0000 7fda0feac700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda0810ed40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda0400b690 tx=0x7fda04009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.997+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 shutdown_connections 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.997+0000 7fda0feac700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7fd9f4036720 0x7fd9f4038bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.997+0000 7fda0feac700 1 --2- 172.21.15.119:0/884874625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda080fc870 0x7fda0810ed40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.997+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 >> 172.21.15.119:0/884874625 conn(0x7fda080f7f50 msgr2=0x7fda0806fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.997+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 shutdown_connections 2023-12-17T11:50:49.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:49.997+0000 7fda0feac700 1 -- 172.21.15.119:0/884874625 wait complete. 2023-12-17T11:50:50.000 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:50 smithi002 ceph-mon[107131]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:50:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:50 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/884874625' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:50 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:50 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:50 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:50:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:50 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-17T11:50:51.358 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:51.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:51.790 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:51.879 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:52.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:52 smithi002 ceph-mon[107131]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-17T11:50:52.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:52 smithi002 ceph-mon[107131]: mgrmap e14: smithi002.cqnuqs(active, since 59s) 2023-12-17T11:50:53.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.121+0000 7f2688e6e700 1 -- 172.21.15.119:0/1073472438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 msgr2=0x7f26840fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:53.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.121+0000 7f2688e6e700 1 --2- 172.21.15.119:0/1073472438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f26840fcc80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26740048c0 tx=0x7f2674009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:53.124 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.121+0000 7f2688e6e700 1 -- 172.21.15.119:0/1073472438 shutdown_connections 2023-12-17T11:50:53.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.121+0000 7f2688e6e700 1 --2- 172.21.15.119:0/1073472438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f26840fcc80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:53.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.121+0000 7f2688e6e700 1 -- 172.21.15.119:0/1073472438 >> 172.21.15.119:0/1073472438 conn(0x7f26840f7f50 msgr2=0x7f26840fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:53.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.122+0000 7f2688e6e700 1 -- 172.21.15.119:0/1073472438 shutdown_connections 2023-12-17T11:50:53.125 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.122+0000 7f2688e6e700 1 -- 172.21.15.119:0/1073472438 wait complete. 2023-12-17T11:50:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.123+0000 7f2688e6e700 1 Processor -- start 2023-12-17T11:50:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.123+0000 7f2688e6e700 1 -- start start 2023-12-17T11:50:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.123+0000 7f2688e6e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f268410ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.123+0000 7f2688e6e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268410f270 con 0x7f26840fc870 2023-12-17T11:50:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.124+0000 7f268259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f268410ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.124+0000 7f268259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f268410ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:39098/0 (socket says 172.21.15.119:39098) 2023-12-17T11:50:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.124+0000 7f268259c700 1 -- 172.21.15.119:0/4018515695 learned_addr learned my addr 172.21.15.119:0/4018515695 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.124+0000 7f268259c700 1 -- 172.21.15.119:0/4018515695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2674005040 con 0x7f26840fc870 2023-12-17T11:50:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.124+0000 7f268259c700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f268410ed30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f267400b690 tx=0x7f2674009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.125+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2674009650 con 0x7f26840fc870 2023-12-17T11:50:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.125+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268410f470 con 0x7f26840fc870 2023-12-17T11:50:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.125+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26740097b0 con 0x7f26840fc870 2023-12-17T11:50:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.125+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f267401c5d0 con 0x7f26840fc870 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.125+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268410ffd0 con 0x7f26840fc870 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.126+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268404bb80 con 0x7f26840fc870 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.126+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 43350+0+0 (secure 0 0 0) 0x7f26740139d0 con 0x7f26840fc870 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.126+0000 7f267affd700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 0x7f2670038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.126+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2674049aa0 con 0x7f26840fc870 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.126+0000 7f267bfff700 1 -- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 msgr2=0x7f2670038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/832159067 2023-12-17T11:50:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.126+0000 7f267bfff700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 0x7f2670038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:50:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.131+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2674025400 con 0x7f26840fc870 2023-12-17T11:50:53.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.327+0000 7f267bfff700 1 -- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 msgr2=0x7f2670038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/832159067 2023-12-17T11:50:53.329 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.327+0000 7f267bfff700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 0x7f2670038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:50:53.402 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.400+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2684110160 con 0x7f26840fc870 2023-12-17T11:50:53.403 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.401+0000 7f267affd700 1 -- 172.21.15.119:0/4018515695 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f2674011b60 con 0x7f26840fc870 2023-12-17T11:50:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:53.403 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 msgr2=0x7f2670038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:50:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 0x7f2670038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 msgr2=0x7f268410ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f268410ed30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f267400b690 tx=0x7f2674009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 shutdown_connections 2023-12-17T11:50:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f2670036720 0x7f2670038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 --2- 172.21.15.119:0/4018515695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26840fc870 0x7f268410ed30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 >> 172.21.15.119:0/4018515695 conn(0x7f26840f7f50 msgr2=0x7f268406fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 shutdown_connections 2023-12-17T11:50:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:53.403+0000 7f2688e6e700 1 -- 172.21.15.119:0/4018515695 wait complete. 2023-12-17T11:50:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:53.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:53 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/4018515695' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:54.770 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:54.770 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:55.177 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:55.266 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/95115285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 msgr2=0x7f6c040fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 --2- 172.21.15.119:0/95115285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c040fcc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40048c0 tx=0x7f6bf4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/95115285 shutdown_connections 2023-12-17T11:50:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 --2- 172.21.15.119:0/95115285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c040fcc80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:56.389 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/95115285 >> 172.21.15.119:0/95115285 conn(0x7f6c040f7f50 msgr2=0x7f6c040fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:56.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/95115285 shutdown_connections 2023-12-17T11:50:56.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.386+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/95115285 wait complete. 2023-12-17T11:50:56.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.387+0000 7f6c0a2ba700 1 Processor -- start 2023-12-17T11:50:56.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.387+0000 7f6c0a2ba700 1 -- start start 2023-12-17T11:50:56.390 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.388+0000 7f6c0a2ba700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c0410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:56.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.388+0000 7f6c0a2ba700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0410f280 con 0x7f6c040fc870 2023-12-17T11:50:56.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.388+0000 7f6c03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c0410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:56.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.388+0000 7f6c03fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c0410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:39124/0 (socket says 172.21.15.119:39124) 2023-12-17T11:50:56.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.388+0000 7f6c03fff700 1 -- 172.21.15.119:0/3151166962 learned_addr learned my addr 172.21.15.119:0/3151166962 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:56.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.388+0000 7f6c03fff700 1 -- 172.21.15.119:0/3151166962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4005040 con 0x7f6c040fc870 2023-12-17T11:50:56.391 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.389+0000 7f6c03fff700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c0410ed40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b690 tx=0x7f6bf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.389+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bf4009650 con 0x7f6c040fc870 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.389+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0410f480 con 0x7f6c040fc870 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.389+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bf40097b0 con 0x7f6c040fc870 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.389+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6bf401c5d0 con 0x7f6c040fc870 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.389+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0410ffe0 con 0x7f6c040fc870 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.390+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 43350+0+0 (secure 0 0 0) 0x7f6bf40139d0 con 0x7f6c040fc870 2023-12-17T11:50:56.392 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.390+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0404bb80 con 0x7f6c040fc870 2023-12-17T11:50:56.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.391+0000 7f6c00ff9700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 0x7f6bec038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:56.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.391+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6bf4049a20 con 0x7f6c040fc870 2023-12-17T11:50:56.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.391+0000 7f6c037fe700 1 -- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 msgr2=0x7f6bec038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/832159067 2023-12-17T11:50:56.393 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.391+0000 7f6c037fe700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 0x7f6bec038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:50:56.398 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.396+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6bf4025400 con 0x7f6c040fc870 2023-12-17T11:50:56.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.592+0000 7f6c037fe700 1 -- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 msgr2=0x7f6bec038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/832159067 2023-12-17T11:50:56.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.592+0000 7f6c037fe700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 0x7f6bec038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:50:56.665 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.663+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c04110e60 con 0x7f6c040fc870 2023-12-17T11:50:56.666 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.664+0000 7f6c00ff9700 1 -- 172.21.15.119:0/3151166962 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f6bf4011b60 con 0x7f6c040fc870 2023-12-17T11:50:56.666 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:56.666 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:56.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 msgr2=0x7f6bec038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:50:56.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 0x7f6bec038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:56.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 msgr2=0x7f6c0410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:56.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c0410ed40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400b690 tx=0x7f6bf4009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:56.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 shutdown_connections 2023-12-17T11:50:56.668 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7f6bec036770 0x7f6bec038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:56.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 --2- 172.21.15.119:0/3151166962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c040fc870 0x7f6c0410ed40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:56.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 >> 172.21.15.119:0/3151166962 conn(0x7f6c040f7f50 msgr2=0x7f6c040f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:56.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 shutdown_connections 2023-12-17T11:50:56.669 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:56.666+0000 7f6c0a2ba700 1 -- 172.21.15.119:0/3151166962 wait complete. 2023-12-17T11:50:56.669 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:50:56.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:50:56 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/3151166962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:50:58.024 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:50:58.025 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:50:58.439 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:58.526 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:50:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 -- 172.21.15.119:0/391992650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 msgr2=0x7faee00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 --2- 172.21.15.119:0/391992650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee00fcc80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faedc0048c0 tx=0x7faedc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:59.640 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 -- 172.21.15.119:0/391992650 shutdown_connections 2023-12-17T11:50:59.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 --2- 172.21.15.119:0/391992650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee00fcc80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:59.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 -- 172.21.15.119:0/391992650 >> 172.21.15.119:0/391992650 conn(0x7faee00f7f50 msgr2=0x7faee00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:59.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 -- 172.21.15.119:0/391992650 shutdown_connections 2023-12-17T11:50:59.641 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.638+0000 7faee7620700 1 -- 172.21.15.119:0/391992650 wait complete. 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.639+0000 7faee7620700 1 Processor -- start 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.639+0000 7faee7620700 1 -- start start 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.639+0000 7faee7620700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee010ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.639+0000 7faee7620700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee010f280 con 0x7faee00fc870 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee53bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee010ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee53bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee010ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:39136/0 (socket says 172.21.15.119:39136) 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee53bc700 1 -- 172.21.15.119:0/2196575956 learned_addr learned my addr 172.21.15.119:0/2196575956 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee53bc700 1 -- 172.21.15.119:0/2196575956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc005040 con 0x7faee00fc870 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee53bc700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee010ed40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faedc00b690 tx=0x7faedc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:59.643 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faedc009650 con 0x7faee00fc870 2023-12-17T11:50:59.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee010f480 con 0x7faee00fc870 2023-12-17T11:50:59.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faedc0097b0 con 0x7faee00fc870 2023-12-17T11:50:59.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faedc01c5d0 con 0x7faee00fc870 2023-12-17T11:50:59.644 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.640+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee010ffe0 con 0x7faee00fc870 2023-12-17T11:50:59.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.642+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee004bb80 con 0x7faee00fc870 2023-12-17T11:50:59.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.642+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) v1 ==== 43350+0+0 (secure 0 0 0) 0x7faedc0139d0 con 0x7faee00fc870 2023-12-17T11:50:59.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.642+0000 7faed5ffb700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 0x7faecc038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:59.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.642+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7faedc049aa0 con 0x7faee00fc870 2023-12-17T11:50:59.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.642+0000 7faee4bbb700 1 -- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 msgr2=0x7faecc038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/832159067 2023-12-17T11:50:59.645 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.642+0000 7faee4bbb700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 0x7faecc038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:50:59.653 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.651+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faedc025400 con 0x7faee00fc870 2023-12-17T11:50:59.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.843+0000 7faee4bbb700 1 -- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 msgr2=0x7faecc038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/832159067 2023-12-17T11:50:59.845 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.843+0000 7faee4bbb700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 0x7faecc038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:50:59.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.918+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7faee0110170 con 0x7faee00fc870 2023-12-17T11:50:59.920 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.918+0000 7faed5ffb700 1 -- 172.21.15.119:0/2196575956 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7faedc011b60 con 0x7faee00fc870 2023-12-17T11:50:59.921 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:50:59.921 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:50:59.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 msgr2=0x7faecc038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:50:59.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 0x7faecc038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:59.923 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 msgr2=0x7faee010ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee010ed40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faedc00b690 tx=0x7faedc009e30 comp rx=0 tx=0).stop 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 shutdown_connections 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:6800/832159067,v1:172.21.15.2:6801/832159067] conn(0x7faecc036720 0x7faecc038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 --2- 172.21.15.119:0/2196575956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee00fc870 0x7faee010ed40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 >> 172.21.15.119:0/2196575956 conn(0x7faee00f7f50 msgr2=0x7faee006fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 shutdown_connections 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:50:59.921+0000 7faee7620700 1 -- 172.21.15.119:0/2196575956 wait complete. 2023-12-17T11:50:59.924 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:00.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2196575956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:00.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: osdmap e5: 0 total, 0 up, 0 in 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: mgrmap e15: smithi002.cqnuqs(active, starting, since 0.00341848s) 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:51:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:51:01.290 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:01.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:01.721 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:51:01.827 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:51:01.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: [17/Dec/2023:11:51:00] ENGINE Bus STARTING 2023-12-17T11:51:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: [17/Dec/2023:11:51:00] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T11:51:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: [17/Dec/2023:11:51:00] ENGINE Bus STARTED 2023-12-17T11:51:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: mgrmap e16: smithi002.cqnuqs(active, since 1.00621s) 2023-12-17T11:51:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:01 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 -- 172.21.15.119:0/235462961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 msgr2=0x7fc32c06ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 --2- 172.21.15.119:0/235462961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c06ffd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0048c0 tx=0x7fc31c009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:03.039 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 -- 172.21.15.119:0/235462961 shutdown_connections 2023-12-17T11:51:03.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 --2- 172.21.15.119:0/235462961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c06ffd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:03.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 -- 172.21.15.119:0/235462961 >> 172.21.15.119:0/235462961 conn(0x7fc32c0f7d70 msgr2=0x7fc32c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:03.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 -- 172.21.15.119:0/235462961 shutdown_connections 2023-12-17T11:51:03.040 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.037+0000 7fc3310fb700 1 -- 172.21.15.119:0/235462961 wait complete. 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.038+0000 7fc3310fb700 1 Processor -- start 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.038+0000 7fc3310fb700 1 -- start start 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.038+0000 7fc3310fb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c10ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.038+0000 7fc3310fb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c10efc0 con 0x7fc32c071b60 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.039+0000 7fc32bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c10ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.039+0000 7fc32bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c10ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:34784/0 (socket says 172.21.15.119:34784) 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.039+0000 7fc32bfff700 1 -- 172.21.15.119:0/3722394332 learned_addr learned my addr 172.21.15.119:0/3722394332 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:03.041 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.039+0000 7fc32bfff700 1 -- 172.21.15.119:0/3722394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c005040 con 0x7fc32c071b60 2023-12-17T11:51:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.039+0000 7fc32bfff700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c10ea80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009040 tx=0x7fc31c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.040+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc31c009620 con 0x7fc32c071b60 2023-12-17T11:51:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.040+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc31c009780 con 0x7fc32c071b60 2023-12-17T11:51:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.040+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c10f1c0 con 0x7fc32c071b60 2023-12-17T11:51:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.040+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc31c01c5b0 con 0x7fc32c071b60 2023-12-17T11:51:03.042 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.040+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c10fe60 con 0x7fc32c071b60 2023-12-17T11:51:03.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.041+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 43392+0+0 (secure 0 0 0) 0x7fc31c01c820 con 0x7fc32c071b60 2023-12-17T11:51:03.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.041+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c05f270 con 0x7fc32c071b60 2023-12-17T11:51:03.043 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.042+0000 7fc328ff9700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc314036860 0x7fc314038d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:03.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.042+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc31c049a40 con 0x7fc32c071b60 2023-12-17T11:51:03.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.042+0000 7fc32b7fe700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc314036860 0x7fc314038d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:03.044 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.043+0000 7fc32b7fe700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc314036860 0x7fc314038d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc320009990 tx=0x7fc320006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:03.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.046+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc31c011dd0 con 0x7fc32c071b60 2023-12-17T11:51:03.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.380+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc32c1109b0 con 0x7fc32c071b60 2023-12-17T11:51:03.383 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.381+0000 7fc328ff9700 1 -- 172.21.15.119:0/3722394332 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fc31c01be90 con 0x7fc32c071b60 2023-12-17T11:51:03.384 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:03.384 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc314036860 msgr2=0x7fc314038d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc314036860 0x7fc314038d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc320009990 tx=0x7fc320006e40 comp rx=0 tx=0).stop 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 msgr2=0x7fc32c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c10ea80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009040 tx=0x7fc31c009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 shutdown_connections 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc314036860 0x7fc314038d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 --2- 172.21.15.119:0/3722394332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc32c071b60 0x7fc32c10ea80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 >> 172.21.15.119:0/3722394332 conn(0x7fc32c0f7d70 msgr2=0x7fc32c0f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 shutdown_connections 2023-12-17T11:51:03.386 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:03.384+0000 7fc3310fb700 1 -- 172.21.15.119:0/3722394332 wait complete. 2023-12-17T11:51:03.387 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:03.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:03 smithi002 ceph-mon[107131]: mgrmap e17: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:51:03.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:03.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:03 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/3722394332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:03.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:03.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:05.076 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:05.076 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:05.514 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:51:05.622 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:51:05.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:05.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:05.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:51:06.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.973+0000 7f61cc328700 1 -- 172.21.15.119:0/3828903398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 msgr2=0x7f61c40fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:06.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.973+0000 7f61cc328700 1 --2- 172.21.15.119:0/3828903398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c40fee90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61c00048c0 tx=0x7f61c0009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:06.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.974+0000 7f61cc328700 1 -- 172.21.15.119:0/3828903398 shutdown_connections 2023-12-17T11:51:06.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.974+0000 7f61cc328700 1 --2- 172.21.15.119:0/3828903398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c40fee90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:06.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.974+0000 7f61cc328700 1 -- 172.21.15.119:0/3828903398 >> 172.21.15.119:0/3828903398 conn(0x7f61c40fa250 msgr2=0x7f61c40fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:06.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.974+0000 7f61cc328700 1 -- 172.21.15.119:0/3828903398 shutdown_connections 2023-12-17T11:51:06.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.974+0000 7f61cc328700 1 -- 172.21.15.119:0/3828903398 wait complete. 2023-12-17T11:51:06.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.974+0000 7f61cc328700 1 Processor -- start 2023-12-17T11:51:06.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.975+0000 7f61cc328700 1 -- start start 2023-12-17T11:51:06.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.975+0000 7f61cc328700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:06.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.975+0000 7f61cc328700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c410f280 con 0x7f61c40fea80 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.975+0000 7f61ca0c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.975+0000 7f61ca0c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:34800/0 (socket says 172.21.15.119:34800) 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.975+0000 7f61ca0c4700 1 -- 172.21.15.119:0/929069236 learned_addr learned my addr 172.21.15.119:0/929069236 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61ca0c4700 1 -- 172.21.15.119:0/929069236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0005040 con 0x7f61c40fea80 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61ca0c4700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c410ed40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b690 tx=0x7f61c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61c0009650 con 0x7f61c40fea80 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61c00097b0 con 0x7f61c40fea80 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61c001c5d0 con 0x7f61c40fea80 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c410f480 con 0x7f61c40fea80 2023-12-17T11:51:06.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.976+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c410ffe0 con 0x7f61c40fea80 2023-12-17T11:51:06.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.977+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 43392+0+0 (secure 0 0 0) 0x7f61c00139d0 con 0x7f61c40fea80 2023-12-17T11:51:06.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.977+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c404bb80 con 0x7f61c40fea80 2023-12-17T11:51:06.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.978+0000 7f61baffd700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f61b0036810 0x7f61b0038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:06.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.978+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f61c0049af0 con 0x7f61c40fea80 2023-12-17T11:51:06.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.978+0000 7f61c98c3700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f61b0036810 0x7f61b0038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:06.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.979+0000 7f61c98c3700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f61b0036810 0x7f61b0038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009990 tx=0x7f61b4006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:06.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:06.988+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f61c0025400 con 0x7f61c40fea80 2023-12-17T11:51:07.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.271+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f61c4110e60 con 0x7f61c40fea80 2023-12-17T11:51:07.274 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.272+0000 7f61baffd700 1 -- 172.21.15.119:0/929069236 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f61c0011370 con 0x7f61c40fea80 2023-12-17T11:51:07.274 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:07.274 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:51:07.276 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.274+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f61b0036810 msgr2=0x7f61b0038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.274+0000 7f61cc328700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f61b0036810 0x7f61b0038cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009990 tx=0x7f61b4006e40 comp rx=0 tx=0).stop 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.274+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 msgr2=0x7f61c410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.274+0000 7f61cc328700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c410ed40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f61c000b690 tx=0x7f61c0009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.275+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 shutdown_connections 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.275+0000 7f61cc328700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f61b0036810 0x7f61b0038cc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.275+0000 7f61cc328700 1 --2- 172.21.15.119:0/929069236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61c40fea80 0x7f61c410ed40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.275+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 >> 172.21.15.119:0/929069236 conn(0x7f61c40fa250 msgr2=0x7f61c40fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.275+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 shutdown_connections 2023-12-17T11:51:07.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:07.275+0000 7f61cc328700 1 -- 172.21.15.119:0/929069236 wait complete. 2023-12-17T11:51:07.278 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:07.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:07.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:07.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:07.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:07.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:07 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/929069236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:08.655 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:08.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:08.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:08 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:08.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:08 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:51:08.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:08 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:51:09.083 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.274+0000 7f934f933700 1 -- 172.21.15.119:0/1740662086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 msgr2=0x7f9348102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.274+0000 7f934f933700 1 --2- 172.21.15.119:0/1740662086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348102ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93440048c0 tx=0x7f9344009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.274+0000 7f934f933700 1 -- 172.21.15.119:0/1740662086 shutdown_connections 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.274+0000 7f934f933700 1 --2- 172.21.15.119:0/1740662086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348102ca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.274+0000 7f934f933700 1 -- 172.21.15.119:0/1740662086 >> 172.21.15.119:0/1740662086 conn(0x7f93480f8410 msgr2=0x7f93480fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.274+0000 7f934f933700 1 -- 172.21.15.119:0/1740662086 shutdown_connections 2023-12-17T11:51:10.277 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.276+0000 7f934f933700 1 -- 172.21.15.119:0/1740662086 wait complete. 2023-12-17T11:51:10.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.276+0000 7f934f933700 1 Processor -- start 2023-12-17T11:51:10.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.276+0000 7f934f933700 1 -- start start 2023-12-17T11:51:10.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.277+0000 7f934f933700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:10.278 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.277+0000 7f934f933700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481130a0 con 0x7f93481028d0 2023-12-17T11:51:10.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.277+0000 7f934d6cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:10.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.277+0000 7f934d6cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:44774/0 (socket says 172.21.15.119:44774) 2023-12-17T11:51:10.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.277+0000 7f934d6cf700 1 -- 172.21.15.119:0/2127359161 learned_addr learned my addr 172.21.15.119:0/2127359161 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:10.279 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.277+0000 7f934d6cf700 1 -- 172.21.15.119:0/2127359161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344005040 con 0x7f93481028d0 2023-12-17T11:51:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.278+0000 7f934d6cf700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348112b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9344009040 tx=0x7f9344009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.278+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9344004e60 con 0x7f93481028d0 2023-12-17T11:51:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.278+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9344009650 con 0x7f93481028d0 2023-12-17T11:51:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.278+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93481132a0 con 0x7f93481028d0 2023-12-17T11:51:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.278+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934401c3f0 con 0x7f93481028d0 2023-12-17T11:51:10.280 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.278+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934810ca20 con 0x7f93481028d0 2023-12-17T11:51:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.279+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 43392+0+0 (secure 0 0 0) 0x7f9344013420 con 0x7f93481028d0 2023-12-17T11:51:10.281 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.279+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934805f270 con 0x7f93481028d0 2023-12-17T11:51:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.280+0000 7f933dffb700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f93340367c0 0x7f9334038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.280+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9344049a10 con 0x7f93481028d0 2023-12-17T11:51:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.280+0000 7f934cece700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f93340367c0 0x7f9334038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:10.282 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.281+0000 7f934cece700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f93340367c0 0x7f9334038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9338009990 tx=0x7f9338006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:10.287 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.285+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9344011960 con 0x7f93481028d0 2023-12-17T11:51:10.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:51:10.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:51:10.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:10.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:10.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:10.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:10.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:10.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:51:10.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-17T11:51:10.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:10.593 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.591+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f934810e140 con 0x7f93481028d0 2023-12-17T11:51:10.594 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.592+0000 7f933dffb700 1 -- 172.21.15.119:0/2127359161 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f9344023560 con 0x7f93481028d0 2023-12-17T11:51:10.594 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:10.594 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f93340367c0 msgr2=0x7f9334038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f93340367c0 0x7f9334038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9338009990 tx=0x7f9338006e40 comp rx=0 tx=0).stop 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 msgr2=0x7f9348112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348112b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9344009040 tx=0x7f9344009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 shutdown_connections 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f93340367c0 0x7f9334038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 --2- 172.21.15.119:0/2127359161 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93481028d0 0x7f9348112b60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 >> 172.21.15.119:0/2127359161 conn(0x7f93480f8410 msgr2=0x7f93480fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 shutdown_connections 2023-12-17T11:51:10.597 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:10.595+0000 7f934f933700 1 -- 172.21.15.119:0/2127359161 wait complete. 2023-12-17T11:51:10.598 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:11.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:11 smithi002 ceph-mon[107131]: Deploying daemon crash.smithi119 on smithi119 2023-12-17T11:51:11.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:11 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2127359161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:12.147 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:12.147 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:12.592 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:13.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.849+0000 7f1a36cd0700 1 -- 172.21.15.119:0/234176665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 msgr2=0x7f1a300703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:13.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.849+0000 7f1a36cd0700 1 --2- 172.21.15.119:0/234176665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a300703b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1a240048c0 tx=0x7f1a24009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:13.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.850+0000 7f1a36cd0700 1 -- 172.21.15.119:0/234176665 shutdown_connections 2023-12-17T11:51:13.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.850+0000 7f1a36cd0700 1 --2- 172.21.15.119:0/234176665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a300703b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:13.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.850+0000 7f1a36cd0700 1 -- 172.21.15.119:0/234176665 >> 172.21.15.119:0/234176665 conn(0x7f1a300f8410 msgr2=0x7f1a300fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:13.852 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.850+0000 7f1a36cd0700 1 -- 172.21.15.119:0/234176665 shutdown_connections 2023-12-17T11:51:13.853 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.850+0000 7f1a36cd0700 1 -- 172.21.15.119:0/234176665 wait complete. 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.850+0000 7f1a36cd0700 1 Processor -- start 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.851+0000 7f1a36cd0700 1 -- start start 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.851+0000 7f1a36cd0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a30114da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.851+0000 7f1a36cd0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a301152e0 con 0x7f1a3006ffe0 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.851+0000 7f1a34a6c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a30114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.851+0000 7f1a34a6c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a30114da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:44806/0 (socket says 172.21.15.119:44806) 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.851+0000 7f1a34a6c700 1 -- 172.21.15.119:0/1256308379 learned_addr learned my addr 172.21.15.119:0/1256308379 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.852+0000 7f1a34a6c700 1 -- 172.21.15.119:0/1256308379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24005040 con 0x7f1a3006ffe0 2023-12-17T11:51:13.854 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.852+0000 7f1a34a6c700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a30114da0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009300 tx=0x7f1a24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:13.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.852+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a24004e60 con 0x7f1a3006ffe0 2023-12-17T11:51:13.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.852+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a24013420 con 0x7f1a3006ffe0 2023-12-17T11:51:13.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.852+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a301154e0 con 0x7f1a3006ffe0 2023-12-17T11:51:13.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.852+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1a2401c5b0 con 0x7f1a3006ffe0 2023-12-17T11:51:13.855 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.853+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a30115950 con 0x7f1a3006ffe0 2023-12-17T11:51:13.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.854+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 43392+0+0 (secure 0 0 0) 0x7f1a24009600 con 0x7f1a3006ffe0 2023-12-17T11:51:13.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.854+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3005f270 con 0x7f1a3006ffe0 2023-12-17T11:51:13.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.854+0000 7f1a2d7fa700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1a20036810 0x7f1a20038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:13.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.854+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1a240498c0 con 0x7f1a3006ffe0 2023-12-17T11:51:13.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.854+0000 7f1a2ffff700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1a20036810 0x7f1a20038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:13.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.855+0000 7f1a2ffff700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1a20036810 0x7f1a20038cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009990 tx=0x7f1a1c006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:13.861 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:13.859+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1a24011960 con 0x7f1a3006ffe0 2023-12-17T11:51:14.167 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.164+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1a30108c80 con 0x7f1a3006ffe0 2023-12-17T11:51:14.168 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.166+0000 7f1a2d7fa700 1 -- 172.21.15.119:0/1256308379 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f1a24011370 con 0x7f1a3006ffe0 2023-12-17T11:51:14.168 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:14.168 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1a20036810 msgr2=0x7f1a20038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1a20036810 0x7f1a20038cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009990 tx=0x7f1a1c006e40 comp rx=0 tx=0).stop 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 msgr2=0x7f1a30114da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a30114da0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009300 tx=0x7f1a24009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 shutdown_connections 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1a20036810 0x7f1a20038cc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:14.174 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 --2- 172.21.15.119:0/1256308379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a3006ffe0 0x7f1a30114da0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:14.175 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 >> 172.21.15.119:0/1256308379 conn(0x7f1a300f8410 msgr2=0x7f1a301033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:14.175 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 shutdown_connections 2023-12-17T11:51:14.175 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:14.170+0000 7f1a36cd0700 1 -- 172.21.15.119:0/1256308379 wait complete. 2023-12-17T11:51:14.175 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:14.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:14 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:14.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:14 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:14.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:14 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:14.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:14 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:14.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:14 smithi002 ceph-mon[107131]: Deploying daemon node-exporter.smithi119 on smithi119 2023-12-17T11:51:14.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:14 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/1256308379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:15.584 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:15.584 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:16 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:16 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:16.499 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:18.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.139+0000 7f0b22708700 1 -- 172.21.15.119:0/1756721333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 msgr2=0x7f0b1c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:18.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.139+0000 7f0b22708700 1 --2- 172.21.15.119:0/1756721333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c0703b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0048c0 tx=0x7f0b0c009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:18.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.140+0000 7f0b22708700 1 -- 172.21.15.119:0/1756721333 shutdown_connections 2023-12-17T11:51:18.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.140+0000 7f0b22708700 1 --2- 172.21.15.119:0/1756721333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c0703b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:18.142 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.140+0000 7f0b22708700 1 -- 172.21.15.119:0/1756721333 >> 172.21.15.119:0/1756721333 conn(0x7f0b1c0f8410 msgr2=0x7f0b1c0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:18.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.140+0000 7f0b22708700 1 -- 172.21.15.119:0/1756721333 shutdown_connections 2023-12-17T11:51:18.143 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.140+0000 7f0b22708700 1 -- 172.21.15.119:0/1756721333 wait complete. 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.140+0000 7f0b22708700 1 Processor -- start 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.141+0000 7f0b22708700 1 -- start start 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.141+0000 7f0b22708700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c114da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.141+0000 7f0b22708700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c1152e0 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.141+0000 7f0b1bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.141+0000 7f0b1bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c114da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:44818/0 (socket says 172.21.15.119:44818) 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.141+0000 7f0b1bfff700 1 -- 172.21.15.119:0/2767741272 learned_addr learned my addr 172.21.15.119:0/2767741272 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.142+0000 7f0b1bfff700 1 -- 172.21.15.119:0/2767741272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c005040 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.142+0000 7f0b1bfff700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c114da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009040 tx=0x7f0b0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:18.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.142+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b0c004e60 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.142+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b0c009650 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.142+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c1154e0 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.142+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0b0c01c3f0 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.145 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.143+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c115950 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.144+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c05f270 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.144+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 43392+0+0 (secure 0 0 0) 0x7f0b0c0097c0 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.144+0000 7f0b18ff9700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f0b040367c0 0x7f0b04038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.144+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0b0c049a50 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.145+0000 7f0b1b7fe700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f0b040367c0 0x7f0b04038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:18.147 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.145+0000 7f0b1b7fe700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f0b040367c0 0x7f0b04038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009990 tx=0x7f0b10006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:18.152 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.150+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0b0c011550 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.438+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0b1c108c80 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.440 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.438+0000 7f0b18ff9700 1 -- 172.21.15.119:0/2767741272 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f0b0c011370 con 0x7f0b1c06ffe0 2023-12-17T11:51:18.440 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:18.441 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:51:18.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f0b040367c0 msgr2=0x7f0b04038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:18.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f0b040367c0 0x7f0b04038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009990 tx=0x7f0b10006e40 comp rx=0 tx=0).stop 2023-12-17T11:51:18.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 msgr2=0x7f0b1c114da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:18.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c114da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009040 tx=0x7f0b0c009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:18.443 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 shutdown_connections 2023-12-17T11:51:18.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f0b040367c0 0x7f0b04038c70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:18.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 --2- 172.21.15.119:0/2767741272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b1c06ffe0 0x7f0b1c114da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:18.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 >> 172.21.15.119:0/2767741272 conn(0x7f0b1c0f8410 msgr2=0x7f0b1c1033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:18.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 shutdown_connections 2023-12-17T11:51:18.444 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:18.441+0000 7f0b22708700 1 -- 172.21.15.119:0/2767741272 wait complete. 2023-12-17T11:51:18.444 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:18.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: Deploying daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:51:18.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:18 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2767741272' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:20.119 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:20.119 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:20.596 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:21.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:21.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:21 smithi002 ceph-mon[107131]: Deploying daemon mon.smithi119 on smithi119 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 -- 172.21.15.119:0/2613587889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 msgr2=0x7fefe8102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 --2- 172.21.15.119:0/2613587889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8102ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0048c0 tx=0x7fefdc009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 -- 172.21.15.119:0/2613587889 shutdown_connections 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 --2- 172.21.15.119:0/2613587889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8102ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 -- 172.21.15.119:0/2613587889 >> 172.21.15.119:0/2613587889 conn(0x7fefe80f8410 msgr2=0x7fefe80fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 -- 172.21.15.119:0/2613587889 shutdown_connections 2023-12-17T11:51:22.154 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.151+0000 7fefeeda2700 1 -- 172.21.15.119:0/2613587889 wait complete. 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.152+0000 7fefeeda2700 1 Processor -- start 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.152+0000 7fefeeda2700 1 -- start start 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.153+0000 7fefeeda2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8114ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.153+0000 7fefeeda2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8115400 con 0x7fefe81028d0 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.153+0000 7fefecb3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8114ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.153+0000 7fefecb3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8114ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:42332/0 (socket says 172.21.15.119:42332) 2023-12-17T11:51:22.155 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.153+0000 7fefecb3e700 1 -- 172.21.15.119:0/3095965113 learned_addr learned my addr 172.21.15.119:0/3095965113 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.153+0000 7fefecb3e700 1 -- 172.21.15.119:0/3095965113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc005040 con 0x7fefe81028d0 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.154+0000 7fefecb3e700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8114ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009300 tx=0x7fefdc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.154+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefdc004e60 con 0x7fefe81028d0 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.154+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe8115600 con 0x7fefe81028d0 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.154+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefdc013420 con 0x7fefe81028d0 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.154+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefdc01c5b0 con 0x7fefe81028d0 2023-12-17T11:51:22.156 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.154+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe8115a70 con 0x7fefe81028d0 2023-12-17T11:51:22.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.155+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe805f270 con 0x7fefe81028d0 2023-12-17T11:51:22.157 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.156+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) v1 ==== 43392+0+0 (secure 0 0 0) 0x7fefdc009600 con 0x7fefe81028d0 2023-12-17T11:51:22.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.156+0000 7fefe57fa700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefd80367c0 0x7fefd8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:22.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.156+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fefdc0498f0 con 0x7fefe81028d0 2023-12-17T11:51:22.158 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.156+0000 7fefe7fff700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefd80367c0 0x7fefd8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:22.159 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.157+0000 7fefe7fff700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefd80367c0 0x7fefd8038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009990 tx=0x7fefd4006e40 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:22.164 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.162+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fefdc011960 con 0x7fefe81028d0 2023-12-17T11:51:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.454+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fefe8110530 con 0x7fefe81028d0 2023-12-17T11:51:22.457 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.455+0000 7fefe57fa700 1 -- 172.21.15.119:0/3095965113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fefdc011370 con 0x7fefe81028d0 2023-12-17T11:51:22.457 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:22.457 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":1,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:48:47.821715Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.457+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefd80367c0 msgr2=0x7fefd8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.457+0000 7fefeeda2700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefd80367c0 0x7fefd8038c70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009990 tx=0x7fefd4006e40 comp rx=0 tx=0).stop 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.457+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 msgr2=0x7fefe8114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.457+0000 7fefeeda2700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8114ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009300 tx=0x7fefdc009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.458+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 shutdown_connections 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.458+0000 7fefeeda2700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefd80367c0 0x7fefd8038c70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.458+0000 7fefeeda2700 1 --2- 172.21.15.119:0/3095965113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefe81028d0 0x7fefe8114ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.458+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 >> 172.21.15.119:0/3095965113 conn(0x7fefe80f8410 msgr2=0x7fefe80fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.458+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 shutdown_connections 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:22.458+0000 7fefeeda2700 1 -- 172.21.15.119:0/3095965113 wait complete. 2023-12-17T11:51:22.460 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 1 2023-12-17T11:51:23.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:23 smithi002 ceph-mon[107131]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:23.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:23 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/3095965113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:23.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 systemd[1]: Starting Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:51:23.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 bash[117374]: 755b61effb85db1244e0f78deb276c4a2498f57bb7598be5660b8d7a2b809634 2023-12-17T11:51:23.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: set uid:gid to 167:167 (ceph:ceph) 2023-12-17T11:51:23.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable), process ceph-mon, pid 7 2023-12-17T11:51:23.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pidfile_write: ignore empty --pid-file 2023-12-17T11:51:23.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 systemd[1]: Started Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:51:23.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: load: jerasure load: lrc 2023-12-17T11:51:24.075 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-17T11:51:24.076 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:51:24.141 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: RocksDB version: 6.15.5 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Compile date Dec 13 2023 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: DB SUMMARY 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: DB Session ID: 301YEQLQ2ITAPQSC6UOJ 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: CURRENT file: CURRENT 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: IDENTITY file: IDENTITY 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi119/store.db dir, Total Num: 0, files: 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi119/store.db: 000004.log size: 511 ; 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.error_if_exists: 0 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.create_if_missing: 0 2023-12-17T11:51:24.142 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.paranoid_checks: 1 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.env: 0x556a0fd21a80 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.fs: Posix File System 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.info_log: 0x556a10752780 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_file_opening_threads: 16 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.statistics: (nil) 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.use_fsync: 0 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_log_file_size: 0 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.keep_log_file_num: 1000 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.recycle_log_file_num: 0 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.allow_fallocate: 1 2023-12-17T11:51:24.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.allow_mmap_reads: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.allow_mmap_writes: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.use_direct_reads: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.create_missing_column_families: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.db_log_dir: 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi119/store.db 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.advise_random_on_open: 1 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.db_write_buffer_size: 0 2023-12-17T11:51:24.144 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.write_buffer_manager: 0x556a114c29f0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.rate_limiter: (nil) 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.wal_recovery_mode: 2 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.enable_thread_tracking: 0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.enable_pipelined_write: 0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.unordered_write: 0 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-17T11:51:24.145 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.row_cache: None 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.wal_filter: None 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.allow_ingest_behind: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.preserve_deletes: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.two_write_queues: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.manual_wal_flush: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.atomic_flush: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.log_readahead_size: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.best_efforts_recovery: 0 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-17T11:51:24.146 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-17T11:51:24.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.allow_data_in_errors: 0 2023-12-17T11:51:24.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.db_host_id: __hostname__ 2023-12-17T11:51:24.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_background_jobs: 2 2023-12-17T11:51:24.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_background_compactions: -1 2023-12-17T11:51:24.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_subcompactions: 1 2023-12-17T11:51:24.147 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_total_wal_size: 0 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_open_files: -1 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bytes_per_sync: 0 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-17T11:51:24.149 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_readahead_size: 0 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_background_flushes: -1 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Compression algorithms supported: 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kZSTD supported: 0 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kXpressCompression supported: 0 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kLZ4HCCompression supported: 1 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kZlibCompression supported: 1 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kSnappyCompression supported: 1 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kLZ4Compression supported: 1 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: kBZip2Compression supported: 0 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000003 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.merge_operator: 2023-12-17T11:51:24.150 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_filter: None 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_filter_factory: None 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.sst_partitioner_factory: None 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556a107a2f90) 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks: 1 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_top_level_index_and_filter: 1 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_type: 0 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_index_type: 0 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_shortening: 1 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: hash_index_allow_collision: 1 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: checksum: 1 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: no_block_cache: 0 2023-12-17T11:51:24.151 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache: 0x556a107d5090 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_name: BinnedLRUCache 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_options: 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: capacity : 536870912 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: num_shard_bits : 4 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: strict_capacity_limit : 0 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: high_pri_pool_ratio: 0.000 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_compressed: (nil) 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: persistent_cache: (nil) 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size: 4096 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size_deviation: 10 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_restart_interval: 16 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_block_restart_interval: 1 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: metadata_block_size: 4096 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: partition_filters: 0 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: use_delta_encoding: 1 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-17T11:51:24.152 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: whole_key_filtering: 1 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: verify_compression: 0 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: read_amp_bytes_per_bit: 0 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: format_version: 4 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_index_compression: 1 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_align: 0 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.write_buffer_size: 33554432 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_write_buffer_number: 2 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression: NoCompression 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression: Disabled 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.prefix_extractor: nullptr 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.num_levels: 7 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-17T11:51:24.153 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.level: 32767 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.strategy: 0 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compression_opts.enabled: false 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-17T11:51:24.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.target_file_size_base: 67108864 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.arena_block_size: 4194304 2023-12-17T11:51:24.155 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.disable_auto_compactions: 0 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.table_properties_collectors: 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.inplace_update_support: 0 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-17T11:51:24.156 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.bloom_locality: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.max_successive_merges: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.paranoid_file_checks: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.force_consistency_checks: 1 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.report_bg_io_stats: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.ttl: 2592000 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.enable_blob_files: false 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.min_blob_size: 0 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.blob_file_size: 268435456 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-17T11:51:24.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702813883827740, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702813883828579, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1702813883, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "5d5537b4-a78c-43e0-b2d7-e9dc98753760", "db_session_id": "301YEQLQ2ITAPQSC6UOJ"}} 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702813883829491, "job": 1, "event": "recovery_finished"} 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi119/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x556a10769180 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: DB pointer 0x556a1083e000 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-17T11:51:24.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** DB Stats ** 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T11:51:24.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T11:51:24.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative compaction: 0.00 GB write, 0.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119 does not exist in monmap, will attempt to join an existing cluster 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: using public_addr v2:172.21.15.119:0/0 -> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: starting mon.smithi119 rank -1 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi119 fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(???) e0 preinit fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).mds e1 new map 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).mds e1 print_map 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: e1 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T11:51:24.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: legacy client fscid: -1 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: No filesystems configured 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3051558798' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-17T11:51:24.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3051558798' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Deploying daemon grafana.smithi002 on smithi002 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Saving service mon spec with placement smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119;count:2 2023-12-17T11:51:24.164 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/76864656' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/396916159' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/1183323884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2693544868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/927396805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2223803588' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.165 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/659689069' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Deploying daemon prometheus.smithi002 on smithi002 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/666809668' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/1179625933' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.166 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/884874625' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14164 172.21.15.2:0/2607471871' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mgrmap e14: smithi002.cqnuqs(active, since 59s) 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/4018515695' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/3151166962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2196575956' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: osdmap e5: 0 total, 0 up, 0 in 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mgrmap e15: smithi002.cqnuqs(active, starting, since 0.00341848s) 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:51:24.167 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: [17/Dec/2023:11:51:00] ENGINE Bus STARTING 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: [17/Dec/2023:11:51:00] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: [17/Dec/2023:11:51:00] ENGINE Bus STARTED 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mgrmap e16: smithi002.cqnuqs(active, since 1.00621s) 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.168 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mgrmap e17: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/3722394332' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:51:24.169 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/929069236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-17T11:51:24.170 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Deploying daemon crash.smithi119 on smithi119 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2127359161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Deploying daemon node-exporter.smithi119 on smithi119 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/1256308379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:51:24.171 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Deploying daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2767741272' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: Deploying daemon mon.smithi119 on smithi119 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/3095965113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: mon.smithi119@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-17T11:51:24.172 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expand map: {default=false} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta from 'false' to 'false' 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expanded map: {default=false} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expand map: {default=info} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta from 'info' to 'info' 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expanded map: {default=info} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expand map: {default=daemon} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta from 'daemon' to 'daemon' 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expanded map: {default=daemon} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expand map: {default=debug} 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta from 'debug' to 'debug' 2023-12-17T11:51:24.173 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:23 smithi119 ceph-mon[117414]: expand_channel_meta expanded map: {default=debug} 2023-12-17T11:51:24.494 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: mon.smithi002 calling monitor election 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: mon.smithi119 calling monitor election 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: mon.smithi002 is new leader, mons smithi002,smithi119 in quorum (ranks 0,1) 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: fsmap 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: osdmap e5: 0 total, 0 up, 0 in 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: mgrmap e17: smithi002.cqnuqs(active, since 28s) 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: Standby manager daemon smithi119.nzblpy started 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:51:29.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: overall HEALTH_OK 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 -- 172.21.15.119:0/2856551516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 msgr2=0x7fd13c005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 --2- 172.21.15.119:0/2856551516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd13c005a00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd14c06ff10 tx=0x7fd14000b040 comp rx=0 tx=0).stop 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 -- 172.21.15.119:0/2856551516 shutdown_connections 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 --2- 172.21.15.119:0/2856551516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd13c005a00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 -- 172.21.15.119:0/2856551516 >> 172.21.15.119:0/2856551516 conn(0x7fd14c0f8510 msgr2=0x7fd14c0fa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 -- 172.21.15.119:0/2856551516 shutdown_connections 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.182+0000 7fd152f2c700 1 -- 172.21.15.119:0/2856551516 wait complete. 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.183+0000 7fd152f2c700 1 Processor -- start 2023-12-17T11:51:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.183+0000 7fd152f2c700 1 -- start start 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.183+0000 7fd152f2c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd14c115050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.183+0000 7fd152f2c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 0x7fd14c10eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.183+0000 7fd152f2c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c115ba0 con 0x7fd13c003580 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.183+0000 7fd152f2c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c10f430 con 0x7fd14c115590 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd150cc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd14c115050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 0x7fd14c10eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd150cc8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd14c115050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.119:42416/0 (socket says 172.21.15.119:42416) 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd150cc8700 1 -- 172.21.15.119:0/745337132 learned_addr learned my addr 172.21.15.119:0/745337132 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd14bfff700 1 -- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 msgr2=0x7fd14c10eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd14bfff700 1 -- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 msgr2=0x7fd14c10eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd14bfff700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 0x7fd14c10eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd14bfff700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 0x7fd14c10eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd150cc8700 1 -- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 msgr2=0x7fd14c10eef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd150cc8700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 0x7fd14c10eef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.184+0000 7fd150cc8700 1 -- 172.21.15.119:0/745337132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140005040 con 0x7fd13c003580 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.185+0000 7fd150cc8700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd14c115050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd140008fd0 tx=0x7fd14000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.185+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1400094d0 con 0x7fd13c003580 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.185+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd14002b470 con 0x7fd13c003580 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.185+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c10f6b0 con 0x7fd13c003580 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.185+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd140009ae0 con 0x7fd13c003580 2023-12-17T11:51:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.185+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c10fbf0 con 0x7fd13c003580 2023-12-17T11:51:29.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.187+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c05f270 con 0x7fd13c003580 2023-12-17T11:51:29.189 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.187+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 86389+0+0 (secure 0 0 0) 0x7fd140028070 con 0x7fd13c003580 2023-12-17T11:51:29.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.188+0000 7fd1497fa700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd130069020 0x7fd13006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:29.190 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.189+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd1400881a0 con 0x7fd13c003580 2023-12-17T11:51:29.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.189+0000 7fd14bfff700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd130069020 0x7fd13006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:29.191 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.189+0000 7fd14bfff700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd130069020 0x7fd13006b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd138006f30 tx=0x7fd138008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:29.195 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.193+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd140059180 con 0x7fd13c003580 2023-12-17T11:51:29.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:51:29.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: mon.smithi002 calling monitor election 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: mon.smithi119 calling monitor election 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: mon.smithi002 is new leader, mons smithi002,smithi119 in quorum (ranks 0,1) 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: fsmap 2023-12-17T11:51:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: osdmap e5: 0 total, 0 up, 0 in 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: mgrmap e17: smithi002.cqnuqs(active, since 28s) 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: Standby manager daemon smithi119.nzblpy started 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: overall HEALTH_OK 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/709998810' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:29.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.478+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd14c1067b0 con 0x7fd13c003580 2023-12-17T11:51:29.480 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.478+0000 7fd1497fa700 1 -- 172.21.15.119:0/745337132 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7fd14001b090 con 0x7fd13c003580 2023-12-17T11:51:29.481 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-12-17T11:51:29.481 INFO:teuthology.orchestra.run.smithi119.stdout:{"epoch":2,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:51:23.873232Z","created":"2023-12-17T11:48:47.821715Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi002","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi119","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd130069020 msgr2=0x7fd13006b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd130069020 0x7fd13006b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd138006f30 tx=0x7fd138008040 comp rx=0 tx=0).stop 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 msgr2=0x7fd14c115050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd14c115050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd140008fd0 tx=0x7fd14000b040 comp rx=0 tx=0).stop 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 shutdown_connections 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd130069020 0x7fd13006b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd13c003580 0x7fd14c115050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:29.483 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 --2- 172.21.15.119:0/745337132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd14c115590 0x7fd14c10eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:29.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 >> 172.21.15.119:0/745337132 conn(0x7fd14c0f8510 msgr2=0x7fd14c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:29.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 shutdown_connections 2023-12-17T11:51:29.484 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:51:29.481+0000 7fd152f2c700 1 -- 172.21.15.119:0/745337132 wait complete. 2023-12-17T11:51:29.484 INFO:teuthology.orchestra.run.smithi119.stderr:dumped monmap epoch 2 2023-12-17T11:51:30.015 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-17T11:51:30.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-17T11:51:30.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:29 smithi119 ceph-mon[117414]: mgrmap e18: smithi002.cqnuqs(active, since 28s), standbys: smithi119.nzblpy 2023-12-17T11:51:30.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:29 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:51:30.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:29 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:30.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:29 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/745337132' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:30.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:29 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:30.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:29 smithi002 ceph-mon[107131]: mgrmap e18: smithi002.cqnuqs(active, since 28s), standbys: smithi119.nzblpy 2023-12-17T11:51:30.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:29 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:51:30.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:29 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:30.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:29 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/745337132' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:51:30.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:29 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:51:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:51:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:30 smithi119 ceph-mon[117414]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:31.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:30 smithi002 ceph-mon[107131]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:31.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.701+0000 7fe643b14700 1 -- 172.21.15.2:0/702027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 msgr2=0x7fe63c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.701+0000 7fe643b14700 1 --2- 172.21.15.2:0/702027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c104ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe638009c60 tx=0x7fe638004d10 comp rx=0 tx=0).stop 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.701+0000 7fe643b14700 1 -- 172.21.15.2:0/702027804 shutdown_connections 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.701+0000 7fe643b14700 1 --2- 172.21.15.2:0/702027804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c104ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.701+0000 7fe643b14700 1 -- 172.21.15.2:0/702027804 >> 172.21.15.2:0/702027804 conn(0x7fe63c0fa630 msgr2=0x7fe63c0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.702+0000 7fe643b14700 1 -- 172.21.15.2:0/702027804 shutdown_connections 2023-12-17T11:51:31.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.702+0000 7fe643b14700 1 -- 172.21.15.2:0/702027804 wait complete. 2023-12-17T11:51:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.703+0000 7fe643b14700 1 Processor -- start 2023-12-17T11:51:31.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.703+0000 7fe643b14700 1 -- start start 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe643b14700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c114f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe643b14700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c115440 0x7fe63c10ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe643b14700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c115a50 con 0x7fe63c104ad0 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe643b14700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c115bc0 con 0x7fe63c115440 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe6418b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c114f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe6418b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c114f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34976/0 (socket says 172.21.15.2:34976) 2023-12-17T11:51:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe6418b0700 1 -- 172.21.15.2:0/2643216811 learned_addr learned my addr 172.21.15.2:0/2643216811 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:51:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe6418b0700 1 -- 172.21.15.2:0/2643216811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c115440 msgr2=0x7fe63c10ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe6418b0700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c115440 0x7fe63c10ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.704+0000 7fe6418b0700 1 -- 172.21.15.2:0/2643216811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009940 con 0x7fe63c104ad0 2023-12-17T11:51:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.705+0000 7fe6418b0700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c114f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe63800bec0 tx=0x7fe638004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.705+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe63800e040 con 0x7fe63c104ad0 2023-12-17T11:51:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.705+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6380128c0 con 0x7fe63c104ad0 2023-12-17T11:51:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.705+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe63801c870 con 0x7fe63c104ad0 2023-12-17T11:51:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.705+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c10f3e0 con 0x7fe63c104ad0 2023-12-17T11:51:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.705+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c10f9a0 con 0x7fe63c104ad0 2023-12-17T11:51:31.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.706+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c05f270 con 0x7fe63c104ad0 2023-12-17T11:51:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.707+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 86389+0+0 (secure 0 0 0) 0x7fe638012a30 con 0x7fe63c104ad0 2023-12-17T11:51:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.708+0000 7fe6327fc700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe628069040 0x7fe62806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.708+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe638087b20 con 0x7fe63c104ad0 2023-12-17T11:51:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.709+0000 7fe6410af700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe628069040 0x7fe62806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.709+0000 7fe6410af700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe628069040 0x7fe62806b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009930 tx=0x7fe62c006de0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:31.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.713+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe6380550d0 con 0x7fe63c104ad0 2023-12-17T11:51:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.923+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe63c108c80 con 0x7fe63c104ad0 2023-12-17T11:51:31.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.923+0000 7fe6327fc700 1 -- 172.21.15.2:0/2643216811 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7fe6380200f0 con 0x7fe63c104ad0 2023-12-17T11:51:31.925 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:51:31.926 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2023-12-17T11:51:31.926 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:51:31.926 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe628069040 msgr2=0x7fe62806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe628069040 0x7fe62806b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009930 tx=0x7fe62c006de0 comp rx=0 tx=0).stop 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 msgr2=0x7fe63c114f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c114f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe63800bec0 tx=0x7fe638004d10 comp rx=0 tx=0).stop 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 shutdown_connections 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe628069040 0x7fe62806b4f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe63c104ad0 0x7fe63c114f00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 --2- 172.21.15.2:0/2643216811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c115440 0x7fe63c10ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 >> 172.21.15.2:0/2643216811 conn(0x7fe63c0fa630 msgr2=0x7fe63c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 shutdown_connections 2023-12-17T11:51:31.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:31.926+0000 7fe643b14700 1 -- 172.21.15.2:0/2643216811 wait complete. 2023-12-17T11:51:32.473 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-17T11:51:32.473 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:51:32.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:51:32.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:32 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2643216811' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:32.546 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:51:32.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:51:32.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:32.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:32.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:32.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:51:32.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:51:32.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:51:32.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:32 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2643216811' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:32.660 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:51:32.660 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2023-12-17T11:51:32.731 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:51:32.731 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:51:32.840 INFO:tasks.cephadm:Deploying OSDs... 2023-12-17T11:51:32.840 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:51:32.840 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:51:32.892 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:51:32.893 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2023-12-17T11:51:32.945 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:51:32.945 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:32.945 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-17T11:51:32.945 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:32.946 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:32.946 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-12-17 11:50:49.620637408 +0000 2023-12-17T11:51:32.946 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-12-17 11:42:24.303634215 +0000 2023-12-17T11:51:32.946 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-12-17 11:42:24.303634215 +0000 2023-12-17T11:51:32.946 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-12-17 11:42:24.279634745 +0000 2023-12-17T11:51:32.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:51:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-12-17T11:51:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-12-17T11:51:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000183683 s, 2.8 MB/s 2023-12-17T11:51:33.023 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:51:33.074 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-12-17 11:50:49.620637408 +0000 2023-12-17T11:51:33.122 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-12-17 11:42:25.166615161 +0000 2023-12-17T11:51:33.123 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-12-17 11:42:25.166615161 +0000 2023-12-17T11:51:33.123 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-12-17 11:42:25.146615602 +0000 2023-12-17T11:51:33.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:51:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-12-17T11:51:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-12-17T11:51:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000160884 s, 3.2 MB/s 2023-12-17T11:51:33.196 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:51:33.249 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2023-12-17T11:51:33.298 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:51:33.298 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:33.298 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-17T11:51:33.299 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:33.299 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:33.299 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-12-17 11:50:49.620637408 +0000 2023-12-17T11:51:33.299 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-12-17 11:42:26.024596217 +0000 2023-12-17T11:51:33.299 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-12-17 11:42:26.024596217 +0000 2023-12-17T11:51:33.299 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-12-17 11:42:25.998596791 +0000 2023-12-17T11:51:33.299 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:51:33.369 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-12-17T11:51:33.370 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-12-17T11:51:33.370 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000160522 s, 3.2 MB/s 2023-12-17T11:51:33.372 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:51:33.421 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-12-17 11:50:49.620637408 +0000 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-12-17 11:42:26.878577361 +0000 2023-12-17T11:51:33.469 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-12-17 11:42:26.878577361 +0000 2023-12-17T11:51:33.470 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-12-17 11:42:26.851577957 +0000 2023-12-17T11:51:33.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:51:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-12-17T11:51:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-12-17T11:51:33.538 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000178547 s, 2.9 MB/s 2023-12-17T11:51:33.540 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:51:33.589 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:51:33.589 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:51:33.640 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:51:33.640 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-12-17T11:51:33.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:51:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:51:33.689 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:33.689 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-17T11:51:33.689 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:33.690 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:33.690 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-17 11:51:23.167800463 +0000 2023-12-17T11:51:33.690 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-17 11:42:13.902478552 +0000 2023-12-17T11:51:33.690 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-17 11:42:13.902478552 +0000 2023-12-17T11:51:33.690 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-17 11:42:13.877479149 +0000 2023-12-17T11:51:33.690 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:51:33.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:33.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:51:33.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:51:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:33.798 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-17T11:51:33.798 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-17T11:51:33.798 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000280088 s, 1.8 MB/s 2023-12-17T11:51:33.800 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:51:33.848 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-12-17T11:51:33.894 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-17 11:51:23.167800463 +0000 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-17 11:42:14.734458664 +0000 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-17 11:42:14.734458664 +0000 2023-12-17T11:51:33.895 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-17 11:42:14.708459286 +0000 2023-12-17T11:51:33.895 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:51:34.001 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-17T11:51:34.002 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-17T11:51:34.002 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00027197 s, 1.9 MB/s 2023-12-17T11:51:34.004 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:51:34.052 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-17 11:51:23.167800463 +0000 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-17 11:42:15.567438817 +0000 2023-12-17T11:51:34.098 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-17 11:42:15.567438817 +0000 2023-12-17T11:51:34.099 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-17 11:42:15.543439387 +0000 2023-12-17T11:51:34.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:51:34.204 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-17T11:51:34.204 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-17T11:51:34.205 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.0002681 s, 1.9 MB/s 2023-12-17T11:51:34.207 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:51:34.255 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-12-17T11:51:34.300 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-12-17 11:51:23.167800463 +0000 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-17 11:42:16.411418745 +0000 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-17 11:42:16.411418745 +0000 2023-12-17T11:51:34.301 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-17 11:42:16.388419293 +0000 2023-12-17T11:51:34.301 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:51:34.407 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-12-17T11:51:34.408 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-12-17T11:51:34.408 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000272713 s, 1.9 MB/s 2023-12-17T11:51:34.410 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:51:34.458 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2023-12-17T11:51:34.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: Reconfiguring mon.smithi002 (unknown last config time)... 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: Reconfiguring daemon mon.smithi002 on smithi002 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:51:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: Reconfiguring mon.smithi002 (unknown last config time)... 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: Reconfiguring daemon mon.smithi002 on smithi002 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:51:34.675 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:35.196 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: Reconfiguring mgr.smithi002.cqnuqs (unknown last config time)... 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: Reconfiguring daemon mgr.smithi002.cqnuqs on smithi002 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:51:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:35.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: Reconfiguring mgr.smithi002.cqnuqs (unknown last config time)... 2023-12-17T11:51:35.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: Reconfiguring daemon mgr.smithi002.cqnuqs on smithi002 2023-12-17T11:51:35.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:35.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:35.696 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:35.697 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:51:35.697 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:36.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:36 smithi002 ceph-mon[107131]: Reconfiguring crash.smithi002 (monmap changed)... 2023-12-17T11:51:36.592 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:36 smithi002 ceph-mon[107131]: Reconfiguring daemon crash.smithi002 on smithi002 2023-12-17T11:51:36.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:36 smithi119 ceph-mon[117414]: Reconfiguring crash.smithi002 (monmap changed)... 2023-12-17T11:51:36.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:36 smithi119 ceph-mon[117414]: Reconfiguring daemon crash.smithi002 on smithi002 2023-12-17T11:51:37.328 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-17T11:51:37.328 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-17T11:51:37.328 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2023-12-17T11:51:37.328 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2023-12-17T11:51:37.328 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0588084 s, 178 MB/s 2023-12-17T11:51:37.328 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2023-12-17T11:51:37.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:37 smithi002 ceph-mon[107131]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:37.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:37 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:37.624 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:37 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:37.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:37 smithi119 ceph-mon[117414]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:37 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:37 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:38.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2023-12-17T11:51:38.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:38 smithi002 ceph-mon[107131]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2023-12-17T11:51:38.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:38 smithi002 ceph-mon[107131]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2023-12-17T11:51:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:38 smithi119 ceph-mon[117414]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2023-12-17T11:51:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:38 smithi119 ceph-mon[117414]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2023-12-17T11:51:38.878 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:51:39.645 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:39 smithi002 ceph-mon[107131]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:39.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:39 smithi119 ceph-mon[117414]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:40 smithi002 ceph-mon[107131]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.745+0000 7f958221f700 1 -- 172.21.15.2:0/3940778275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 msgr2=0x7f957c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.745+0000 7f958221f700 1 --2- 172.21.15.2:0/3940778275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c070030 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f956c004940 tx=0x7f956c009e30 comp rx=0 tx=0).stop 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.745+0000 7f958221f700 1 -- 172.21.15.2:0/3940778275 shutdown_connections 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.745+0000 7f958221f700 1 --2- 172.21.15.2:0/3940778275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f957c070570 0x7f957c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.745+0000 7f958221f700 1 --2- 172.21.15.2:0/3940778275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c070030 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.745+0000 7f958221f700 1 -- 172.21.15.2:0/3940778275 >> 172.21.15.2:0/3940778275 conn(0x7f957c0f82d0 msgr2=0x7f957c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.746+0000 7f958221f700 1 -- 172.21.15.2:0/3940778275 shutdown_connections 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.746+0000 7f958221f700 1 -- 172.21.15.2:0/3940778275 wait complete. 2023-12-17T11:51:40.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.746+0000 7f958221f700 1 Processor -- start 2023-12-17T11:51:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f958221f700 1 -- start start 2023-12-17T11:51:40.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f958221f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f957c070570 0x7f957c10f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f958221f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c10fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f958221f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c110420 con 0x7f957c071bc0 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f958221f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c110cc0 con 0x7f957c070570 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f957affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c10fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f957affd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c10fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51672/0 (socket says 172.21.15.2:51672) 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f957affd700 1 -- 172.21.15.2:0/195157087 learned_addr learned my addr 172.21.15.2:0/195157087 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.747+0000 7f957b7fe700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f957c070570 0x7f957c10f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f957affd700 1 -- 172.21.15.2:0/195157087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f957c070570 msgr2=0x7f957c10f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f957affd700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f957c070570 0x7f957c10f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f957affd700 1 -- 172.21.15.2:0/195157087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c005040 con 0x7f957c071bc0 2023-12-17T11:51:40.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f957affd700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c10fe20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f957000eb40 tx=0x7f957000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9570007cc0 con 0x7f957c071bc0 2023-12-17T11:51:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f957000f040 con 0x7f957c071bc0 2023-12-17T11:51:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c110f40 con 0x7f957c071bc0 2023-12-17T11:51:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f957000c990 con 0x7f957c071bc0 2023-12-17T11:51:40.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.748+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c111480 con 0x7f957c071bc0 2023-12-17T11:51:40.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.750+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957c1096f0 con 0x7f957c071bc0 2023-12-17T11:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.751+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 86389+0+0 (secure 0 0 0) 0x7f957000caf0 con 0x7f957c071bc0 2023-12-17T11:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.751+0000 7f9563fff700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f9564068ed0 0x7f956406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.751+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9570085860 con 0x7f957c071bc0 2023-12-17T11:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.752+0000 7f957b7fe700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f9564068ed0 0x7f956406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:40.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.752+0000 7f957b7fe700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f9564068ed0 0x7f956406b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f956c013600 tx=0x7f956c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:40.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:40.756+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f957004da00 con 0x7f957c071bc0 2023-12-17T11:51:40.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:40 smithi119 ceph-mon[117414]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:41.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:51:41.004+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f957c1116f0 con 0x7f9564068ed0 2023-12-17T11:51:41.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:41 smithi002 ceph-mon[107131]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:51:41.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:51:41.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:51:41.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:41.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:41.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:41.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:41 smithi119 ceph-mon[117414]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:51:41.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:51:41.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:51:41.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:41.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:41.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:42.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:42 smithi002 ceph-mon[107131]: Reconfiguring grafana.smithi002 (dependencies changed)... 2023-12-17T11:51:42.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:42 smithi002 ceph-mon[107131]: Reconfiguring daemon grafana.smithi002 on smithi002 2023-12-17T11:51:42.678 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:42 smithi002 ceph-mon[107131]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:42 smithi119 ceph-mon[117414]: Reconfiguring grafana.smithi002 (dependencies changed)... 2023-12-17T11:51:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:42 smithi119 ceph-mon[117414]: Reconfiguring daemon grafana.smithi002 on smithi002 2023-12-17T11:51:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:42 smithi119 ceph-mon[117414]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:45.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:45 smithi002 ceph-mon[107131]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:45.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:45.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:45.198 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:45 smithi119 ceph-mon[117414]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:51:46.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:46 smithi119 ceph-mon[117414]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2023-12-17T11:51:46.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:46 smithi119 ceph-mon[117414]: Reconfiguring daemon prometheus.smithi002 on smithi002 2023-12-17T11:51:46.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:46 smithi002 ceph-mon[107131]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2023-12-17T11:51:46.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:46 smithi002 ceph-mon[107131]: Reconfiguring daemon prometheus.smithi002 on smithi002 2023-12-17T11:51:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:47 smithi119 ceph-mon[117414]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:47 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3856088294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2114bd7b-19fb-4504-8164-694ca3b767d9"}]: dispatch 2023-12-17T11:51:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:47 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3856088294' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2114bd7b-19fb-4504-8164-694ca3b767d9"}]': finished 2023-12-17T11:51:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:47 smithi119 ceph-mon[117414]: osdmap e6: 1 total, 0 up, 1 in 2023-12-17T11:51:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:47 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:51:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:47 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1360896663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:51:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:47 smithi002 ceph-mon[107131]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:47 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3856088294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2114bd7b-19fb-4504-8164-694ca3b767d9"}]: dispatch 2023-12-17T11:51:47.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:47 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3856088294' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2114bd7b-19fb-4504-8164-694ca3b767d9"}]': finished 2023-12-17T11:51:47.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:47 smithi002 ceph-mon[107131]: osdmap e6: 1 total, 0 up, 1 in 2023-12-17T11:51:47.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:47 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:51:47.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:47 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1360896663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:51:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:49 smithi119 ceph-mon[117414]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:49 smithi002 ceph-mon[107131]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:50.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:50 smithi002 ceph-mon[107131]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:50.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:50 smithi119 ceph-mon[117414]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:53.201 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:53 smithi002 ceph-mon[107131]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:53 smithi119 ceph-mon[117414]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:55.360 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:55.360 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:55.360 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:55.360 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: Reconfiguring crash.smithi119 (monmap changed)... 2023-12-17T11:51:55.360 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:51:55.361 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:55.361 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:55 smithi002 ceph-mon[107131]: Reconfiguring daemon crash.smithi119 on smithi119 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: Reconfiguring crash.smithi119 (monmap changed)... 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:55 smithi119 ceph-mon[117414]: Reconfiguring daemon crash.smithi119 on smithi119 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: Deploying daemon osd.0 on smithi002 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:51:56.395 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:56.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T11:51:56.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:56.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: Deploying daemon osd.0 on smithi002 2023-12-17T11:51:56.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:56.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:56.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:51:56.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:51:56.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: Reconfiguring mgr.smithi119.nzblpy (monmap changed)... 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: Reconfiguring daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:51:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: Reconfiguring mgr.smithi119.nzblpy (monmap changed)... 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: Reconfiguring daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:51:57.594 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:51:57.595 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: Reconfiguring mon.smithi119 (monmap changed)... 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: Reconfiguring daemon mon.smithi119 on smithi119 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2023-12-17T11:51:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:51:58.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2023-12-17T11:51:58.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: Reconfiguring mon.smithi119 (monmap changed)... 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: Reconfiguring daemon mon.smithi119 on smithi119 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:51:58.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2023-12-17T11:51:58.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:51:58.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2023-12-17T11:51:58.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:51:58.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2023-12-17T11:51:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:51:59 smithi002 ceph-mon[107131]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi002.front.sepia.ceph.com:9093"}]: dispatch 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi002.front.sepia.ceph.com:3000"}]: dispatch 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi002.front.sepia.ceph.com:9095"}]: dispatch 2023-12-17T11:51:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:51:59 smithi119 ceph-mon[117414]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:00.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:00.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:00.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:00 smithi002 ceph-mon[107131]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:00.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:00 smithi119 ceph-mon[117414]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:02.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:02.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:04.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.417+0000 7f9563fff700 1 -- 172.21.15.2:0/195157087 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f957c1116f0 con 0x7f9564068ed0 2023-12-17T11:52:04.421 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.420+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f9564068ed0 msgr2=0x7f956406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.420+0000 7f958221f700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f9564068ed0 0x7f956406b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f956c013600 tx=0x7f956c009e30 comp rx=0 tx=0).stop 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.420+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 msgr2=0x7f957c10fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.420+0000 7f958221f700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c10fe20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f957000eb40 tx=0x7f957000b040 comp rx=0 tx=0).stop 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.420+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 shutdown_connections 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.421+0000 7f958221f700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f9564068ed0 0x7f956406b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.421+0000 7f958221f700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f957c070570 0x7f957c10f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.421+0000 7f958221f700 1 --2- 172.21.15.2:0/195157087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f957c071bc0 0x7f957c10fe20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.421+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 >> 172.21.15.2:0/195157087 conn(0x7f957c0f82d0 msgr2=0x7f957c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.421+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 shutdown_connections 2023-12-17T11:52:04.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:04.421+0000 7f958221f700 1 -- 172.21.15.2:0/195157087 wait complete. 2023-12-17T11:52:04.798 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.0.service 2023-12-17T11:52:04.803 INFO:tasks.cephadm:Deploying osd.1 on smithi002 with /dev/vg_nvme/lv_3... 2023-12-17T11:52:04.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-17T11:52:04.879 INFO:journalctl@ceph.osd.0.smithi002.stdout:-- Logs begin at Sun 2023-12-17 11:31:09 UTC. -- 2023-12-17T11:52:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:05 smithi119 ceph-mon[117414]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:05 smithi119 ceph-mon[117414]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T11:52:05.673 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-mon[107131]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:05.673 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.673 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.673 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.673 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:05.673 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-mon[107131]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T11:52:05.673 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:05 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[131333]: 2023-12-17T11:52:05.227+0000 7f3c03d7f540 -1 osd.0 0 log_to_monitors true 2023-12-17T11:52:05.707 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:52:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:06 smithi119 ceph-mon[117414]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T11:52:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:06 smithi119 ceph-mon[117414]: osdmap e7: 1 total, 0 up, 1 in 2023-12-17T11:52:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:06 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:06 smithi119 ceph-mon[117414]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T11:52:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:06 smithi119 ceph-mon[117414]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:06.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-mon[107131]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T11:52:06.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-mon[107131]: osdmap e7: 1 total, 0 up, 1 in 2023-12-17T11:52:06.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:06.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-mon[107131]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T11:52:06.953 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-mon[107131]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:52:06.953 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[131333]: 2023-12-17T11:52:06.608+0000 7f3bfa564700 -1 osd.0 0 waiting for initial osdmap 2023-12-17T11:52:06.953 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:06 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[131333]: 2023-12-17T11:52:06.613+0000 7f3bf4b5e700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:52:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-17T11:52:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-17T11:52:07.741 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2023-12-17T11:52:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2023-12-17T11:52:07.741 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0555548 s, 189 MB/s 2023-12-17T11:52:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2023-12-17T11:52:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:07 smithi119 ceph-mon[117414]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2023-12-17T11:52:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:07 smithi119 ceph-mon[117414]: osdmap e8: 1 total, 0 up, 1 in 2023-12-17T11:52:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:07 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:07 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:07 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:07 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:07.949 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:07 smithi002 ceph-mon[107131]: from='osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2023-12-17T11:52:07.950 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:07 smithi002 ceph-mon[107131]: osdmap e8: 1 total, 0 up, 1 in 2023-12-17T11:52:07.950 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:07.950 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:07.950 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:07.950 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:07 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:08.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2023-12-17T11:52:08.637 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:52:08.879 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:08 smithi002 ceph-mon[107131]: purged_snaps scrub starts 2023-12-17T11:52:08.880 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:08 smithi002 ceph-mon[107131]: purged_snaps scrub ok 2023-12-17T11:52:08.880 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:08 smithi002 ceph-mon[107131]: osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] boot 2023-12-17T11:52:08.880 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:08 smithi002 ceph-mon[107131]: osdmap e9: 1 total, 1 up, 1 in 2023-12-17T11:52:08.880 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:08.880 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:08 smithi002 ceph-mon[107131]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:08 smithi119 ceph-mon[117414]: purged_snaps scrub starts 2023-12-17T11:52:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:08 smithi119 ceph-mon[117414]: purged_snaps scrub ok 2023-12-17T11:52:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:08 smithi119 ceph-mon[117414]: osd.0 [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] boot 2023-12-17T11:52:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:08 smithi119 ceph-mon[117414]: osdmap e9: 1 total, 1 up, 1 in 2023-12-17T11:52:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:52:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:08 smithi119 ceph-mon[117414]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 -- 172.21.15.2:0/107391809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 msgr2=0x7f5e300fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 --2- 172.21.15.2:0/107391809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e300fd000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e20004940 tx=0x7f5e20009e30 comp rx=0 tx=0).stop 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 -- 172.21.15.2:0/107391809 shutdown_connections 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 --2- 172.21.15.2:0/107391809 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e300fde00 0x7f5e300fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 --2- 172.21.15.2:0/107391809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e300fd000 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 -- 172.21.15.2:0/107391809 >> 172.21.15.2:0/107391809 conn(0x7f5e300f82d0 msgr2=0x7f5e300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 -- 172.21.15.2:0/107391809 shutdown_connections 2023-12-17T11:52:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.797+0000 7f5e35b60700 1 -- 172.21.15.2:0/107391809 wait complete. 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.798+0000 7f5e35b60700 1 Processor -- start 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e35b60700 1 -- start start 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e35b60700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e3010f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e35b60700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e300fde00 0x7f5e3010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e35b60700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301102a0 con 0x7f5e300fcbf0 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e35b60700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30110b40 con 0x7f5e300fde00 2023-12-17T11:52:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e2f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e3010f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e2f7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e3010f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44584/0 (socket says 172.21.15.2:44584) 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e2f7fe700 1 -- 172.21.15.2:0/3168936933 learned_addr learned my addr 172.21.15.2:0/3168936933 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.799+0000 7f5e2effd700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e300fde00 0x7f5e3010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e2f7fe700 1 -- 172.21.15.2:0/3168936933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e300fde00 msgr2=0x7f5e3010fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e2f7fe700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e300fde00 0x7f5e3010fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e2f7fe700 1 -- 172.21.15.2:0/3168936933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20005040 con 0x7f5e300fcbf0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e2f7fe700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e3010f760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000c00 tx=0x7f5e20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e2000e040 con 0x7f5e300fcbf0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e20013420 con 0x7f5e300fcbf0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e30110dc0 con 0x7f5e300fcbf0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e2001c630 con 0x7f5e300fcbf0 2023-12-17T11:52:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.800+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e30111300 con 0x7f5e300fcbf0 2023-12-17T11:52:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.801+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e30101ea0 con 0x7f5e300fcbf0 2023-12-17T11:52:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.803+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 86389+0+0 (secure 0 0 0) 0x7f5e20013590 con 0x7f5e300fcbf0 2023-12-17T11:52:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.803+0000 7f5e17fff700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5e18068ed0 0x7f5e1806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.804+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f5e20087140 con 0x7f5e300fcbf0 2023-12-17T11:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.804+0000 7f5e2effd700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5e18068ed0 0x7f5e1806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.804+0000 7f5e2effd700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5e18068ed0 0x7f5e1806b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e24004f40 tx=0x7f5e2400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:52:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:09.808+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5e20057f00 con 0x7f5e300fcbf0 2023-12-17T11:52:09.824 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:09 smithi002 ceph-mon[107131]: osdmap e10: 1 total, 1 up, 1 in 2023-12-17T11:52:09.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:09 smithi119 ceph-mon[117414]: osdmap e10: 1 total, 1 up, 1 in 2023-12-17T11:52:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:10.026+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e301116f0 con 0x7f5e18068ed0 2023-12-17T11:52:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:10 smithi119 ceph-mon[117414]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:10 smithi119 ceph-mon[117414]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:52:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:52:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:52:10.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:10.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:10 smithi002 ceph-mon[107131]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:10.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:10 smithi002 ceph-mon[107131]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:52:10.929 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:52:10.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:52:10.930 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi002 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi002 to 13052M 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:13.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:13.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: Detected new or changed devices on smithi002 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi002 to 13052M 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:14.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:14 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3294482544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b728955-c4f6-4426-ae59-4614cbfea807"}]: dispatch 2023-12-17T11:52:14.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:14 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3294482544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b728955-c4f6-4426-ae59-4614cbfea807"}]': finished 2023-12-17T11:52:14.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:14 smithi002 ceph-mon[107131]: osdmap e11: 2 total, 1 up, 2 in 2023-12-17T11:52:14.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:14 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:14.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:14 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3294482544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b728955-c4f6-4426-ae59-4614cbfea807"}]: dispatch 2023-12-17T11:52:14.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:14 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3294482544' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b728955-c4f6-4426-ae59-4614cbfea807"}]': finished 2023-12-17T11:52:14.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:14 smithi119 ceph-mon[117414]: osdmap e11: 2 total, 1 up, 2 in 2023-12-17T11:52:14.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:14 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:15 smithi119 ceph-mon[117414]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:15 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3497215842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:52:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:15 smithi002 ceph-mon[107131]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:15 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3497215842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:52:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:17 smithi119 ceph-mon[117414]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:17 smithi002 ceph-mon[107131]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:17.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:17.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:17.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:17.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:17.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:19.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:19 smithi002 ceph-mon[107131]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:19 smithi119 ceph-mon[117414]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:20.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:20 smithi002 ceph-mon[107131]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:20.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:20 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T11:52:20.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:20 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:20.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:20 smithi002 ceph-mon[107131]: Deploying daemon osd.1 on smithi002 2023-12-17T11:52:20.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:20 smithi119 ceph-mon[117414]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:20.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:20 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T11:52:20.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:20 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:20.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:20 smithi119 ceph-mon[117414]: Deploying daemon osd.1 on smithi002 2023-12-17T11:52:23.189 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:23 smithi002 ceph-mon[107131]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:23.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:23 smithi119 ceph-mon[117414]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:25.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:25 smithi002 ceph-mon[107131]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:25.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:25 smithi119 ceph-mon[117414]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:26.429 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:26 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:26.429 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:26 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:26.429 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:26 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:26 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:26 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:26 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:27.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:27 smithi002 ceph-mon[107131]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:27 smithi119 ceph-mon[117414]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:28.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.027+0000 7f5e17fff700 1 -- 172.21.15.2:0/3168936933 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5e301116f0 con 0x7f5e18068ed0 2023-12-17T11:52:28.029 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 1 on host 'smithi002' 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5e18068ed0 msgr2=0x7f5e1806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5e18068ed0 0x7f5e1806b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e24004f40 tx=0x7f5e2400b040 comp rx=0 tx=0).stop 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 msgr2=0x7f5e3010f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e3010f760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000c00 tx=0x7f5e20009e30 comp rx=0 tx=0).stop 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 shutdown_connections 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5e18068ed0 0x7f5e1806b380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e300fcbf0 0x7f5e3010f760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 --2- 172.21.15.2:0/3168936933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e300fde00 0x7f5e3010fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.030+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 >> 172.21.15.2:0/3168936933 conn(0x7f5e300f82d0 msgr2=0x7f5e300ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.031+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 shutdown_connections 2023-12-17T11:52:28.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:28.031+0000 7f5e35b60700 1 -- 172.21.15.2:0/3168936933 wait complete. 2023-12-17T11:52:28.443 DEBUG:teuthology.orchestra.run.smithi002:osd.1> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.1.service 2023-12-17T11:52:28.447 INFO:tasks.cephadm:Deploying osd.2 on smithi002 with /dev/vg_nvme/lv_2... 2023-12-17T11:52:28.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-17T11:52:28.534 INFO:journalctl@ceph.osd.1.smithi002.stdout:-- Logs begin at Sun 2023-12-17 11:31:09 UTC. -- 2023-12-17T11:52:29.136 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:52:29.206 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:29.206 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:29.206 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:28 smithi002 ceph-mon[107131]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:28 smithi119 ceph-mon[117414]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:29.475 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:52:29 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[140981]: 2023-12-17T11:52:29.203+0000 7fbb45409540 -1 osd.1 0 log_to_monitors true 2023-12-17T11:52:30.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:29 smithi002 ceph-mon[107131]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:52:30.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:29 smithi119 ceph-mon[117414]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0365658 s, 287 MB/s 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 2023-12-17T11:52:31.025 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2023-12-17T11:52:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T11:52:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: osdmap e12: 2 total, 1 up, 2 in 2023-12-17T11:52:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T11:52:31.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:31.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:31.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:31.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:31.225 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[140981]: 2023-12-17T11:52:30.992+0000 7fbb3bbee700 -1 osd.1 0 waiting for initial osdmap 2023-12-17T11:52:31.225 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:52:31 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[140981]: 2023-12-17T11:52:31.002+0000 7fbb369e9700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: osdmap e12: 2 total, 1 up, 2 in 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:31.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2023-12-17T11:52:32.141 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:52:32.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:31 smithi002 ceph-mon[107131]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2023-12-17T11:52:32.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:31 smithi002 ceph-mon[107131]: osdmap e13: 2 total, 1 up, 2 in 2023-12-17T11:52:32.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:31 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:32.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:31 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:32 smithi119 ceph-mon[117414]: from='osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2023-12-17T11:52:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:32 smithi119 ceph-mon[117414]: osdmap e13: 2 total, 1 up, 2 in 2023-12-17T11:52:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:32 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:32 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.350+0000 7f131be2e700 1 -- 172.21.15.2:0/2296444422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fee00 msgr2=0x7f13140ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.350+0000 7f131be2e700 1 --2- 172.21.15.2:0/2296444422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fee00 0x7f13140ff210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1310004940 tx=0x7f1310009e30 comp rx=0 tx=0).stop 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 -- 172.21.15.2:0/2296444422 shutdown_connections 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 --2- 172.21.15.2:0/2296444422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13140fff70 0x7f13141003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 --2- 172.21.15.2:0/2296444422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fee00 0x7f13140ff210 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 -- 172.21.15.2:0/2296444422 >> 172.21.15.2:0/2296444422 conn(0x7f13140fa5d0 msgr2=0x7f13140fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:52:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 -- 172.21.15.2:0/2296444422 shutdown_connections 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 -- 172.21.15.2:0/2296444422 wait complete. 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.351+0000 7f131be2e700 1 Processor -- start 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f131be2e700 1 -- start start 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f131be2e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13140fee00 0x7f131410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f131be2e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 0x7f131410fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f131be2e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13141102c0 con 0x7f13140fff70 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f131be2e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314110b60 con 0x7f13140fee00 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f13193c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 0x7f131410fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f13193c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 0x7f131410fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53294/0 (socket says 172.21.15.2:53294) 2023-12-17T11:52:33.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.352+0000 7f13193c9700 1 -- 172.21.15.2:0/2312063163 learned_addr learned my addr 172.21.15.2:0/2312063163 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:52:33.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.353+0000 7f1319bca700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13140fee00 0x7f131410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.353+0000 7f13193c9700 1 -- 172.21.15.2:0/2312063163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13140fee00 msgr2=0x7f131410f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.353+0000 7f13193c9700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13140fee00 0x7f131410f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.353+0000 7f13193c9700 1 -- 172.21.15.2:0/2312063163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310005040 con 0x7f13140fff70 2023-12-17T11:52:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.353+0000 7f13193c9700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 0x7f131410fcc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1304002a50 tx=0x7f13040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:52:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.353+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1304007cc0 con 0x7f13140fff70 2023-12-17T11:52:33.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.354+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f130400f040 con 0x7f13140fff70 2023-12-17T11:52:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.354+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1314110e40 con 0x7f13140fff70 2023-12-17T11:52:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.354+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1304009540 con 0x7f13140fff70 2023-12-17T11:52:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.354+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1314111380 con 0x7f13140fff70 2023-12-17T11:52:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.356+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131404bb80 con 0x7f13140fff70 2023-12-17T11:52:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.356+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) v1 ==== 86389+0+0 (secure 0 0 0) 0x7f13040096c0 con 0x7f13140fff70 2023-12-17T11:52:33.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.357+0000 7f130a7fc700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1300068fb0 0x7f130006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:33.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.357+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f1304085e60 con 0x7f13140fff70 2023-12-17T11:52:33.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.357+0000 7f1319bca700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1300068fb0 0x7f130006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:33.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.358+0000 7f1319bca700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1300068fb0 0x7f130006b460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f131000b3b0 tx=0x7f1310009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:52:33.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.362+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f13040569f0 con 0x7f13140fff70 2023-12-17T11:52:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:33 smithi119 ceph-mon[117414]: purged_snaps scrub starts 2023-12-17T11:52:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:33 smithi119 ceph-mon[117414]: purged_snaps scrub ok 2023-12-17T11:52:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:33 smithi119 ceph-mon[117414]: osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] boot 2023-12-17T11:52:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:33 smithi119 ceph-mon[117414]: osdmap e14: 2 total, 2 up, 2 in 2023-12-17T11:52:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:33 smithi119 ceph-mon[117414]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:33.443 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:33 smithi002 ceph-mon[107131]: purged_snaps scrub starts 2023-12-17T11:52:33.443 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:33 smithi002 ceph-mon[107131]: purged_snaps scrub ok 2023-12-17T11:52:33.443 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:33 smithi002 ceph-mon[107131]: osd.1 [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] boot 2023-12-17T11:52:33.443 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:33 smithi002 ceph-mon[107131]: osdmap e14: 2 total, 2 up, 2 in 2023-12-17T11:52:33.443 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:52:33.444 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:33 smithi002 ceph-mon[107131]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:52:33.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:33.593+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1314111820 con 0x7f1300068fb0 2023-12-17T11:52:34.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: osdmap e15: 2 total, 2 up, 2 in 2023-12-17T11:52:34.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:52:34.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:34 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: osdmap e15: 2 total, 2 up, 2 in 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:34.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:34.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:34.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:34.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:34 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:35.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:35 smithi002 ceph-mon[107131]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:52:35.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:35 smithi002 ceph-mon[107131]: Detected new or changed devices on smithi002 2023-12-17T11:52:35.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:35 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi002 to 6526M 2023-12-17T11:52:35.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:35 smithi002 ceph-mon[107131]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:35.305 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:35 smithi119 ceph-mon[117414]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:52:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:35 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi002 2023-12-17T11:52:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:35 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi002 to 6526M 2023-12-17T11:52:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:35 smithi119 ceph-mon[117414]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:37 smithi119 ceph-mon[117414]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:37 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1878718545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f28cc1-78bc-4434-a7a0-ca4a373fc384"}]: dispatch 2023-12-17T11:52:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:37 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1878718545' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4f28cc1-78bc-4434-a7a0-ca4a373fc384"}]': finished 2023-12-17T11:52:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:37 smithi119 ceph-mon[117414]: osdmap e16: 3 total, 2 up, 3 in 2023-12-17T11:52:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:37 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:37 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2792040685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:52:37.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:37 smithi002 ceph-mon[107131]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:37.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:37 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1878718545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4f28cc1-78bc-4434-a7a0-ca4a373fc384"}]: dispatch 2023-12-17T11:52:37.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:37 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1878718545' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4f28cc1-78bc-4434-a7a0-ca4a373fc384"}]': finished 2023-12-17T11:52:37.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:37 smithi002 ceph-mon[107131]: osdmap e16: 3 total, 2 up, 3 in 2023-12-17T11:52:37.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:37 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:37.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:37 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2792040685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:52:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:39 smithi119 ceph-mon[117414]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:39 smithi002 ceph-mon[107131]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:40 smithi002 ceph-mon[107131]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:40.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:40 smithi119 ceph-mon[117414]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:43.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:43 smithi119 ceph-mon[117414]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:43.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:43 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T11:52:43.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:43 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:43.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:43 smithi002 ceph-mon[107131]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:43.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:43 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T11:52:43.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:43 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:44.337 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:44 smithi002 ceph-mon[107131]: Deploying daemon osd.2 on smithi002 2023-12-17T11:52:44.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:44 smithi119 ceph-mon[117414]: Deploying daemon osd.2 on smithi002 2023-12-17T11:52:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:45 smithi119 ceph-mon[117414]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:45 smithi002 ceph-mon[107131]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:52:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:47 smithi002 ceph-mon[107131]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:47 smithi119 ceph-mon[117414]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:48.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:48 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:48.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:48 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:48.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:48 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:48.829 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:48 smithi002 ceph-mon[107131]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:49.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:48 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:49.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:48 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:49.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:48 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:49.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:48 smithi119 ceph-mon[117414]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.744+0000 7f130a7fc700 1 -- 172.21.15.2:0/2312063163 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1314111820 con 0x7f1300068fb0 2023-12-17T11:52:50.748 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 2 on host 'smithi002' 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1300068fb0 msgr2=0x7f130006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1300068fb0 0x7f130006b460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f131000b3b0 tx=0x7f1310009e30 comp rx=0 tx=0).stop 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 msgr2=0x7f131410fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 0x7f131410fcc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1304002a50 tx=0x7f13040046b0 comp rx=0 tx=0).stop 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 shutdown_connections 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1300068fb0 0x7f130006b460 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13140fee00 0x7f131410f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 --2- 172.21.15.2:0/2312063163 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13140fff70 0x7f131410fcc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 >> 172.21.15.2:0/2312063163 conn(0x7f13140fa5d0 msgr2=0x7f1314103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:52:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 shutdown_connections 2023-12-17T11:52:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:52:50.747+0000 7f131be2e700 1 -- 172.21.15.2:0/2312063163 wait complete. 2023-12-17T11:52:50.771 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:50 smithi002 ceph-mon[107131]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:50.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:50 smithi119 ceph-mon[117414]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:51.342 DEBUG:teuthology.orchestra.run.smithi002:osd.2> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.2.service 2023-12-17T11:52:51.346 INFO:tasks.cephadm:Deploying osd.3 on smithi119 with /dev/vg_nvme/lv_4... 2023-12-17T11:52:51.347 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-17T11:52:51.429 INFO:journalctl@ceph.osd.2.smithi002.stdout:-- Logs begin at Sun 2023-12-17 11:31:09 UTC. -- 2023-12-17T11:52:51.764 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:52:51.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:51 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:51.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:51 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:51.976 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:52:51 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[150361]: 2023-12-17T11:52:51.800+0000 7f8c3917d540 -1 osd.2 0 log_to_monitors true 2023-12-17T11:52:51.976 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:51 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:51.976 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:51 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:52.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:52 smithi002 ceph-mon[107131]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:52:52.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:52 smithi002 ceph-mon[107131]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:52.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:52 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:52.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:52 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:53.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:52 smithi119 ceph-mon[117414]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:52:53.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:52 smithi119 ceph-mon[117414]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:53.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:52 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:53.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:52 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:53.313 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-17T11:52:53.313 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-17T11:52:53.313 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-17T11:52:53.314 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-17T11:52:53.314 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0317865 s, 330 MB/s 2023-12-17T11:52:53.314 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-17T11:52:53.733 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:52:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[150361]: 2023-12-17T11:52:53.723+0000 7f8c2f962700 -1 osd.2 0 waiting for initial osdmap 2023-12-17T11:52:53.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:53 smithi002 ceph-mon[107131]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T11:52:53.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:53 smithi002 ceph-mon[107131]: osdmap e17: 3 total, 2 up, 3 in 2023-12-17T11:52:53.733 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:53 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:53.734 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:53 smithi002 ceph-mon[107131]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T11:52:53.734 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2023-12-17T11:52:54.146 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:52:54.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:53 smithi119 ceph-mon[117414]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T11:52:54.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:53 smithi119 ceph-mon[117414]: osdmap e17: 3 total, 2 up, 3 in 2023-12-17T11:52:54.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:53 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:54.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:53 smithi119 ceph-mon[117414]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T11:52:54.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:52:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[150361]: 2023-12-17T11:52:53.731+0000 7f8c29f5c700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:52:55.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:54 smithi002 ceph-mon[107131]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2023-12-17T11:52:55.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:54 smithi002 ceph-mon[107131]: osdmap e18: 3 total, 2 up, 3 in 2023-12-17T11:52:55.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:54 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:55.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:54 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:55.017 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:54 smithi002 ceph-mon[107131]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:55.100 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:54 smithi119 ceph-mon[117414]: from='osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2023-12-17T11:52:55.100 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:54 smithi119 ceph-mon[117414]: osdmap e18: 3 total, 2 up, 3 in 2023-12-17T11:52:55.101 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:54 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:55.101 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:54 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:55.101 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:54 smithi119 ceph-mon[117414]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-17T11:52:55.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 -- 172.21.15.119:0/2351610244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fcbf0 msgr2=0x7f85500fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:55.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 --2- 172.21.15.119:0/2351610244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fcbf0 0x7f85500fd000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f854c004940 tx=0x7f854c009e30 comp rx=0 tx=0).stop 2023-12-17T11:52:55.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 -- 172.21.15.119:0/2351610244 shutdown_connections 2023-12-17T11:52:55.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 --2- 172.21.15.119:0/2351610244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85500fde00 0x7f85500fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:55.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 --2- 172.21.15.119:0/2351610244 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fcbf0 0x7f85500fd000 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:55.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 -- 172.21.15.119:0/2351610244 >> 172.21.15.119:0/2351610244 conn(0x7f85500f82d0 msgr2=0x7f85500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:52:55.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 -- 172.21.15.119:0/2351610244 shutdown_connections 2023-12-17T11:52:55.341 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.338+0000 7f85581a0700 1 -- 172.21.15.119:0/2351610244 wait complete. 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.339+0000 7f85581a0700 1 Processor -- start 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.339+0000 7f85581a0700 1 -- start start 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.339+0000 7f85581a0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85500fcbf0 0x7f8550071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.339+0000 7f85581a0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 0x7f855006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.339+0000 7f85581a0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550070590 con 0x7f85500fcbf0 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.339+0000 7f85581a0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550070700 con 0x7f85500fde00 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 0x7f855006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 0x7f855006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:38874/0 (socket says 172.21.15.119:38874) 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 -- 172.21.15.119:0/1633549739 learned_addr learned my addr 172.21.15.119:0/1633549739 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f8555f3c700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85500fcbf0 0x7f8550071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:55.342 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 -- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85500fcbf0 msgr2=0x7f8550071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:52:55.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85500fcbf0 0x7f8550071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:52:55.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 -- 172.21.15.119:0/1633549739 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c005040 con 0x7f85500fde00 2023-12-17T11:52:55.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f855573b700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 0x7f855006ff90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f854000eb40 tx=0x7f854000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:52:55.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8540007cc0 con 0x7f85500fde00 2023-12-17T11:52:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8550070980 con 0x7f85500fde00 2023-12-17T11:52:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f854000f040 con 0x7f85500fde00 2023-12-17T11:52:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f854000c990 con 0x7f85500fde00 2023-12-17T11:52:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.340+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8550115500 con 0x7f85500fde00 2023-12-17T11:52:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.341+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855004bb80 con 0x7f85500fde00 2023-12-17T11:52:55.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.342+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 18) v1 ==== 86389+0+0 (secure 0 0 0) 0x7f854000cc00 con 0x7f85500fde00 2023-12-17T11:52:55.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.343+0000 7f85467fc700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f853c068ed0 0x7f853c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:52:55.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.343+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2842+0+0 (secure 0 0 0) 0x7f8540085ee0 con 0x7f85500fde00 2023-12-17T11:52:55.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.344+0000 7f8555f3c700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f853c068ed0 0x7f853c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:52:55.346 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.344+0000 7f8555f3c700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f853c068ed0 0x7f853c06b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f854c009fd0 tx=0x7f854c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:52:55.350 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.348+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f854004da00 con 0x7f85500fde00 2023-12-17T11:52:55.558 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:52:55.556+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8550102750 con 0x7f853c068ed0 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: purged_snaps scrub starts 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: purged_snaps scrub ok 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] boot 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: osdmap e19: 3 total, 3 up, 3 in 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi002 2023-12-17T11:52:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi002 to 4350M 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:52:56.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:56.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: purged_snaps scrub starts 2023-12-17T11:52:56.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: purged_snaps scrub ok 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: osd.2 [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] boot 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: osdmap e19: 3 total, 3 up, 3 in 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: Detected new or changed devices on smithi002 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi002 to 4350M 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:52:56.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:52:56.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:52:56.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:52:56.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:52:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:56 smithi119 ceph-mon[117414]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:52:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:56 smithi119 ceph-mon[117414]: osdmap e20: 3 total, 3 up, 3 in 2023-12-17T11:52:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:56 smithi119 ceph-mon[117414]: pgmap v66: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:52:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-17T11:52:57.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:56 smithi002 ceph-mon[107131]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:52:57.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:56 smithi002 ceph-mon[107131]: osdmap e20: 3 total, 3 up, 3 in 2023-12-17T11:52:57.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:56 smithi002 ceph-mon[107131]: pgmap v66: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:52:57.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-17T11:52:58.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-17T11:52:58.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:57 smithi119 ceph-mon[117414]: osdmap e21: 3 total, 3 up, 3 in 2023-12-17T11:52:58.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:52:58.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-17T11:52:58.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:57 smithi002 ceph-mon[107131]: osdmap e21: 3 total, 3 up, 3 in 2023-12-17T11:52:58.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:52:59.029 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-17T11:52:59.029 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: osdmap e22: 3 total, 3 up, 3 in 2023-12-17T11:52:59.029 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2187196334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8f7021b-7c22-415a-9635-af30e6e6fc13"}]: dispatch 2023-12-17T11:52:59.030 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8f7021b-7c22-415a-9635-af30e6e6fc13"}]: dispatch 2023-12-17T11:52:59.030 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8f7021b-7c22-415a-9635-af30e6e6fc13"}]': finished 2023-12-17T11:52:59.030 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: osdmap e23: 4 total, 3 up, 4 in 2023-12-17T11:52:59.030 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:52:59.030 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:52:59.030 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:58 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/2355574316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: osdmap e22: 3 total, 3 up, 3 in 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2187196334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8f7021b-7c22-415a-9635-af30e6e6fc13"}]: dispatch 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8f7021b-7c22-415a-9635-af30e6e6fc13"}]: dispatch 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8f7021b-7c22-415a-9635-af30e6e6fc13"}]': finished 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: osdmap e23: 4 total, 3 up, 4 in 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:52:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:58 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/2355574316' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:52:59.475 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156105]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:52:59.475 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156105]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:52:59.476 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156105]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:52:59.476 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156105]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:52:59.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156108]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:52:59.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156108]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:52:59.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156108]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:52:59.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 11:52:59 smithi002 sudo[156108]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:00.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:59 smithi119 ceph-mon[117414]: osdmap e24: 4 total, 3 up, 4 in 2023-12-17T11:53:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:52:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:00.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:59 smithi002 ceph-mon[107131]: osdmap e24: 4 total, 3 up, 4 in 2023-12-17T11:53:00.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:00.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:52:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:00.475 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156111]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:53:00.476 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156111]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:00.476 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156111]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:00.476 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156111]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:00.975 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156114]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:53:00.975 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156114]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:00.975 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156114]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:00.976 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 11:53:00 smithi002 sudo[156114]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:00.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:00.987+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f8540053230 con 0x7f85500fde00 2023-12-17T11:53:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:00 smithi119 ceph-mon[117414]: pgmap v72: 1 pgs: 1 creating+activating; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:01.264 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:00 smithi002 ceph-mon[107131]: pgmap v72: 1 pgs: 1 creating+activating; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:01.264 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:01.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156117]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:53:01.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:01.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156117]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:01.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156117]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:02.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156120]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:53:02.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156120]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:02.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156120]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:02.226 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 11:53:01 smithi002 sudo[156120]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156123]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:53:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156123]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156123]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156123]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:03.204 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:02 smithi119 ceph-mon[117414]: mgrmap e19: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T11:53:03.205 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:02 smithi119 ceph-mon[117414]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:53:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156126]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:53:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156126]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 sudo[156126]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 ceph-mon[107131]: mgrmap e19: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T11:53:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:02 smithi002 ceph-mon[107131]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:53:03.470 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123071]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:53:03.470 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123071]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:03.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123071]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:03.471 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123071]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123117]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:03 smithi119 sudo[123117]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 sudo[123117]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 ceph-mon[117414]: pgmap v73: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 ceph-mon[117414]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:53:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:53:04.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:04 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:53:04.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:04 smithi002 ceph-mon[107131]: pgmap v73: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:04.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:04 smithi002 ceph-mon[107131]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:53:04.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:04 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:53:04.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:04 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:53:04.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:04 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:53:04.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:04 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:53:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:05 smithi119 ceph-mon[117414]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:53:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:05 smithi119 ceph-mon[117414]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:05 smithi119 ceph-mon[117414]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:53:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T11:53:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:05.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:05 smithi002 ceph-mon[107131]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:53:05.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:05 smithi002 ceph-mon[107131]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:05.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:05 smithi002 ceph-mon[107131]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:53:05.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:05.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T11:53:05.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:06.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:06 smithi119 ceph-mon[117414]: Deploying daemon osd.3 on smithi119 2023-12-17T11:53:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:06 smithi002 ceph-mon[107131]: Deploying daemon osd.3 on smithi119 2023-12-17T11:53:07.107 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:07 smithi119 ceph-mon[117414]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:07.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:07 smithi002 ceph-mon[107131]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:09.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:09 smithi119 ceph-mon[117414]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:09.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:09 smithi002 ceph-mon[107131]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-17T11:53:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:10.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:10 smithi119 ceph-mon[117414]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-17T11:53:10.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:10.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:10 smithi002 ceph-mon[107131]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-17T11:53:12.767 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 3 on host 'smithi119' 2023-12-17T11:53:12.767 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.764+0000 7f85467fc700 1 -- 172.21.15.119:0/1633549739 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8550102750 con 0x7f853c068ed0 2023-12-17T11:53:12.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f853c068ed0 msgr2=0x7f853c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:12.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f853c068ed0 0x7f853c06b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f854c009fd0 tx=0x7f854c009e30 comp rx=0 tx=0).stop 2023-12-17T11:53:12.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 msgr2=0x7f855006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:12.769 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 0x7f855006ff90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f854000eb40 tx=0x7f854000b040 comp rx=0 tx=0).stop 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 shutdown_connections 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f853c068ed0 0x7f853c06b380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85500fcbf0 0x7f8550071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 --2- 172.21.15.119:0/1633549739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85500fde00 0x7f855006ff90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 >> 172.21.15.119:0/1633549739 conn(0x7f85500f82d0 msgr2=0x7f8550101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 shutdown_connections 2023-12-17T11:53:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:12.767+0000 7f85581a0700 1 -- 172.21.15.119:0/1633549739 wait complete. 2023-12-17T11:53:13.199 DEBUG:teuthology.orchestra.run.smithi119:osd.3> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.3.service 2023-12-17T11:53:13.203 INFO:tasks.cephadm:Deploying osd.4 on smithi119 with /dev/vg_nvme/lv_3... 2023-12-17T11:53:13.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-17T11:53:13.279 INFO:journalctl@ceph.osd.3.smithi119.stdout:-- Logs begin at Sun 2023-12-17 11:32:10 UTC. -- 2023-12-17T11:53:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:13 smithi119 ceph-mon[117414]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-17T11:53:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:13 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.691 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:53:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:13 smithi002 ceph-mon[107131]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-17T11:53:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:13 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:14.158 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 11:53:13 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[123802]: 2023-12-17T11:53:13.785+0000 7f28afb7b540 -1 osd.3 0 log_to_monitors true 2023-12-17T11:53:14.588 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:14 smithi119 ceph-mon[117414]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T11:53:14.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:14 smithi002 ceph-mon[107131]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T11:53:15.444 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-17T11:53:15.444 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-17T11:53:15.444 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-17T11:53:15.444 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-17T11:53:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0308052 s, 340 MB/s 2023-12-17T11:53:15.445 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-17T11:53:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:15 smithi002 ceph-mon[107131]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-17T11:53:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:15 smithi002 ceph-mon[107131]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T11:53:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:15 smithi002 ceph-mon[107131]: osdmap e25: 4 total, 3 up, 4 in 2023-12-17T11:53:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:15 smithi002 ceph-mon[107131]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:53:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:15.740 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[123802]: 2023-12-17T11:53:15.456+0000 7f28a6360700 -1 osd.3 0 waiting for initial osdmap 2023-12-17T11:53:15.741 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[123802]: 2023-12-17T11:53:15.466+0000 7f289f958700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:53:15.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-mon[117414]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-17T11:53:15.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-mon[117414]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T11:53:15.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-mon[117414]: osdmap e25: 4 total, 3 up, 4 in 2023-12-17T11:53:15.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:15.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-mon[117414]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:53:15.741 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:15.945 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2023-12-17T11:53:16.421 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:53:16.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:16 smithi002 ceph-mon[107131]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-17T11:53:16.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:16 smithi002 ceph-mon[107131]: osdmap e26: 4 total, 3 up, 4 in 2023-12-17T11:53:16.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:16 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:16.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:16 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:16.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:16 smithi002 ceph-mon[107131]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-17T11:53:16.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:16 smithi119 ceph-mon[117414]: from='osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-17T11:53:16.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:16 smithi119 ceph-mon[117414]: osdmap e26: 4 total, 3 up, 4 in 2023-12-17T11:53:16.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:16 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:16.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:16 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:16.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:16 smithi119 ceph-mon[117414]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: purged_snaps scrub starts 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: purged_snaps scrub ok 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] boot 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: osdmap e27: 4 total, 4 up, 4 in 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi119 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.646 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi119 to 16119M 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:17.647 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:17 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:17.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: purged_snaps scrub starts 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: purged_snaps scrub ok 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: osd.3 [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] boot 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: osdmap e27: 4 total, 4 up, 4 in 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: Detected new or changed devices on smithi119 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi119 to 16119M 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:17.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:17.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:17.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:17.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:17.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:17 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.868+0000 7fd302110700 1 -- 172.21.15.119:0/2747166782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 msgr2=0x7fd2fc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 --2- 172.21.15.119:0/2747166782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc0fe250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0004940 tx=0x7fd2f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 -- 172.21.15.119:0/2747166782 shutdown_connections 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 --2- 172.21.15.119:0/2747166782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc0fe250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 --2- 172.21.15.119:0/2747166782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2fc0fcbf0 0x7fd2fc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 -- 172.21.15.119:0/2747166782 >> 172.21.15.119:0/2747166782 conn(0x7fd2fc0f82d0 msgr2=0x7fd2fc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 -- 172.21.15.119:0/2747166782 shutdown_connections 2023-12-17T11:53:17.871 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 -- 172.21.15.119:0/2747166782 wait complete. 2023-12-17T11:53:17.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.869+0000 7fd302110700 1 Processor -- start 2023-12-17T11:53:17.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd302110700 1 -- start start 2023-12-17T11:53:17.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd302110700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2fc0fcbf0 0x7fd2fc10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:53:17.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd302110700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:53:17.873 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd302110700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc10e0b0 con 0x7fd2fc0fcbf0 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd302110700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc10e950 con 0x7fd2fc0fde00 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd2faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd2fb7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2fc0fcbf0 0x7fd2fc10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd2faffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc10dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:44484/0 (socket says 172.21.15.119:44484) 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.870+0000 7fd2faffd700 1 -- 172.21.15.119:0/917508665 learned_addr learned my addr 172.21.15.119:0/917508665 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2faffd700 1 -- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2fc0fcbf0 msgr2=0x7fd2fc10d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2faffd700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2fc0fcbf0 0x7fd2fc10d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2faffd700 1 -- 172.21.15.119:0/917508665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f0005040 con 0x7fd2fc0fde00 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2faffd700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc10dab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009380 tx=0x7fd2f0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2f000e040 con 0x7fd2fc0fde00 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2f000bd20 con 0x7fd2fc0fde00 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc10ebd0 con 0x7fd2fc0fde00 2023-12-17T11:53:17.874 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2f001c630 con 0x7fd2fc0fde00 2023-12-17T11:53:17.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.871+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc10f110 con 0x7fd2fc0fde00 2023-12-17T11:53:17.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.872+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc04bb80 con 0x7fd2fc0fde00 2023-12-17T11:53:17.875 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.873+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fd2f0013420 con 0x7fd2fc0fde00 2023-12-17T11:53:17.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.874+0000 7fd2e3fff700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd2e4068f60 0x7fd2e406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:53:17.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.874+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3799+0+0 (secure 0 0 0) 0x7fd2f0087b50 con 0x7fd2fc0fde00 2023-12-17T11:53:17.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.874+0000 7fd2fb7fe700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd2e4068f60 0x7fd2e406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:53:17.876 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.875+0000 7fd2fb7fe700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd2e4068f60 0x7fd2e406b410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0fdc60 tx=0x7fd2ec00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:53:17.881 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:17.879+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd2f0058090 con 0x7fd2fc0fde00 2023-12-17T11:53:18.081 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:18.079+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2fc10f520 con 0x7fd2e4068f60 2023-12-17T11:53:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:18.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: osdmap e28: 4 total, 4 up, 4 in 2023-12-17T11:53:18.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:18.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:53:18.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:53:18.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:53:18.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:18.751 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:18.752 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: osdmap e28: 4 total, 4 up, 4 in 2023-12-17T11:53:18.752 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:18.752 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:53:18.752 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:53:18.752 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:53:18.752 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:19.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:19 smithi002 ceph-mon[107131]: osdmap e29: 4 total, 4 up, 4 in 2023-12-17T11:53:19.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:19 smithi119 ceph-mon[117414]: osdmap e29: 4 total, 4 up, 4 in 2023-12-17T11:53:20.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:20 smithi119 ceph-mon[117414]: osdmap e30: 4 total, 4 up, 4 in 2023-12-17T11:53:20.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:20 smithi119 ceph-mon[117414]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:20.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:20 smithi002 ceph-mon[107131]: osdmap e30: 4 total, 4 up, 4 in 2023-12-17T11:53:20.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:20 smithi002 ceph-mon[107131]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: osdmap e31: 4 total, 4 up, 4 in 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/956565839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5ebbeab-3ba4-4e81-b453-d775808ac559"}]: dispatch 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5ebbeab-3ba4-4e81-b453-d775808ac559"}]: dispatch 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5ebbeab-3ba4-4e81-b453-d775808ac559"}]': finished 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: osdmap e32: 5 total, 4 up, 5 in 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:21 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/3309307477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:53:21.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: osdmap e31: 4 total, 4 up, 4 in 2023-12-17T11:53:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/956565839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5ebbeab-3ba4-4e81-b453-d775808ac559"}]: dispatch 2023-12-17T11:53:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5ebbeab-3ba4-4e81-b453-d775808ac559"}]: dispatch 2023-12-17T11:53:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5ebbeab-3ba4-4e81-b453-d775808ac559"}]': finished 2023-12-17T11:53:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: osdmap e32: 5 total, 4 up, 5 in 2023-12-17T11:53:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:21 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/3309307477' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:53:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:22 smithi119 ceph-mon[117414]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:22.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:22 smithi002 ceph-mon[107131]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:25.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:25 smithi119 ceph-mon[117414]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 104 KiB/s, 0 objects/s recovering 2023-12-17T11:53:25.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:25 smithi002 ceph-mon[107131]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 104 KiB/s, 0 objects/s recovering 2023-12-17T11:53:27.404 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:27 smithi119 ceph-mon[117414]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-12-17T11:53:27.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:27 smithi002 ceph-mon[107131]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-12-17T11:53:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T11:53:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:28 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:28 smithi119 ceph-mon[117414]: Deploying daemon osd.4 on smithi119 2023-12-17T11:53:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T11:53:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:28 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:28 smithi002 ceph-mon[107131]: Deploying daemon osd.4 on smithi119 2023-12-17T11:53:29.393 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:29 smithi119 ceph-mon[117414]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T11:53:29.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:29 smithi002 ceph-mon[107131]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T11:53:30.822 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:30 smithi119 ceph-mon[117414]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-12-17T11:53:30.823 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:30.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:30 smithi002 ceph-mon[107131]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2023-12-17T11:53:30.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:33.583 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:33 smithi119 ceph-mon[117414]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-17T11:53:33.583 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:33.583 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:33.583 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:33 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:33 smithi002 ceph-mon[107131]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-17T11:53:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:33 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:35.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:35 smithi119 ceph-mon[117414]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T11:53:35.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:35.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:35.628 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:35.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:35.629 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:35 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:35.698 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.696+0000 7fd2e3fff700 1 -- 172.21.15.119:0/917508665 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd2fc10f520 con 0x7fd2e4068f60 2023-12-17T11:53:35.699 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 4 on host 'smithi119' 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd2e4068f60 msgr2=0x7fd2e406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd2e4068f60 0x7fd2e406b410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0fdc60 tx=0x7fd2ec00b040 comp rx=0 tx=0).stop 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 msgr2=0x7fd2fc10dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc10dab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009380 tx=0x7fd2f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 shutdown_connections 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd2e4068f60 0x7fd2e406b410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.698+0000 7fd302110700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd2fc0fcbf0 0x7fd2fc10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.699+0000 7fd302110700 1 --2- 172.21.15.119:0/917508665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2fc0fde00 0x7fd2fc10dab0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.699+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 >> 172.21.15.119:0/917508665 conn(0x7fd2fc0f82d0 msgr2=0x7fd2fc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.699+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 shutdown_connections 2023-12-17T11:53:35.701 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:35.699+0000 7fd302110700 1 -- 172.21.15.119:0/917508665 wait complete. 2023-12-17T11:53:35.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:35 smithi002 ceph-mon[107131]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T11:53:35.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:35.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:35.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:35.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:35.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:35 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:36.088 DEBUG:teuthology.orchestra.run.smithi119:osd.4> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.4.service 2023-12-17T11:53:36.092 INFO:tasks.cephadm:Deploying osd.5 on smithi119 with /dev/vg_nvme/lv_2... 2023-12-17T11:53:36.092 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-17T11:53:36.174 INFO:journalctl@ceph.osd.4.smithi119.stdout:-- Logs begin at Sun 2023-12-17 11:32:10 UTC. -- 2023-12-17T11:53:36.429 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[131721]: 2023-12-17T11:53:36.230+0000 7f170130c540 -1 osd.4 0 log_to_monitors true 2023-12-17T11:53:36.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:36.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:36.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:36.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-mon[117414]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:36.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-mon[117414]: from='osd.4 [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:53:36.728 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:36 smithi119 ceph-mon[117414]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:53:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:36 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:36 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:36 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:36 smithi002 ceph-mon[107131]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:36 smithi002 ceph-mon[107131]: from='osd.4 [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:53:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:36 smithi002 ceph-mon[107131]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:53:36.991 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:53:37.908 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[131721]: 2023-12-17T11:53:37.673+0000 7f16f7af1700 -1 osd.4 0 waiting for initial osdmap 2023-12-17T11:53:37.908 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[131721]: 2023-12-17T11:53:37.682+0000 7f16f28ec700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:53:37.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-mon[117414]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T11:53:37.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-mon[117414]: osdmap e33: 5 total, 4 up, 5 in 2023-12-17T11:53:37.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:37.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-mon[117414]: from='osd.4 [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:53:37.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:37 smithi119 ceph-mon[117414]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:53:37.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:37 smithi002 ceph-mon[107131]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T11:53:37.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:37 smithi002 ceph-mon[107131]: osdmap e33: 5 total, 4 up, 5 in 2023-12-17T11:53:37.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:37 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:37.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:37 smithi002 ceph-mon[107131]: from='osd.4 [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:53:37.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:37 smithi002 ceph-mon[107131]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:53:38.875 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-17T11:53:38.875 INFO:teuthology.orchestra.run.smithi119.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-17T11:53:38.875 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10+0 records in 2023-12-17T11:53:38.875 INFO:teuthology.orchestra.run.smithi119.stderr:10+0 records out 2023-12-17T11:53:38.875 INFO:teuthology.orchestra.run.smithi119.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303166 s, 346 MB/s 2023-12-17T11:53:38.876 INFO:teuthology.orchestra.run.smithi119.stderr:--> Zapping successful for: 2023-12-17T11:53:38.952 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:38 smithi119 ceph-mon[117414]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-17T11:53:38.952 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:38 smithi119 ceph-mon[117414]: osdmap e34: 5 total, 4 up, 5 in 2023-12-17T11:53:38.952 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:38 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:38.952 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:38 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:38.952 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:38 smithi119 ceph-mon[117414]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:38.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:38 smithi002 ceph-mon[107131]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-17T11:53:38.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:38 smithi002 ceph-mon[107131]: osdmap e34: 5 total, 4 up, 5 in 2023-12-17T11:53:38.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:38 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:38.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:38 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:38.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:38 smithi002 ceph-mon[107131]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-17T11:53:39.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2023-12-17T11:53:39.824 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: purged_snaps scrub starts 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: purged_snaps scrub ok 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: osd.4 [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] boot 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: osdmap e35: 5 total, 5 up, 5 in 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi119 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:53:39.972 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi119 to 8059M 2023-12-17T11:53:39.973 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.973 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:39.973 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:39.973 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:39 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: purged_snaps scrub starts 2023-12-17T11:53:39.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: purged_snaps scrub ok 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: osd.4 [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] boot 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: osdmap e35: 5 total, 5 up, 5 in 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: Detected new or changed devices on smithi119 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi119 to 8059M 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:39 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:40.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:40 smithi002 ceph-mon[107131]: osdmap e36: 5 total, 5 up, 5 in 2023-12-17T11:53:40.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:40 smithi002 ceph-mon[107131]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:40.976 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 -- 172.21.15.119:0/3501049215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fcbf0 msgr2=0x7f07f40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 --2- 172.21.15.119:0/3501049215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fcbf0 0x7f07f40fd000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f07e4004940 tx=0x7f07e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 -- 172.21.15.119:0/3501049215 shutdown_connections 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 --2- 172.21.15.119:0/3501049215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07f40fde00 0x7f07f40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 --2- 172.21.15.119:0/3501049215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fcbf0 0x7f07f40fd000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 -- 172.21.15.119:0/3501049215 >> 172.21.15.119:0/3501049215 conn(0x7f07f40f82d0 msgr2=0x7f07f40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 -- 172.21.15.119:0/3501049215 shutdown_connections 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.973+0000 7f07f8f27700 1 -- 172.21.15.119:0/3501049215 wait complete. 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.974+0000 7f07f8f27700 1 Processor -- start 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.974+0000 7f07f8f27700 1 -- start start 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f8f27700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07f40fcbf0 0x7f07f410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:53:40.977 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f8f27700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 0x7f07f410fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:53:40.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f8f27700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41102c0 con 0x7f07f40fcbf0 2023-12-17T11:53:40.978 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f8f27700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4110b60 con 0x7f07f40fde00 2023-12-17T11:53:40.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f1d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 0x7f07f410fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:53:40.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f1d9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 0x7f07f410fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:51646/0 (socket says 172.21.15.119:51646) 2023-12-17T11:53:40.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f1d9b700 1 -- 172.21.15.119:0/2214180209 learned_addr learned my addr 172.21.15.119:0/2214180209 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:53:40.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f259c700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07f40fcbf0 0x7f07f410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:53:40.979 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f1d9b700 1 -- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07f40fcbf0 msgr2=0x7f07f410f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f1d9b700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07f40fcbf0 0x7f07f410f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.975+0000 7f07f1d9b700 1 -- 172.21.15.119:0/2214180209 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4005040 con 0x7f07f40fde00 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.976+0000 7f07f1d9b700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 0x7f07f410fcc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07e8002a50 tx=0x7f07e80046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.976+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e8007cc0 con 0x7f07f40fde00 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.976+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07e800f040 con 0x7f07f40fde00 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.976+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f4110e40 con 0x7f07f40fde00 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.976+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e800d9c0 con 0x7f07f40fde00 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.976+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f4111380 con 0x7f07f40fde00 2023-12-17T11:53:40.980 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.977+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f4101ea0 con 0x7f07f40fde00 2023-12-17T11:53:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.978+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f07e800db20 con 0x7f07f40fde00 2023-12-17T11:53:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.979+0000 7f07e2ffd700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f07dc068f70 0x7f07dc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:53:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.979+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f07e80864f0 con 0x7f07f40fde00 2023-12-17T11:53:40.981 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.979+0000 7f07f259c700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f07dc068f70 0x7f07dc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:53:40.982 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.980+0000 7f07f259c700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f07dc068f70 0x7f07dc06b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07e400b7d0 tx=0x7f07e4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:53:40.985 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:40.983+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f07e8056940 con 0x7f07f40fde00 2023-12-17T11:53:41.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:40 smithi119 ceph-mon[117414]: osdmap e36: 5 total, 5 up, 5 in 2023-12-17T11:53:41.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:40 smithi119 ceph-mon[117414]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:41.186 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:41.184+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f41115f0 con 0x7f07dc068f70 2023-12-17T11:53:41.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:41 smithi002 ceph-mon[107131]: from='client.24189 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:53:41.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:53:41.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:53:41.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:41 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:41.988 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:41 smithi119 ceph-mon[117414]: from='client.24189 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:53:41.989 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:53:41.989 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:53:41.989 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:41 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:42 smithi002 ceph-mon[107131]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:42 smithi119 ceph-mon[117414]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:43.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:43 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/906720619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc8023ee-4370-4354-921e-5f7d71df5bc2"}]: dispatch 2023-12-17T11:53:43.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:43 smithi002 ceph-mon[107131]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc8023ee-4370-4354-921e-5f7d71df5bc2"}]: dispatch 2023-12-17T11:53:43.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:43 smithi002 ceph-mon[107131]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc8023ee-4370-4354-921e-5f7d71df5bc2"}]': finished 2023-12-17T11:53:43.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:43 smithi002 ceph-mon[107131]: osdmap e37: 6 total, 5 up, 6 in 2023-12-17T11:53:43.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:43 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:53:44.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:43 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/906720619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc8023ee-4370-4354-921e-5f7d71df5bc2"}]: dispatch 2023-12-17T11:53:44.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:43 smithi119 ceph-mon[117414]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc8023ee-4370-4354-921e-5f7d71df5bc2"}]: dispatch 2023-12-17T11:53:44.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:43 smithi119 ceph-mon[117414]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc8023ee-4370-4354-921e-5f7d71df5bc2"}]': finished 2023-12-17T11:53:44.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:43 smithi119 ceph-mon[117414]: osdmap e37: 6 total, 5 up, 6 in 2023-12-17T11:53:44.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:43 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:53:44.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:44 smithi002 ceph-mon[107131]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:44.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:44 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/3803547782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:53:45.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:44 smithi119 ceph-mon[117414]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:45.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:44 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/3803547782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:53:45.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:46.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:53:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:46 smithi119 ceph-mon[117414]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:46 smithi002 ceph-mon[107131]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:49 smithi119 ceph-mon[117414]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:49 smithi002 ceph-mon[107131]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:50 smithi119 ceph-mon[117414]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:50 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T11:53:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:50 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:50 smithi119 ceph-mon[117414]: Deploying daemon osd.5 on smithi119 2023-12-17T11:53:50.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:50 smithi002 ceph-mon[107131]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:50.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:50 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T11:53:50.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:50 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:50.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:50 smithi002 ceph-mon[107131]: Deploying daemon osd.5 on smithi119 2023-12-17T11:53:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:53 smithi119 ceph-mon[117414]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:53.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:53 smithi002 ceph-mon[107131]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:55.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:55 smithi119 ceph-mon[117414]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:55.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:55 smithi002 ceph-mon[107131]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:56.735 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:56.735 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:56.735 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:57.604 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:57 smithi119 ceph-mon[117414]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:57.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:57 smithi002 ceph-mon[107131]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:58.955 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 5 on host 'smithi119' 2023-12-17T11:53:58.955 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.952+0000 7f07e2ffd700 1 -- 172.21.15.119:0/2214180209 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f07f41115f0 con 0x7f07dc068f70 2023-12-17T11:53:58.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f07dc068f70 msgr2=0x7f07dc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:58.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f07dc068f70 0x7f07dc06b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07e400b7d0 tx=0x7f07e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:53:58.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 msgr2=0x7f07f410fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:53:58.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 0x7f07f410fcc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07e8002a50 tx=0x7f07e80046b0 comp rx=0 tx=0).stop 2023-12-17T11:53:58.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 shutdown_connections 2023-12-17T11:53:58.957 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f07dc068f70 0x7f07dc06b420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:58.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07f40fcbf0 0x7f07f410f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:58.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 --2- 172.21.15.119:0/2214180209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07f40fde00 0x7f07f410fcc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:53:58.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 >> 172.21.15.119:0/2214180209 conn(0x7f07f40f82d0 msgr2=0x7f07f40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:53:58.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 shutdown_connections 2023-12-17T11:53:58.958 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:53:58.955+0000 7f07f8f27700 1 -- 172.21.15.119:0/2214180209 wait complete. 2023-12-17T11:53:59.345 DEBUG:teuthology.orchestra.run.smithi119:osd.5> sudo journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.5.service 2023-12-17T11:53:59.350 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-17T11:53:59.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-17T11:53:59.424 INFO:journalctl@ceph.osd.5.smithi119.stdout:-- Logs begin at Sun 2023-12-17 11:32:10 UTC. -- 2023-12-17T11:53:59.485 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.486 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:53:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:53:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:53:59.744 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 11:53:59 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[140280]: 2023-12-17T11:53:59.482+0000 7fe17f42d540 -1 osd.5 0 log_to_monitors true 2023-12-17T11:53:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:00.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:00 smithi002 ceph-mon[107131]: from='osd.5 [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:54:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:00 smithi002 ceph-mon[107131]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:54:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:00 smithi002 ceph-mon[107131]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:54:00.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:00.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:00 smithi119 ceph-mon[117414]: from='osd.5 [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:54:00.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:00 smithi119 ceph-mon[117414]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:54:00.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:00 smithi119 ceph-mon[117414]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:54:00.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:00.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 -- 172.21.15.2:0/878989986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 msgr2=0x7f63040fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 --2- 172.21.15.2:0/878989986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f63040fd000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6300004940 tx=0x7f6300009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 -- 172.21.15.2:0/878989986 shutdown_connections 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 --2- 172.21.15.2:0/878989986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63040fde00 0x7f63040fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 --2- 172.21.15.2:0/878989986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f63040fd000 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 -- 172.21.15.2:0/878989986 >> 172.21.15.2:0/878989986 conn(0x7f63040f82d0 msgr2=0x7f63040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 -- 172.21.15.2:0/878989986 shutdown_connections 2023-12-17T11:54:00.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.980+0000 7f630bbe5700 1 -- 172.21.15.2:0/878989986 wait complete. 2023-12-17T11:54:00.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.981+0000 7f630bbe5700 1 Processor -- start 2023-12-17T11:54:00.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.981+0000 7f630bbe5700 1 -- start start 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f630bbe5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f630410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f630bbe5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63040fde00 0x7f630410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f630bbe5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630410e010 con 0x7f63040fcbf0 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f630bbe5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630410e8b0 con 0x7f63040fde00 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309981700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f630410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309981700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f630410d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58530/0 (socket says 172.21.15.2:58530) 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309981700 1 -- 172.21.15.2:0/142865871 learned_addr learned my addr 172.21.15.2:0/142865871 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309180700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63040fde00 0x7f630410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309981700 1 -- 172.21.15.2:0/142865871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63040fde00 msgr2=0x7f630410da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309981700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63040fde00 0x7f630410da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.982+0000 7f6309981700 1 -- 172.21.15.2:0/142865871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300005040 con 0x7f63040fcbf0 2023-12-17T11:54:00.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.983+0000 7f6309981700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f630410d4d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6300009fd0 tx=0x7f6300009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:00.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.983+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6300021070 con 0x7f63040fcbf0 2023-12-17T11:54:00.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.983+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630410eb30 con 0x7f63040fcbf0 2023-12-17T11:54:00.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.983+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f630001c400 con 0x7f63040fcbf0 2023-12-17T11:54:00.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.983+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630410f070 con 0x7f63040fcbf0 2023-12-17T11:54:00.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.983+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f630000e070 con 0x7f63040fcbf0 2023-12-17T11:54:00.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.984+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630404bb80 con 0x7f63040fcbf0 2023-12-17T11:54:00.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.985+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f630001c9c0 con 0x7f63040fcbf0 2023-12-17T11:54:00.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.986+0000 7f62fa7fc700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62f0068f70 0x7f62f006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:00.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.986+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4338+0+0 (secure 0 0 0) 0x7f6300087b30 con 0x7f63040fcbf0 2023-12-17T11:54:00.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.986+0000 7f6309180700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62f0068f70 0x7f62f006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:00.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.987+0000 7f6309180700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62f0068f70 0x7f62f006b420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009b80 tx=0x7f62f400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:00.991+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6300057ef0 con 0x7f63040fcbf0 2023-12-17T11:54:01.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.197+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f630410f470 con 0x7f63040fcbf0 2023-12-17T11:54:01.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.197+0000 7f62fa7fc700 1 -- 172.21.15.2:0/142865871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f6300057a80 con 0x7f63040fcbf0 2023-12-17T11:54:01.199 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:01.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62f0068f70 msgr2=0x7f62f006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62f0068f70 0x7f62f006b420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009b80 tx=0x7f62f400b040 comp rx=0 tx=0).stop 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 msgr2=0x7f630410d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f630410d4d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6300009fd0 tx=0x7f6300009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 shutdown_connections 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62f0068f70 0x7f62f006b420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63040fcbf0 0x7f630410d4d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.199+0000 7f630bbe5700 1 --2- 172.21.15.2:0/142865871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63040fde00 0x7f630410da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.200+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 >> 172.21.15.2:0/142865871 conn(0x7f63040f82d0 msgr2=0x7f6304101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.200+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 shutdown_connections 2023-12-17T11:54:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:01.200+0000 7f630bbe5700 1 -- 172.21.15.2:0/142865871 wait complete. 2023-12-17T11:54:01.549 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1702814018,"num_in_osds":6,"osd_in_since":1702814023,"num_remapped_pgs":0} 2023-12-17T11:54:01.890 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-mon[117414]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T11:54:01.890 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-mon[117414]: osdmap e38: 6 total, 5 up, 6 in 2023-12-17T11:54:01.890 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:01.891 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-mon[117414]: from='osd.5 [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:54:01.891 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-mon[117414]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:54:01.891 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/142865871' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T11:54:01.891 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[140280]: 2023-12-17T11:54:01.503+0000 7fe175c12700 -1 osd.5 0 waiting for initial osdmap 2023-12-17T11:54:01.891 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 11:54:01 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[140280]: 2023-12-17T11:54:01.516+0000 7fe172a11700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:54:01.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:01 smithi002 ceph-mon[107131]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T11:54:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:01 smithi002 ceph-mon[107131]: osdmap e38: 6 total, 5 up, 6 in 2023-12-17T11:54:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:01 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:01 smithi002 ceph-mon[107131]: from='osd.5 [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:54:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:01 smithi002 ceph-mon[107131]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T11:54:01.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:01 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/142865871' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T11:54:02.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: purged_snaps scrub starts 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: purged_snaps scrub ok 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: osdmap e39: 6 total, 5 up, 6 in 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi119 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi119 to 5373M 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:54:02.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: purged_snaps scrub starts 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: purged_snaps scrub ok 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: osdmap e39: 6 total, 5 up, 6 in 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: Detected new or changed devices on smithi119 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:54:02.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi119 to 5373M 2023-12-17T11:54:02.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:02.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:54:02.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:02.987 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:03.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:03 smithi119 ceph-mon[117414]: osd.5 [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] boot 2023-12-17T11:54:03.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:03 smithi119 ceph-mon[117414]: osdmap e40: 6 total, 6 up, 6 in 2023-12-17T11:54:03.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:03 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:03.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:03 smithi002 ceph-mon[107131]: osd.5 [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] boot 2023-12-17T11:54:03.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:03 smithi002 ceph-mon[107131]: osdmap e40: 6 total, 6 up, 6 in 2023-12-17T11:54:03.954 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:03 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:54:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.188+0000 7f68f68e7700 1 -- 172.21.15.2:0/3335909787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 msgr2=0x7f68f0070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.188+0000 7f68f68e7700 1 --2- 172.21.15.2:0/3335909787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f0070960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f68e4004940 tx=0x7f68e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.188+0000 7f68f68e7700 1 -- 172.21.15.2:0/3335909787 shutdown_connections 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.188+0000 7f68f68e7700 1 --2- 172.21.15.2:0/3335909787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f0070960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.188+0000 7f68f68e7700 1 --2- 172.21.15.2:0/3335909787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68f0071b40 0x7f68f006ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.188+0000 7f68f68e7700 1 -- 172.21.15.2:0/3335909787 >> 172.21.15.2:0/3335909787 conn(0x7f68f00f82d0 msgr2=0x7f68f00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.189+0000 7f68f68e7700 1 -- 172.21.15.2:0/3335909787 shutdown_connections 2023-12-17T11:54:04.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.189+0000 7f68f68e7700 1 -- 172.21.15.2:0/3335909787 wait complete. 2023-12-17T11:54:04.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.190+0000 7f68f68e7700 1 Processor -- start 2023-12-17T11:54:04.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.190+0000 7f68f68e7700 1 -- start start 2023-12-17T11:54:04.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.190+0000 7f68f68e7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:04.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.190+0000 7f68f68e7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68f0071b40 0x7f68f010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68f68e7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f01102c0 con 0x7f68f00704f0 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68f68e7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0110b00 con 0x7f68f0071b40 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f010f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58556/0 (socket says 172.21.15.2:58556) 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 -- 172.21.15.2:0/708700774 learned_addr learned my addr 172.21.15.2:0/708700774 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68ef7fe700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68f0071b40 0x7f68f010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 -- 172.21.15.2:0/708700774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68f0071b40 msgr2=0x7f68f010fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68f0071b40 0x7f68f010fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 -- 172.21.15.2:0/708700774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4005040 con 0x7f68f00704f0 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.191+0000 7f68effff700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f010f6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f68e000b790 tx=0x7f68e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.192+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e000f6f0 con 0x7f68f00704f0 2023-12-17T11:54:04.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.192+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68e000fd00 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.192+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f0110de0 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.192+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e00103a0 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.192+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f0111320 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.193+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f004bb80 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.194+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f68e000f850 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.195+0000 7f68ecff9700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f68d8068f70 0x7f68d806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.196+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f68e0086870 con 0x7f68f00704f0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.196+0000 7f68ef7fe700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f68d8068f70 0x7f68d806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.196+0000 7f68ef7fe700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f68d8068f70 0x7f68d806b420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68e40043d0 tx=0x7f68e4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.200+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68e0056b10 con 0x7f68f00704f0 2023-12-17T11:54:04.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.406+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f68f0115d10 con 0x7f68f00704f0 2023-12-17T11:54:04.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.407+0000 7f68ecff9700 1 -- 172.21.15.2:0/708700774 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7f68e00566a0 con 0x7f68f00704f0 2023-12-17T11:54:04.409 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f68d8068f70 msgr2=0x7f68d806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f68d8068f70 0x7f68d806b420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68e40043d0 tx=0x7f68e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 msgr2=0x7f68f010f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f010f6f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f68e000b790 tx=0x7f68e0009250 comp rx=0 tx=0).stop 2023-12-17T11:54:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 shutdown_connections 2023-12-17T11:54:04.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f68d8068f70 0x7f68d806b420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68f00704f0 0x7f68f010f6f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 --2- 172.21.15.2:0/708700774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68f0071b40 0x7f68f010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 >> 172.21.15.2:0/708700774 conn(0x7f68f00f82d0 msgr2=0x7f68f0102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 shutdown_connections 2023-12-17T11:54:04.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:04.409+0000 7f68f68e7700 1 -- 172.21.15.2:0/708700774 wait complete. 2023-12-17T11:54:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:04 smithi002 ceph-mon[107131]: osdmap e41: 6 total, 6 up, 6 in 2023-12-17T11:54:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:04 smithi002 ceph-mon[107131]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:04 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/708700774' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T11:54:04.783 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1702814042,"num_in_osds":6,"osd_in_since":1702814023,"num_remapped_pgs":0} 2023-12-17T11:54:04.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-17T11:54:04.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:04 smithi119 ceph-mon[117414]: osdmap e41: 6 total, 6 up, 6 in 2023-12-17T11:54:04.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:04 smithi119 ceph-mon[117414]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:04.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:04 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/708700774' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T11:54:05.216 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:06.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 -- 172.21.15.2:0/1713692173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 msgr2=0x7f8834102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:06.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 --2- 172.21.15.2:0/1713692173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f8834102fd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8828004940 tx=0x7f8828009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:06.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 -- 172.21.15.2:0/1713692173 shutdown_connections 2023-12-17T11:54:06.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 --2- 172.21.15.2:0/1713692173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88341035a0 0x7f88340fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 --2- 172.21.15.2:0/1713692173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f8834102fd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 -- 172.21.15.2:0/1713692173 >> 172.21.15.2:0/1713692173 conn(0x7f88340f8790 msgr2=0x7f88340faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 -- 172.21.15.2:0/1713692173 shutdown_connections 2023-12-17T11:54:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.345+0000 7f883ae38700 1 -- 172.21.15.2:0/1713692173 wait complete. 2023-12-17T11:54:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.346+0000 7f883ae38700 1 Processor -- start 2023-12-17T11:54:06.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.346+0000 7f883ae38700 1 -- start start 2023-12-17T11:54:06.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.346+0000 7f883ae38700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f88341157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.346+0000 7f883ae38700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88341035a0 0x7f8834115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.346+0000 7f883ae38700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834116360 con 0x7f8834102c00 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f883ae38700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883410f690 con 0x7f88341035a0 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f88341157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f88341157d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58582/0 (socket says 172.21.15.2:58582) 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 -- 172.21.15.2:0/2027862612 learned_addr learned my addr 172.21.15.2:0/2027862612 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8833fff700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88341035a0 0x7f8834115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 -- 172.21.15.2:0/2027862612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88341035a0 msgr2=0x7f8834115d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88341035a0 0x7f8834115d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 -- 172.21.15.2:0/2027862612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828005040 con 0x7f8834102c00 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.347+0000 7f8838bd4700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f88341157d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8828008d80 tx=0x7f8828009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.348+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882800e030 con 0x7f8834102c00 2023-12-17T11:54:06.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.348+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8828004290 con 0x7f8834102c00 2023-12-17T11:54:06.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.348+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883410f910 con 0x7f8834102c00 2023-12-17T11:54:06.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.348+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882801ce60 con 0x7f8834102c00 2023-12-17T11:54:06.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.348+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883410fe50 con 0x7f8834102c00 2023-12-17T11:54:06.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.349+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340fc390 con 0x7f8834102c00 2023-12-17T11:54:06.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.350+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f882801c690 con 0x7f8834102c00 2023-12-17T11:54:06.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.351+0000 7f88317fa700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f8824068f70 0x7f882406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:06.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.351+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f88280884b0 con 0x7f8834102c00 2023-12-17T11:54:06.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.351+0000 7f8833fff700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f8824068f70 0x7f882406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:06.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.352+0000 7f8833fff700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f8824068f70 0x7f882406b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8820004600 tx=0x7f882000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:06.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.356+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8828058730 con 0x7f8834102c00 2023-12-17T11:54:06.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.562+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8834110de0 con 0x7f8834102c00 2023-12-17T11:54:06.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.563+0000 7f88317fa700 1 -- 172.21.15.2:0/2027862612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11016 (secure 0 0 0) 0x7f88280582c0 con 0x7f8834102c00 2023-12-17T11:54:06.565 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:06.565 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:48:50.417719+0000","modified":"2023-12-17T11:54:03.507739+0000","last_up_change":"2023-12-17T11:54:02.501200+0000","last_in_change":"2023-12-17T11:53:43.616013+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:52:56.580032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"2114bd7b-19fb-4504-8164-694ca3b767d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6803","nonce":705553234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6805","nonce":705553234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6809","nonce":705553234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6807","nonce":705553234}]},"public_addr":"172.21.15.2:6803/705553234","cluster_addr":"172.21.15.2:6805/705553234","heartbeat_back_addr":"172.21.15.2:6809/705553234","heartbeat_front_addr":"172.21.15.2:6807/705553234","state":["exists","up"]},{"osd":1,"uuid":"4b728955-c4f6-4426-ae59-4614cbfea807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6811","nonce":3692503315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6813","nonce":3692503315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6817","nonce":3692503315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6815","nonce":3692503315}]},"public_addr":"172.21.15.2:6811/3692503315","cluster_addr":"172.21.15.2:6813/3692503315","heartbeat_back_addr":"172.21.15.2:6817/3692503315","heartbeat_front_addr":"172.21.15.2:6815/3692503315","state":["exists","up"]},{"osd":2,"uuid":"a4f28cc1-78bc-4434-a7a0-ca4a373fc384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6819","nonce":3160012484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6821","nonce":3160012484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6825","nonce":3160012484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6823","nonce":3160012484}]},"public_addr":"172.21.15.2:6819/3160012484","cluster_addr":"172.21.15.2:6821/3160012484","heartbeat_back_addr":"172.21.15.2:6825/3160012484","heartbeat_front_addr":"172.21.15.2:6823/3160012484","state":["exists","up"]},{"osd":3,"uuid":"b8f7021b-7c22-415a-9635-af30e6e6fc13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6801","nonce":1489766066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6803","nonce":1489766066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6807","nonce":1489766066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6805","nonce":1489766066}]},"public_addr":"172.21.15.119:6801/1489766066","cluster_addr":"172.21.15.119:6803/1489766066","heartbeat_back_addr":"172.21.15.119:6807/1489766066","heartbeat_front_addr":"172.21.15.119:6805/1489766066","state":["exists","up"]},{"osd":4,"uuid":"d5ebbeab-3ba4-4e81-b453-d775808ac559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6809","nonce":487685407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6811","nonce":487685407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6815","nonce":487685407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6813","nonce":487685407}]},"public_addr":"172.21.15.119:6809/487685407","cluster_addr":"172.21.15.119:6811/487685407","heartbeat_back_addr":"172.21.15.119:6815/487685407","heartbeat_front_addr":"172.21.15.119:6813/487685407","state":["exists","up"]},{"osd":5,"uuid":"dc8023ee-4370-4354-921e-5f7d71df5bc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6817","nonce":3782361466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6819","nonce":3782361466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6823","nonce":3782361466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6821","nonce":3782361466}]},"public_addr":"172.21.15.119:6817/3782361466","cluster_addr":"172.21.15.119:6819/3782361466","heartbeat_back_addr":"172.21.15.119:6823/3782361466","heartbeat_front_addr":"172.21.15.119:6821/3782361466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:06.272236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:30.215924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:52.820296+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:14.743572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:37.197272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:54:00.536614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1129063553":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3796631798":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3009915854":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6801/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/3091655634":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3688904349":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6800/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/2886179339":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6801/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/599472466":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/1642465919":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/582228833":"2023-12-18T11:49:51.668708+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:54:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f8824068f70 msgr2=0x7f882406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f8824068f70 0x7f882406b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8820004600 tx=0x7f882000b040 comp rx=0 tx=0).stop 2023-12-17T11:54:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 msgr2=0x7f88341157d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:06.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f88341157d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8828008d80 tx=0x7f8828009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 shutdown_connections 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f8824068f70 0x7f882406b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8834102c00 0x7f88341157d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 --2- 172.21.15.2:0/2027862612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88341035a0 0x7f8834115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 >> 172.21.15.2:0/2027862612 conn(0x7f88340f8790 msgr2=0x7f88340f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 shutdown_connections 2023-12-17T11:54:06.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:06.565+0000 7f883ae38700 1 -- 172.21.15.2:0/2027862612 wait complete. 2023-12-17T11:54:06.944 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:52:56.580032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-17T11:54:06.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-17T11:54:07.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:07 smithi002 ceph-mon[107131]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:07.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:07 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2027862612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:54:07.375 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:07.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:07 smithi119 ceph-mon[117414]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:07.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:07 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2027862612' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 -- 172.21.15.2:0/3509738832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450102c00 msgr2=0x7f2450102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 --2- 172.21.15.2:0/3509738832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450102c00 0x7f2450102fd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f244c004940 tx=0x7f244c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 -- 172.21.15.2:0/3509738832 shutdown_connections 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 --2- 172.21.15.2:0/3509738832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24501035a0 0x7f24500fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 --2- 172.21.15.2:0/3509738832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2450102c00 0x7f2450102fd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 -- 172.21.15.2:0/3509738832 >> 172.21.15.2:0/3509738832 conn(0x7f24500f8790 msgr2=0x7f24500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 -- 172.21.15.2:0/3509738832 shutdown_connections 2023-12-17T11:54:08.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.499+0000 7f2457856700 1 -- 172.21.15.2:0/3509738832 wait complete. 2023-12-17T11:54:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.500+0000 7f2457856700 1 Processor -- start 2023-12-17T11:54:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.500+0000 7f2457856700 1 -- start start 2023-12-17T11:54:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f2457856700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 0x7f245006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f2457856700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24501035a0 0x7f2450070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f2457856700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450070a80 con 0x7f2450102c00 2023-12-17T11:54:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f2457856700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450070bf0 con 0x7f24501035a0 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f24555f2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 0x7f245006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f24555f2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 0x7f245006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58598/0 (socket says 172.21.15.2:58598) 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f24555f2700 1 -- 172.21.15.2:0/3521228427 learned_addr learned my addr 172.21.15.2:0/3521228427 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f2454df1700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24501035a0 0x7f2450070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f24555f2700 1 -- 172.21.15.2:0/3521228427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24501035a0 msgr2=0x7f2450070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f24555f2700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24501035a0 0x7f2450070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.501+0000 7f24555f2700 1 -- 172.21.15.2:0/3521228427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440005040 con 0x7f2450102c00 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.502+0000 7f24555f2700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 0x7f245006ff40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f244c0040d0 tx=0x7f244c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.502+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244c021070 con 0x7f2450102c00 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.502+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c005040 con 0x7f2450102c00 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.502+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f244c0093b0 con 0x7f2450102c00 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.502+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2450119ab0 con 0x7f2450102c00 2023-12-17T11:54:08.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.502+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244c00e070 con 0x7f2450102c00 2023-12-17T11:54:08.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.503+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24500fff10 con 0x7f2450102c00 2023-12-17T11:54:08.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.504+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f244c01c5e0 con 0x7f2450102c00 2023-12-17T11:54:08.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.505+0000 7f2445ffb700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f243c068f70 0x7f243c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:08.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.505+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f244c087c10 con 0x7f2450102c00 2023-12-17T11:54:08.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.505+0000 7f2454df1700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f243c068f70 0x7f243c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:08.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.506+0000 7f2454df1700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f243c068f70 0x7f243c06b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2450071940 tx=0x7f244000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.509+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f244c054380 con 0x7f2450102c00 2023-12-17T11:54:08.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.713+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2450071680 con 0x7f2450102c00 2023-12-17T11:54:08.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.713+0000 7f2445ffb700 1 -- 172.21.15.2:0/3521228427 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f244c0579a0 con 0x7f2450102c00 2023-12-17T11:54:08.715 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.715+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f243c068f70 msgr2=0x7f243c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.715+0000 7f2457856700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f243c068f70 0x7f243c06b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2450071940 tx=0x7f244000b040 comp rx=0 tx=0).stop 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.715+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 msgr2=0x7f245006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.715+0000 7f2457856700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 0x7f245006ff40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f244c0040d0 tx=0x7f244c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 shutdown_connections 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f243c068f70 0x7f243c06b420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2450102c00 0x7f245006ff40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 --2- 172.21.15.2:0/3521228427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24501035a0 0x7f2450070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 >> 172.21.15.2:0/3521228427 conn(0x7f24500f8790 msgr2=0x7f24500fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 shutdown_connections 2023-12-17T11:54:08.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:08.716+0000 7f2457856700 1 -- 172.21.15.2:0/3521228427 wait complete. 2023-12-17T11:54:09.105 INFO:tasks.cephadm:Setting up client nodes... 2023-12-17T11:54:09.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-17T11:54:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:09 smithi119 ceph-mon[117414]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:09 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3521228427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T11:54:09.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:09 smithi002 ceph-mon[107131]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:09.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:09 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3521228427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T11:54:09.539 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 -- 172.21.15.2:0/3079459201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 msgr2=0x7ff4180fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 --2- 172.21.15.2:0/3079459201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff4180fd000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff40c004940 tx=0x7ff40c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 -- 172.21.15.2:0/3079459201 shutdown_connections 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 --2- 172.21.15.2:0/3079459201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4180fde00 0x7ff4180fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 --2- 172.21.15.2:0/3079459201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff4180fd000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 -- 172.21.15.2:0/3079459201 >> 172.21.15.2:0/3079459201 conn(0x7ff4180f82d0 msgr2=0x7ff4180fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 -- 172.21.15.2:0/3079459201 shutdown_connections 2023-12-17T11:54:10.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.686+0000 7ff41eff5700 1 -- 172.21.15.2:0/3079459201 wait complete. 2023-12-17T11:54:10.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41eff5700 1 Processor -- start 2023-12-17T11:54:10.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41eff5700 1 -- start start 2023-12-17T11:54:10.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41eff5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff41810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:10.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41eff5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4180fde00 0x7ff41810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41eff5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4181102a0 con 0x7ff4180fcbf0 2023-12-17T11:54:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41eff5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff418110b40 con 0x7ff4180fde00 2023-12-17T11:54:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.688+0000 7ff41cd91700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff41810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41cd91700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff41810f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53032/0 (socket says 172.21.15.2:53032) 2023-12-17T11:54:10.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41cd91700 1 -- 172.21.15.2:0/2629449118 learned_addr learned my addr 172.21.15.2:0/2629449118 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff417fff700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4180fde00 0x7ff41810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41cd91700 1 -- 172.21.15.2:0/2629449118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4180fde00 msgr2=0x7ff41810fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41cd91700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4180fde00 0x7ff41810fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41cd91700 1 -- 172.21.15.2:0/2629449118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c005040 con 0x7ff4180fcbf0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41cd91700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff41810f760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009360 tx=0x7ff40c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40c00e040 con 0x7ff4180fcbf0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff40c004290 con 0x7ff4180fcbf0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40c01c630 con 0x7ff4180fcbf0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.689+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff418110dc0 con 0x7ff4180fcbf0 2023-12-17T11:54:10.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.690+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418111300 con 0x7ff4180fcbf0 2023-12-17T11:54:10.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.691+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff418101ea0 con 0x7ff4180fcbf0 2023-12-17T11:54:10.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.692+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7ff40c013960 con 0x7ff4180fcbf0 2023-12-17T11:54:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.693+0000 7ff4157fa700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff408068f70 0x7ff40806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.693+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff40c087d10 con 0x7ff4180fcbf0 2023-12-17T11:54:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.693+0000 7ff417fff700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff408068f70 0x7ff40806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:10.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.694+0000 7ff417fff700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff408068f70 0x7ff40806b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff404007fd0 tx=0x7ff404009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:10.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.697+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff40c058050 con 0x7ff4180fcbf0 2023-12-17T11:54:10.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:10 smithi002 ceph-mon[107131]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:10 smithi119 ceph-mon[117414]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:10.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.981+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ff41804bb80 con 0x7ff4180fcbf0 2023-12-17T11:54:10.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.986+0000 7ff4157fa700 1 -- 172.21.15.2:0/2629449118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7ff40c057be0 con 0x7ff4180fcbf0 2023-12-17T11:54:10.988 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-12-17T11:54:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBi4X5llG+ZOhAANnWn5OfqPM+Ai5GcsVDcYg== 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff408068f70 msgr2=0x7ff40806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff408068f70 0x7ff40806b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff404007fd0 tx=0x7ff404009040 comp rx=0 tx=0).stop 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 msgr2=0x7ff41810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff41810f760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009360 tx=0x7ff40c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 shutdown_connections 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff408068f70 0x7ff40806b420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4180fcbf0 0x7ff41810f760 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 --2- 172.21.15.2:0/2629449118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4180fde00 0x7ff41810fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 >> 172.21.15.2:0/2629449118 conn(0x7ff4180f82d0 msgr2=0x7ff4180ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.988+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 shutdown_connections 2023-12-17T11:54:10.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:10.989+0000 7ff41eff5700 1 -- 172.21.15.2:0/2629449118 wait complete. 2023-12-17T11:54:11.379 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:54:11.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-17T11:54:11.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-17T11:54:11.478 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-17T11:54:11.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:11 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2629449118' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T11:54:11.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:11 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2629449118' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T11:54:11.906 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi119/config 2023-12-17T11:54:11.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:11 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2629449118' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T11:54:11.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:11 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2629449118' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T11:54:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:12 smithi119 ceph-mon[117414]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:12.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:12 smithi002 ceph-mon[107131]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:13.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.042+0000 7f3864cb6700 1 -- 172.21.15.119:0/3747353848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860071bc0 msgr2=0x7f3860070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:13.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.042+0000 7f3864cb6700 1 --2- 172.21.15.119:0/3747353848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860071bc0 0x7f3860070030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3850004940 tx=0x7f3850009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:13.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.043+0000 7f3864cb6700 1 -- 172.21.15.119:0/3747353848 shutdown_connections 2023-12-17T11:54:13.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.043+0000 7f3864cb6700 1 --2- 172.21.15.119:0/3747353848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860070570 0x7f38600709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:13.046 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.043+0000 7f3864cb6700 1 --2- 172.21.15.119:0/3747353848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860071bc0 0x7f3860070030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.043+0000 7f3864cb6700 1 -- 172.21.15.119:0/3747353848 >> 172.21.15.119:0/3747353848 conn(0x7f38600f82d0 msgr2=0x7f38600fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.043+0000 7f3864cb6700 1 -- 172.21.15.119:0/3747353848 shutdown_connections 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.043+0000 7f3864cb6700 1 -- 172.21.15.119:0/3747353848 wait complete. 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f3864cb6700 1 Processor -- start 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f3864cb6700 1 -- start start 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f3864cb6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 0x7f386010f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f3864cb6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860071bc0 0x7f386010fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f3864cb6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860110200 con 0x7f3860071bc0 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f3864cb6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860110aa0 con 0x7f3860070570 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f385e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 0x7f386010f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f385e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 0x7f386010f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53604/0 (socket says 172.21.15.119:53604) 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f385e59c700 1 -- 172.21.15.119:0/827165662 learned_addr learned my addr 172.21.15.119:0/827165662 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-12-17T11:54:13.047 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.044+0000 7f385dd9b700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860071bc0 0x7f386010fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f385e59c700 1 -- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860071bc0 msgr2=0x7f386010fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f385e59c700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860071bc0 0x7f386010fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:13.048 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f385e59c700 1 -- 172.21.15.119:0/827165662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850005040 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f385e59c700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 0x7f386010f6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3850009040 tx=0x7f3850009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385000e040 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3860110d20 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3850004290 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385001c630 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.045+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3860111260 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.046+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860109720 con 0x7f3860070570 2023-12-17T11:54:13.049 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.047+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f385000bc50 con 0x7f3860070570 2023-12-17T11:54:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.048+0000 7f384effd700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3848068f70 0x7f384806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.048+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3850087fe0 con 0x7f3860070570 2023-12-17T11:54:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.048+0000 7f385dd9b700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3848068f70 0x7f384806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:13.050 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.049+0000 7f385dd9b700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3848068f70 0x7f384806b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3854004f60 tx=0x7f385400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:13.054 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.052+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f38500b9a00 con 0x7f3860070570 2023-12-17T11:54:13.322 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.320+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f386004bb80 con 0x7f3860070570 2023-12-17T11:54:13.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.326+0000 7f384effd700 1 -- 172.21.15.119:0/827165662 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f38500581e0 con 0x7f3860070570 2023-12-17T11:54:13.328 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2023-12-17T11:54:13.328 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBl4X5lKIY5ExAA2KAuiYmg9b99QmvNgh8r2w== 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3848068f70 msgr2=0x7f384806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3848068f70 0x7f384806b420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3854004f60 tx=0x7f385400b040 comp rx=0 tx=0).stop 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 msgr2=0x7f386010f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 0x7f386010f6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3850009040 tx=0x7f3850009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 shutdown_connections 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3848068f70 0x7f384806b420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3860070570 0x7f386010f6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 --2- 172.21.15.119:0/827165662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3860071bc0 0x7f386010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.328+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 >> 172.21.15.119:0/827165662 conn(0x7f38600f82d0 msgr2=0x7f38600fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.329+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 shutdown_connections 2023-12-17T11:54:13.331 INFO:teuthology.orchestra.run.smithi119.stderr:2023-12-17T11:54:13.329+0000 7f3864cb6700 1 -- 172.21.15.119:0/827165662 wait complete. 2023-12-17T11:54:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:13 smithi119 ceph-mon[117414]: from='client.? 172.21.15.119:0/827165662' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T11:54:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:13 smithi119 ceph-mon[117414]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T11:54:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:13 smithi119 ceph-mon[117414]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T11:54:13.699 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:54:13.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-17T11:54:13.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-17T11:54:13.799 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-17T11:54:13.800 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-17T11:54:13.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-17T11:54:13.869 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:13 smithi002 ceph-mon[107131]: from='client.? 172.21.15.119:0/827165662' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T11:54:13.870 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:13 smithi002 ceph-mon[107131]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T11:54:13.870 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:13 smithi002 ceph-mon[107131]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T11:54:14.239 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:14.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:14 smithi002 ceph-mon[107131]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:14.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:14 smithi119 ceph-mon[117414]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2050400340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0480fca30 msgr2=0x7fa0480fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2050400340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0480fca30 0x7fa0480fcea0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa03c004940 tx=0x7fa03c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2050400340 shutdown_connections 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2050400340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0480fca30 0x7fa0480fcea0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2050400340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa048102a70 0x7fa048102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2050400340 >> 172.21.15.2:0/2050400340 conn(0x7fa0480f8590 msgr2=0x7fa0480fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2050400340 shutdown_connections 2023-12-17T11:54:15.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.345+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2050400340 wait complete. 2023-12-17T11:54:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.346+0000 7fa04cfc2700 1 Processor -- start 2023-12-17T11:54:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.346+0000 7fa04cfc2700 1 -- start start 2023-12-17T11:54:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa04cfc2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0480fca30 0x7fa04806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa04cfc2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 0x7fa048070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:15.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa04cfc2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048070a80 con 0x7fa048102a70 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa04cfc2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048070bf0 con 0x7fa0480fca30 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa046ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 0x7fa048070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa046ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 0x7fa048070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53052/0 (socket says 172.21.15.2:53052) 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa046ffd700 1 -- 172.21.15.2:0/2150494057 learned_addr learned my addr 172.21.15.2:0/2150494057 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa0477fe700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0480fca30 0x7fa04806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa046ffd700 1 -- 172.21.15.2:0/2150494057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0480fca30 msgr2=0x7fa04806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa046ffd700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0480fca30 0x7fa04806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.347+0000 7fa046ffd700 1 -- 172.21.15.2:0/2150494057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c005040 con 0x7fa048102a70 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.348+0000 7fa046ffd700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 0x7fa048070480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0040d0 tx=0x7fa03c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.348+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03c021070 con 0x7fa048102a70 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.348+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa03c01c400 con 0x7fa048102a70 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.348+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03c00e070 con 0x7fa048102a70 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.348+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0481195e0 con 0x7fa048102a70 2023-12-17T11:54:15.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.348+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa048119ac0 con 0x7fa048102a70 2023-12-17T11:54:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.349+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa048104ef0 con 0x7fa048102a70 2023-12-17T11:54:15.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.350+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fa03c01c9c0 con 0x7fa048102a70 2023-12-17T11:54:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.351+0000 7fa02ffff700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa030068f70 0x7fa03006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.351+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa03c087c90 con 0x7fa048102a70 2023-12-17T11:54:15.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.351+0000 7fa0477fe700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa030068f70 0x7fa03006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:15.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.352+0000 7fa0477fe700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa030068f70 0x7fa03006b420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa038009fd0 tx=0x7fa03800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:15.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.356+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa03c054480 con 0x7fa048102a70 2023-12-17T11:54:15.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.619+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa048071680 con 0x7fa048102a70 2023-12-17T11:54:15.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.622+0000 7fa02ffff700 1 -- 172.21.15.2:0/2150494057 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166766 (secure 0 0 0) 0x7fa03c057aa0 con 0x7fa048102a70 2023-12-17T11:54:15.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:15.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa030068f70 msgr2=0x7fa03006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa030068f70 0x7fa03006b420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa038009fd0 tx=0x7fa03800b040 comp rx=0 tx=0).stop 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 msgr2=0x7fa048070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 0x7fa048070480 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0040d0 tx=0x7fa03c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 shutdown_connections 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa030068f70 0x7fa03006b420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0480fca30 0x7fa04806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 --2- 172.21.15.2:0/2150494057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa048102a70 0x7fa048070480 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 >> 172.21.15.2:0/2150494057 conn(0x7fa0480f8590 msgr2=0x7fa0480f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 shutdown_connections 2023-12-17T11:54:15.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:15.626+0000 7fa04cfc2700 1 -- 172.21.15.2:0/2150494057 wait complete. 2023-12-17T11:54:15.796 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:15.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:16.004 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"active_gid":14218,"active_name":"smithi002.cqnuqs","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3359833978},{"type":"v1","addr":"172.21.15.2:6801","nonce":3359833978}]},"active_addr":"172.21.15.2:6801/3359833978","active_change":"2023-12-17T11:50:59.977898+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14242,"name":"smithi119.nzblpy","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/","prometheus":"http://172.21.15.2:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2256843163}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3461314058}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":4058365663}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":96945266}]}]} 2023-12-17T11:54:16.007 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-17T11:54:16.008 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-17T11:54:16.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-17T11:54:16.442 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:16.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:16 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2150494057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-17T11:54:16.904 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:16 smithi002 ceph-mon[107131]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:16.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:16 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2150494057' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-17T11:54:16.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:16 smithi119 ceph-mon[117414]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:17.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 -- 172.21.15.2:0/729846088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7150102c00 msgr2=0x7f7150102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 --2- 172.21.15.2:0/729846088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7150102c00 0x7f7150102fd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f714c004940 tx=0x7f714c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 -- 172.21.15.2:0/729846088 shutdown_connections 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 --2- 172.21.15.2:0/729846088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71501035a0 0x7f71500fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 --2- 172.21.15.2:0/729846088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7150102c00 0x7f7150102fd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 -- 172.21.15.2:0/729846088 >> 172.21.15.2:0/729846088 conn(0x7f71500f8790 msgr2=0x7f71500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 -- 172.21.15.2:0/729846088 shutdown_connections 2023-12-17T11:54:17.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.585+0000 7f7157fdd700 1 -- 172.21.15.2:0/729846088 wait complete. 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.586+0000 7f7157fdd700 1 Processor -- start 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.586+0000 7f7157fdd700 1 -- start start 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.586+0000 7f7157fdd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7150102c00 0x7f7150115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7157fdd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 0x7f7150115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7157fdd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71501163d0 con 0x7f71501035a0 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7157fdd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715010f700 con 0x7f7150102c00 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 0x7f7150115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 0x7f7150115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53068/0 (socket says 172.21.15.2:53068) 2023-12-17T11:54:17.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 -- 172.21.15.2:0/1498939226 learned_addr learned my addr 172.21.15.2:0/1498939226 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155d79700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7150102c00 0x7f7150115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 -- 172.21.15.2:0/1498939226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7150102c00 msgr2=0x7f7150115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7150102c00 0x7f7150115840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 -- 172.21.15.2:0/1498939226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c005040 con 0x7f71501035a0 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.587+0000 7f7155578700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 0x7f7150115d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7140002a50 tx=0x7f7140004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.588+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7140007cc0 con 0x7f71501035a0 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.588+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f714000f040 con 0x7f71501035a0 2023-12-17T11:54:17.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.588+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715010f9e0 con 0x7f71501035a0 2023-12-17T11:54:17.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.588+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f714000d920 con 0x7f71501035a0 2023-12-17T11:54:17.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.588+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715010ff20 con 0x7f71501035a0 2023-12-17T11:54:17.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.589+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500fc390 con 0x7f71501035a0 2023-12-17T11:54:17.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.590+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f7140009680 con 0x7f71501035a0 2023-12-17T11:54:17.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.591+0000 7f71467fc700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f713c068f70 0x7f713c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:17.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.591+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7140086750 con 0x7f71501035a0 2023-12-17T11:54:17.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.591+0000 7f7155d79700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f713c068f70 0x7f713c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:17.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.592+0000 7f7155d79700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f713c068f70 0x7f713c06b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b3b0 tx=0x7f714c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:17.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.595+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7140056950 con 0x7f71501035a0 2023-12-17T11:54:17.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.799+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f715004bb80 con 0x7f71501035a0 2023-12-17T11:54:17.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.800+0000 7f71467fc700 1 -- 172.21.15.2:0/1498939226 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11016 (secure 0 0 0) 0x7f71400564e0 con 0x7f71501035a0 2023-12-17T11:54:17.802 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:17.802 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:48:50.417719+0000","modified":"2023-12-17T11:54:03.507739+0000","last_up_change":"2023-12-17T11:54:02.501200+0000","last_in_change":"2023-12-17T11:53:43.616013+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:52:56.580032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"2114bd7b-19fb-4504-8164-694ca3b767d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6803","nonce":705553234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6805","nonce":705553234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6809","nonce":705553234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6807","nonce":705553234}]},"public_addr":"172.21.15.2:6803/705553234","cluster_addr":"172.21.15.2:6805/705553234","heartbeat_back_addr":"172.21.15.2:6809/705553234","heartbeat_front_addr":"172.21.15.2:6807/705553234","state":["exists","up"]},{"osd":1,"uuid":"4b728955-c4f6-4426-ae59-4614cbfea807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6811","nonce":3692503315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6813","nonce":3692503315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6817","nonce":3692503315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6815","nonce":3692503315}]},"public_addr":"172.21.15.2:6811/3692503315","cluster_addr":"172.21.15.2:6813/3692503315","heartbeat_back_addr":"172.21.15.2:6817/3692503315","heartbeat_front_addr":"172.21.15.2:6815/3692503315","state":["exists","up"]},{"osd":2,"uuid":"a4f28cc1-78bc-4434-a7a0-ca4a373fc384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6819","nonce":3160012484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6821","nonce":3160012484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6825","nonce":3160012484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6823","nonce":3160012484}]},"public_addr":"172.21.15.2:6819/3160012484","cluster_addr":"172.21.15.2:6821/3160012484","heartbeat_back_addr":"172.21.15.2:6825/3160012484","heartbeat_front_addr":"172.21.15.2:6823/3160012484","state":["exists","up"]},{"osd":3,"uuid":"b8f7021b-7c22-415a-9635-af30e6e6fc13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6801","nonce":1489766066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6803","nonce":1489766066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6807","nonce":1489766066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6805","nonce":1489766066}]},"public_addr":"172.21.15.119:6801/1489766066","cluster_addr":"172.21.15.119:6803/1489766066","heartbeat_back_addr":"172.21.15.119:6807/1489766066","heartbeat_front_addr":"172.21.15.119:6805/1489766066","state":["exists","up"]},{"osd":4,"uuid":"d5ebbeab-3ba4-4e81-b453-d775808ac559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6809","nonce":487685407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6811","nonce":487685407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6815","nonce":487685407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6813","nonce":487685407}]},"public_addr":"172.21.15.119:6809/487685407","cluster_addr":"172.21.15.119:6811/487685407","heartbeat_back_addr":"172.21.15.119:6815/487685407","heartbeat_front_addr":"172.21.15.119:6813/487685407","state":["exists","up"]},{"osd":5,"uuid":"dc8023ee-4370-4354-921e-5f7d71df5bc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6817","nonce":3782361466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6819","nonce":3782361466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6823","nonce":3782361466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6821","nonce":3782361466}]},"public_addr":"172.21.15.119:6817/3782361466","cluster_addr":"172.21.15.119:6819/3782361466","heartbeat_back_addr":"172.21.15.119:6823/3782361466","heartbeat_front_addr":"172.21.15.119:6821/3782361466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:06.272236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:30.215924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:52.820296+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:14.743572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:37.197272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:54:00.536614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1129063553":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3796631798":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3009915854":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6801/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/3091655634":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3688904349":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6800/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/2886179339":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6801/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/599472466":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/1642465919":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/582228833":"2023-12-18T11:49:51.668708+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:54:17.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f713c068f70 msgr2=0x7f713c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:17.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f713c068f70 0x7f713c06b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b3b0 tx=0x7f714c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:17.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 msgr2=0x7f7150115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:17.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 0x7f7150115d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7140002a50 tx=0x7f7140004600 comp rx=0 tx=0).stop 2023-12-17T11:54:17.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 shutdown_connections 2023-12-17T11:54:17.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f713c068f70 0x7f713c06b420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:17.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7150102c00 0x7f7150115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:17.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 --2- 172.21.15.2:0/1498939226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71501035a0 0x7f7150115d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:17.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 >> 172.21.15.2:0/1498939226 conn(0x7f71500f8790 msgr2=0x7f71500fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:17.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 shutdown_connections 2023-12-17T11:54:17.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:17.802+0000 7f7157fdd700 1 -- 172.21.15.2:0/1498939226 wait complete. 2023-12-17T11:54:18.145 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:17 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1498939226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:54:18.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:17 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1498939226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:54:18.172 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-17T11:54:18.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-17T11:54:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:19.096 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:18 smithi002 ceph-mon[107131]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:19.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:18 smithi119 ceph-mon[117414]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3879461592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 msgr2=0x7ff7e4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3879461592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4102fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4004940 tx=0x7ff7d4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3879461592 shutdown_connections 2023-12-17T11:54:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3879461592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 0x7ff7e40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3879461592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4102fd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3879461592 >> 172.21.15.2:0/3879461592 conn(0x7ff7e40f8790 msgr2=0x7ff7e40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3879461592 shutdown_connections 2023-12-17T11:54:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.743+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3879461592 wait complete. 2023-12-17T11:54:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.744+0000 7ff7e9db6700 1 Processor -- start 2023-12-17T11:54:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.744+0000 7ff7e9db6700 1 -- start start 2023-12-17T11:54:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.744+0000 7ff7e9db6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4113630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.744+0000 7ff7e9db6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 0x7ff7e4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e9db6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4114200 con 0x7ff7e4102c00 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e9db6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e410d4f0 con 0x7ff7e41035a0 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4113630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4113630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55418/0 (socket says 172.21.15.2:55418) 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e37fe700 1 -- 172.21.15.2:0/3934913121 learned_addr learned my addr 172.21.15.2:0/3934913121 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e2ffd700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 0x7ff7e4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e37fe700 1 -- 172.21.15.2:0/3934913121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 msgr2=0x7ff7e4113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e37fe700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 0x7ff7e4113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e37fe700 1 -- 172.21.15.2:0/3934913121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4005040 con 0x7ff7e4102c00 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.745+0000 7ff7e2ffd700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 0x7ff7e4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:54:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.746+0000 7ff7e37fe700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4113630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009fd0 tx=0x7ff7d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.746+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d400e040 con 0x7ff7e4102c00 2023-12-17T11:54:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.746+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7d400bc50 con 0x7ff7e4102c00 2023-12-17T11:54:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.746+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e410d720 con 0x7ff7e4102c00 2023-12-17T11:54:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.746+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7d4013ea0 con 0x7ff7e4102c00 2023-12-17T11:54:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.746+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e410dc60 con 0x7ff7e4102c00 2023-12-17T11:54:19.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.747+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e40fff10 con 0x7ff7e4102c00 2023-12-17T11:54:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.748+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7ff7d4013420 con 0x7ff7e4102c00 2023-12-17T11:54:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.749+0000 7ff7cbfff700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff7cc068f70 0x7ff7cc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.749+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff7d4087f50 con 0x7ff7e4102c00 2023-12-17T11:54:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.749+0000 7ff7e2ffd700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff7cc068f70 0x7ff7cc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.750+0000 7ff7e2ffd700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff7cc068f70 0x7ff7cc06b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009fd0 tx=0x7ff7d8009f20 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:19.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.754+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff7d4058150 con 0x7ff7e4102c00 2023-12-17T11:54:19.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.958+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e404bb80 con 0x7ff7e4102c00 2023-12-17T11:54:19.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.959+0000 7ff7cbfff700 1 -- 172.21.15.2:0/3934913121 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11016 (secure 0 0 0) 0x7ff7d4057ce0 con 0x7ff7e4102c00 2023-12-17T11:54:19.963 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:19.963 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:48:50.417719+0000","modified":"2023-12-17T11:54:03.507739+0000","last_up_change":"2023-12-17T11:54:02.501200+0000","last_in_change":"2023-12-17T11:53:43.616013+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:52:56.580032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"2114bd7b-19fb-4504-8164-694ca3b767d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6803","nonce":705553234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6805","nonce":705553234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6809","nonce":705553234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6807","nonce":705553234}]},"public_addr":"172.21.15.2:6803/705553234","cluster_addr":"172.21.15.2:6805/705553234","heartbeat_back_addr":"172.21.15.2:6809/705553234","heartbeat_front_addr":"172.21.15.2:6807/705553234","state":["exists","up"]},{"osd":1,"uuid":"4b728955-c4f6-4426-ae59-4614cbfea807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6811","nonce":3692503315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6813","nonce":3692503315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6817","nonce":3692503315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6815","nonce":3692503315}]},"public_addr":"172.21.15.2:6811/3692503315","cluster_addr":"172.21.15.2:6813/3692503315","heartbeat_back_addr":"172.21.15.2:6817/3692503315","heartbeat_front_addr":"172.21.15.2:6815/3692503315","state":["exists","up"]},{"osd":2,"uuid":"a4f28cc1-78bc-4434-a7a0-ca4a373fc384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6819","nonce":3160012484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6821","nonce":3160012484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6825","nonce":3160012484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6823","nonce":3160012484}]},"public_addr":"172.21.15.2:6819/3160012484","cluster_addr":"172.21.15.2:6821/3160012484","heartbeat_back_addr":"172.21.15.2:6825/3160012484","heartbeat_front_addr":"172.21.15.2:6823/3160012484","state":["exists","up"]},{"osd":3,"uuid":"b8f7021b-7c22-415a-9635-af30e6e6fc13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6801","nonce":1489766066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6803","nonce":1489766066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6807","nonce":1489766066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6805","nonce":1489766066}]},"public_addr":"172.21.15.119:6801/1489766066","cluster_addr":"172.21.15.119:6803/1489766066","heartbeat_back_addr":"172.21.15.119:6807/1489766066","heartbeat_front_addr":"172.21.15.119:6805/1489766066","state":["exists","up"]},{"osd":4,"uuid":"d5ebbeab-3ba4-4e81-b453-d775808ac559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6809","nonce":487685407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6811","nonce":487685407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6815","nonce":487685407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6813","nonce":487685407}]},"public_addr":"172.21.15.119:6809/487685407","cluster_addr":"172.21.15.119:6811/487685407","heartbeat_back_addr":"172.21.15.119:6815/487685407","heartbeat_front_addr":"172.21.15.119:6813/487685407","state":["exists","up"]},{"osd":5,"uuid":"dc8023ee-4370-4354-921e-5f7d71df5bc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6817","nonce":3782361466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6819","nonce":3782361466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6823","nonce":3782361466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6821","nonce":3782361466}]},"public_addr":"172.21.15.119:6817/3782361466","cluster_addr":"172.21.15.119:6819/3782361466","heartbeat_back_addr":"172.21.15.119:6823/3782361466","heartbeat_front_addr":"172.21.15.119:6821/3782361466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:06.272236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:30.215924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:52.820296+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:14.743572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:37.197272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:54:00.536614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1129063553":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3796631798":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3009915854":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6801/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/3091655634":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3688904349":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6800/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/2886179339":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6801/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/599472466":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/1642465919":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/582228833":"2023-12-18T11:49:51.668708+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff7cc068f70 msgr2=0x7ff7cc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff7cc068f70 0x7ff7cc06b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009fd0 tx=0x7ff7d8009f20 comp rx=0 tx=0).stop 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 msgr2=0x7ff7e4113630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4113630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009fd0 tx=0x7ff7d4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 shutdown_connections 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff7cc068f70 0x7ff7cc06b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7e4102c00 0x7ff7e4113630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 --2- 172.21.15.2:0/3934913121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7e41035a0 0x7ff7e4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:19.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.961+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 >> 172.21.15.2:0/3934913121 conn(0x7ff7e40f8790 msgr2=0x7ff7e40fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:19.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.962+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 shutdown_connections 2023-12-17T11:54:19.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:19.962+0000 7ff7e9db6700 1 -- 172.21.15.2:0/3934913121 wait complete. 2023-12-17T11:54:20.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-17T11:54:20.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-17T11:54:20.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-17T11:54:20.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-17T11:54:20.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-17T11:54:20.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-17T11:54:20.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:20 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3934913121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:54:20.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:20 smithi002 ceph-mon[107131]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:20.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:20 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3934913121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:54:20.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:20 smithi119 ceph-mon[117414]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:21.185 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:21.940 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:22.247 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:22.364 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 -- 172.21.15.2:0/2511909030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac102c20 msgr2=0x7feaac102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 --2- 172.21.15.2:0/2511909030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac102c20 0x7feaac102ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feaa8004940 tx=0x7feaa8009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 -- 172.21.15.2:0/2511909030 shutdown_connections 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 --2- 172.21.15.2:0/2511909030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac065390 0x7feaac065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 --2- 172.21.15.2:0/2511909030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac102c20 0x7feaac102ff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 -- 172.21.15.2:0/2511909030 >> 172.21.15.2:0/2511909030 conn(0x7feaac0719b0 msgr2=0x7feaac071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.545+0000 7feab4101700 1 -- 172.21.15.2:0/2511909030 shutdown_connections 2023-12-17T11:54:22.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.546+0000 7feab4101700 1 -- 172.21.15.2:0/2511909030 wait complete. 2023-12-17T11:54:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.547+0000 7feab4101700 1 Processor -- start 2023-12-17T11:54:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.547+0000 7feab4101700 1 -- start start 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.547+0000 7feab4101700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 0x7feaac0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.547+0000 7feab4101700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac102c20 0x7feaac0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.547+0000 7feab4101700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0fc730 con 0x7feaac065390 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.547+0000 7feab4101700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0fc8a0 con 0x7feaac102c20 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 0x7feaac0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 0x7feaac0fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55424/0 (socket says 172.21.15.2:55424) 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 -- 172.21.15.2:0/771566990 learned_addr learned my addr 172.21.15.2:0/771566990 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab169c700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac102c20 0x7feaac0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 -- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac102c20 msgr2=0x7feaac0fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac102c20 0x7feaac0fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 -- 172.21.15.2:0/771566990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa8005040 con 0x7feaac065390 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab169c700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac102c20 0x7feaac0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.548+0000 7feab1e9d700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 0x7feaac0fbbf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009360 tx=0x7feaa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.549+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa800e040 con 0x7feaac065390 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.549+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feaa800bc50 con 0x7feaac065390 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.549+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaa801c630 con 0x7feaac065390 2023-12-17T11:54:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.549+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac119850 con 0x7feaac065390 2023-12-17T11:54:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.549+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac119cb0 con 0x7feaac065390 2023-12-17T11:54:22.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.550+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feaac05e300 con 0x7feaac065390 2023-12-17T11:54:22.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.551+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7feaa8013420 con 0x7feaac065390 2023-12-17T11:54:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.552+0000 7feaa27fc700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fea98068f70 0x7fea9806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:22.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.552+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7feaa80887f0 con 0x7feaac065390 2023-12-17T11:54:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.552+0000 7feaa27fc700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] conn(0x7fea9806ec40 0x7fea98071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.552+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 --> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea98071700 con 0x7fea9806ec40 2023-12-17T11:54:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.552+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa8088b30 con 0x7feaac065390 2023-12-17T11:54:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.553+0000 7feab169c700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fea98068f70 0x7fea9806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:22.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.553+0000 7feab269e700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] conn(0x7fea9806ec40 0x7fea98071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.553+0000 7feab169c700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fea98068f70 0x7fea9806b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea9c009f60 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.554+0000 7feab269e700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] conn(0x7fea9806ec40 0x7fea98071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:22.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.555+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== osd.4 v2:172.21.15.119:6808/487685407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fea98071700 con 0x7fea9806ec40 2023-12-17T11:54:22.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.571+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 --> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feaac05e700 con 0x7fea9806ec40 2023-12-17T11:54:22.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feaa27fc700 1 -- 172.21.15.2:0/771566990 <== osd.4 v2:172.21.15.119:6808/487685407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7feaac05e700 con 0x7fea9806ec40 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] conn(0x7fea9806ec40 msgr2=0x7fea98071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] conn(0x7fea9806ec40 0x7fea98071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fea98068f70 msgr2=0x7fea9806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fea98068f70 0x7fea9806b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea9c009f60 comp rx=0 tx=0).stop 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 msgr2=0x7feaac0fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.572+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 0x7feaac0fbbf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009360 tx=0x7feaa8009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 shutdown_connections 2023-12-17T11:54:22.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:6808/487685407,v1:172.21.15.119:6809/487685407] conn(0x7fea9806ec40 0x7fea98071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fea98068f70 0x7fea9806b420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feaac065390 0x7feaac0fbbf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 --2- 172.21.15.2:0/771566990 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feaac102c20 0x7feaac0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 >> 172.21.15.2:0/771566990 conn(0x7feaac0719b0 msgr2=0x7feaac0fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 shutdown_connections 2023-12-17T11:54:22.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:22.573+0000 7feab4101700 1 -- 172.21.15.2:0/771566990 wait complete. 2023-12-17T11:54:22.749 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:22.851 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:23.293 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:23 smithi002 ceph-mon[107131]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:23.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:23 smithi119 ceph-mon[117414]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:23.467 INFO:teuthology.orchestra.run.smithi002.stdout:150323855371 2023-12-17T11:54:23.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-17T11:54:23.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 -- 172.21.15.2:0/2156082975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe41035a0 msgr2=0x7fcfe40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:23.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/2156082975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe41035a0 0x7fcfe40fcc10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004940 tx=0x7fcfd4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:23.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 -- 172.21.15.2:0/2156082975 shutdown_connections 2023-12-17T11:54:23.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/2156082975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe41035a0 0x7fcfe40fcc10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/2156082975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe4102c00 0x7fcfe4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 -- 172.21.15.2:0/2156082975 >> 172.21.15.2:0/2156082975 conn(0x7fcfe40f8790 msgr2=0x7fcfe40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 -- 172.21.15.2:0/2156082975 shutdown_connections 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.967+0000 7fcfebdd4700 1 -- 172.21.15.2:0/2156082975 wait complete. 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfebdd4700 1 Processor -- start 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfebdd4700 1 -- start start 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfebdd4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 0x7fcfe41136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfebdd4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe41035a0 0x7fcfe4113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfebdd4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4114240 con 0x7fcfe4102c00 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfebdd4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410d590 con 0x7fcfe41035a0 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfe9b70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 0x7fcfe41136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfe9b70700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 0x7fcfe41136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55444/0 (socket says 172.21.15.2:55444) 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.968+0000 7fcfe9b70700 1 -- 172.21.15.2:0/1583307067 learned_addr learned my addr 172.21.15.2:0/1583307067 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfe9b70700 1 -- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe41035a0 msgr2=0x7fcfe4113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfe9b70700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe41035a0 0x7fcfe4113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfe9b70700 1 -- 172.21.15.2:0/1583307067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4005040 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfe9b70700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 0x7fcfe41136b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0002a50 tx=0x7fcfe00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe0007cc0 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfe000f040 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfe0009540 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe410d870 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.969+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe410ddb0 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.970+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfe410e2a0 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.971+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fcfe00096a0 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.972+0000 7fcfda7fc700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fcfd0068f70 0x7fcfd006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.972+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcfe0086820 con 0x7fcfe4102c00 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.972+0000 7fcfe936f700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fcfd0068f70 0x7fcfd006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.972+0000 7fcfda7fc700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] conn(0x7fcfd006ec40 0x7fcfd0071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:23.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.973+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 --> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfd0071700 con 0x7fcfd006ec40 2023-12-17T11:54:23.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.973+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfe0088d70 con 0x7fcfe4102c00 2023-12-17T11:54:23.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.973+0000 7fcfe936f700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fcfd0068f70 0x7fcfd006b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004f90 tx=0x7fcfd4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:23.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.973+0000 7fcfea371700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] conn(0x7fcfd006ec40 0x7fcfd0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:23.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.974+0000 7fcfea371700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] conn(0x7fcfd006ec40 0x7fcfd0071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:23.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.975+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== osd.5 v2:172.21.15.119:6816/3782361466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcfd0071700 con 0x7fcfd006ec40 2023-12-17T11:54:23.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.991+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 --> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfe405e2f0 con 0x7fcfd006ec40 2023-12-17T11:54:23.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.991+0000 7fcfda7fc700 1 -- 172.21.15.2:0/1583307067 <== osd.5 v2:172.21.15.119:6816/3782361466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fcfe405e2f0 con 0x7fcfd006ec40 2023-12-17T11:54:23.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] conn(0x7fcfd006ec40 msgr2=0x7fcfd0071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:23.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] conn(0x7fcfd006ec40 0x7fcfd0071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fcfd0068f70 msgr2=0x7fcfd006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fcfd0068f70 0x7fcfd006b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004f90 tx=0x7fcfd4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 msgr2=0x7fcfe41136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 0x7fcfe41136b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0002a50 tx=0x7fcfe00046b0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 shutdown_connections 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:6816/3782361466,v1:172.21.15.119:6817/3782361466] conn(0x7fcfd006ec40 0x7fcfd0071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fcfd0068f70 0x7fcfd006b420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfe4102c00 0x7fcfe41136b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 --2- 172.21.15.2:0/1583307067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfe41035a0 0x7fcfe4113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 >> 172.21.15.2:0/1583307067 conn(0x7fcfe40f8790 msgr2=0x7fcfe40fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 shutdown_connections 2023-12-17T11:54:23.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:23.992+0000 7fcfebdd4700 1 -- 172.21.15.2:0/1583307067 wait complete. 2023-12-17T11:54:24.670 INFO:teuthology.orchestra.run.smithi002.stdout:171798691846 2023-12-17T11:54:24.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-17T11:54:25.283 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:25 smithi002 ceph-mon[107131]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:25.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 -- 172.21.15.2:0/2971939823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57640708f0 msgr2=0x7f5764108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 --2- 172.21.15.2:0/2971939823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57640708f0 0x7f5764108f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5750004970 tx=0x7f5750009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 -- 172.21.15.2:0/2971939823 shutdown_connections 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 --2- 172.21.15.2:0/2971939823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57640708f0 0x7f5764108f10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 --2- 172.21.15.2:0/2971939823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576406ffe0 0x7f57640703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 -- 172.21.15.2:0/2971939823 >> 172.21.15.2:0/2971939823 conn(0x7f57640f8790 msgr2=0x7f57640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 -- 172.21.15.2:0/2971939823 shutdown_connections 2023-12-17T11:54:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.361+0000 7f576b175700 1 -- 172.21.15.2:0/2971939823 wait complete. 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.362+0000 7f576b175700 1 Processor -- start 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.362+0000 7f576b175700 1 -- start start 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f576b175700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 0x7f5764115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f576b175700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57640708f0 0x7f5764115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f576b175700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57641163a0 con 0x7f576406ffe0 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f576b175700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576410f6d0 con 0x7f57640708f0 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 0x7f5764115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:25.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 0x7f5764115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55450/0 (socket says 172.21.15.2:55450) 2023-12-17T11:54:25.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 -- 172.21.15.2:0/3557563209 learned_addr learned my addr 172.21.15.2:0/3557563209 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:25.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 -- 172.21.15.2:0/3557563209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57640708f0 msgr2=0x7f5764115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57640708f0 0x7f5764115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 -- 172.21.15.2:0/3557563209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750005040 con 0x7f576406ffe0 2023-12-17T11:54:25.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.363+0000 7f5768f11700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 0x7f5764115810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5758002a50 tx=0x7f57580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.364+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5758007cc0 con 0x7f576406ffe0 2023-12-17T11:54:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.364+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f575800f040 con 0x7f576406ffe0 2023-12-17T11:54:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.364+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5758009570 con 0x7f576406ffe0 2023-12-17T11:54:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.364+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576410f9b0 con 0x7f576406ffe0 2023-12-17T11:54:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.364+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576410fef0 con 0x7f576406ffe0 2023-12-17T11:54:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.365+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57641103e0 con 0x7f576406ffe0 2023-12-17T11:54:25.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.366+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f57580096d0 con 0x7f576406ffe0 2023-12-17T11:54:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f57617fa700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5754068f70 0x7f575406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f57580867f0 con 0x7f576406ffe0 2023-12-17T11:54:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f5763fff700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5754068f70 0x7f575406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f57617fa700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] conn(0x7f575406ec40 0x7f5754071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 --> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5754071700 con 0x7f575406ec40 2023-12-17T11:54:25.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5758088d40 con 0x7f576406ffe0 2023-12-17T11:54:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.367+0000 7f5769712700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] conn(0x7f575406ec40 0x7f5754071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.368+0000 7f5763fff700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5754068f70 0x7f575406b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f575000b370 tx=0x7f5750009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.368+0000 7f5769712700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] conn(0x7f575406ec40 0x7f5754071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:25.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.369+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== osd.0 v2:172.21.15.2:6802/705553234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5754071700 con 0x7f575406ec40 2023-12-17T11:54:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.385+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 --> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f576405e2c0 con 0x7f575406ec40 2023-12-17T11:54:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.385+0000 7f57617fa700 1 -- 172.21.15.2:0/3557563209 <== osd.0 v2:172.21.15.2:6802/705553234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f576405e2c0 con 0x7f575406ec40 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] conn(0x7f575406ec40 msgr2=0x7f5754071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] conn(0x7f575406ec40 0x7f5754071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5754068f70 msgr2=0x7f575406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5754068f70 0x7f575406b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f575000b370 tx=0x7f5750009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 msgr2=0x7f5764115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 0x7f5764115810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5758002a50 tx=0x7f57580046b0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 shutdown_connections 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f5754068f70 0x7f575406b420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f576406ffe0 0x7f5764115810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.2:6802/705553234,v1:172.21.15.2:6803/705553234] conn(0x7f575406ec40 0x7f5754071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 --2- 172.21.15.2:0/3557563209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57640708f0 0x7f5764115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 >> 172.21.15.2:0/3557563209 conn(0x7f57640f8790 msgr2=0x7f5764103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 shutdown_connections 2023-12-17T11:54:25.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.386+0000 7f576b175700 1 -- 172.21.15.2:0/3557563209 wait complete. 2023-12-17T11:54:25.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:25 smithi119 ceph-mon[117414]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 -- 172.21.15.2:0/4165505533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 msgr2=0x7fe498102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 --2- 172.21.15.2:0/4165505533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe498102ff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe494004940 tx=0x7fe494009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 -- 172.21.15.2:0/4165505533 shutdown_connections 2023-12-17T11:54:25.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 --2- 172.21.15.2:0/4165505533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe498065390 0x7fe498065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 --2- 172.21.15.2:0/4165505533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe498102ff0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 -- 172.21.15.2:0/4165505533 >> 172.21.15.2:0/4165505533 conn(0x7fe4980719b0 msgr2=0x7fe498071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 -- 172.21.15.2:0/4165505533 shutdown_connections 2023-12-17T11:54:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.991+0000 7fe49f04a700 1 -- 172.21.15.2:0/4165505533 wait complete. 2023-12-17T11:54:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.992+0000 7fe49f04a700 1 Processor -- start 2023-12-17T11:54:25.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.992+0000 7fe49f04a700 1 -- start start 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe49f04a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe498065390 0x7fe4980fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe49f04a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe4980fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe49f04a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4980fc730 con 0x7fe498102c20 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe49f04a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4980fc8a0 con 0x7fe498065390 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe48ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe4980fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe48ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe4980fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55466/0 (socket says 172.21.15.2:55466) 2023-12-17T11:54:25.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe48ffff700 1 -- 172.21.15.2:0/741391509 learned_addr learned my addr 172.21.15.2:0/741391509 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe49cde6700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe498065390 0x7fe4980fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe48ffff700 1 -- 172.21.15.2:0/741391509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe498065390 msgr2=0x7fe4980fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe48ffff700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe498065390 0x7fe4980fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.993+0000 7fe48ffff700 1 -- 172.21.15.2:0/741391509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494005040 con 0x7fe498102c20 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.994+0000 7fe48ffff700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe4980fc130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe48800eb40 tx=0x7fe48800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.994+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe488007cc0 con 0x7fe498102c20 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.994+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe48800f040 con 0x7fe498102c20 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.994+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe498119850 con 0x7fe498102c20 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.994+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48800c990 con 0x7fe498102c20 2023-12-17T11:54:25.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.994+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe498119cb0 con 0x7fe498102c20 2023-12-17T11:54:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.995+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe49805e300 con 0x7fe498102c20 2023-12-17T11:54:25.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.996+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fe48800caf0 con 0x7fe498102c20 2023-12-17T11:54:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.998+0000 7fe48d7fa700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe480068f60 0x7fe48006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.998+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe488086630 con 0x7fe498102c20 2023-12-17T11:54:26.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.998+0000 7fe49cde6700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe480068f60 0x7fe48006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.999+0000 7fe48d7fa700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] conn(0x7fe48006ec30 0x7fe480071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.999+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 --> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4800716f0 con 0x7fe48006ec30 2023-12-17T11:54:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.999+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe488088be0 con 0x7fe498102c20 2023-12-17T11:54:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.999+0000 7fe49d5e7700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] conn(0x7fe48006ec30 0x7fe480071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.999+0000 7fe49cde6700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe480068f60 0x7fe48006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe494009fd0 tx=0x7fe494009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:25.999+0000 7fe49d5e7700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] conn(0x7fe48006ec30 0x7fe480071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.000+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== osd.1 v2:172.21.15.2:6810/3692503315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe4800716f0 con 0x7fe48006ec30 2023-12-17T11:54:26.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.034+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 --> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe49805e730 con 0x7fe48006ec30 2023-12-17T11:54:26.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.034+0000 7fe48d7fa700 1 -- 172.21.15.2:0/741391509 <== osd.1 v2:172.21.15.2:6810/3692503315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe49805e730 con 0x7fe48006ec30 2023-12-17T11:54:26.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] conn(0x7fe48006ec30 msgr2=0x7fe480071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] conn(0x7fe48006ec30 0x7fe480071040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe480068f60 msgr2=0x7fe48006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe480068f60 0x7fe48006b410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe494009fd0 tx=0x7fe494009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 msgr2=0x7fe4980fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe4980fc130 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe48800eb40 tx=0x7fe48800b040 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.035+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 shutdown_connections 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6810/3692503315,v1:172.21.15.2:6811/3692503315] conn(0x7fe48006ec30 0x7fe480071040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fe480068f60 0x7fe48006b410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe498065390 0x7fe4980fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 --2- 172.21.15.2:0/741391509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe498102c20 0x7fe4980fc130 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 >> 172.21.15.2:0/741391509 conn(0x7fe4980719b0 msgr2=0x7fe4980fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 shutdown_connections 2023-12-17T11:54:26.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.036+0000 7fe49f04a700 1 -- 172.21.15.2:0/741391509 wait complete. 2023-12-17T11:54:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.111+0000 7f97007b9700 1 -- 172.21.15.2:0/1459527730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f8101b00 msgr2=0x7f96f8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.111+0000 7f97007b9700 1 --2- 172.21.15.2:0/1459527730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f8101b00 0x7f96f8101ed0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96f4004940 tx=0x7f96f4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.111+0000 7f97007b9700 1 -- 172.21.15.2:0/1459527730 shutdown_connections 2023-12-17T11:54:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.112+0000 7f97007b9700 1 --2- 172.21.15.2:0/1459527730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f80fbb40 0x7f96f80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.112+0000 7f97007b9700 1 --2- 172.21.15.2:0/1459527730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f8101b00 0x7f96f8101ed0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.112+0000 7f97007b9700 1 -- 172.21.15.2:0/1459527730 >> 172.21.15.2:0/1459527730 conn(0x7f96f80719b0 msgr2=0x7f96f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.112+0000 7f97007b9700 1 -- 172.21.15.2:0/1459527730 shutdown_connections 2023-12-17T11:54:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.112+0000 7f97007b9700 1 -- 172.21.15.2:0/1459527730 wait complete. 2023-12-17T11:54:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.113+0000 7f97007b9700 1 Processor -- start 2023-12-17T11:54:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.113+0000 7f97007b9700 1 -- start start 2023-12-17T11:54:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.114+0000 7f97007b9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 0x7f96f80fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.114+0000 7f97007b9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f8101b00 0x7f96f80fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.114+0000 7f97007b9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80fe260 con 0x7f96f80fbb40 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.114+0000 7f97007b9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f80fe3d0 con 0x7f96f8101b00 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.114+0000 7f96fe555700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 0x7f96f80fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fe555700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 0x7f96f80fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55476/0 (socket says 172.21.15.2:55476) 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fe555700 1 -- 172.21.15.2:0/2815097766 learned_addr learned my addr 172.21.15.2:0/2815097766 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fdd54700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f8101b00 0x7f96f80fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fe555700 1 -- 172.21.15.2:0/2815097766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f8101b00 msgr2=0x7f96f80fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fe555700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f8101b00 0x7f96f80fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fe555700 1 -- 172.21.15.2:0/2815097766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4005040 con 0x7f96f80fbb40 2023-12-17T11:54:26.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.115+0000 7f96fe555700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 0x7f96f80fd720 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f96f40040d0 tx=0x7f96f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.116+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96f4021070 con 0x7f96f80fbb40 2023-12-17T11:54:26.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.116+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f81197d0 con 0x7f96f80fbb40 2023-12-17T11:54:26.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.116+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f96f401c400 con 0x7f96f80fbb40 2023-12-17T11:54:26.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.116+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f8119c30 con 0x7f96f80fbb40 2023-12-17T11:54:26.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.117+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96f400e030 con 0x7f96f80fbb40 2023-12-17T11:54:26.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.117+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96f8065e80 con 0x7f96f80fbb40 2023-12-17T11:54:26.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.118+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f96f400b760 con 0x7f96f80fbb40 2023-12-17T11:54:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.119+0000 7f96eeffd700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f96e4068f70 0x7f96e406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.119+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f96f4087c30 con 0x7f96f80fbb40 2023-12-17T11:54:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.120+0000 7f96fdd54700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f96e4068f70 0x7f96e406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.120+0000 7f96eeffd700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] conn(0x7f96e406ec40 0x7f96e4071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.120+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 --> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96e4071700 con 0x7f96e406ec40 2023-12-17T11:54:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.120+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96f408a240 con 0x7f96f80fbb40 2023-12-17T11:54:26.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.120+0000 7f96fed56700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] conn(0x7f96e406ec40 0x7f96e4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.121+0000 7f96fdd54700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f96e4068f70 0x7f96e406b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96f80ff120 tx=0x7f96e800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.121+0000 7f96fed56700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] conn(0x7f96e406ec40 0x7f96e4071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.122+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== osd.2 v2:172.21.15.2:6818/3160012484 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f96e4071700 con 0x7f96e406ec40 2023-12-17T11:54:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.142+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 --> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96f80fe590 con 0x7f96e406ec40 2023-12-17T11:54:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.142+0000 7f96eeffd700 1 -- 172.21.15.2:0/2815097766 <== osd.2 v2:172.21.15.2:6818/3160012484 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96f80fe590 con 0x7f96e406ec40 2023-12-17T11:54:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.142+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] conn(0x7f96e406ec40 msgr2=0x7f96e4071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.142+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] conn(0x7f96e406ec40 0x7f96e4071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f96e4068f70 msgr2=0x7f96e406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f96e4068f70 0x7f96e406b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96f80ff120 tx=0x7f96e800b040 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 msgr2=0x7f96f80fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 0x7f96f80fd720 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f96f40040d0 tx=0x7f96f4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 shutdown_connections 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6818/3160012484,v1:172.21.15.2:6819/3160012484] conn(0x7f96e406ec40 0x7f96e4071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f96e4068f70 0x7f96e406b420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96f80fbb40 0x7f96f80fd720 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 --2- 172.21.15.2:0/2815097766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96f8101b00 0x7f96f80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 >> 172.21.15.2:0/2815097766 conn(0x7f96f80719b0 msgr2=0x7f96f8065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 shutdown_connections 2023-12-17T11:54:26.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.143+0000 7f97007b9700 1 -- 172.21.15.2:0/2815097766 wait complete. 2023-12-17T11:54:26.243 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 -- 172.21.15.2:0/1497897725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc1035a0 msgr2=0x7f62bc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 --2- 172.21.15.2:0/1497897725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc1035a0 0x7f62bc0fcc10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f62b0004940 tx=0x7f62b0009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 -- 172.21.15.2:0/1497897725 shutdown_connections 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 --2- 172.21.15.2:0/1497897725 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc1035a0 0x7f62bc0fcc10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 --2- 172.21.15.2:0/1497897725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc102c00 0x7f62bc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 -- 172.21.15.2:0/1497897725 >> 172.21.15.2:0/1497897725 conn(0x7f62bc0f8790 msgr2=0x7f62bc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 -- 172.21.15.2:0/1497897725 shutdown_connections 2023-12-17T11:54:26.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.335+0000 7f62c13c3700 1 -- 172.21.15.2:0/1497897725 wait complete. 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.336+0000 7f62c13c3700 1 Processor -- start 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.336+0000 7f62c13c3700 1 -- start start 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62c13c3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 0x7f62bc115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62c13c3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc1035a0 0x7f62bc115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62c13c3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc1163c0 con 0x7f62bc102c00 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62c13c3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc10f6f0 con 0x7f62bc1035a0 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 0x7f62bc115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62baffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 0x7f62bc115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55502/0 (socket says 172.21.15.2:55502) 2023-12-17T11:54:26.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62baffd700 1 -- 172.21.15.2:0/2916770191 learned_addr learned my addr 172.21.15.2:0/2916770191 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62ba7fc700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc1035a0 0x7f62bc115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62baffd700 1 -- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc1035a0 msgr2=0x7f62bc115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62baffd700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc1035a0 0x7f62bc115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62baffd700 1 -- 172.21.15.2:0/2916770191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0005040 con 0x7f62bc102c00 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.337+0000 7f62ba7fc700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc1035a0 0x7f62bc115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.338+0000 7f62baffd700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 0x7f62bc115830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c8c0 tx=0x7f62ac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.338+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ac00a980 con 0x7f62bc102c00 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.338+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc10f9d0 con 0x7f62bc102c00 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.338+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62ac00ce60 con 0x7f62bc102c00 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.338+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62ac0113a0 con 0x7f62bc102c00 2023-12-17T11:54:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.338+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc10ff10 con 0x7f62bc102c00 2023-12-17T11:54:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.339+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62bc110490 con 0x7f62bc102c00 2023-12-17T11:54:26.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.340+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f62ac012400 con 0x7f62bc102c00 2023-12-17T11:54:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.341+0000 7f62a37fe700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62a4068f70 0x7f62a406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.341+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f62ac086c40 con 0x7f62bc102c00 2023-12-17T11:54:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.341+0000 7f62ba7fc700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62a4068f70 0x7f62a406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.341+0000 7f62a37fe700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] conn(0x7f62a406ec40 0x7f62a4071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.341+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 --> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f62a4071700 con 0x7f62a406ec40 2023-12-17T11:54:26.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.341+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62ac08b220 con 0x7f62bc102c00 2023-12-17T11:54:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.342+0000 7f62bb7fe700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] conn(0x7f62a406ec40 0x7f62a4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.342+0000 7f62ba7fc700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62a4068f70 0x7f62a406b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b3b0 tx=0x7f62b0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.342+0000 7f62bb7fe700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] conn(0x7f62a406ec40 0x7f62a4071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:26.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.343+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== osd.3 v2:172.21.15.119:6800/1489766066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f62a4071700 con 0x7f62a406ec40 2023-12-17T11:54:26.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.360+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 --> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62bc0fc390 con 0x7f62a406ec40 2023-12-17T11:54:26.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.361+0000 7f62a37fe700 1 -- 172.21.15.2:0/2916770191 <== osd.3 v2:172.21.15.119:6800/1489766066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f62bc0fc390 con 0x7f62a406ec40 2023-12-17T11:54:26.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.361+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] conn(0x7f62a406ec40 msgr2=0x7f62a4071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] conn(0x7f62a406ec40 0x7f62a4071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62a4068f70 msgr2=0x7f62a406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62a4068f70 0x7f62a406b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b3b0 tx=0x7f62b0009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 msgr2=0x7f62bc115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 0x7f62bc115830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00c8c0 tx=0x7f62ac0044c0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 shutdown_connections 2023-12-17T11:54:26.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f62a4068f70 0x7f62a406b420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:6800/1489766066,v1:172.21.15.119:6801/1489766066] conn(0x7f62a406ec40 0x7f62a4071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f62bc102c00 0x7f62bc115830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 --2- 172.21.15.2:0/2916770191 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62bc1035a0 0x7f62bc115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:26.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 >> 172.21.15.2:0/2916770191 conn(0x7f62bc0f8790 msgr2=0x7f62bc0fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:26.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 shutdown_connections 2023-12-17T11:54:26.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:26.362+0000 7f62c13c3700 1 -- 172.21.15.2:0/2916770191 wait complete. 2023-12-17T11:54:26.591 INFO:teuthology.orchestra.run.smithi002.stdout:81604378645 2023-12-17T11:54:26.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-17T11:54:26.991 INFO:teuthology.orchestra.run.smithi002.stdout:60129542169 2023-12-17T11:54:26.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-17T11:54:27.106 INFO:teuthology.orchestra.run.smithi002.stdout:38654705694 2023-12-17T11:54:27.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-17T11:54:27.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:27 smithi002 ceph-mon[107131]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:27.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:27 smithi119 ceph-mon[117414]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:27.591 INFO:teuthology.orchestra.run.smithi002.stdout:115964117008 2023-12-17T11:54:27.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-17T11:54:28.254 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:28.512 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:28.534 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:28.867 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 -- 172.21.15.2:0/3207245914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fdc20 msgr2=0x7f699c0fdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/3207245914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fdc20 0x7f699c0fdff0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6990004970 tx=0x7f6990009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 -- 172.21.15.2:0/3207245914 shutdown_connections 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/3207245914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fe5c0 0x7f699c106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/3207245914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fdc20 0x7f699c0fdff0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 -- 172.21.15.2:0/3207245914 >> 172.21.15.2:0/3207245914 conn(0x7f699c0f76c0 msgr2=0x7f699c0f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.035+0000 7f69a2f9c700 1 -- 172.21.15.2:0/3207245914 shutdown_connections 2023-12-17T11:54:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.036+0000 7f69a2f9c700 1 -- 172.21.15.2:0/3207245914 wait complete. 2023-12-17T11:54:29.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.037+0000 7f69a2f9c700 1 Processor -- start 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.037+0000 7f69a2f9c700 1 -- start start 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.037+0000 7f69a2f9c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 0x7f699c0fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.037+0000 7f69a2f9c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fe5c0 0x7f699c0fc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.037+0000 7f69a2f9c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c111500 con 0x7f699c0fe5c0 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.037+0000 7f69a2f9c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c111670 con 0x7f699c0fdc20 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f69a0d38700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 0x7f699c0fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f69a0d38700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 0x7f699c0fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:56028/0 (socket says 172.21.15.2:56028) 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f69a0d38700 1 -- 172.21.15.2:0/395679328 learned_addr learned my addr 172.21.15.2:0/395679328 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:29.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f699bfff700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fe5c0 0x7f699c0fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f69a0d38700 1 -- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fe5c0 msgr2=0x7f699c0fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f69a0d38700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fe5c0 0x7f699c0fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f69a0d38700 1 -- 172.21.15.2:0/395679328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990005040 con 0x7f699c0fdc20 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.038+0000 7f699bfff700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fe5c0 0x7f699c0fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.039+0000 7f69a0d38700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 0x7f699c0fbae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6990000c00 tx=0x7f6990009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.039+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f699000e040 con 0x7f699c0fdc20 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.039+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699c0fc650 con 0x7f699c0fdc20 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.039+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6990004290 con 0x7f699c0fdc20 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.039+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f699001c3f0 con 0x7f699c0fdc20 2023-12-17T11:54:29.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.040+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c11e200 con 0x7f699c0fdc20 2023-12-17T11:54:29.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.041+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c104350 con 0x7f699c0fdc20 2023-12-17T11:54:29.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.042+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f69900095b0 con 0x7f699c0fdc20 2023-12-17T11:54:29.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.043+0000 7f69997fa700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f698c068f70 0x7f698c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:29.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.043+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6990087e00 con 0x7f699c0fdc20 2023-12-17T11:54:29.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.043+0000 7f699bfff700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f698c068f70 0x7f698c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:29.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.045+0000 7f699bfff700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f698c068f70 0x7f698c06b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f699c0fd4e0 tx=0x7f698800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:29.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.048+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f69900545f0 con 0x7f699c0fdc20 2023-12-17T11:54:29.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.266+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f699c0fb2c0 con 0x7f699c0fdc20 2023-12-17T11:54:29.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.267+0000 7f69997fa700 1 -- 172.21.15.2:0/395679328 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6990057c10 con 0x7f699c0fdc20 2023-12-17T11:54:29.269 INFO:teuthology.orchestra.run.smithi002.stdout:150323855372 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f698c068f70 msgr2=0x7f698c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f698c068f70 0x7f698c06b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f699c0fd4e0 tx=0x7f698800b040 comp rx=0 tx=0).stop 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 msgr2=0x7f699c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 0x7f699c0fbae0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6990000c00 tx=0x7f6990009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 shutdown_connections 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f698c068f70 0x7f698c06b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f699c0fdc20 0x7f699c0fbae0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 --2- 172.21.15.2:0/395679328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699c0fe5c0 0x7f699c0fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 >> 172.21.15.2:0/395679328 conn(0x7f699c0f76c0 msgr2=0x7f699c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:29.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 shutdown_connections 2023-12-17T11:54:29.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:29.270+0000 7f69a2f9c700 1 -- 172.21.15.2:0/395679328 wait complete. 2023-12-17T11:54:29.294 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:29 smithi002 ceph-mon[107131]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:29 smithi119 ceph-mon[117414]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:30.088 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855371 got 150323855372 for osd.4 2023-12-17T11:54:30.088 DEBUG:teuthology.parallel:result is None 2023-12-17T11:54:30.370 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:30 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/395679328' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-17T11:54:30.370 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:30 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/395679328' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-17T11:54:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:30.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 -- 172.21.15.2:0/2186404729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe8006ffe0 msgr2=0x7efe800703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 --2- 172.21.15.2:0/2186404729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe8006ffe0 0x7efe800703b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe70004940 tx=0x7efe70009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 -- 172.21.15.2:0/2186404729 shutdown_connections 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 --2- 172.21.15.2:0/2186404729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe800708f0 0x7efe80108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 --2- 172.21.15.2:0/2186404729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe8006ffe0 0x7efe800703b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 -- 172.21.15.2:0/2186404729 >> 172.21.15.2:0/2186404729 conn(0x7efe800f85d0 msgr2=0x7efe800fa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 -- 172.21.15.2:0/2186404729 shutdown_connections 2023-12-17T11:54:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.684+0000 7efe8481f700 1 -- 172.21.15.2:0/2186404729 wait complete. 2023-12-17T11:54:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.685+0000 7efe8481f700 1 Processor -- start 2023-12-17T11:54:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.685+0000 7efe8481f700 1 -- start start 2023-12-17T11:54:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe8481f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8006ffe0 0x7efe801156b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe8481f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe800708f0 0x7efe80115c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe8481f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8010f570 con 0x7efe8006ffe0 2023-12-17T11:54:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe8481f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8010f6e0 con 0x7efe800708f0 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe7ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8006ffe0 0x7efe801156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe7ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8006ffe0 0x7efe801156b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46462/0 (socket says 172.21.15.2:46462) 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe7ed9d700 1 -- 172.21.15.2:0/319408319 learned_addr learned my addr 172.21.15.2:0/319408319 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.686+0000 7efe7e59c700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe800708f0 0x7efe80115c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe7e59c700 1 -- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8006ffe0 msgr2=0x7efe801156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe7e59c700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8006ffe0 0x7efe801156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe7e59c700 1 -- 172.21.15.2:0/319408319 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70005040 con 0x7efe800708f0 2023-12-17T11:54:30.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe7e59c700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe800708f0 0x7efe80115c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe7400b580 tx=0x7efe740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:30.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe7400f6f0 con 0x7efe800708f0 2023-12-17T11:54:30.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe7400fd00 con 0x7efe800708f0 2023-12-17T11:54:30.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe740103a0 con 0x7efe800708f0 2023-12-17T11:54:30.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8010f9c0 con 0x7efe800708f0 2023-12-17T11:54:30.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.687+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8010feb0 con 0x7efe800708f0 2023-12-17T11:54:30.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.689+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe80106410 con 0x7efe800708f0 2023-12-17T11:54:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.690+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7efe7400f850 con 0x7efe800708f0 2023-12-17T11:54:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.691+0000 7efe677fe700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efe68068f70 0x7efe6806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.691+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efe74086aa0 con 0x7efe800708f0 2023-12-17T11:54:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.691+0000 7efe7ed9d700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efe68068f70 0x7efe6806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:30.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.692+0000 7efe7ed9d700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efe68068f70 0x7efe6806b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe70009fd0 tx=0x7efe70009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:30.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.711+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efe74056d20 con 0x7efe800708f0 2023-12-17T11:54:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.961+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efe8004bb80 con 0x7efe800708f0 2023-12-17T11:54:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.962+0000 7efe677fe700 1 -- 172.21.15.2:0/319408319 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe740568b0 con 0x7efe800708f0 2023-12-17T11:54:30.965 INFO:teuthology.orchestra.run.smithi002.stdout:171798691847 2023-12-17T11:54:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efe68068f70 msgr2=0x7efe6806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efe68068f70 0x7efe6806b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe70009fd0 tx=0x7efe70009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe800708f0 msgr2=0x7efe80115c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe800708f0 0x7efe80115c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe7400b580 tx=0x7efe740091a0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 shutdown_connections 2023-12-17T11:54:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efe68068f70 0x7efe6806b420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe8006ffe0 0x7efe801156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 --2- 172.21.15.2:0/319408319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe800708f0 0x7efe80115c30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.965+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 >> 172.21.15.2:0/319408319 conn(0x7efe800f85d0 msgr2=0x7efe80103590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.966+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 shutdown_connections 2023-12-17T11:54:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:30.966+0000 7efe8481f700 1 -- 172.21.15.2:0/319408319 wait complete. 2023-12-17T11:54:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:31 smithi119 ceph-mon[117414]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:31 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/319408319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-17T11:54:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 -- 172.21.15.2:0/3619988416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 msgr2=0x7fd948102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 --2- 172.21.15.2:0/3619988416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd948102fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd938004940 tx=0x7fd938009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 -- 172.21.15.2:0/3619988416 shutdown_connections 2023-12-17T11:54:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 --2- 172.21.15.2:0/3619988416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481035a0 0x7fd9480fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 --2- 172.21.15.2:0/3619988416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd948102fd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 -- 172.21.15.2:0/3619988416 >> 172.21.15.2:0/3619988416 conn(0x7fd9480f8790 msgr2=0x7fd9480faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 -- 172.21.15.2:0/3619988416 shutdown_connections 2023-12-17T11:54:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.172+0000 7fd94e25a700 1 -- 172.21.15.2:0/3619988416 wait complete. 2023-12-17T11:54:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.173+0000 7fd94e25a700 1 Processor -- start 2023-12-17T11:54:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.173+0000 7fd94e25a700 1 -- start start 2023-12-17T11:54:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.173+0000 7fd94e25a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd94806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd94e25a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481035a0 0x7fd948070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd94e25a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948070a80 con 0x7fd948102c00 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd94e25a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948070bf0 con 0x7fd9481035a0 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd94806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd94806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46520/0 (socket says 172.21.15.2:46520) 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 -- 172.21.15.2:0/459807975 learned_addr learned my addr 172.21.15.2:0/459807975 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd946ffd700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481035a0 0x7fd948070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 -- 172.21.15.2:0/459807975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481035a0 msgr2=0x7fd948070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481035a0 0x7fd948070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 -- 172.21.15.2:0/459807975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd938005040 con 0x7fd948102c00 2023-12-17T11:54:31.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.174+0000 7fd9477fe700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd94806ff40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd938009360 tx=0x7fd938009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.175+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93800e040 con 0x7fd948102c00 2023-12-17T11:54:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.175+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd938013420 con 0x7fd948102c00 2023-12-17T11:54:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.175+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd948119850 con 0x7fd948102c00 2023-12-17T11:54:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.175+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd93801c610 con 0x7fd948102c00 2023-12-17T11:54:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.175+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd948119cb0 con 0x7fd948102c00 2023-12-17T11:54:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.176+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9480fff10 con 0x7fd948102c00 2023-12-17T11:54:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.177+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fd938013590 con 0x7fd948102c00 2023-12-17T11:54:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.178+0000 7fd92ffff700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd930068f70 0x7fd93006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.178+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd938087cf0 con 0x7fd948102c00 2023-12-17T11:54:31.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.178+0000 7fd946ffd700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd930068f70 0x7fd93006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.179+0000 7fd946ffd700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd930068f70 0x7fd93006b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd948071940 tx=0x7fd93c00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.183+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd938054510 con 0x7fd948102c00 2023-12-17T11:54:31.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:31 smithi002 ceph-mon[107131]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:31.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:31 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/319408319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-17T11:54:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.144+0000 7f65dc055700 1 -- 172.21.15.2:0/2602300947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4070520 msgr2=0x7f65d4070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.144+0000 7f65dc055700 1 --2- 172.21.15.2:0/2602300947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4070520 0x7f65d4070990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65c4004940 tx=0x7f65c4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.145+0000 7f65dc055700 1 -- 172.21.15.2:0/2602300947 shutdown_connections 2023-12-17T11:54:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.145+0000 7f65dc055700 1 --2- 172.21.15.2:0/2602300947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4070520 0x7f65d4070990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.145+0000 7f65dc055700 1 --2- 172.21.15.2:0/2602300947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4071c10 0x7f65d406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.145+0000 7f65dc055700 1 -- 172.21.15.2:0/2602300947 >> 172.21.15.2:0/2602300947 conn(0x7f65d40f8790 msgr2=0x7f65d40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.145+0000 7f65dc055700 1 -- 172.21.15.2:0/2602300947 shutdown_connections 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.145+0000 7f65dc055700 1 -- 172.21.15.2:0/2602300947 wait complete. 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.146+0000 7f65dc055700 1 Processor -- start 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.146+0000 7f65dc055700 1 -- start start 2023-12-17T11:54:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65dc055700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 0x7f65d4119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65dc055700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4071c10 0x7f65d411a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65dc055700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d411a810 con 0x7f65d4070520 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65dc055700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4113b40 con 0x7f65d4071c10 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d9df1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 0x7f65d4119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d9df1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 0x7f65d4119c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46490/0 (socket says 172.21.15.2:46490) 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d9df1700 1 -- 172.21.15.2:0/2969384304 learned_addr learned my addr 172.21.15.2:0/2969384304 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d95f0700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4071c10 0x7f65d411a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d9df1700 1 -- 172.21.15.2:0/2969384304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4071c10 msgr2=0x7f65d411a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d9df1700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4071c10 0x7f65d411a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.147+0000 7f65d9df1700 1 -- 172.21.15.2:0/2969384304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4005040 con 0x7f65d4070520 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.148+0000 7f65d9df1700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 0x7f65d4119c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f65d000eb40 tx=0x7f65d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.148+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d0007cc0 con 0x7f65d4070520 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.148+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d4113dc0 con 0x7f65d4070520 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.148+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65d000f040 con 0x7f65d4070520 2023-12-17T11:54:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.148+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d000c990 con 0x7f65d4070520 2023-12-17T11:54:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.148+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d4114300 con 0x7f65d4070520 2023-12-17T11:54:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.149+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d40fe0b0 con 0x7f65d4070520 2023-12-17T11:54:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.150+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f65d000caf0 con 0x7f65d4070520 2023-12-17T11:54:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.151+0000 7f65ca7fc700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f65c0068f70 0x7f65c006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.151+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f65d00865f0 con 0x7f65d4070520 2023-12-17T11:54:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.152+0000 7f65d95f0700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f65c0068f70 0x7f65c006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.153+0000 7f65d95f0700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f65c0068f70 0x7f65c006b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65d41154b0 tx=0x7f65c4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.156+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65d004da00 con 0x7f65d4070520 2023-12-17T11:54:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.408+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65d404bb80 con 0x7f65d4070520 2023-12-17T11:54:31.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.409+0000 7f65ca7fc700 1 -- 172.21.15.2:0/2969384304 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65d00568a0 con 0x7f65d4070520 2023-12-17T11:54:31.412 INFO:teuthology.orchestra.run.smithi002.stdout:38654705695 2023-12-17T11:54:31.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f65c0068f70 msgr2=0x7f65c006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f65c0068f70 0x7f65c006b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65d41154b0 tx=0x7f65c4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 msgr2=0x7f65d4119c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 0x7f65d4119c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f65d000eb40 tx=0x7f65d000b040 comp rx=0 tx=0).stop 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 shutdown_connections 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f65c0068f70 0x7f65c006b420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65d4070520 0x7f65d4119c80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 --2- 172.21.15.2:0/2969384304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65d4071c10 0x7f65d411a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 >> 172.21.15.2:0/2969384304 conn(0x7f65d40f8790 msgr2=0x7f65d410ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.411+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 shutdown_connections 2023-12-17T11:54:31.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.412+0000 7f65dc055700 1 -- 172.21.15.2:0/2969384304 wait complete. 2023-12-17T11:54:31.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.449+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd948071680 con 0x7fd948102c00 2023-12-17T11:54:31.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.449+0000 7fd92ffff700 1 -- 172.21.15.2:0/459807975 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd938057b30 con 0x7fd948102c00 2023-12-17T11:54:31.452 INFO:teuthology.orchestra.run.smithi002.stdout:81604378645 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.451+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd930068f70 msgr2=0x7fd93006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.451+0000 7fd94e25a700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd930068f70 0x7fd93006b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd948071940 tx=0x7fd93c00b040 comp rx=0 tx=0).stop 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.451+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 msgr2=0x7fd94806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.451+0000 7fd94e25a700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd94806ff40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd938009360 tx=0x7fd938009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 shutdown_connections 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd930068f70 0x7fd93006b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd948102c00 0x7fd94806ff40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 --2- 172.21.15.2:0/459807975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9481035a0 0x7fd948070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 >> 172.21.15.2:0/459807975 conn(0x7fd9480f8790 msgr2=0x7fd9480fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 shutdown_connections 2023-12-17T11:54:31.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.452+0000 7fd94e25a700 1 -- 172.21.15.2:0/459807975 wait complete. 2023-12-17T11:54:31.537 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691846 got 171798691847 for osd.5 2023-12-17T11:54:31.537 DEBUG:teuthology.parallel:result is None 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 -- 172.21.15.2:0/2037523563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 msgr2=0x7f7340102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 --2- 172.21.15.2:0/2037523563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340102fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7330004940 tx=0x7f7330009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 -- 172.21.15.2:0/2037523563 shutdown_connections 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 --2- 172.21.15.2:0/2037523563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 0x7f73400fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 --2- 172.21.15.2:0/2037523563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340102fd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 -- 172.21.15.2:0/2037523563 >> 172.21.15.2:0/2037523563 conn(0x7f73400f8790 msgr2=0x7f73400faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 -- 172.21.15.2:0/2037523563 shutdown_connections 2023-12-17T11:54:31.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.742+0000 7f734541e700 1 -- 172.21.15.2:0/2037523563 wait complete. 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.743+0000 7f734541e700 1 Processor -- start 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.743+0000 7f734541e700 1 -- start start 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f734541e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f734541e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 0x7f7340115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f734541e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73401163d0 con 0x7f7340102c00 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f734541e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734010f700 con 0x7f73401035a0 2023-12-17T11:54:31.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f733effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f733effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46544/0 (socket says 172.21.15.2:46544) 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.744+0000 7f733effd700 1 -- 172.21.15.2:0/2345780721 learned_addr learned my addr 172.21.15.2:0/2345780721 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f733e7fc700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 0x7f7340115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f733effd700 1 -- 172.21.15.2:0/2345780721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 msgr2=0x7f7340115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f733effd700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 0x7f7340115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f733effd700 1 -- 172.21.15.2:0/2345780721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330005040 con 0x7f7340102c00 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f733e7fc700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 0x7f7340115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f733effd700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340115840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7330009fd0 tx=0x7f7330009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733000e040 con 0x7f7340102c00 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f733000bc50 con 0x7f7340102c00 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7330013ea0 con 0x7f7340102c00 2023-12-17T11:54:31.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734010f980 con 0x7f7340102c00 2023-12-17T11:54:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.745+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734010fec0 con 0x7f7340102c00 2023-12-17T11:54:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.746+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73400fc390 con 0x7f7340102c00 2023-12-17T11:54:31.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.747+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f7330013420 con 0x7f7340102c00 2023-12-17T11:54:31.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.748+0000 7f73277fe700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7328068f70 0x7f732806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.748+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7330087f90 con 0x7f7340102c00 2023-12-17T11:54:31.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.749+0000 7f733e7fc700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7328068f70 0x7f732806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.750+0000 7f733e7fc700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7328068f70 0x7f732806b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7334009fd0 tx=0x7f733400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.753+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7330058190 con 0x7f7340102c00 2023-12-17T11:54:31.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3582917559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa594102c00 msgr2=0x7fa594102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3582917559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa594102c00 0x7fa594102fd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa584004940 tx=0x7fa584009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3582917559 shutdown_connections 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3582917559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5941035a0 0x7fa5940fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3582917559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa594102c00 0x7fa594102fd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3582917559 >> 172.21.15.2:0/3582917559 conn(0x7fa5940f8790 msgr2=0x7fa5940faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3582917559 shutdown_connections 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.903+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3582917559 wait complete. 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.904+0000 7fa59a3a2700 1 Processor -- start 2023-12-17T11:54:31.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa59a3a2700 1 -- start start 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa59a3a2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa594102c00 0x7fa59406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa59a3a2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 0x7fa594070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa59a3a2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594070a80 con 0x7fa5941035a0 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa59a3a2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594070bf0 con 0x7fa594102c00 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa5937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 0x7fa594070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.905+0000 7fa5937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 0x7fa594070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46562/0 (socket says 172.21.15.2:46562) 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa5937fe700 1 -- 172.21.15.2:0/3268137088 learned_addr learned my addr 172.21.15.2:0/3268137088 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa593fff700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa594102c00 0x7fa59406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa5937fe700 1 -- 172.21.15.2:0/3268137088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa594102c00 msgr2=0x7fa59406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa5937fe700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa594102c00 0x7fa59406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa5937fe700 1 -- 172.21.15.2:0/3268137088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584005040 con 0x7fa5941035a0 2023-12-17T11:54:31.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa5937fe700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 0x7fa594070480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa588002a50 tx=0x7fa5880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.906+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa588007cc0 con 0x7fa5941035a0 2023-12-17T11:54:31.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.907+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa58800f040 con 0x7fa5941035a0 2023-12-17T11:54:31.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.907+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa58800da30 con 0x7fa5941035a0 2023-12-17T11:54:31.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.907+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa594119880 con 0x7fa5941035a0 2023-12-17T11:54:31.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.907+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa594119d60 con 0x7fa5941035a0 2023-12-17T11:54:31.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.908+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5940fff10 con 0x7fa5941035a0 2023-12-17T11:54:31.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.910+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fa58800db90 con 0x7fa5941035a0 2023-12-17T11:54:31.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.912+0000 7fa590ff9700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa57c068f70 0x7fa57c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:31.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.913+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa588086ca0 con 0x7fa5941035a0 2023-12-17T11:54:31.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.913+0000 7fa593fff700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa57c068f70 0x7fa57c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:31.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.914+0000 7fa593fff700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa57c068f70 0x7fa57c06b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5840043d0 tx=0x7fa584009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:31.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.916+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa588053410 con 0x7fa5941035a0 2023-12-17T11:54:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.981+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7340110e20 con 0x7f7340102c00 2023-12-17T11:54:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.981+0000 7f73277fe700 1 -- 172.21.15.2:0/2345780721 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7330057d20 con 0x7f7340102c00 2023-12-17T11:54:31.984 INFO:teuthology.orchestra.run.smithi002.stdout:115964117009 2023-12-17T11:54:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7328068f70 msgr2=0x7f732806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7328068f70 0x7f732806b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7334009fd0 tx=0x7f733400b040 comp rx=0 tx=0).stop 2023-12-17T11:54:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 msgr2=0x7f7340115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340115840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7330009fd0 tx=0x7f7330009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:31.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 shutdown_connections 2023-12-17T11:54:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7328068f70 0x7f732806b420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7340102c00 0x7f7340115840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 --2- 172.21.15.2:0/2345780721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73401035a0 0x7f7340115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 >> 172.21.15.2:0/2345780721 conn(0x7f73400f8790 msgr2=0x7f73400fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 shutdown_connections 2023-12-17T11:54:31.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:31.984+0000 7f734541e700 1 -- 172.21.15.2:0/2345780721 wait complete. 2023-12-17T11:54:32.143 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:32 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2969384304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-17T11:54:32.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:32 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/459807975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-17T11:54:32.144 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:32 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2345780721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-17T11:54:32.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.143+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa59404bb80 con 0x7fa5941035a0 2023-12-17T11:54:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.144+0000 7fa590ff9700 1 -- 172.21.15.2:0/3268137088 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa588056a30 con 0x7fa5941035a0 2023-12-17T11:54:32.146 INFO:teuthology.orchestra.run.smithi002.stdout:60129542170 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa57c068f70 msgr2=0x7fa57c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa57c068f70 0x7fa57c06b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5840043d0 tx=0x7fa584009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 msgr2=0x7fa594070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 0x7fa594070480 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa588002a50 tx=0x7fa5880046b0 comp rx=0 tx=0).stop 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 shutdown_connections 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa57c068f70 0x7fa57c06b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa594102c00 0x7fa59406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 --2- 172.21.15.2:0/3268137088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5941035a0 0x7fa594070480 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 >> 172.21.15.2:0/3268137088 conn(0x7fa5940f8790 msgr2=0x7fa5940fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 shutdown_connections 2023-12-17T11:54:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:32.147+0000 7fa59a3a2700 1 -- 172.21.15.2:0/3268137088 wait complete. 2023-12-17T11:54:32.169 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378645 for osd.2 2023-12-17T11:54:32.169 DEBUG:teuthology.parallel:result is None 2023-12-17T11:54:32.349 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.0 2023-12-17T11:54:32.349 DEBUG:teuthology.parallel:result is None 2023-12-17T11:54:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:32 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2969384304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-17T11:54:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:32 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/459807975' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-17T11:54:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:32 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2345780721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-17T11:54:32.666 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117008 got 115964117009 for osd.3 2023-12-17T11:54:32.666 DEBUG:teuthology.parallel:result is None 2023-12-17T11:54:32.885 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542169 got 60129542170 for osd.1 2023-12-17T11:54:32.885 DEBUG:teuthology.parallel:result is None 2023-12-17T11:54:32.885 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-17T11:54:32.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-17T11:54:33.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:33 smithi002 ceph-mon[107131]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:33.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:33 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3268137088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-17T11:54:33.322 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:33 smithi119 ceph-mon[117414]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:33 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3268137088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-17T11:54:34.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 -- 172.21.15.2:0/1576684429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 msgr2=0x7f6ab4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 --2- 172.21.15.2:0/1576684429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4102fd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4004940 tx=0x7f6aa4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 -- 172.21.15.2:0/1576684429 shutdown_connections 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 --2- 172.21.15.2:0/1576684429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ab41035a0 0x7f6ab40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 --2- 172.21.15.2:0/1576684429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4102fd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 -- 172.21.15.2:0/1576684429 >> 172.21.15.2:0/1576684429 conn(0x7f6ab40f8790 msgr2=0x7f6ab40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 -- 172.21.15.2:0/1576684429 shutdown_connections 2023-12-17T11:54:34.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.473+0000 7f6ab895c700 1 -- 172.21.15.2:0/1576684429 wait complete. 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.474+0000 7f6ab895c700 1 Processor -- start 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.474+0000 7f6ab895c700 1 -- start start 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab895c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab895c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ab41035a0 0x7f6ab4115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab895c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab41163b0 con 0x7f6ab4102c00 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab895c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab410f6e0 con 0x7f6ab41035a0 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4115820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46570/0 (socket says 172.21.15.2:46570) 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 -- 172.21.15.2:0/850322956 learned_addr learned my addr 172.21.15.2:0/850322956 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 -- 172.21.15.2:0/850322956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ab41035a0 msgr2=0x7f6ab4115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:34.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ab41035a0 0x7f6ab4115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 -- 172.21.15.2:0/850322956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4005040 con 0x7f6ab4102c00 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.475+0000 7f6ab259c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4115820 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009360 tx=0x7f6aa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.476+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa400e040 con 0x7f6ab4102c00 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.476+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6aa400bc50 con 0x7f6ab4102c00 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.476+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aa401c630 con 0x7f6ab4102c00 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.476+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab410f960 con 0x7f6ab4102c00 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.476+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab410fea0 con 0x7f6ab4102c00 2023-12-17T11:54:34.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.477+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab40fc390 con 0x7f6ab4102c00 2023-12-17T11:54:34.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.478+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f6aa4013420 con 0x7f6ab4102c00 2023-12-17T11:54:34.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.479+0000 7f6aaaffd700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6aa0068f70 0x7f6aa006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:34.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.479+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6aa4087d40 con 0x7f6ab4102c00 2023-12-17T11:54:34.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.479+0000 7f6aabfff700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6aa0068f70 0x7f6aa006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:34.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.479+0000 7f6aabfff700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6aa0068f70 0x7f6aa006b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4111050 tx=0x7f6a9c007cc0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:34.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.483+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6aa4057fc0 con 0x7f6ab4102c00 2023-12-17T11:54:34.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.686+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ab4109c50 con 0x7f6aa0068f70 2023-12-17T11:54:34.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.687+0000 7f6aaaffd700 1 -- 172.21.15.2:0/850322956 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24667 (secure 0 0 0) 0x7f6a9c00c650 con 0x7f6aa0068f70 2023-12-17T11:54:34.690 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:34.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6aa0068f70 msgr2=0x7f6aa006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:34.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6aa0068f70 0x7f6aa006b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4111050 tx=0x7f6a9c007cc0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 msgr2=0x7f6ab4115820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4115820 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009360 tx=0x7f6aa4009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 shutdown_connections 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6aa0068f70 0x7f6aa006b420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ab4102c00 0x7f6ab4115820 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 --2- 172.21.15.2:0/850322956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ab41035a0 0x7f6ab4115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 >> 172.21.15.2:0/850322956 conn(0x7f6ab40f8790 msgr2=0x7f6ab40fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 shutdown_connections 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:34.689+0000 7f6ab895c700 1 -- 172.21.15.2:0/850322956 wait complete. 2023-12-17T11:54:34.692 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-12-17T11:54:35.066 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-12-17T11:54:34.024253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787648,"kb_used_data":3920,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683264,"statfs":{"total":575970213888,"available":574139662336,"internally_reserved":0,"allocated":4014080,"data_stored":2624833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001906"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:54:03.027539+0000","last_change":"2023-12-17T11:53:38.680095+0000","last_active":"2023-12-17T11:54:03.027539+0000","last_peered":"2023-12-17T11:54:03.027539+0000","last_clean":"2023-12-17T11:54:03.027539+0000","last_became_active":"2023-12-17T11:53:38.679683+0000","last_became_peered":"2023-12-17T11:53:38.679683+0000","last_unstale":"2023-12-17T11:54:03.027539+0000","last_undegraded":"2023-12-17T11:54:03.027539+0000","last_fullsized":"2023-12-17T11:54:03.027539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:52:56.732420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:52:56.732420+0000","last_clean_scrub_stamp":"2023-12-17T11:52:56.732420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:49:38.843404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":3,"up_from":27,"seq":115964117010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446924,"statfs":{"total":95995035648,"available":95689650176,"internally_reserved":0,"allocated":962560,"data_stored":732387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.85699999999999998}]},{"osd":1,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378646,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54500000000000004}]},{"osd":1,"last update":"Sun Dec 17 11:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.9290000000000003,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38}]},{"osd":2,"last update":"Sun Dec 17 11:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.29399999999999998}]},{"osd":2,"last update":"Sun Dec 17 11:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.376},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Dec 17 11:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:54:35.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-17T11:54:35.304 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:35 smithi002 ceph-mon[107131]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:35 smithi119 ceph-mon[117414]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:35.500 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:36.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:36 smithi119 ceph-mon[117414]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:54:36.411 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:36 smithi002 ceph-mon[107131]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:54:36.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 -- 172.21.15.2:0/477454522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a81035a0 msgr2=0x7fb7a80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 --2- 172.21.15.2:0/477454522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a81035a0 0x7fb7a80fcc10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb79c004940 tx=0x7fb79c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 -- 172.21.15.2:0/477454522 shutdown_connections 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 --2- 172.21.15.2:0/477454522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a81035a0 0x7fb7a80fcc10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 --2- 172.21.15.2:0/477454522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a8102c00 0x7fb7a8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 -- 172.21.15.2:0/477454522 >> 172.21.15.2:0/477454522 conn(0x7fb7a80f8790 msgr2=0x7fb7a80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 -- 172.21.15.2:0/477454522 shutdown_connections 2023-12-17T11:54:36.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.641+0000 7fb7ae542700 1 -- 172.21.15.2:0/477454522 wait complete. 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.642+0000 7fb7ae542700 1 Processor -- start 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.642+0000 7fb7ae542700 1 -- start start 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.642+0000 7fb7ae542700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 0x7fb7a806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.642+0000 7fb7ae542700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a81035a0 0x7fb7a80704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.642+0000 7fb7ae542700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8070af0 con 0x7fb7a8102c00 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.642+0000 7fb7ae542700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a8070c60 con 0x7fb7a81035a0 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 0x7fb7a806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 0x7fb7a806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46598/0 (socket says 172.21.15.2:46598) 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 -- 172.21.15.2:0/2520459172 learned_addr learned my addr 172.21.15.2:0/2520459172 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:36.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a77fe700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a81035a0 0x7fb7a80704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 -- 172.21.15.2:0/2520459172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a81035a0 msgr2=0x7fb7a80704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a81035a0 0x7fb7a80704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 -- 172.21.15.2:0/2520459172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c005040 con 0x7fb7a8102c00 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.643+0000 7fb7a7fff700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 0x7fb7a806ff40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c8c0 tx=0x7fb7980044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.644+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb79800a980 con 0x7fb7a8102c00 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.644+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb79800ce60 con 0x7fb7a8102c00 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.644+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7980113a0 con 0x7fb7a8102c00 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.644+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a8119880 con 0x7fb7a8102c00 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.644+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a8119dc0 con 0x7fb7a8102c00 2023-12-17T11:54:36.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.645+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a81050d0 con 0x7fb7a8102c00 2023-12-17T11:54:36.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.646+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fb798012400 con 0x7fb7a8102c00 2023-12-17T11:54:36.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.647+0000 7fb7a4ff9700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fb790068f70 0x7fb79006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:36.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.647+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb798086b30 con 0x7fb7a8102c00 2023-12-17T11:54:36.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.647+0000 7fb7a77fe700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fb790068f70 0x7fb79006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:36.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.648+0000 7fb7a77fe700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fb790068f70 0x7fb79006b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8071940 tx=0x7fb79c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:36.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.651+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb798053320 con 0x7fb7a8102c00 2023-12-17T11:54:36.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.853+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7a804bbf0 con 0x7fb790068f70 2023-12-17T11:54:36.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.854+0000 7fb7a4ff9700 1 -- 172.21.15.2:0/2520459172 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24624 (secure 0 0 0) 0x7fb7a804bbf0 con 0x7fb790068f70 2023-12-17T11:54:36.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fb790068f70 msgr2=0x7fb79006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fb790068f70 0x7fb79006b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8071940 tx=0x7fb79c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 msgr2=0x7fb7a806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 0x7fb7a806ff40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c8c0 tx=0x7fb7980044c0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 shutdown_connections 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fb790068f70 0x7fb79006b420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7a8102c00 0x7fb7a806ff40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 --2- 172.21.15.2:0/2520459172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a81035a0 0x7fb7a80704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:36.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 >> 172.21.15.2:0/2520459172 conn(0x7fb7a80f8790 msgr2=0x7fb7a80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 shutdown_connections 2023-12-17T11:54:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:36.857+0000 7fb7ae542700 1 -- 172.21.15.2:0/2520459172 wait complete. 2023-12-17T11:54:36.860 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-12-17T11:54:37.218 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:37 smithi002 ceph-mon[107131]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:37.241 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-12-17T11:54:36.024648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787648,"kb_used_data":3920,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683264,"statfs":{"total":575970213888,"available":574139662336,"internally_reserved":0,"allocated":4014080,"data_stored":2624833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002001"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":188,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:54:03.027539+0000","last_change":"2023-12-17T11:53:38.680095+0000","last_active":"2023-12-17T11:54:03.027539+0000","last_peered":"2023-12-17T11:54:03.027539+0000","last_clean":"2023-12-17T11:54:03.027539+0000","last_became_active":"2023-12-17T11:53:38.679683+0000","last_became_peered":"2023-12-17T11:53:38.679683+0000","last_unstale":"2023-12-17T11:54:03.027539+0000","last_undegraded":"2023-12-17T11:54:03.027539+0000","last_fullsized":"2023-12-17T11:54:03.027539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:52:56.732420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:52:56.732420+0000","last_clean_scrub_stamp":"2023-12-17T11:52:56.732420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:49:38.843404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":4,"up_from":35,"seq":150323855374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":3,"up_from":27,"seq":115964117010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446924,"statfs":{"total":95995035648,"available":95689650176,"internally_reserved":0,"allocated":962560,"data_stored":732387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.85699999999999998}]},{"osd":1,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447500,"statfs":{"total":95995035648,"available":95690240000,"internally_reserved":0,"allocated":372736,"data_stored":142342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.314}]},{"osd":1,"last update":"Sun Dec 17 11:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.377}]},{"osd":3,"last update":"Sun Dec 17 11:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":4.9290000000000003,"5min":4.9290000000000003,"15min":4.9290000000000003},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38}]},{"osd":2,"last update":"Sun Dec 17 11:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446920,"statfs":{"total":95995035648,"available":95689646080,"internally_reserved":0,"allocated":966656,"data_stored":732710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.29399999999999998}]},{"osd":2,"last update":"Sun Dec 17 11:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.376},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Dec 17 11:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:54:37.242 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-17T11:54:37.242 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-17T11:54:37.242 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-17T11:54:37.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-17T11:54:37.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:37 smithi119 ceph-mon[117414]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:38.217 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:38 smithi002 ceph-mon[107131]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:54:38.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:38 smithi119 ceph-mon[117414]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:54:38.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 -- 172.21.15.2:0/4058952019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 msgr2=0x7fefc0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 --2- 172.21.15.2:0/4058952019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0102fd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fefbc004940 tx=0x7fefbc009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 -- 172.21.15.2:0/4058952019 shutdown_connections 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 --2- 172.21.15.2:0/4058952019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc01035a0 0x7fefc00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 --2- 172.21.15.2:0/4058952019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0102fd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 -- 172.21.15.2:0/4058952019 >> 172.21.15.2:0/4058952019 conn(0x7fefc00f8790 msgr2=0x7fefc00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 -- 172.21.15.2:0/4058952019 shutdown_connections 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.847+0000 7fefc72e0700 1 -- 172.21.15.2:0/4058952019 wait complete. 2023-12-17T11:54:38.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.848+0000 7fefc72e0700 1 Processor -- start 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.848+0000 7fefc72e0700 1 -- start start 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.848+0000 7fefc72e0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.848+0000 7fefc72e0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc01035a0 0x7fefc0115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc72e0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc01163d0 con 0x7fefc0102c00 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc72e0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc010f700 con 0x7fefc01035a0 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46628/0 (socket says 172.21.15.2:46628) 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 -- 172.21.15.2:0/1198230904 learned_addr learned my addr 172.21.15.2:0/1198230904 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc487b700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc01035a0 0x7fefc0115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 -- 172.21.15.2:0/1198230904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc01035a0 msgr2=0x7fefc0115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc01035a0 0x7fefc0115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:38.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 -- 172.21.15.2:0/1198230904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefbc005040 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.849+0000 7fefc507c700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0115840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009360 tx=0x7fefbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.850+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefbc00e040 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.850+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefbc00bc50 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.850+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc010f980 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.850+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefbc01c630 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.850+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc010fec0 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.851+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc00fc390 con 0x7fefc0102c00 2023-12-17T11:54:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.852+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fefbc013420 con 0x7fefc0102c00 2023-12-17T11:54:38.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.853+0000 7fefb5ffb700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefac068f70 0x7fefac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:38.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.853+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fefbc087d40 con 0x7fefc0102c00 2023-12-17T11:54:38.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.854+0000 7fefc487b700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefac068f70 0x7fefac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:38.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.854+0000 7fefc487b700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefac068f70 0x7fefac06b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefc0111070 tx=0x7fefb0009ee0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:38.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:38.858+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fefbc057fc0 con 0x7fefc0102c00 2023-12-17T11:54:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.106+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fefc0110e20 con 0x7fefc0102c00 2023-12-17T11:54:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.107+0000 7fefb5ffb700 1 -- 172.21.15.2:0/1198230904 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fefbc057b50 con 0x7fefc0102c00 2023-12-17T11:54:39.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:39.109 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-17T11:54:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefac068f70 msgr2=0x7fefac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefac068f70 0x7fefac06b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefc0111070 tx=0x7fefb0009ee0 comp rx=0 tx=0).stop 2023-12-17T11:54:39.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 msgr2=0x7fefc0115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0115840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009360 tx=0x7fefbc009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 shutdown_connections 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fefac068f70 0x7fefac06b420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fefc0102c00 0x7fefc0115840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 --2- 172.21.15.2:0/1198230904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefc01035a0 0x7fefc0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 >> 172.21.15.2:0/1198230904 conn(0x7fefc00f8790 msgr2=0x7fefc00fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 shutdown_connections 2023-12-17T11:54:39.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:39.109+0000 7fefc72e0700 1 -- 172.21.15.2:0/1198230904 wait complete. 2023-12-17T11:54:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:39 smithi119 ceph-mon[117414]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:39 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1198230904' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-17T11:54:39.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:39 smithi002 ceph-mon[107131]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:39.470 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:39 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1198230904' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-17T11:54:39.491 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-17T11:54:39.492 INFO:tasks.cephadm:Setup complete, yielding 2023-12-17T11:54:39.492 INFO:teuthology.run_tasks:Running task print... 2023-12-17T11:54:39.501 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-17T11:54:39.501 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:54:39.511 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:54:39.511 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-17T11:54:39.944 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:40 smithi002 ceph-mon[107131]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:40.882 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:40 smithi119 ceph-mon[117414]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.128+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2644409297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 msgr2=0x7fdf700fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.128+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2644409297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf700fe250 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf60004940 tx=0x7fdf60009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2644409297 shutdown_connections 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2644409297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf700fe250 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2644409297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 0x7fdf700fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2644409297 >> 172.21.15.2:0/2644409297 conn(0x7fdf700f82d0 msgr2=0x7fdf700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2644409297 shutdown_connections 2023-12-17T11:54:41.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2644409297 wait complete. 2023-12-17T11:54:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.129+0000 7fdf77b6f700 1 Processor -- start 2023-12-17T11:54:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf77b6f700 1 -- start start 2023-12-17T11:54:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf77b6f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 0x7fdf70071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf77b6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf7006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf77b6f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70070590 con 0x7fdf700fde00 2023-12-17T11:54:41.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf77b6f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70070700 con 0x7fdf700fcbf0 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf7510a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf7006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf7510a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf7006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58680/0 (socket says 172.21.15.2:58680) 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.130+0000 7fdf7510a700 1 -- 172.21.15.2:0/2881051994 learned_addr learned my addr 172.21.15.2:0/2881051994 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf7590b700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 0x7fdf70071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf7510a700 1 -- 172.21.15.2:0/2881051994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 msgr2=0x7fdf70071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf7510a700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 0x7fdf70071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf7510a700 1 -- 172.21.15.2:0/2881051994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60005040 con 0x7fdf700fde00 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf7590b700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 0x7fdf70071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf7510a700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf7006ff90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009360 tx=0x7fdf60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf6000e040 con 0x7fdf700fde00 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf6000bcd0 con 0x7fdf700fde00 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf70070980 con 0x7fdf700fde00 2023-12-17T11:54:41.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf6001c630 con 0x7fdf700fde00 2023-12-17T11:54:41.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.131+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701155b0 con 0x7fdf700fde00 2023-12-17T11:54:41.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.132+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7004bb80 con 0x7fdf700fde00 2023-12-17T11:54:41.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.133+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fdf60013960 con 0x7fdf700fde00 2023-12-17T11:54:41.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.134+0000 7fdf667fc700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdf5c068f60 0x7fdf5c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:41.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.134+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdf60087fc0 con 0x7fdf700fde00 2023-12-17T11:54:41.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.135+0000 7fdf7590b700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdf5c068f60 0x7fdf5c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:41.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.135+0000 7fdf7590b700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdf5c068f60 0x7fdf5c06b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c007fd0 tx=0x7fdf6c009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:41.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.139+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdf600b9a00 con 0x7fdf700fde00 2023-12-17T11:54:41.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.346+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fdf70115880 con 0x7fdf700fde00 2023-12-17T11:54:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.351+0000 7fdf667fc700 1 -- 172.21.15.2:0/2881051994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fdf600581c0 con 0x7fdf700fde00 2023-12-17T11:54:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdf5c068f60 msgr2=0x7fdf5c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdf5c068f60 0x7fdf5c06b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c007fd0 tx=0x7fdf6c009040 comp rx=0 tx=0).stop 2023-12-17T11:54:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 msgr2=0x7fdf7006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf7006ff90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009360 tx=0x7fdf60009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 shutdown_connections 2023-12-17T11:54:41.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdf5c068f60 0x7fdf5c06b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf700fcbf0 0x7fdf70071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 --2- 172.21.15.2:0/2881051994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf700fde00 0x7fdf7006ff90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.353+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 >> 172.21.15.2:0/2881051994 conn(0x7fdf700f82d0 msgr2=0x7fdf70101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.354+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 shutdown_connections 2023-12-17T11:54:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:41.354+0000 7fdf77b6f700 1 -- 172.21.15.2:0/2881051994 wait complete. 2023-12-17T11:54:41.768 INFO:teuthology.run_tasks:Running task print... 2023-12-17T11:54:41.778 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-17T11:54:41.778 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:54:41.825 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:54:41.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-17T11:54:42.275 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:42 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2881051994' entity='client.admin' 2023-12-17T11:54:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:42 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:54:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:42 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:42 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:54:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:42 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:42 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2881051994' entity='client.admin' 2023-12-17T11:54:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:42 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:54:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:42 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:42 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:54:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:42 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.442+0000 7fc98f2c2700 1 -- 172.21.15.2:0/1379343768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 msgr2=0x7fc9880fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.442+0000 7fc98f2c2700 1 --2- 172.21.15.2:0/1379343768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc9880fd000 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc984004940 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.442+0000 7fc98f2c2700 1 -- 172.21.15.2:0/1379343768 shutdown_connections 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.442+0000 7fc98f2c2700 1 --2- 172.21.15.2:0/1379343768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9880fde00 0x7fc9880fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.442+0000 7fc98f2c2700 1 --2- 172.21.15.2:0/1379343768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc9880fd000 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.442+0000 7fc98f2c2700 1 -- 172.21.15.2:0/1379343768 >> 172.21.15.2:0/1379343768 conn(0x7fc9880f82d0 msgr2=0x7fc9880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.443+0000 7fc98f2c2700 1 -- 172.21.15.2:0/1379343768 shutdown_connections 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.443+0000 7fc98f2c2700 1 -- 172.21.15.2:0/1379343768 wait complete. 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.443+0000 7fc98f2c2700 1 Processor -- start 2023-12-17T11:54:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.443+0000 7fc98f2c2700 1 -- start start 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98f2c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc98810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98f2c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9880fde00 0x7fc98810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98f2c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98810e010 con 0x7fc9880fcbf0 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98f2c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98810e8b0 con 0x7fc9880fde00 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98d05e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc98810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98d05e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc98810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58698/0 (socket says 172.21.15.2:58698) 2023-12-17T11:54:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98d05e700 1 -- 172.21.15.2:0/4183542762 learned_addr learned my addr 172.21.15.2:0/4183542762 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98c85d700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9880fde00 0x7fc98810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98d05e700 1 -- 172.21.15.2:0/4183542762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9880fde00 msgr2=0x7fc98810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98d05e700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9880fde00 0x7fc98810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.444+0000 7fc98d05e700 1 -- 172.21.15.2:0/4183542762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984005040 con 0x7fc9880fcbf0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.445+0000 7fc98d05e700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc98810d4d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc984008f80 tx=0x7fc984009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.445+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc984021070 con 0x7fc9880fcbf0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.445+0000 7fc98f2c2700 1 -- 172.21.15.2:0/4183542762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98810eb30 con 0x7fc9880fcbf0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.445+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc98401c400 con 0x7fc9880fcbf0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.445+0000 7fc98f2c2700 1 -- 172.21.15.2:0/4183542762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98810f010 con 0x7fc9880fcbf0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.445+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98400e070 con 0x7fc9880fcbf0 2023-12-17T11:54:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.446+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98804bb80 con 0x7fc9880fcbf0 2023-12-17T11:54:43.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.447+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fc98401c950 con 0x7fc9880fcbf0 2023-12-17T11:54:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.448+0000 7fc97dffb700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc974068f70 0x7fc97406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.448+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc984087d00 con 0x7fc9880fcbf0 2023-12-17T11:54:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.448+0000 7fc98c85d700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc974068f70 0x7fc97406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:43.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.449+0000 7fc98c85d700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc974068f70 0x7fc97406b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc978009b80 tx=0x7fc97800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:43.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.452+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc984057f00 con 0x7fc9880fcbf0 2023-12-17T11:54:43.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:43 smithi002 ceph-mon[107131]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:43 smithi119 ceph-mon[117414]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:43.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.674+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc988105590 con 0x7fc974068f70 2023-12-17T11:54:43.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.675+0000 7fc97dffb700 1 -- 172.21.15.2:0/4183542762 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc988105590 con 0x7fc974068f70 2023-12-17T11:54:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2023-12-17T11:54:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2023-12-17T11:54:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc974068f70 msgr2=0x7fc97406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc974068f70 0x7fc97406b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc978009b80 tx=0x7fc97800b040 comp rx=0 tx=0).stop 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 msgr2=0x7fc98810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc98810d4d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc984008f80 tx=0x7fc984009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 shutdown_connections 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc974068f70 0x7fc97406b420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:43.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9880fcbf0 0x7fc98810d4d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 --2- 172.21.15.2:0/4183542762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9880fde00 0x7fc98810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 >> 172.21.15.2:0/4183542762 conn(0x7fc9880f82d0 msgr2=0x7fc988101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 shutdown_connections 2023-12-17T11:54:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:43.678+0000 7fc9737fe700 1 -- 172.21.15.2:0/4183542762 wait complete. 2023-12-17T11:54:44.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-17T11:54:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:45.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 -- 172.21.15.2:0/3836343174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 msgr2=0x7f305c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:45.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 --2- 172.21.15.2:0/3836343174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 0x7f305c0fe250 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f304c004940 tx=0x7f304c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:45.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 -- 172.21.15.2:0/3836343174 shutdown_connections 2023-12-17T11:54:45.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 --2- 172.21.15.2:0/3836343174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 0x7f305c0fe250 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:45.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 --2- 172.21.15.2:0/3836343174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:45.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 -- 172.21.15.2:0/3836343174 >> 172.21.15.2:0/3836343174 conn(0x7f305c0f82d0 msgr2=0x7f305c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:45.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 -- 172.21.15.2:0/3836343174 shutdown_connections 2023-12-17T11:54:45.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.609+0000 7f3063543700 1 -- 172.21.15.2:0/3836343174 wait complete. 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f3063543700 1 Processor -- start 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f3063543700 1 -- start start 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f3063543700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f3063543700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 0x7f305c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f3063543700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c110200 con 0x7f305c0fcbf0 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f3063543700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c110aa0 con 0x7f305c0fde00 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f30612df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f30612df700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c10f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58718/0 (socket says 172.21.15.2:58718) 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.610+0000 7f30612df700 1 -- 172.21.15.2:0/3665553985 learned_addr learned my addr 172.21.15.2:0/3665553985 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f3060ade700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 0x7f305c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f30612df700 1 -- 172.21.15.2:0/3665553985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 msgr2=0x7f305c10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f30612df700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 0x7f305c10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:45.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f30612df700 1 -- 172.21.15.2:0/3665553985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c005040 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f30612df700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c10f6c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f305800eb70 tx=0x7f305800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3058007cc0 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f305800f040 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c110d20 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f305800cad0 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.611+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c111260 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.613+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c101ea0 con 0x7f305c0fcbf0 2023-12-17T11:54:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.613+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f305800cc30 con 0x7f305c0fcbf0 2023-12-17T11:54:45.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.614+0000 7f3051ffb700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3048068f70 0x7f304806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:45.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.614+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3058086550 con 0x7f305c0fcbf0 2023-12-17T11:54:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.615+0000 7f3060ade700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3048068f70 0x7f304806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.615+0000 7f3060ade700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3048068f70 0x7f304806b420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f304c00b0d0 tx=0x7f304c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:45.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.619+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f305804da00 con 0x7f305c0fcbf0 2023-12-17T11:54:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:45 smithi119 ceph-mon[117414]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:45 smithi119 ceph-mon[117414]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:45.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:45 smithi002 ceph-mon[107131]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:45 smithi002 ceph-mon[107131]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:54:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.834+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f305c02b150 con 0x7f3048068f70 2023-12-17T11:54:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.843+0000 7f3051ffb700 1 -- 172.21.15.2:0/3665553985 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f305c02b150 con 0x7f3048068f70 2023-12-17T11:54:45.845 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 113s ago 4m 14.7M - 0.25.0 c8568f914cd2 ede7a91db214 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (4m) 113s ago 4m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (3m) 47s ago 3m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 113s ago 4m 78.0M - 9.4.7 954c08fa6188 43eb0083cc6a 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:9283 running (5m) 113s ago 5m 489M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ae71c0243acd 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283 running (3m) 47s ago 3m 441M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4765879e3e64 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (5m) 113s ago 5m 56.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (3m) 47s ago 3m 50.7M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 113s ago 4m 9034k - 1.5.0 0da6a335fe13 5a889148dac0 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (3m) 47s ago 3m 8586k - 1.5.0 0da6a335fe13 db4c4aade2ec 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (2m) 113s ago 2m 39.5M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 113s ago 2m 39.6M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (118s) 113s ago 118s 11.9M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:54:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (96s) 47s ago 96s 44.7M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:54:45.847 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (73s) 47s ago 73s 40.8M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:54:45.847 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (50s) 47s ago 50s 11.9M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:54:45.847 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (2m) 113s ago 3m 34.3M - 2.43.0 a07b618ecd1d 29a015410237 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3048068f70 msgr2=0x7f304806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3048068f70 0x7f304806b420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f304c00b0d0 tx=0x7f304c009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 msgr2=0x7f305c10f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c10f6c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f305800eb70 tx=0x7f305800b040 comp rx=0 tx=0).stop 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 shutdown_connections 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3048068f70 0x7f304806b420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f305c0fcbf0 0x7f305c10f6c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 --2- 172.21.15.2:0/3665553985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f305c0fde00 0x7f305c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 >> 172.21.15.2:0/3665553985 conn(0x7f305c0f82d0 msgr2=0x7f305c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 shutdown_connections 2023-12-17T11:54:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:45.846+0000 7f3063543700 1 -- 172.21.15.2:0/3665553985 wait complete. 2023-12-17T11:54:46.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-17T11:54:46.689 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:47 smithi002 ceph-mon[107131]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:47 smithi002 ceph-mon[107131]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:47 smithi119 ceph-mon[117414]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:47 smithi119 ceph-mon[117414]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:47.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1790151339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 msgr2=0x7f1c000fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1790151339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c000fe250 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0004940 tx=0x7f1bf0009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1790151339 shutdown_connections 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1790151339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c000fe250 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1790151339 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c000fcbf0 0x7f1c000fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1790151339 >> 172.21.15.2:0/1790151339 conn(0x7f1c000f82d0 msgr2=0x7f1c000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1790151339 shutdown_connections 2023-12-17T11:54:47.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.857+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1790151339 wait complete. 2023-12-17T11:54:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.858+0000 7f1c07a6f700 1 Processor -- start 2023-12-17T11:54:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.858+0000 7f1c07a6f700 1 -- start start 2023-12-17T11:54:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.858+0000 7f1c07a6f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c000fcbf0 0x7f1c0010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.858+0000 7f1c07a6f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c0010dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:47.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.858+0000 7f1c07a6f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0010e140 con 0x7f1c000fde00 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.858+0000 7f1c07a6f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0010e980 con 0x7f1c000fcbf0 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c0010dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c0010dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58734/0 (socket says 172.21.15.2:58734) 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 -- 172.21.15.2:0/1132496615 learned_addr learned my addr 172.21.15.2:0/1132496615 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0580b700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c000fcbf0 0x7f1c0010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 -- 172.21.15.2:0/1132496615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c000fcbf0 msgr2=0x7f1c0010d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c000fcbf0 0x7f1c0010d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 -- 172.21.15.2:0/1132496615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0005040 con 0x7f1c000fde00 2023-12-17T11:54:47.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.859+0000 7f1c0500a700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c0010dab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009fd0 tx=0x7f1bf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.860+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf000e040 con 0x7f1c000fde00 2023-12-17T11:54:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.860+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0010ec00 con 0x7f1c000fde00 2023-12-17T11:54:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.860+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bf0004290 con 0x7f1c000fde00 2023-12-17T11:54:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.860+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf001c3f0 con 0x7f1c000fde00 2023-12-17T11:54:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.860+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0010f140 con 0x7f1c000fde00 2023-12-17T11:54:47.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.861+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0004bb80 con 0x7f1c000fde00 2023-12-17T11:54:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.862+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f1bf000bc50 con 0x7f1c000fde00 2023-12-17T11:54:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.863+0000 7f1bf67fc700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1bec068f70 0x7f1bec06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.863+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1bf0087ef0 con 0x7f1c000fde00 2023-12-17T11:54:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.863+0000 7f1c0580b700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1bec068f70 0x7f1bec06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:47.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.864+0000 7f1c0580b700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1bec068f70 0x7f1bec06b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c000fdc60 tx=0x7f1bfc0091a0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:47.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:47.867+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1bf00580f0 con 0x7f1c000fde00 2023-12-17T11:54:48.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.081+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c0010f670 con 0x7f1bec068f70 2023-12-17T11:54:48.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.085+0000 7f1bf67fc700 1 -- 172.21.15.2:0/1132496615 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7f1c0010f670 con 0x7f1bec068f70 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager ?:9093,9094 1/1 116s ago 5m count:1 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:crash 2/2 116s ago 5m * 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:grafana ?:3000 1/1 116s ago 5m count:1 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 2/2 116s ago 5m count:2 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:mon 2/2 116s ago 4m smithi002:172.21.15.2=smithi002;smithi119:172.21.15.119=smithi119;count:2 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter ?:9100 2/2 116s ago 5m * 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:osd 6 116s ago - 2023-12-17T11:54:48.088 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus ?:9095 1/1 116s ago 5m count:1 2023-12-17T11:54:48.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.087+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1bec068f70 msgr2=0x7f1bec06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.087+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1bec068f70 0x7f1bec06b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c000fdc60 tx=0x7f1bfc0091a0 comp rx=0 tx=0).stop 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 msgr2=0x7f1c0010dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c0010dab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0009fd0 tx=0x7f1bf0009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 shutdown_connections 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f1bec068f70 0x7f1bec06b420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c000fcbf0 0x7f1c0010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 --2- 172.21.15.2:0/1132496615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c000fde00 0x7f1c0010dab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 >> 172.21.15.2:0/1132496615 conn(0x7f1c000f82d0 msgr2=0x7f1c00101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 shutdown_connections 2023-12-17T11:54:48.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:48.088+0000 7f1c07a6f700 1 -- 172.21.15.2:0/1132496615 wait complete. 2023-12-17T11:54:48.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-17T11:54:48.904 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:49.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:49 smithi119 ceph-mon[117414]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:49.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:49 smithi119 ceph-mon[117414]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:49.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:49 smithi002 ceph-mon[107131]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:49 smithi002 ceph-mon[107131]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 -- 172.21.15.2:0/521066394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 msgr2=0x7fdc340fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 --2- 172.21.15.2:0/521066394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc340fe250 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdc28004940 tx=0x7fdc28009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 -- 172.21.15.2:0/521066394 shutdown_connections 2023-12-17T11:54:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 --2- 172.21.15.2:0/521066394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc340fe250 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 --2- 172.21.15.2:0/521066394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc340fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 -- 172.21.15.2:0/521066394 >> 172.21.15.2:0/521066394 conn(0x7fdc340f82d0 msgr2=0x7fdc340fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 -- 172.21.15.2:0/521066394 shutdown_connections 2023-12-17T11:54:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.032+0000 7fdc3a914700 1 -- 172.21.15.2:0/521066394 wait complete. 2023-12-17T11:54:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.033+0000 7fdc3a914700 1 Processor -- start 2023-12-17T11:54:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.033+0000 7fdc3a914700 1 -- start start 2023-12-17T11:54:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.033+0000 7fdc3a914700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc3410f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.033+0000 7fdc3a914700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc3410fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.033+0000 7fdc3a914700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34110310 con 0x7fdc340fde00 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.033+0000 7fdc3a914700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc34110b60 con 0x7fdc340fcbf0 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc33fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc3410f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc337fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc3410fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc33fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc3410f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:37350/0 (socket says 172.21.15.2:37350) 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc33fff700 1 -- 172.21.15.2:0/3748105262 learned_addr learned my addr 172.21.15.2:0/3748105262 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc337fe700 1 -- 172.21.15.2:0/3748105262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 msgr2=0x7fdc3410f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc337fe700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc3410f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc337fe700 1 -- 172.21.15.2:0/3748105262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28005040 con 0x7fdc340fde00 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc33fff700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc3410f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:54:50.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.034+0000 7fdc337fe700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc3410fd10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009fd0 tx=0x7fdc28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.035+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2800e040 con 0x7fdc340fde00 2023-12-17T11:54:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.035+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc28004290 con 0x7fdc340fde00 2023-12-17T11:54:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.035+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc2801c3f0 con 0x7fdc340fde00 2023-12-17T11:54:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.035+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc34110de0 con 0x7fdc340fde00 2023-12-17T11:54:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.035+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc34111320 con 0x7fdc340fde00 2023-12-17T11:54:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.036+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc34101ea0 con 0x7fdc340fde00 2023-12-17T11:54:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.037+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fdc28013420 con 0x7fdc340fde00 2023-12-17T11:54:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.038+0000 7fdc30ff9700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdc1c068f70 0x7fdc1c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.038+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdc28087db0 con 0x7fdc340fde00 2023-12-17T11:54:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.038+0000 7fdc33fff700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdc1c068f70 0x7fdc1c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.039+0000 7fdc33fff700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdc1c068f70 0x7fdc1c06b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc24004fd0 tx=0x7fdc24009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:50.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.042+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdc28058030 con 0x7fdc340fde00 2023-12-17T11:54:50.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.255+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc34111590 con 0x7fdc1c068f70 2023-12-17T11:54:50.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.256+0000 7fdc30ff9700 1 -- 172.21.15.2:0/3748105262 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fdc34111590 con 0x7fdc1c068f70 2023-12-17T11:54:50.258 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2023-12-17T11:54:50.258 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2023-12-17T11:54:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:smithi119 172.21.15.119 2023-12-17T11:54:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:2 hosts in cluster 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdc1c068f70 msgr2=0x7fdc1c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdc1c068f70 0x7fdc1c06b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc24004fd0 tx=0x7fdc24009040 comp rx=0 tx=0).stop 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 msgr2=0x7fdc3410fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc3410fd10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009fd0 tx=0x7fdc28009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 shutdown_connections 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdc1c068f70 0x7fdc1c06b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdc340fcbf0 0x7fdc3410f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 --2- 172.21.15.2:0/3748105262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc340fde00 0x7fdc3410fd10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:50.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 >> 172.21.15.2:0/3748105262 conn(0x7fdc340f82d0 msgr2=0x7fdc340ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:50.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 shutdown_connections 2023-12-17T11:54:50.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:50.259+0000 7fdc3a914700 1 -- 172.21.15.2:0/3748105262 wait complete. 2023-12-17T11:54:50.616 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:50 smithi002 ceph-mon[107131]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:50.616 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:50 smithi002 ceph-mon[107131]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:50.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-17T11:54:50.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:50 smithi119 ceph-mon[117414]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:50.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:50 smithi119 ceph-mon[117414]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:51.072 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 -- 172.21.15.2:0/2038198645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fcbf0 msgr2=0x7f83640fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 --2- 172.21.15.2:0/2038198645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fcbf0 0x7f83640fd000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8354004940 tx=0x7f8354009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 -- 172.21.15.2:0/2038198645 shutdown_connections 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 --2- 172.21.15.2:0/2038198645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fde00 0x7f83640fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 --2- 172.21.15.2:0/2038198645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fcbf0 0x7f83640fd000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 -- 172.21.15.2:0/2038198645 >> 172.21.15.2:0/2038198645 conn(0x7f83640f82d0 msgr2=0x7f83640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:52.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 -- 172.21.15.2:0/2038198645 shutdown_connections 2023-12-17T11:54:52.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.232+0000 7f83695d9700 1 -- 172.21.15.2:0/2038198645 wait complete. 2023-12-17T11:54:52.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.233+0000 7f83695d9700 1 Processor -- start 2023-12-17T11:54:52.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.233+0000 7f83695d9700 1 -- start start 2023-12-17T11:54:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.233+0000 7f83695d9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 0x7f836410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.233+0000 7f83695d9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 0x7f836410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.233+0000 7f83695d9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83641102a0 con 0x7f83640fde00 2023-12-17T11:54:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.233+0000 7f83695d9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8364110b40 con 0x7f83640fcbf0 2023-12-17T11:54:52.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f83627fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 0x7f836410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f8362ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 0x7f836410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f8362ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 0x7f836410f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:37358/0 (socket says 172.21.15.2:37358) 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f8362ffd700 1 -- 172.21.15.2:0/3261223036 learned_addr learned my addr 172.21.15.2:0/3261223036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f83627fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 0x7f836410fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50890/0 (socket says 172.21.15.2:50890) 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f83627fc700 1 -- 172.21.15.2:0/3261223036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 msgr2=0x7f836410f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f83627fc700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 0x7f836410f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f83627fc700 1 -- 172.21.15.2:0/3261223036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354005040 con 0x7f83640fde00 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.234+0000 7f8362ffd700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 0x7f836410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.235+0000 7f83627fc700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 0x7f836410fca0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8358002820 tx=0x7f8358004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.235+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8358007cc0 con 0x7f83640fde00 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.235+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f835800f040 con 0x7f83640fde00 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.235+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83580137d0 con 0x7f83640fde00 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.235+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8364110e20 con 0x7f83640fde00 2023-12-17T11:54:52.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.235+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8364111310 con 0x7f83640fde00 2023-12-17T11:54:52.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.236+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364101ea0 con 0x7f83640fde00 2023-12-17T11:54:52.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.237+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f835801c400 con 0x7f83640fde00 2023-12-17T11:54:52.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.238+0000 7f834b7fe700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f834c068f70 0x7f834c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:52.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.238+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f83580867c0 con 0x7f83640fde00 2023-12-17T11:54:52.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.238+0000 7f8362ffd700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f834c068f70 0x7f834c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:52.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.239+0000 7f8362ffd700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f834c068f70 0x7f834c06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8354004f90 tx=0x7f8354009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:52.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.242+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8358056940 con 0x7f83640fde00 2023-12-17T11:54:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.457+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8364111580 con 0x7f834c068f70 2023-12-17T11:54:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.458+0000 7f834b7fe700 1 -- 172.21.15.2:0/3261223036 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f8364111580 con 0x7f834c068f70 2023-12-17T11:54:52.461 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-17T11:54:52.461 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 117s ago Has a FileSystem, LVM detected 2023-12-17T11:54:52.461 INFO:teuthology.orchestra.run.smithi002.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 50s ago Has a FileSystem, LVM detected 2023-12-17T11:54:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f834c068f70 msgr2=0x7f834c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f834c068f70 0x7f834c06b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8354004f90 tx=0x7f8354009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 msgr2=0x7f836410fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 0x7f836410fca0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8358002820 tx=0x7f8358004570 comp rx=0 tx=0).stop 2023-12-17T11:54:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 shutdown_connections 2023-12-17T11:54:52.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f834c068f70 0x7f834c06b420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83640fcbf0 0x7f836410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 --2- 172.21.15.2:0/3261223036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83640fde00 0x7f836410fca0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 >> 172.21.15.2:0/3261223036 conn(0x7f83640f82d0 msgr2=0x7f83640ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 shutdown_connections 2023-12-17T11:54:52.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:52.461+0000 7f83695d9700 1 -- 172.21.15.2:0/3261223036 wait complete. 2023-12-17T11:54:52.882 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:54:52.892 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:54:52.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-17T11:54:53.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:53 smithi002 ceph-mon[107131]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:53.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:53 smithi002 ceph-mon[107131]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:53.326 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:53 smithi119 ceph-mon[117414]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:53 smithi119 ceph-mon[117414]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 -- 172.21.15.2:0/1658169772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 msgr2=0x7f82400709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 --2- 172.21.15.2:0/1658169772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f82400709c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8230004940 tx=0x7f8230009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 -- 172.21.15.2:0/1658169772 shutdown_connections 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 --2- 172.21.15.2:0/1658169772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f82400709c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 --2- 172.21.15.2:0/1658169772 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8240071bc0 0x7f8240070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 -- 172.21.15.2:0/1658169772 >> 172.21.15.2:0/1658169772 conn(0x7f82400f82d0 msgr2=0x7f82400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 -- 172.21.15.2:0/1658169772 shutdown_connections 2023-12-17T11:54:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.468+0000 7f824831c700 1 -- 172.21.15.2:0/1658169772 wait complete. 2023-12-17T11:54:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.469+0000 7f824831c700 1 Processor -- start 2023-12-17T11:54:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.469+0000 7f824831c700 1 -- start start 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.469+0000 7f824831c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f824010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.469+0000 7f824831c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8240071bc0 0x7f824010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.469+0000 7f824831c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82401103a0 con 0x7f8240070570 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.469+0000 7f824831c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8240110c40 con 0x7f8240071bc0 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f824010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f824010f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50902/0 (socket says 172.21.15.2:50902) 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 -- 172.21.15.2:0/2727457924 learned_addr learned my addr 172.21.15.2:0/2727457924 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:54.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82458b7700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8240071bc0 0x7f824010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 -- 172.21.15.2:0/2727457924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8240071bc0 msgr2=0x7f824010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8240071bc0 0x7f824010fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 -- 172.21.15.2:0/2727457924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8230005040 con 0x7f8240070570 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.470+0000 7f82460b8700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f824010f860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c8c0 tx=0x7f823c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.471+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823c00a760 con 0x7f8240070570 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.471+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f823c00ad70 con 0x7f8240070570 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.471+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8240110f20 con 0x7f8240070570 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.471+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f823c0113a0 con 0x7f8240070570 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.471+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8240111460 con 0x7f8240070570 2023-12-17T11:54:54.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.472+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82401096f0 con 0x7f8240070570 2023-12-17T11:54:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.473+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f823c012400 con 0x7f8240070570 2023-12-17T11:54:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.474+0000 7f8236ffd700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f822c068f60 0x7f822c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.474+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f823c086a90 con 0x7f8240070570 2023-12-17T11:54:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.474+0000 7f82458b7700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f822c068f60 0x7f822c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:54.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.475+0000 7f82458b7700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f822c068f60 0x7f822c06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8230004560 tx=0x7f8230009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:54.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.478+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f823c056d10 con 0x7f8240070570 2023-12-17T11:54:54.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:54.716+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8240111730 con 0x7f822c068f60 2023-12-17T11:54:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:55 smithi119 ceph-mon[117414]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-17T11:54:55.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:55 smithi002 ceph-mon[107131]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-17T11:54:56.521 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:56 smithi002 ceph-mon[107131]: from='client.14482 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:56.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-17T11:54:56.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:56 smithi002 ceph-mon[107131]: osdmap e42: 6 total, 6 up, 6 in 2023-12-17T11:54:56.522 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:56 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-17T11:54:56.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.543+0000 7f8236ffd700 1 -- 172.21.15.2:0/2727457924 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8240111730 con 0x7f822c068f60 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.547+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f822c068f60 msgr2=0x7f822c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.547+0000 7f824831c700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f822c068f60 0x7f822c06b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8230004560 tx=0x7f8230009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.547+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 msgr2=0x7f824010f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.547+0000 7f824831c700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f824010f860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c8c0 tx=0x7f823c0044c0 comp rx=0 tx=0).stop 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 shutdown_connections 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f822c068f60 0x7f822c06b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:56.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8240070570 0x7f824010f860 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 --2- 172.21.15.2:0/2727457924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8240071bc0 0x7f824010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 >> 172.21.15.2:0/2727457924 conn(0x7f82400f82d0 msgr2=0x7f8240103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 shutdown_connections 2023-12-17T11:54:56.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:56.548+0000 7f824831c700 1 -- 172.21.15.2:0/2727457924 wait complete. 2023-12-17T11:54:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:56 smithi119 ceph-mon[117414]: from='client.14482 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:54:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-17T11:54:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:56 smithi119 ceph-mon[117414]: osdmap e42: 6 total, 6 up, 6 in 2023-12-17T11:54:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:56 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-17T11:54:56.926 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:56 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[107108]: 2023-12-17T11:54:56.517+0000 7ff9179cb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T11:54:56.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-17T11:54:57.640 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: pgmap v148: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: osdmap e43: 6 total, 6 up, 6 in 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: osdmap e44: 6 total, 6 up, 6 in 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: fsmap cephfs:0 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:57.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:54:57.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:57.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.ercyvj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:54:57.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.ercyvj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:54:57.642 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:57 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: pgmap v148: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-17T11:54:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-17T11:54:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: osdmap e43: 6 total, 6 up, 6 in 2023-12-17T11:54:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-17T11:54:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: osdmap e44: 6 total, 6 up, 6 in 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: fsmap cephfs:0 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.ercyvj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.ercyvj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:54:57.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:57 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:54:57.809 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:54:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:58 smithi002 ceph-mon[107131]: Saving service mds.cephfs spec with placement count:4 2023-12-17T11:54:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:58 smithi002 ceph-mon[107131]: Deploying daemon mds.cephfs.smithi002.ercyvj on smithi002 2023-12-17T11:54:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:58 smithi002 ceph-mon[107131]: osdmap e45: 6 total, 6 up, 6 in 2023-12-17T11:54:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:58 smithi119 ceph-mon[117414]: Saving service mds.cephfs spec with placement count:4 2023-12-17T11:54:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:58 smithi119 ceph-mon[117414]: Deploying daemon mds.cephfs.smithi002.ercyvj on smithi002 2023-12-17T11:54:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:58 smithi119 ceph-mon[117414]: osdmap e45: 6 total, 6 up, 6 in 2023-12-17T11:54:59.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.197+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3507389754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4071bc0 msgr2=0x7f28b4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:59.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.197+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3507389754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4071bc0 0x7f28b4070030 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f28b0004940 tx=0x7f28b0009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.198+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3507389754 shutdown_connections 2023-12-17T11:54:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.198+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3507389754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b4070570 0x7f28b40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.198+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3507389754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4071bc0 0x7f28b4070030 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.198+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3507389754 >> 172.21.15.2:0/3507389754 conn(0x7f28b40f82d0 msgr2=0x7f28b40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.198+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3507389754 shutdown_connections 2023-12-17T11:54:59.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.198+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3507389754 wait complete. 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28bbcd5700 1 Processor -- start 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28bbcd5700 1 -- start start 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28bbcd5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 0x7f28b410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28bbcd5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b4071bc0 0x7f28b410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28bbcd5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4110420 con 0x7f28b4070570 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28bbcd5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4110cc0 con 0x7f28b4071bc0 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28b9a71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 0x7f28b410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28b9a71700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 0x7f28b410f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57102/0 (socket says 172.21.15.2:57102) 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.199+0000 7f28b9a71700 1 -- 172.21.15.2:0/3390178983 learned_addr learned my addr 172.21.15.2:0/3390178983 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28b9a71700 1 -- 172.21.15.2:0/3390178983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b4071bc0 msgr2=0x7f28b410fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28b9270700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b4071bc0 0x7f28b410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28b9a71700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b4071bc0 0x7f28b410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28b9a71700 1 -- 172.21.15.2:0/3390178983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0005040 con 0x7f28b4070570 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28b9a71700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 0x7f28b410f8e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009fd0 tx=0x7f28b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b000e040 con 0x7f28b4070570 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28b0004290 con 0x7f28b4070570 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b4110f40 con 0x7f28b4070570 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.200+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b001c630 con 0x7f28b4070570 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.201+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b4111480 con 0x7f28b4070570 2023-12-17T11:54:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.202+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b41096f0 con 0x7f28b4070570 2023-12-17T11:54:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.203+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f28b000bc70 con 0x7f28b4070570 2023-12-17T11:54:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.205+0000 7f28aa7fc700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f28a0068f70 0x7f28a006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:54:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.205+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f28b0088320 con 0x7f28b4070570 2023-12-17T11:54:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.205+0000 7f28b9270700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f28a0068f70 0x7f28a006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:54:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.206+0000 7f28b9270700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f28a0068f70 0x7f28a006b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28a4004d60 tx=0x7f28a400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:54:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.210+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f28b00581e0 con 0x7f28b4070570 2023-12-17T11:54:59.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:59 smithi002 ceph-mon[107131]: pgmap v152: 65 pgs: 22 active+clean, 14 creating+peering, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:59 smithi002 ceph-mon[107131]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-17T11:54:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:54:59 smithi002 ceph-mon[107131]: osdmap e46: 6 total, 6 up, 6 in 2023-12-17T11:54:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.476+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f28b4111760 con 0x7f28b4070570 2023-12-17T11:54:59.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.477+0000 7f28aa7fc700 1 -- 172.21.15.2:0/3390178983 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f28b0057d70 con 0x7f28b4070570 2023-12-17T11:54:59.480 INFO:teuthology.orchestra.run.smithi002.stdout:e2 2023-12-17T11:54:59.480 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T11:54:59.480 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T11:54:59.480 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 2 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T11:54:56.518548+0000 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T11:54:59.481 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 1 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:in 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:up {} 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T11:54:59.482 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T11:54:59.483 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T11:54:59.483 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2023-12-17T11:54:59.483 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T11:54:59.483 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2023-12-17T11:54:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:54:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f28a0068f70 msgr2=0x7f28a006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f28a0068f70 0x7f28a006b420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f28a4004d60 tx=0x7f28a400b040 comp rx=0 tx=0).stop 2023-12-17T11:54:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 msgr2=0x7f28b410f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:54:59.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 0x7f28b410f8e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009fd0 tx=0x7f28b0009e30 comp rx=0 tx=0).stop 2023-12-17T11:54:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 shutdown_connections 2023-12-17T11:54:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f28a0068f70 0x7f28a006b420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b4070570 0x7f28b410f8e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 --2- 172.21.15.2:0/3390178983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28b4071bc0 0x7f28b410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:54:59.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.479+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 >> 172.21.15.2:0/3390178983 conn(0x7f28b40f82d0 msgr2=0x7f28b4103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:54:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.480+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 shutdown_connections 2023-12-17T11:54:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:54:59.480+0000 7f28bbcd5700 1 -- 172.21.15.2:0/3390178983 wait complete. 2023-12-17T11:54:59.486 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2023-12-17T11:54:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:59 smithi119 ceph-mon[117414]: pgmap v152: 65 pgs: 22 active+clean, 14 creating+peering, 29 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:54:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:59 smithi119 ceph-mon[117414]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-17T11:54:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:54:59 smithi119 ceph-mon[117414]: osdmap e46: 6 total, 6 up, 6 in 2023-12-17T11:54:59.874 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:54:59.884 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:54:59.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-17T11:55:00.322 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.mzkvrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.mzkvrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: Deploying daemon mds.cephfs.smithi119.mzkvrk on smithi119 2023-12-17T11:55:00.373 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3390178983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: daemon mds.cephfs.smithi002.ercyvj assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: Cluster is now healthy 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6826/696982378,v1:172.21.15.2:6827/696982378] up:boot 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: fsmap cephfs:1 {0=cephfs.smithi002.ercyvj=up:creating} 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: daemon mds.cephfs.smithi002.ercyvj is now active in filesystem cephfs as rank 0 2023-12-17T11:55:00.374 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:00.542 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.mzkvrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.mzkvrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: Deploying daemon mds.cephfs.smithi119.mzkvrk on smithi119 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3390178983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: daemon mds.cephfs.smithi002.ercyvj assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: Cluster is now healthy 2023-12-17T11:55:00.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6826/696982378,v1:172.21.15.2:6827/696982378] up:boot 2023-12-17T11:55:00.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: fsmap cephfs:1 {0=cephfs.smithi002.ercyvj=up:creating} 2023-12-17T11:55:00.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:55:00.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: daemon mds.cephfs.smithi002.ercyvj is now active in filesystem cephfs as rank 0 2023-12-17T11:55:00.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.467+0000 7f6bee396700 1 -- 172.21.15.2:0/2524044575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 msgr2=0x7f6be8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.467+0000 7f6bee396700 1 --2- 172.21.15.2:0/2524044575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be8070030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8004940 tx=0x7f6bd8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 -- 172.21.15.2:0/2524044575 shutdown_connections 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 --2- 172.21.15.2:0/2524044575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 0x7f6be80709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 --2- 172.21.15.2:0/2524044575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be8070030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 -- 172.21.15.2:0/2524044575 >> 172.21.15.2:0/2524044575 conn(0x7f6be80f82d0 msgr2=0x7f6be80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 -- 172.21.15.2:0/2524044575 shutdown_connections 2023-12-17T11:55:01.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 -- 172.21.15.2:0/2524044575 wait complete. 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.468+0000 7f6bee396700 1 Processor -- start 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6bee396700 1 -- start start 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6bee396700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 0x7f6be810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6bee396700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be810fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6bee396700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81102c0 con 0x7f6be8071bc0 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6bee396700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be8110b60 con 0x7f6be8070570 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be810fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6be77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be810fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57140/0 (socket says 172.21.15.2:57140) 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6be77fe700 1 -- 172.21.15.2:0/2181504451 learned_addr learned my addr 172.21.15.2:0/2181504451 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.469+0000 7f6be7fff700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 0x7f6be810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be77fe700 1 -- 172.21.15.2:0/2181504451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 msgr2=0x7f6be810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be77fe700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 0x7f6be810f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:01.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be77fe700 1 -- 172.21.15.2:0/2181504451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8005040 con 0x7f6be8071bc0 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be7fff700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 0x7f6be810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be77fe700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be810fcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc002a50 tx=0x7f6bdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bdc007cc0 con 0x7f6be8071bc0 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bdc00f040 con 0x7f6be8071bc0 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bdc00d9c0 con 0x7f6be8071bc0 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be8110e40 con 0x7f6be8071bc0 2023-12-17T11:55:01.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.470+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be8111380 con 0x7f6be8071bc0 2023-12-17T11:55:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.471+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be81097e0 con 0x7f6be8071bc0 2023-12-17T11:55:01.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.472+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f6bdc00db60 con 0x7f6be8071bc0 2023-12-17T11:55:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.473+0000 7f6be4ff9700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6bd0068f70 0x7f6bd006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.474+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6bdc0864c0 con 0x7f6be8071bc0 2023-12-17T11:55:01.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.474+0000 7f6be7fff700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6bd0068f70 0x7f6bd006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:01.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.474+0000 7f6be7fff700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6bd0068f70 0x7f6bd006b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800b3b0 tx=0x7f6bd8009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:01.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.477+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6bdc04ca00 con 0x7f6be8071bc0 2023-12-17T11:55:01.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:01 smithi119 ceph-mon[117414]: pgmap v154: 65 pgs: 41 active+clean, 14 creating+peering, 10 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-17T11:55:01.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:01 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6826/696982378,v1:172.21.15.2:6827/696982378] up:active 2023-12-17T11:55:01.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:01 smithi119 ceph-mon[117414]: fsmap cephfs:1 {0=cephfs.smithi002.ercyvj=up:active} 2023-12-17T11:55:01.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:01 smithi002 ceph-mon[107131]: pgmap v154: 65 pgs: 41 active+clean, 14 creating+peering, 10 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-17T11:55:01.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:01 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6826/696982378,v1:172.21.15.2:6827/696982378] up:active 2023-12-17T11:55:01.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:01 smithi002 ceph-mon[107131]: fsmap cephfs:1 {0=cephfs.smithi002.ercyvj=up:active} 2023-12-17T11:55:01.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:01.735+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f6be81077d0 con 0x7f6be8071bc0 2023-12-17T11:55:02.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.287+0000 7f6be4ff9700 1 -- 172.21.15.2:0/2181504451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6bdc056300 con 0x7f6be8071bc0 2023-12-17T11:55:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6bd0068f70 msgr2=0x7f6bd006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6bd0068f70 0x7f6bd006b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800b3b0 tx=0x7f6bd8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 msgr2=0x7f6be810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be810fcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc002a50 tx=0x7f6bdc0046b0 comp rx=0 tx=0).stop 2023-12-17T11:55:02.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 shutdown_connections 2023-12-17T11:55:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6bd0068f70 0x7f6bd006b420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6be8070570 0x7f6be810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 --2- 172.21.15.2:0/2181504451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6be8071bc0 0x7f6be810fcc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 >> 172.21.15.2:0/2181504451 conn(0x7f6be80f82d0 msgr2=0x7f6be80fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 shutdown_connections 2023-12-17T11:55:02.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:02.290+0000 7f6bee396700 1 -- 172.21.15.2:0/2181504451 wait complete. 2023-12-17T11:55:02.708 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:55:02.718 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:55:02.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-17T11:55:02.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:02.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:02.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:02.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.atwfoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:55:02.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.atwfoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:55:02.918 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: Deploying daemon mds.cephfs.smithi002.atwfoy on smithi002 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2181504451' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: pgmap v155: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 742 B/s wr, 5 op/s 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] up:boot 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2181504451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: daemon mds.cephfs.smithi119.mzkvrk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-17T11:55:02.919 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-17T11:55:02.920 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T11:55:02.920 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: fsmap cephfs:1 {0=cephfs.smithi002.ercyvj=up:active} 1 up:standby 2023-12-17T11:55:02.920 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T11:55:02.920 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:creating} 2023-12-17T11:55:02.920 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:02 smithi002 ceph-mon[107131]: daemon mds.cephfs.smithi119.mzkvrk is now active in filesystem cephfs as rank 1 2023-12-17T11:55:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.atwfoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:55:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.atwfoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:55:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: Deploying daemon mds.cephfs.smithi002.atwfoy on smithi002 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2181504451' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: pgmap v155: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 742 B/s wr, 5 op/s 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] up:boot 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2181504451' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: daemon mds.cephfs.smithi119.mzkvrk assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: fsmap cephfs:1 {0=cephfs.smithi002.ercyvj=up:active} 1 up:standby 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:creating} 2023-12-17T11:55:03.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:02 smithi119 ceph-mon[117414]: daemon mds.cephfs.smithi119.mzkvrk is now active in filesystem cephfs as rank 1 2023-12-17T11:55:03.399 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:04.516 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:04 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] up:active 2023-12-17T11:55:04.517 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:04 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2023-12-17T11:55:04.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:04 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] up:active 2023-12-17T11:55:04.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:04 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 -- 172.21.15.2:0/1083384522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 msgr2=0x7f83240fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 --2- 172.21.15.2:0/1083384522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f83240fe060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8318004940 tx=0x7f8318009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 -- 172.21.15.2:0/1083384522 shutdown_connections 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 --2- 172.21.15.2:0/1083384522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f83240fe060 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 --2- 172.21.15.2:0/1083384522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f83240fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 -- 172.21.15.2:0/1083384522 >> 172.21.15.2:0/1083384522 conn(0x7f83240f80e0 msgr2=0x7f83240fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 -- 172.21.15.2:0/1083384522 shutdown_connections 2023-12-17T11:55:05.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.064+0000 7f8328838700 1 -- 172.21.15.2:0/1083384522 wait complete. 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.065+0000 7f8328838700 1 Processor -- start 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8328838700 1 -- start start 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8328838700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f832410d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8328838700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f832410d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8328838700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832410ddc0 con 0x7f83240fdc10 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8328838700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832410e660 con 0x7f83240fca00 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8322d9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f832410d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f832259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f832410d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8322d9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f832410d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:36262/0 (socket says 172.21.15.2:36262) 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.066+0000 7f8322d9d700 1 -- 172.21.15.2:0/2257685521 learned_addr learned my addr 172.21.15.2:0/2257685521 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:05.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f8322d9d700 1 -- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 msgr2=0x7f832410d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f8322d9d700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f832410d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f8322d9d700 1 -- 172.21.15.2:0/2257685521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318005040 con 0x7f83240fca00 2023-12-17T11:55:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f832259c700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f832410d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:55:05.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f8322d9d700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f832410d280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f831400eb70 tx=0x7f831400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8314007cc0 con 0x7f83240fca00 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832410e8e0 con 0x7f83240fca00 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f831400f040 con 0x7f83240fca00 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f831400c9d0 con 0x7f83240fca00 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.067+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832410ee20 con 0x7f83240fca00 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.069+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832404bb80 con 0x7f83240fca00 2023-12-17T11:55:05.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.069+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f831400cc40 con 0x7f83240fca00 2023-12-17T11:55:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.070+0000 7f830b7fe700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f830c068f70 0x7f830c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.070+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f83140868f0 con 0x7f83240fca00 2023-12-17T11:55:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.071+0000 7f832259c700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f830c068f70 0x7f830c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:05.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.071+0000 7f832259c700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f830c068f70 0x7f830c06b420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8318013600 tx=0x7f8318009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:05.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.075+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f831404da00 con 0x7f83240fca00 2023-12-17T11:55:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.333+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f832410f280 con 0x7f83240fca00 2023-12-17T11:55:05.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.508+0000 7f830b7fe700 1 -- 172.21.15.2:0/2257685521 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f83140567e0 con 0x7f83240fca00 2023-12-17T11:55:05.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.511+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f830c068f70 msgr2=0x7f830c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:05.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.511+0000 7f8328838700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f830c068f70 0x7f830c06b420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8318013600 tx=0x7f8318009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:05.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.511+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 msgr2=0x7f832410d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:05.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.511+0000 7f8328838700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f832410d280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f831400eb70 tx=0x7f831400b040 comp rx=0 tx=0).stop 2023-12-17T11:55:05.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.512+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 shutdown_connections 2023-12-17T11:55:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.512+0000 7f8328838700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f830c068f70 0x7f830c06b420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.512+0000 7f8328838700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83240fca00 0x7f832410d280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.512+0000 7f8328838700 1 --2- 172.21.15.2:0/2257685521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83240fdc10 0x7f832410d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.512+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 >> 172.21.15.2:0/2257685521 conn(0x7f83240f80e0 msgr2=0x7f8324100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.512+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 shutdown_connections 2023-12-17T11:55:05.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:05.513+0000 7f8328838700 1 -- 172.21.15.2:0/2257685521 wait complete. 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: pgmap v156: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s wr, 8 op/s 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.qgnwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.qgnwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:55:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:05 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: pgmap v156: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s wr, 8 op/s 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.qgnwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.qgnwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T11:55:05.687 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:05 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:05.876 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:55:05.886 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:55:05.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2023-12-17T11:55:06.324 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:06.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: Deploying daemon mds.cephfs.smithi119.qgnwfs on smithi119 2023-12-17T11:55:06.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2257685521' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-17T11:55:06.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-17T11:55:06.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-17T11:55:06.587 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: Cluster is now healthy 2023-12-17T11:55:06.588 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:boot 2023-12-17T11:55:06.588 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-17T11:55:06.588 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 1 up:standby 2023-12-17T11:55:06.588 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:06 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T11:55:06.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: Deploying daemon mds.cephfs.smithi119.qgnwfs on smithi119 2023-12-17T11:55:06.625 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2257685521' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: Cluster is now healthy 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:boot 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 1 up:standby 2023-12-17T11:55:06.626 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:06 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 -- 172.21.15.2:0/1390329535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c070570 msgr2=0x7f396c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 --2- 172.21.15.2:0/1390329535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c070570 0x7f396c0709c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3960004940 tx=0x7f3960009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 -- 172.21.15.2:0/1390329535 shutdown_connections 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 --2- 172.21.15.2:0/1390329535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c070570 0x7f396c0709c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 --2- 172.21.15.2:0/1390329535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f396c071bc0 0x7f396c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 -- 172.21.15.2:0/1390329535 >> 172.21.15.2:0/1390329535 conn(0x7f396c0f82d0 msgr2=0x7f396c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 -- 172.21.15.2:0/1390329535 shutdown_connections 2023-12-17T11:55:07.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.510+0000 7f3972500700 1 -- 172.21.15.2:0/1390329535 wait complete. 2023-12-17T11:55:07.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.511+0000 7f3972500700 1 Processor -- start 2023-12-17T11:55:07.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.511+0000 7f3972500700 1 -- start start 2023-12-17T11:55:07.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f3972500700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f396c070570 0x7f396c10f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f3972500700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 0x7f396c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f3972500700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c1103a0 con 0x7f396c071bc0 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f3972500700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c110c40 con 0x7f396c070570 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 0x7f396c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f396c070570 0x7f396c10f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 0x7f396c10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57204/0 (socket says 172.21.15.2:57204) 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396b7fe700 1 -- 172.21.15.2:0/1063735430 learned_addr learned my addr 172.21.15.2:0/1063735430 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396b7fe700 1 -- 172.21.15.2:0/1063735430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f396c070570 msgr2=0x7f396c10f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396b7fe700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f396c070570 0x7f396c10f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:07.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.512+0000 7f396b7fe700 1 -- 172.21.15.2:0/1063735430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960005040 con 0x7f396c071bc0 2023-12-17T11:55:07.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.513+0000 7f396b7fe700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 0x7f396c10fda0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3960000c00 tx=0x7f3960009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:07.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.513+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396000e040 con 0x7f396c071bc0 2023-12-17T11:55:07.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.513+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c110ec0 con 0x7f396c071bc0 2023-12-17T11:55:07.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.513+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3960004290 con 0x7f396c071bc0 2023-12-17T11:55:07.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.513+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396001c3f0 con 0x7f396c071bc0 2023-12-17T11:55:07.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.513+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c111400 con 0x7f396c071bc0 2023-12-17T11:55:07.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.515+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c1096f0 con 0x7f396c071bc0 2023-12-17T11:55:07.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.515+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f396000bbf0 con 0x7f396c071bc0 2023-12-17T11:55:07.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.517+0000 7f3968ff9700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3954068f60 0x7f395406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:07.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.517+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f39600880f0 con 0x7f396c071bc0 2023-12-17T11:55:07.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.517+0000 7f396bfff700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3954068f60 0x7f395406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:07.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.517+0000 7f396bfff700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3954068f60 0x7f395406b410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f395c007fd0 tx=0x7f395c009040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:07.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.521+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3960058100 con 0x7f396c071bc0 2023-12-17T11:55:07.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:07 smithi119 ceph-mon[117414]: pgmap v157: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s wr, 7 op/s 2023-12-17T11:55:07.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:07 smithi002 ceph-mon[107131]: pgmap v157: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s wr, 7 op/s 2023-12-17T11:55:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:07.780+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f396c1078c0 con 0x7f396c071bc0 2023-12-17T11:55:08.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.318+0000 7f3968ff9700 1 -- 172.21.15.2:0/1063735430 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) v1 ==== 168+0+0 (secure 0 0 0) 0x7f3960057c90 con 0x7f396c071bc0 2023-12-17T11:55:08.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3954068f60 msgr2=0x7f395406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:08.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3954068f60 0x7f395406b410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f395c007fd0 tx=0x7f395c009040 comp rx=0 tx=0).stop 2023-12-17T11:55:08.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 msgr2=0x7f396c10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:08.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 0x7f396c10fda0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3960000c00 tx=0x7f3960009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:08.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 shutdown_connections 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3954068f60 0x7f395406b410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f396c070570 0x7f396c10f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 --2- 172.21.15.2:0/1063735430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f396c071bc0 0x7f396c10fda0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 >> 172.21.15.2:0/1063735430 conn(0x7f396c0f82d0 msgr2=0x7f396c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 shutdown_connections 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:08.321+0000 7f3972500700 1 -- 172.21.15.2:0/1063735430 wait complete. 2023-12-17T11:55:08.324 INFO:teuthology.orchestra.run.smithi002.stderr:inline data enabled 2023-12-17T11:55:08.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1063735430' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] up:boot 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1063735430' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:08.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:08 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T11:55:08.772 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T11:55:08.786 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:55:08.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1063735430' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2023-12-17T11:55:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] up:boot 2023-12-17T11:55:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1063735430' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2023-12-17T11:55:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:08 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T11:55:09.389 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:09.633 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:09 smithi002 ceph-mon[107131]: pgmap v158: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-17T11:55:09.633 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:09 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:09.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:09 smithi119 ceph-mon[117414]: pgmap v158: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-17T11:55:09.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:09 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:10.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:standby 2023-12-17T11:55:10.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: Dropping low affinity active daemon mds.cephfs.smithi002.ercyvj in favor of higher affinity standby. 2023-12-17T11:55:10.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: Replacing daemon mds.cephfs.smithi002.ercyvj as rank 0 with standby daemon mds.cephfs.smithi002.atwfoy 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: osdmap e47: 6 total, 6 up, 6 in 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:replay,1=cephfs.smithi119.mzkvrk=up:active} 1 up:standby 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:10.723 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:10 smithi002 ceph-mon[107131]: pgmap v160: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-17T11:55:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:standby 2023-12-17T11:55:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: Dropping low affinity active daemon mds.cephfs.smithi002.ercyvj in favor of higher affinity standby. 2023-12-17T11:55:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: Replacing daemon mds.cephfs.smithi002.ercyvj as rank 0 with standby daemon mds.cephfs.smithi002.atwfoy 2023-12-17T11:55:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-17T11:55:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.ercyvj=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:10.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: osdmap e47: 6 total, 6 up, 6 in 2023-12-17T11:55:10.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:replay,1=cephfs.smithi119.mzkvrk=up:active} 1 up:standby 2023-12-17T11:55:10.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:10.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:10.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:10 smithi119 ceph-mon[117414]: pgmap v160: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-17T11:55:10.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 -- 172.21.15.2:0/412711042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 msgr2=0x7f85f4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 --2- 172.21.15.2:0/412711042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f4070030 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f85f0004940 tx=0x7f85f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 -- 172.21.15.2:0/412711042 shutdown_connections 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 --2- 172.21.15.2:0/412711042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85f4070570 0x7f85f40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 --2- 172.21.15.2:0/412711042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f4070030 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 -- 172.21.15.2:0/412711042 >> 172.21.15.2:0/412711042 conn(0x7f85f40f82d0 msgr2=0x7f85f40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 -- 172.21.15.2:0/412711042 shutdown_connections 2023-12-17T11:55:10.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.972+0000 7f85fc393700 1 -- 172.21.15.2:0/412711042 wait complete. 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.973+0000 7f85fc393700 1 Processor -- start 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.973+0000 7f85fc393700 1 -- start start 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.973+0000 7f85fc393700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85f4070570 0x7f85f410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85fc393700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85fc393700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f4110420 con 0x7f85f4071bc0 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85fc393700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f4110cc0 con 0x7f85f4070570 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85f992e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85f992e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44598/0 (socket says 172.21.15.2:44598) 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85f992e700 1 -- 172.21.15.2:0/2656644335 learned_addr learned my addr 172.21.15.2:0/2656644335 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:10.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85fa12f700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85f4070570 0x7f85f410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:10.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85f992e700 1 -- 172.21.15.2:0/2656644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85f4070570 msgr2=0x7f85f410f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:10.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85f992e700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85f4070570 0x7f85f410f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:10.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.974+0000 7f85f992e700 1 -- 172.21.15.2:0/2656644335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0005040 con 0x7f85f4071bc0 2023-12-17T11:55:10.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.975+0000 7f85f992e700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f410fe20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85e4002a50 tx=0x7f85e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:10.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.975+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85e4007cc0 con 0x7f85f4071bc0 2023-12-17T11:55:10.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.975+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85e400f040 con 0x7f85f4071bc0 2023-12-17T11:55:10.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.975+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f4110fa0 con 0x7f85f4071bc0 2023-12-17T11:55:10.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.975+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85e400d9c0 con 0x7f85f4071bc0 2023-12-17T11:55:10.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.975+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f41114e0 con 0x7f85f4071bc0 2023-12-17T11:55:10.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.976+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f41096f0 con 0x7f85f4071bc0 2023-12-17T11:55:10.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.977+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f85e400db20 con 0x7f85f4071bc0 2023-12-17T11:55:10.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.978+0000 7f85eaffd700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f85e0068f60 0x7f85e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:10.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.978+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f85e4086bc0 con 0x7f85f4071bc0 2023-12-17T11:55:10.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.978+0000 7f85fa12f700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f85e0068f60 0x7f85e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:10.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.979+0000 7f85fa12f700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f85e0068f60 0x7f85e006b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85f0004560 tx=0x7f85f0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:10.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:10.983+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f85e40569b0 con 0x7f85f4071bc0 2023-12-17T11:55:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.246+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85f4107900 con 0x7f85f4071bc0 2023-12-17T11:55:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.246+0000 7f85eaffd700 1 -- 172.21.15.2:0/2656644335 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1799 (secure 0 0 0) 0x7f85e4056540 con 0x7f85f4071bc0 2023-12-17T11:55:11.249 INFO:teuthology.orchestra.run.smithi002.stdout:e12 2023-12-17T11:55:11.249 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T11:55:11.249 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T11:55:11.249 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 12 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T11:55:10.507989+0000 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T11:55:11.250 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T11:55:11.251 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:resolve seq 3 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T11:55:11.252 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T11:55:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.249+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f85e0068f60 msgr2=0x7f85e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.249+0000 7f85fc393700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f85e0068f60 0x7f85e006b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f85f0004560 tx=0x7f85f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 msgr2=0x7f85f410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f410fe20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f85e4002a50 tx=0x7f85e40046b0 comp rx=0 tx=0).stop 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 shutdown_connections 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f85e0068f60 0x7f85e006b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85f4070570 0x7f85f410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 --2- 172.21.15.2:0/2656644335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85f4071bc0 0x7f85f410fe20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 >> 172.21.15.2:0/2656644335 conn(0x7f85f40f82d0 msgr2=0x7f85f4103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 shutdown_connections 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:11.250+0000 7f85fc393700 1 -- 172.21.15.2:0/2656644335 wait complete. 2023-12-17T11:55:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2023-12-17T11:55:11.534 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:11 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:resolve 2023-12-17T11:55:11.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:11 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] up:boot 2023-12-17T11:55:11.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:11 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] up:active 2023-12-17T11:55:11.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:11 smithi002 ceph-mon[107131]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:resolve,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:11.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:11 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:55:11.535 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:11 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2656644335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T11:55:11.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-17T11:55:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:11 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:resolve 2023-12-17T11:55:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:11 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] up:boot 2023-12-17T11:55:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:11 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] up:active 2023-12-17T11:55:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:11 smithi119 ceph-mon[117414]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:resolve,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:11 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:55:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:11 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2656644335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T11:55:12.225 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:12.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:reconnect 2023-12-17T11:55:12.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] up:standby 2023-12-17T11:55:12.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:reconnect,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:12.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: pgmap v161: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 2.0 KiB/s wr, 5 op/s 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:rejoin 2023-12-17T11:55:12.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:12 smithi002 ceph-mon[107131]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:rejoin,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:reconnect 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] up:standby 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:reconnect,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: pgmap v161: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 2.0 KiB/s wr, 5 op/s 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:55:12.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:12.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:55:12.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:rejoin 2023-12-17T11:55:12.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:12 smithi119 ceph-mon[117414]: fsmap cephfs:2/2 {0=cephfs.smithi002.atwfoy=up:rejoin,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.383+0000 7f7c1012d700 1 -- 172.21.15.2:0/3069028036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c08100050 msgr2=0x7f7c08102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.383+0000 7f7c1012d700 1 --2- 172.21.15.2:0/3069028036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c08100050 0x7f7c08102430 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8004940 tx=0x7f7bf8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.384+0000 7f7c1012d700 1 -- 172.21.15.2:0/3069028036 shutdown_connections 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.384+0000 7f7c1012d700 1 --2- 172.21.15.2:0/3069028036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c08100050 0x7f7c08102430 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.384+0000 7f7c1012d700 1 --2- 172.21.15.2:0/3069028036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c080fd730 0x7f7c080ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.384+0000 7f7c1012d700 1 -- 172.21.15.2:0/3069028036 >> 172.21.15.2:0/3069028036 conn(0x7f7c080f7190 msgr2=0x7f7c080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.384+0000 7f7c1012d700 1 -- 172.21.15.2:0/3069028036 shutdown_connections 2023-12-17T11:55:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.384+0000 7f7c1012d700 1 -- 172.21.15.2:0/3069028036 wait complete. 2023-12-17T11:55:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c1012d700 1 Processor -- start 2023-12-17T11:55:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c1012d700 1 -- start start 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c1012d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c080fd730 0x7f7c0810d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c1012d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 0x7f7c0810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c1012d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0810dfe0 con 0x7f7c080fd730 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c1012d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0810e880 con 0x7f7c08100050 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.385+0000 7f7c0d6c8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 0x7f7c0810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0d6c8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 0x7f7c0810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:60594/0 (socket says 172.21.15.2:60594) 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0d6c8700 1 -- 172.21.15.2:0/1408129716 learned_addr learned my addr 172.21.15.2:0/1408129716 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0dec9700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c080fd730 0x7f7c0810d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0d6c8700 1 -- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c080fd730 msgr2=0x7f7c0810d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0d6c8700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c080fd730 0x7f7c0810d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0d6c8700 1 -- 172.21.15.2:0/1408129716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8005040 con 0x7f7c08100050 2023-12-17T11:55:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0dec9700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c080fd730 0x7f7c0810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:55:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.386+0000 7f7c0d6c8700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 0x7f7c0810d9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80093b0 tx=0x7f7bf8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.387+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf800e070 con 0x7f7c08100050 2023-12-17T11:55:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.387+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0810eb00 con 0x7f7c08100050 2023-12-17T11:55:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.387+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bf801ed60 con 0x7f7c08100050 2023-12-17T11:55:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.387+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf8023070 con 0x7f7c08100050 2023-12-17T11:55:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.387+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0810f040 con 0x7f7c08100050 2023-12-17T11:55:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.388+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0804bb80 con 0x7f7c08100050 2023-12-17T11:55:13.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.390+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f7bf8013850 con 0x7f7c08100050 2023-12-17T11:55:13.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.391+0000 7f7bfe7fc700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7bf4068f70 0x7f7bf406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:13.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.391+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7bf80909f0 con 0x7f7c08100050 2023-12-17T11:55:13.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.391+0000 7f7c0dec9700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7bf4068f70 0x7f7bf406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:13.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.392+0000 7f7c0dec9700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7bf4068f70 0x7f7bf406b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7c04004600 tx=0x7f7c0400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:13.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.396+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7bf80607e0 con 0x7f7c08100050 2023-12-17T11:55:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:13 smithi119 ceph-mon[117414]: daemon mds.cephfs.smithi002.atwfoy is now active in filesystem cephfs as rank 0 2023-12-17T11:55:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:13 smithi119 ceph-mon[117414]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-17T11:55:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:13 smithi119 ceph-mon[117414]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:active 2023-12-17T11:55:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:13 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.656+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c0810f4a0 con 0x7f7c08100050 2023-12-17T11:55:13.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.657+0000 7f7bfe7fc700 1 -- 172.21.15.2:0/1408129716 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f7bf8060370 con 0x7f7c08100050 2023-12-17T11:55:13.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.659+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7bf4068f70 msgr2=0x7f7bf406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.659+0000 7f7c1012d700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7bf4068f70 0x7f7bf406b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7c04004600 tx=0x7f7c0400b040 comp rx=0 tx=0).stop 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.659+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 msgr2=0x7f7c0810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.659+0000 7f7c1012d700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 0x7f7c0810d9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80093b0 tx=0x7f7bf8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 shutdown_connections 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7bf4068f70 0x7f7bf406b420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c080fd730 0x7f7c0810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 --2- 172.21.15.2:0/1408129716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c08100050 0x7f7c0810d9e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 >> 172.21.15.2:0/1408129716 conn(0x7f7c080f7190 msgr2=0x7f7c080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 shutdown_connections 2023-12-17T11:55:13.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:13.660+0000 7f7c1012d700 1 -- 172.21.15.2:0/1408129716 wait complete. 2023-12-17T11:55:13.663 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 15 2023-12-17T11:55:13.676 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:55:13.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:13 smithi002 ceph-mon[107131]: daemon mds.cephfs.smithi002.atwfoy is now active in filesystem cephfs as rank 0 2023-12-17T11:55:13.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:13 smithi002 ceph-mon[107131]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-17T11:55:13.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:13 smithi002 ceph-mon[107131]: mds.? [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] up:active 2023-12-17T11:55:13.896 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:13 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:55:14.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-17T11:55:14.723 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:14.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:14 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1408129716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T11:55:14.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:14 smithi002 ceph-mon[107131]: pgmap v162: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 102 B/s wr, 3 op/s 2023-12-17T11:55:14.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:14 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1408129716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T11:55:14.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:14 smithi119 ceph-mon[117414]: pgmap v162: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 102 B/s wr, 3 op/s 2023-12-17T11:55:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:15.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:15.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:15.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:15.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:15.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 -- 172.21.15.2:0/847806263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec100050 msgr2=0x7f6fec102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 --2- 172.21.15.2:0/847806263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec100050 0x7f6fec102430 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0004940 tx=0x7f6fe0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 -- 172.21.15.2:0/847806263 shutdown_connections 2023-12-17T11:55:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 --2- 172.21.15.2:0/847806263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec100050 0x7f6fec102430 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 --2- 172.21.15.2:0/847806263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fec0fd730 0x7f6fec0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 -- 172.21.15.2:0/847806263 >> 172.21.15.2:0/847806263 conn(0x7f6fec0f7190 msgr2=0x7f6fec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 -- 172.21.15.2:0/847806263 shutdown_connections 2023-12-17T11:55:16.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.205+0000 7f6ff1956700 1 -- 172.21.15.2:0/847806263 wait complete. 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6ff1956700 1 Processor -- start 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6ff1956700 1 -- start start 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6ff1956700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 0x7f6fec0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6ff1956700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fec100050 0x7f6fec0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6ff1956700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0fbcd0 con 0x7f6fec0fd730 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6ff1956700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0fbe40 con 0x7f6fec100050 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.206+0000 7f6feaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 0x7f6fec0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6feaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 0x7f6fec0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44630/0 (socket says 172.21.15.2:44630) 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6feaffd700 1 -- 172.21.15.2:0/2676336101 learned_addr learned my addr 172.21.15.2:0/2676336101 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6fea7fc700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fec100050 0x7f6fec0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6feaffd700 1 -- 172.21.15.2:0/2676336101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fec100050 msgr2=0x7f6fec0fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6feaffd700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fec100050 0x7f6fec0fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6feaffd700 1 -- 172.21.15.2:0/2676336101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0005040 con 0x7f6fec0fd730 2023-12-17T11:55:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6feaffd700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 0x7f6fec0fd1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00b790 tx=0x7f6fdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fdc00f6f0 con 0x7f6fec0fd730 2023-12-17T11:55:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec0fc120 con 0x7f6fec0fd730 2023-12-17T11:55:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6fdc00fd00 con 0x7f6fec0fd730 2023-12-17T11:55:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.207+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fdc0103a0 con 0x7f6fec0fd730 2023-12-17T11:55:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.208+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec0fc4a0 con 0x7f6fec0fd730 2023-12-17T11:55:16.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.209+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec04bb80 con 0x7f6fec0fd730 2023-12-17T11:55:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.210+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f6fdc00f850 con 0x7f6fec0fd730 2023-12-17T11:55:16.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.210+0000 7f6fd37fe700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6fd4068f70 0x7f6fd406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.211+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6fdc086ca0 con 0x7f6fec0fd730 2023-12-17T11:55:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.211+0000 7f6fea7fc700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6fd4068f70 0x7f6fd406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:16.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.211+0000 7f6fea7fc700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6fd4068f70 0x7f6fd406b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00043d0 tx=0x7f6fe0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:16.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.215+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6fdc056b10 con 0x7f6fec0fd730 2023-12-17T11:55:16.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.529+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f6fec115980 con 0x7f6fec0fd730 2023-12-17T11:55:16.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.530+0000 7f6fd37fe700 1 -- 172.21.15.2:0/2676336101 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+99 (secure 0 0 0) 0x7f6fdc0566a0 con 0x7f6fec0fd730 2023-12-17T11:55:16.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6fd4068f70 msgr2=0x7f6fd406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:16.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6fd4068f70 0x7f6fd406b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6fe00043d0 tx=0x7f6fe0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:16.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 msgr2=0x7f6fec0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:16.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 0x7f6fec0fd1c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00b790 tx=0x7f6fdc009250 comp rx=0 tx=0).stop 2023-12-17T11:55:16.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 shutdown_connections 2023-12-17T11:55:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6fd4068f70 0x7f6fd406b420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6fec0fd730 0x7f6fec0fd1c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 --2- 172.21.15.2:0/2676336101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fec100050 0x7f6fec0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 >> 172.21.15.2:0/2676336101 conn(0x7f6fec0f7190 msgr2=0x7f6fec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 shutdown_connections 2023-12-17T11:55:16.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:16.532+0000 7f6ff1956700 1 -- 172.21.15.2:0/2676336101 wait complete. 2023-12-17T11:55:16.554 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:55:16.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:16 smithi119 ceph-mon[117414]: pgmap v163: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 102 B/s wr, 4 op/s 2023-12-17T11:55:16.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:16 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2676336101' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-17T11:55:16.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:16 smithi002 ceph-mon[107131]: pgmap v163: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 102 B/s wr, 4 op/s 2023-12-17T11:55:16.912 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:16 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2676336101' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-17T11:55:17.130 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-17T11:55:17.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:55:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 -- 172.21.15.2:0/21581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 msgr2=0x7f3ae4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 --2- 172.21.15.2:0/21581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4070030 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0004940 tx=0x7f3ae0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 -- 172.21.15.2:0/21581082 shutdown_connections 2023-12-17T11:55:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 --2- 172.21.15.2:0/21581082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 0x7f3ae40709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 --2- 172.21.15.2:0/21581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4070030 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 -- 172.21.15.2:0/21581082 >> 172.21.15.2:0/21581082 conn(0x7f3ae40f8200 msgr2=0x7f3ae40fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 -- 172.21.15.2:0/21581082 shutdown_connections 2023-12-17T11:55:17.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.378+0000 7f3aeadff700 1 -- 172.21.15.2:0/21581082 wait complete. 2023-12-17T11:55:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.379+0000 7f3aeadff700 1 Processor -- start 2023-12-17T11:55:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.379+0000 7f3aeadff700 1 -- start start 2023-12-17T11:55:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.379+0000 7f3aeadff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 0x7f3ae4113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.379+0000 7f3aeadff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4113da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.379+0000 7f3aeadff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41143a0 con 0x7f3ae4071b20 2023-12-17T11:55:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.379+0000 7f3aeadff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae4114510 con 0x7f3ae4070570 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44650/0 (socket says 172.21.15.2:44650) 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 -- 172.21.15.2:0/4094643137 learned_addr learned my addr 172.21.15.2:0/4094643137 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3ae8b9b700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 0x7f3ae4113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 -- 172.21.15.2:0/4094643137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 msgr2=0x7f3ae4113860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 0x7f3ae4113860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 -- 172.21.15.2:0/4094643137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0005040 con 0x7f3ae4071b20 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3ae8b9b700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 0x7f3ae4113860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:55:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.380+0000 7f3adbfff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4113da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400eb70 tx=0x7f3ad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:17.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.381+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4007cc0 con 0x7f3ae4071b20 2023-12-17T11:55:17.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.381+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ad400f040 con 0x7f3ae4071b20 2023-12-17T11:55:17.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.381+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae4118f60 con 0x7f3ae4071b20 2023-12-17T11:55:17.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.381+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad400c9f0 con 0x7f3ae4071b20 2023-12-17T11:55:17.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.381+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae41194f0 con 0x7f3ae4071b20 2023-12-17T11:55:17.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.382+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae410ba80 con 0x7f3ae4071b20 2023-12-17T11:55:17.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.383+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f3ad400cb50 con 0x7f3ae4071b20 2023-12-17T11:55:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.385+0000 7f3ad97fa700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3acc068f70 0x7f3acc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.385+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3ad4086930 con 0x7f3ae4071b20 2023-12-17T11:55:17.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.385+0000 7f3ae8b9b700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3acc068f70 0x7f3acc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:17.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.386+0000 7f3ae8b9b700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3acc068f70 0x7f3acc06b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0013680 tx=0x7f3ae0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:17.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.389+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3ad40567a0 con 0x7f3ae4071b20 2023-12-17T11:55:17.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.610+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ae4119c90 con 0x7f3ae4071b20 2023-12-17T11:55:17.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.611+0000 7f3ad97fa700 1 -- 172.21.15.2:0/4094643137 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14327 (secure 0 0 0) 0x7f3ad4056330 con 0x7f3ae4071b20 2023-12-17T11:55:17.613 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:55:17.613 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":47,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:48:50.417719+0000","modified":"2023-12-17T11:55:09.500863+0000","last_up_change":"2023-12-17T11:54:02.501200+0000","last_in_change":"2023-12-17T11:53:43.616013+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:52:56.580032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-17T11:54:55.230450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-17T11:54:56.027076+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2114bd7b-19fb-4504-8164-694ca3b767d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6803","nonce":705553234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6805","nonce":705553234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6809","nonce":705553234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":705553234},{"type":"v1","addr":"172.21.15.2:6807","nonce":705553234}]},"public_addr":"172.21.15.2:6803/705553234","cluster_addr":"172.21.15.2:6805/705553234","heartbeat_back_addr":"172.21.15.2:6809/705553234","heartbeat_front_addr":"172.21.15.2:6807/705553234","state":["exists","up"]},{"osd":1,"uuid":"4b728955-c4f6-4426-ae59-4614cbfea807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6811","nonce":3692503315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6813","nonce":3692503315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6817","nonce":3692503315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3692503315},{"type":"v1","addr":"172.21.15.2:6815","nonce":3692503315}]},"public_addr":"172.21.15.2:6811/3692503315","cluster_addr":"172.21.15.2:6813/3692503315","heartbeat_back_addr":"172.21.15.2:6817/3692503315","heartbeat_front_addr":"172.21.15.2:6815/3692503315","state":["exists","up"]},{"osd":2,"uuid":"a4f28cc1-78bc-4434-a7a0-ca4a373fc384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6819","nonce":3160012484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6821","nonce":3160012484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6825","nonce":3160012484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3160012484},{"type":"v1","addr":"172.21.15.2:6823","nonce":3160012484}]},"public_addr":"172.21.15.2:6819/3160012484","cluster_addr":"172.21.15.2:6821/3160012484","heartbeat_back_addr":"172.21.15.2:6825/3160012484","heartbeat_front_addr":"172.21.15.2:6823/3160012484","state":["exists","up"]},{"osd":3,"uuid":"b8f7021b-7c22-415a-9635-af30e6e6fc13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6801","nonce":1489766066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6803","nonce":1489766066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6807","nonce":1489766066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1489766066},{"type":"v1","addr":"172.21.15.119:6805","nonce":1489766066}]},"public_addr":"172.21.15.119:6801/1489766066","cluster_addr":"172.21.15.119:6803/1489766066","heartbeat_back_addr":"172.21.15.119:6807/1489766066","heartbeat_front_addr":"172.21.15.119:6805/1489766066","state":["exists","up"]},{"osd":4,"uuid":"d5ebbeab-3ba4-4e81-b453-d775808ac559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6809","nonce":487685407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6811","nonce":487685407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6815","nonce":487685407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":487685407},{"type":"v1","addr":"172.21.15.119:6813","nonce":487685407}]},"public_addr":"172.21.15.119:6809/487685407","cluster_addr":"172.21.15.119:6811/487685407","heartbeat_back_addr":"172.21.15.119:6815/487685407","heartbeat_front_addr":"172.21.15.119:6813/487685407","state":["exists","up"]},{"osd":5,"uuid":"dc8023ee-4370-4354-921e-5f7d71df5bc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6817","nonce":3782361466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6819","nonce":3782361466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6823","nonce":3782361466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":3782361466},{"type":"v1","addr":"172.21.15.119:6821","nonce":3782361466}]},"public_addr":"172.21.15.119:6817/3782361466","cluster_addr":"172.21.15.119:6819/3782361466","heartbeat_back_addr":"172.21.15.119:6823/3782361466","heartbeat_front_addr":"172.21.15.119:6821/3782361466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:06.272236+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:30.215924+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:52.820296+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:14.743572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:37.197272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:54:00.536614+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/582228833":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/1642465919":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/599472466":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/2886179339":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/3688904349":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6827/696982378":"2023-12-18T11:55:09.500838+0000","172.21.15.2:0/3091655634":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/3009915854":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/3796631798":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6826/696982378":"2023-12-18T11:55:09.500838+0000","172.21.15.2:6801/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/1129063553":"2023-12-18T11:50:59.977791+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.613+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3acc068f70 msgr2=0x7f3acc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.613+0000 7f3aeadff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3acc068f70 0x7f3acc06b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0013680 tx=0x7f3ae0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.613+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 msgr2=0x7f3ae4113da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.613+0000 7f3aeadff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4113da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400eb70 tx=0x7f3ad400b040 comp rx=0 tx=0).stop 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 shutdown_connections 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3acc068f70 0x7f3acc06b420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ae4070570 0x7f3ae4113860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 --2- 172.21.15.2:0/4094643137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4071b20 0x7f3ae4113da0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 >> 172.21.15.2:0/4094643137 conn(0x7f3ae40f8200 msgr2=0x7f3ae40fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 shutdown_connections 2023-12-17T11:55:17.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.614+0000 7f3aeadff700 1 -- 172.21.15.2:0/4094643137 wait complete. 2023-12-17T11:55:17.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:52:56.580032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-17T11:54:55.230450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-17T11:54:56.027076+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:55:17.636 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:55:17.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1953362116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fca40 msgr2=0x7ff5f80fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:17.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1953362116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fca40 0x7ff5f80fce50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8004940 tx=0x7ff5e8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1953362116 shutdown_connections 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1953362116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f80fd390 0x7ff5f80fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1953362116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fca40 0x7ff5f80fce50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1953362116 >> 172.21.15.2:0/1953362116 conn(0x7ff5f80f81c0 msgr2=0x7ff5f80fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1953362116 shutdown_connections 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.834+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1953362116 wait complete. 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.835+0000 7ff5fd1ff700 1 Processor -- start 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.835+0000 7ff5fd1ff700 1 -- start start 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5fd1ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f80fca40 0x7ff5f810d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5fd1ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 0x7ff5f810d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5fd1ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f810de00 con 0x7ff5f80fd390 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5fd1ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f810df70 con 0x7ff5f80fca40 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 0x7ff5f810d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:17.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 0x7ff5f810d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44666/0 (socket says 172.21.15.2:44666) 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f6d9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f80fca40 0x7ff5f810d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f659c700 1 -- 172.21.15.2:0/1888146779 learned_addr learned my addr 172.21.15.2:0/1888146779 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f659c700 1 -- 172.21.15.2:0/1888146779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f80fca40 msgr2=0x7ff5f810d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f659c700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f80fca40 0x7ff5f810d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.836+0000 7ff5f659c700 1 -- 172.21.15.2:0/1888146779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8005040 con 0x7ff5f80fd390 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.837+0000 7ff5f659c700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 0x7ff5f810d800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec002a50 tx=0x7ff5ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.837+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5ec007cc0 con 0x7ff5f80fd390 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.837+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5ec00f040 con 0x7ff5f80fd390 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.837+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f8112a20 con 0x7ff5f80fd390 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.837+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5ec00d9c0 con 0x7ff5f80fd390 2023-12-17T11:55:17.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.837+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f8112fe0 con 0x7ff5f80fd390 2023-12-17T11:55:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.838+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f8105440 con 0x7ff5f80fd390 2023-12-17T11:55:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.839+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7ff5ec00db60 con 0x7ff5f80fd390 2023-12-17T11:55:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.840+0000 7ff5df7fe700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff5e0068f70 0x7ff5e006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:17.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.840+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff5ec086470 con 0x7ff5f80fd390 2023-12-17T11:55:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.840+0000 7ff5f6d9d700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff5e0068f70 0x7ff5e006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:17.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.841+0000 7ff5f6d9d700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff5e0068f70 0x7ff5e006b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800b3b0 tx=0x7ff5e8009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:17.844+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff5ec04ca00 con 0x7ff5f80fd390 2023-12-17T11:55:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.049+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5f8113230 con 0x7ff5f80fd390 2023-12-17T11:55:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.050+0000 7ff5df7fe700 1 -- 172.21.15.2:0/1888146779 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5ec056300 con 0x7ff5f80fd390 2023-12-17T11:55:18.052 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-12-17T11:55:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff5e0068f70 msgr2=0x7ff5e006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff5e0068f70 0x7ff5e006b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800b3b0 tx=0x7ff5e8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 msgr2=0x7ff5f810d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 0x7ff5f810d800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec002a50 tx=0x7ff5ec0046b0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 shutdown_connections 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff5e0068f70 0x7ff5e006b420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f80fca40 0x7ff5f810d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 --2- 172.21.15.2:0/1888146779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5f80fd390 0x7ff5f810d800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 >> 172.21.15.2:0/1888146779 conn(0x7ff5f80f81c0 msgr2=0x7ff5f8100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 shutdown_connections 2023-12-17T11:55:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.052+0000 7ff5fd1ff700 1 -- 172.21.15.2:0/1888146779 wait complete. 2023-12-17T11:55:18.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.271+0000 7ff9483ff700 1 -- 172.21.15.2:0/1471793908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fd390 msgr2=0x7ff9400fdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.271+0000 7ff9483ff700 1 --2- 172.21.15.2:0/1471793908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fd390 0x7ff9400fdd90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff930004940 tx=0x7ff930009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 -- 172.21.15.2:0/1471793908 shutdown_connections 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 --2- 172.21.15.2:0/1471793908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fd390 0x7ff9400fdd90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 --2- 172.21.15.2:0/1471793908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9400fca40 0x7ff9400fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 -- 172.21.15.2:0/1471793908 >> 172.21.15.2:0/1471793908 conn(0x7ff9400f81c0 msgr2=0x7ff9400fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 -- 172.21.15.2:0/1471793908 shutdown_connections 2023-12-17T11:55:18.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 -- 172.21.15.2:0/1471793908 wait complete. 2023-12-17T11:55:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.272+0000 7ff9483ff700 1 Processor -- start 2023-12-17T11:55:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff9483ff700 1 -- start start 2023-12-17T11:55:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff9483ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 0x7ff94010f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff9483ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9400fd390 0x7ff94010fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:18.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff9483ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940110000 con 0x7ff9400fca40 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff9483ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940110170 con 0x7ff9400fd390 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff94619b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 0x7ff94010f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff94619b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 0x7ff94010f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44690/0 (socket says 172.21.15.2:44690) 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.273+0000 7ff94619b700 1 -- 172.21.15.2:0/2702778240 learned_addr learned my addr 172.21.15.2:0/2702778240 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff94619b700 1 -- 172.21.15.2:0/2702778240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9400fd390 msgr2=0x7ff94010fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff94619b700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9400fd390 0x7ff94010fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff94619b700 1 -- 172.21.15.2:0/2702778240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930005040 con 0x7ff9400fca40 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff94619b700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 0x7ff94010f4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff93c002a50 tx=0x7ff93c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c007cc0 con 0x7ff9400fca40 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff940114c20 con 0x7ff9400fca40 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff93c00f040 con 0x7ff9400fca40 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93c00d990 con 0x7ff9400fca40 2023-12-17T11:55:18.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.274+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9401151e0 con 0x7ff9400fca40 2023-12-17T11:55:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.275+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff940101dd0 con 0x7ff9400fca40 2023-12-17T11:55:18.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.276+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7ff93c009710 con 0x7ff9400fca40 2023-12-17T11:55:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.277+0000 7ff936ffd700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff92c068f70 0x7ff92c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.277+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff93c086bf0 con 0x7ff9400fca40 2023-12-17T11:55:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.277+0000 7ff94599a700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff92c068f70 0x7ff92c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:18.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.278+0000 7ff94599a700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff92c068f70 0x7ff92c06b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff930000c00 tx=0x7ff930009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.281+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff93c056750 con 0x7ff9400fca40 2023-12-17T11:55:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.488+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff94002b2a0 con 0x7ff9400fca40 2023-12-17T11:55:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.489+0000 7ff936ffd700 1 -- 172.21.15.2:0/2702778240 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff93c056570 con 0x7ff9400fca40 2023-12-17T11:55:18.491 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-12-17T11:55:18.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff92c068f70 msgr2=0x7ff92c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff92c068f70 0x7ff92c06b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff930000c00 tx=0x7ff930009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 msgr2=0x7ff94010f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 0x7ff94010f4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff93c002a50 tx=0x7ff93c004600 comp rx=0 tx=0).stop 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 shutdown_connections 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7ff92c068f70 0x7ff92c06b420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9400fca40 0x7ff94010f4c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 --2- 172.21.15.2:0/2702778240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9400fd390 0x7ff94010fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.491+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 >> 172.21.15.2:0/2702778240 conn(0x7ff9400f81c0 msgr2=0x7ff9400fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.492+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 shutdown_connections 2023-12-17T11:55:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.492+0000 7ff9483ff700 1 -- 172.21.15.2:0/2702778240 wait complete. 2023-12-17T11:55:18.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-17T11:55:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.710+0000 7fc3f3bff700 1 -- 172.21.15.2:0/814072566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec070570 msgr2=0x7fc3ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.710+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/814072566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec070570 0x7fc3ec0709e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004940 tx=0x7fc3dc009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 -- 172.21.15.2:0/814072566 shutdown_connections 2023-12-17T11:55:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/814072566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec070570 0x7fc3ec0709e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/814072566 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec071b30 0x7fc3ec070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 -- 172.21.15.2:0/814072566 >> 172.21.15.2:0/814072566 conn(0x7fc3ec0f81c0 msgr2=0x7fc3ec0fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:18.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 -- 172.21.15.2:0/814072566 shutdown_connections 2023-12-17T11:55:18.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 -- 172.21.15.2:0/814072566 wait complete. 2023-12-17T11:55:18.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.711+0000 7fc3f3bff700 1 Processor -- start 2023-12-17T11:55:18.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f3bff700 1 -- start start 2023-12-17T11:55:18.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f3bff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec070570 0x7fc3ec10f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f3bff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 0x7fc3ec10f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f3bff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec10ff60 con 0x7fc3ec071b30 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f3bff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1100d0 con 0x7fc3ec070570 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f119a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 0x7fc3ec10f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f119a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 0x7fc3ec10f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44712/0 (socket says 172.21.15.2:44712) 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f119a700 1 -- 172.21.15.2:0/2075573509 learned_addr learned my addr 172.21.15.2:0/2075573509 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.712+0000 7fc3f199b700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec070570 0x7fc3ec10f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f119a700 1 -- 172.21.15.2:0/2075573509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec070570 msgr2=0x7fc3ec10f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f119a700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec070570 0x7fc3ec10f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f119a700 1 -- 172.21.15.2:0/2075573509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc005040 con 0x7fc3ec071b30 2023-12-17T11:55:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f199b700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec070570 0x7fc3ec10f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f119a700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 0x7fc3ec10f960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009fd0 tx=0x7fc3dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3dc021070 con 0x7fc3ec071b30 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc3dc01c400 con 0x7fc3ec071b30 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec114b20 con 0x7fc3ec071b30 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3dc00e070 con 0x7fc3ec071b30 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.713+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec115080 con 0x7fc3ec071b30 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.714+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec107640 con 0x7fc3ec071b30 2023-12-17T11:55:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.715+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fc3dc01c570 con 0x7fc3ec071b30 2023-12-17T11:55:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.716+0000 7fc3e27fc700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc3d8068f70 0x7fc3d806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.716+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc3dc087fe0 con 0x7fc3ec071b30 2023-12-17T11:55:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.716+0000 7fc3f199b700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc3d8068f70 0x7fc3d806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:18.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.717+0000 7fc3f199b700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc3d8068f70 0x7fc3d806b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8007fd0 tx=0x7fc3e800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:18.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.720+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc3dc057f30 con 0x7fc3ec071b30 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4094643137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:55:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:18 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1888146779' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T11:55:18.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:18.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:18.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:18.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:55:18.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:55:18.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/4094643137' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T11:55:18.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:18 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1888146779' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T11:55:18.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.923+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc3ec1154d0 con 0x7fc3ec071b30 2023-12-17T11:55:18.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.923+0000 7fc3e27fc700 1 -- 172.21.15.2:0/2075573509 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc3dc057ac0 con 0x7fc3ec071b30 2023-12-17T11:55:18.926 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-12-17T11:55:18.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc3d8068f70 msgr2=0x7fc3d806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc3d8068f70 0x7fc3d806b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8007fd0 tx=0x7fc3e800b040 comp rx=0 tx=0).stop 2023-12-17T11:55:18.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 msgr2=0x7fc3ec10f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:18.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 0x7fc3ec10f960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009fd0 tx=0x7fc3dc009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:18.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 shutdown_connections 2023-12-17T11:55:18.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc3d8068f70 0x7fc3d806b420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ec070570 0x7fc3ec10f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 --2- 172.21.15.2:0/2075573509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3ec071b30 0x7fc3ec10f960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:18.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 >> 172.21.15.2:0/2075573509 conn(0x7fc3ec0f81c0 msgr2=0x7fc3ec1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:18.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.925+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 shutdown_connections 2023-12-17T11:55:18.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:18.926+0000 7fc3f3bff700 1 -- 172.21.15.2:0/2075573509 wait complete. 2023-12-17T11:55:18.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:55:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 -- 172.21.15.2:0/898347743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 msgr2=0x7f45600fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 --2- 172.21.15.2:0/898347743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f45600fe0e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f454c004940 tx=0x7f454c009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 -- 172.21.15.2:0/898347743 shutdown_connections 2023-12-17T11:55:19.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 --2- 172.21.15.2:0/898347743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f45600fe0e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 --2- 172.21.15.2:0/898347743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45600fca80 0x7f45600fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 -- 172.21.15.2:0/898347743 >> 172.21.15.2:0/898347743 conn(0x7f45600f8100 msgr2=0x7f45600fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 -- 172.21.15.2:0/898347743 shutdown_connections 2023-12-17T11:55:19.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.142+0000 7f4566bff700 1 -- 172.21.15.2:0/898347743 wait complete. 2023-12-17T11:55:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.143+0000 7f4566bff700 1 Processor -- start 2023-12-17T11:55:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.143+0000 7f4566bff700 1 -- start start 2023-12-17T11:55:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f4566bff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45600fca80 0x7f456010d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f4566bff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f456010d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f4566bff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456010de70 con 0x7f45600fdc90 2023-12-17T11:55:19.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f4566bff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456010dfe0 con 0x7f45600fca80 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f455ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f456010d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f455ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f456010d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34944/0 (socket says 172.21.15.2:34944) 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f455ffff700 1 -- 172.21.15.2:0/460036944 learned_addr learned my addr 172.21.15.2:0/460036944 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f456499b700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45600fca80 0x7f456010d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f455ffff700 1 -- 172.21.15.2:0/460036944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45600fca80 msgr2=0x7f456010d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f455ffff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45600fca80 0x7f456010d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.144+0000 7f455ffff700 1 -- 172.21.15.2:0/460036944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c005040 con 0x7f45600fdc90 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.145+0000 7f455ffff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f456010d870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f454c00b3b0 tx=0x7f454c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.145+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454c00e040 con 0x7f45600fdc90 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.145+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f454c00bcd0 con 0x7f45600fdc90 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.145+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4560112a30 con 0x7f45600fdc90 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.145+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454c01c630 con 0x7f45600fdc90 2023-12-17T11:55:19.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.145+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4560112ff0 con 0x7f45600fdc90 2023-12-17T11:55:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.146+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4560105440 con 0x7f45600fdc90 2023-12-17T11:55:19.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.147+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f454c013420 con 0x7f45600fdc90 2023-12-17T11:55:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.148+0000 7f455d7fa700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4550068f70 0x7f455006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.148+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f454c088200 con 0x7f45600fdc90 2023-12-17T11:55:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.148+0000 7f456499b700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4550068f70 0x7f455006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:19.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.149+0000 7f456499b700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4550068f70 0x7f455006b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45600fdaf0 tx=0x7f4554009ee0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:19.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.152+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f454c058110 con 0x7f45600fdc90 2023-12-17T11:55:19.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.403+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45601132a0 con 0x7f45600fdc90 2023-12-17T11:55:19.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.403+0000 7f455d7fa700 1 -- 172.21.15.2:0/460036944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f454c057ca0 con 0x7f45600fdc90 2023-12-17T11:55:19.405 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T11:55:19.406 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14518,"name":"cephfs.smithi002.ercyvj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6827/3968194298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3968194298},{"type":"v1","addr":"172.21.15.2:6827","nonce":3968194298}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24323,"name":"cephfs.smithi119.qgnwfs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.119:6827/1797418404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":1797418404},{"type":"v1","addr":"172.21.15.119:6827","nonce":1797418404}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:54:56.518485+0000","modified":"2023-12-17T11:55:13.512476+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":24315,"mds_1":24311},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24311":{"gid":24311,"name":"cephfs.smithi119.mzkvrk","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6825/2104379829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2104379829},{"type":"v1","addr":"172.21.15.119:6825","nonce":2104379829}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24315":{"gid":24315,"name":"cephfs.smithi002.atwfoy","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6829/12221605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":12221605},{"type":"v1","addr":"172.21.15.2:6829","nonce":12221605}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.405+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4550068f70 msgr2=0x7f455006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.405+0000 7f4566bff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4550068f70 0x7f455006b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45600fdaf0 tx=0x7f4554009ee0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.405+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 msgr2=0x7f456010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.405+0000 7f4566bff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f456010d870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f454c00b3b0 tx=0x7f454c009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 shutdown_connections 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4550068f70 0x7f455006b420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45600fca80 0x7f456010d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 --2- 172.21.15.2:0/460036944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45600fdc90 0x7f456010d870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:19.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 >> 172.21.15.2:0/460036944 conn(0x7f45600f8100 msgr2=0x7f4560100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:19.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 shutdown_connections 2023-12-17T11:55:19.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:19.406+0000 7f4566bff700 1 -- 172.21.15.2:0/460036944 wait complete. 2023-12-17T11:55:19.409 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 15 2023-12-17T11:55:19.425 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 18} 2023-12-17T11:55:19.426 INFO:teuthology.run_tasks:Running task kclient... 2023-12-17T11:55:19.453 INFO:tasks.kclient:Mounting kernel clients... 2023-12-17T11:55:19.453 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-17T11:55:19.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:19.453 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-12-17T11:55:19.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:19.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-12-17T11:55:19.577 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2023-12-17T11:55:19.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:55:19.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:19.581 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-17T11:55:19.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:19.635 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-12-17T11:55:19.705 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:19 smithi119 ceph-mon[117414]: pgmap v164: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-17T11:55:19.705 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:19 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2702778240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-17T11:55:19.705 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:19 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2075573509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-17T11:55:19.705 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:19 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/460036944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T11:55:19.716 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2023-12-17T11:55:19.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:55:19.719 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-17T11:55:19.719 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:55:19.720 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:19.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-17T11:55:19.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:19 smithi002 ceph-mon[107131]: pgmap v164: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-17T11:55:19.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:19 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2702778240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-17T11:55:19.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:19 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2075573509' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-17T11:55:19.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:19 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/460036944' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T11:55:20.151 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:20.654 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:20 smithi002 ceph-mon[107131]: pgmap v165: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-17T11:55:20.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:20 smithi119 ceph-mon[117414]: pgmap v165: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 -- 172.21.15.2:0/2937680338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 msgr2=0x7fa07c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 --2- 172.21.15.2:0/2937680338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c0fcc10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa068004940 tx=0x7fa068009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 -- 172.21.15.2:0/2937680338 shutdown_connections 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 --2- 172.21.15.2:0/2937680338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c0fcc10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 --2- 172.21.15.2:0/2937680338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07c102c00 0x7fa07c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 -- 172.21.15.2:0/2937680338 >> 172.21.15.2:0/2937680338 conn(0x7fa07c0f8790 msgr2=0x7fa07c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 -- 172.21.15.2:0/2937680338 shutdown_connections 2023-12-17T11:55:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.309+0000 7fa082fff700 1 -- 172.21.15.2:0/2937680338 wait complete. 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.310+0000 7fa082fff700 1 Processor -- start 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.310+0000 7fa082fff700 1 -- start start 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.310+0000 7fa082fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07c102c00 0x7fa07c1157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.310+0000 7fa082fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa082fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c116350 con 0x7fa07c1035a0 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa082fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c10f680 con 0x7fa07c102c00 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c115d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34956/0 (socket says 172.21.15.2:34956) 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 -- 172.21.15.2:0/2611056469 learned_addr learned my addr 172.21.15.2:0/2611056469 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa080d9b700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07c102c00 0x7fa07c1157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 -- 172.21.15.2:0/2611056469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07c102c00 msgr2=0x7fa07c1157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07c102c00 0x7fa07c1157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 -- 172.21.15.2:0/2611056469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068005040 con 0x7fa07c1035a0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.311+0000 7fa07bfff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c115d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa068008d80 tx=0x7fa068009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.312+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa068021070 con 0x7fa07c1035a0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.312+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c10f900 con 0x7fa07c1035a0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.312+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0680093b0 con 0x7fa07c1035a0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.312+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa06800e070 con 0x7fa07c1035a0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.312+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c10fde0 con 0x7fa07c1035a0 2023-12-17T11:55:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.313+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c0fc390 con 0x7fa07c1035a0 2023-12-17T11:55:21.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.314+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fa06801c5e0 con 0x7fa07c1035a0 2023-12-17T11:55:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.315+0000 7fa0797fa700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa06c068f70 0x7fa06c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.315+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa068087ea0 con 0x7fa07c1035a0 2023-12-17T11:55:21.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.315+0000 7fa080d9b700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa06c068f70 0x7fa06c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:21.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.316+0000 7fa080d9b700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa06c068f70 0x7fa06c06b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa070009b80 tx=0x7fa07000b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:21.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.320+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa068057d90 con 0x7fa07c1035a0 2023-12-17T11:55:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.577+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa07c04bb80 con 0x7fa07c1035a0 2023-12-17T11:55:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.577+0000 7fa0797fa700 1 -- 172.21.15.2:0/2611056469 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fa068057920 con 0x7fa07c1035a0 2023-12-17T11:55:21.579 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.579+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa06c068f70 msgr2=0x7fa06c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.579+0000 7fa082fff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa06c068f70 0x7fa06c06b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa070009b80 tx=0x7fa07000b040 comp rx=0 tx=0).stop 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.579+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 msgr2=0x7fa07c115d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.579+0000 7fa082fff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c115d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa068008d80 tx=0x7fa068009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.579+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 shutdown_connections 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.580+0000 7fa082fff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fa06c068f70 0x7fa06c06b420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.580+0000 7fa082fff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07c102c00 0x7fa07c1157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.580+0000 7fa082fff700 1 --2- 172.21.15.2:0/2611056469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa07c1035a0 0x7fa07c115d00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.580+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 >> 172.21.15.2:0/2611056469 conn(0x7fa07c0f8790 msgr2=0x7fa07c070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.580+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 shutdown_connections 2023-12-17T11:55:21.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:21.580+0000 7fa082fff700 1 -- 172.21.15.2:0/2611056469 wait complete. 2023-12-17T11:55:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:21 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/2611056469' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-17T11:55:21.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:21 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/2611056469' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-17T11:55:22.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:55:22.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:55:22.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:22.010 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:55:22.060 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:55:22.061 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41764sec preferred_lft 41764sec 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:22.062 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-12-17T11:55:22.063 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-17T11:55:22.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-17T11:55:22.063 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-12-17T11:55:22.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:22.495 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:55:22.570 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-12-17T11:55:22.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:22.573 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-12-17T11:55:22.637 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-12-17T11:55:22.638 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:55:22.638 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-17T11:55:22.638 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-17T11:55:22.638 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:55:22.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:22.639 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-12-17T11:55:22.639 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-12-17T11:55:22.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-17T11:55:22.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-17T11:55:22.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-17T11:55:22.639 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-12-17T11:55:22.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:22 smithi002 ceph-mon[107131]: pgmap v166: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-17T11:55:22.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:22 smithi119 ceph-mon[117414]: pgmap v166: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-17T11:55:23.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:23.335 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-12-17T11:55:23.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:23.383 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-12-17T11:55:23.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:23.432 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-12-17T11:55:23.432 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-12-17T11:55:23.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-17T11:55:23.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-17T11:55:23.432 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-12-17T11:55:23.582 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-17T11:55:23.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-17T11:55:23.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-17T11:55:23.584 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-12-17T11:55:23.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:23.862 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-12-17T11:55:23.862 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-12-17T11:55:23.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-12-17T11:55:23.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2023-12-17T11:55:23.862 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-12-17T11:55:24.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:55:24.039 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:24.085 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:55:24.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:55:24.086 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:24.172 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:55:24.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:24.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:55:24.321 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:55:24.321 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:55:24.321 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-12-17T11:55:24.753 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:55:24.753 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:55:24.753 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-12-17T11:55:24.753 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.119:3300" 2023-12-17T11:55:24.753 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:55:24.781 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:55:24.781 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:55:24.782 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2023-12-17T11:55:24.782 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.119:3300" 2023-12-17T11:55:24.782 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:55:24.782 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.119:6789" 2023-12-17T11:55:24.782 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.119:6789:/ 2023-12-17T11:55:24.782 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1a404768-9cd2-11ee-95a5-87774f69a715" will pass to kernel 2023-12-17T11:55:24.786 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:55:24.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:24.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:24.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:24.860 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:55:24.955 INFO:teuthology.orchestra.run.smithi002.stdout:client24361 2023-12-17T11:55:24.956 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:55:24.956 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:55:25.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:25.003 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:55:25.134 INFO:teuthology.orchestra.run.smithi002.stdout:client24361 2023-12-17T11:55:25.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:25.134 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:55:25.223 INFO:teuthology.orchestra.run.smithi002.stdout:client24361 2023-12-17T11:55:25.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:25.224 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/1a404768-9cd2-11ee-95a5-87774f69a715.client24361/status') 2023-12-17T11:55:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.24361 (3)172.21.15.2:0/2793167843 2023-12-17T11:55:25.339 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2023-12-17T11:55:25.339 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2023-12-17T11:55:25.339 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2023-12-17T11:55:25.339 INFO:teuthology.orchestra.run.smithi002.stderr:70 bytes copied, 5.7377e-05 s, 1.2 MB/s 2023-12-17T11:55:25.340 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:25 smithi002 ceph-mon[107131]: pgmap v167: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-17T11:55:25.342 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-17T11:55:25.342 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:55:25.342 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:25.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -- ceph fs ls 2023-12-17T11:55:25.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:25 smithi119 ceph-mon[117414]: pgmap v167: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-17T11:55:25.780 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.923+0000 7f7dfa326700 1 -- 172.21.15.2:0/317185396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 msgr2=0x7f7df4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.923+0000 7f7dfa326700 1 --2- 172.21.15.2:0/317185396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df4102fd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7de4004940 tx=0x7f7de4009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 -- 172.21.15.2:0/317185396 shutdown_connections 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 --2- 172.21.15.2:0/317185396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7df41035a0 0x7f7df40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 --2- 172.21.15.2:0/317185396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df4102fd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 -- 172.21.15.2:0/317185396 >> 172.21.15.2:0/317185396 conn(0x7f7df40f8790 msgr2=0x7f7df40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 -- 172.21.15.2:0/317185396 shutdown_connections 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 -- 172.21.15.2:0/317185396 wait complete. 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.924+0000 7f7dfa326700 1 Processor -- start 2023-12-17T11:55:26.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7dfa326700 1 -- start start 2023-12-17T11:55:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7dfa326700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:26.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7dfa326700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7df41035a0 0x7f7df4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7dfa326700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4070a80 con 0x7f7df4102c00 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7dfa326700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4070bf0 con 0x7f7df41035a0 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7df3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7df3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34964/0 (socket says 172.21.15.2:34964) 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7df3fff700 1 -- 172.21.15.2:0/3243921645 learned_addr learned my addr 172.21.15.2:0/3243921645 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.925+0000 7f7df37fe700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7df41035a0 0x7f7df4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df3fff700 1 -- 172.21.15.2:0/3243921645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7df41035a0 msgr2=0x7f7df4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df3fff700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7df41035a0 0x7f7df4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df3fff700 1 -- 172.21.15.2:0/3243921645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4005040 con 0x7f7df4102c00 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df3fff700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df406ff40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7de4008d80 tx=0x7f7de4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de400e030 con 0x7f7df4102c00 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7de4004290 con 0x7f7df4102c00 2023-12-17T11:55:26.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7de401cda0 con 0x7f7df4102c00 2023-12-17T11:55:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df4119830 con 0x7f7df4102c00 2023-12-17T11:55:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.926+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df4119c90 con 0x7f7df4102c00 2023-12-17T11:55:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.927+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df40fc390 con 0x7f7df4102c00 2023-12-17T11:55:26.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.928+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f7de401c600 con 0x7f7df4102c00 2023-12-17T11:55:26.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.929+0000 7f7df0ff9700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7ddc068f70 0x7f7ddc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.930+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7de40887b0 con 0x7f7df4102c00 2023-12-17T11:55:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.930+0000 7f7df37fe700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7ddc068f70 0x7f7ddc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:26.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.930+0000 7f7df37fe700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7ddc068f70 0x7f7ddc06b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7df4071940 tx=0x7f7de800b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:26.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:26.934+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7de4054c10 con 0x7f7df4102c00 2023-12-17T11:55:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.183+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7df4071780 con 0x7f7df4102c00 2023-12-17T11:55:27.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.183+0000 7f7df0ff9700 1 -- 172.21.15.2:0/3243921645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f7de4086e60 con 0x7f7df4102c00 2023-12-17T11:55:27.186 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-17T11:55:27.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7ddc068f70 msgr2=0x7f7ddc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7ddc068f70 0x7f7ddc06b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7df4071940 tx=0x7f7de800b040 comp rx=0 tx=0).stop 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 msgr2=0x7f7df406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df406ff40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7de4008d80 tx=0x7f7de4009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 shutdown_connections 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7ddc068f70 0x7f7ddc06b420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7df4102c00 0x7f7df406ff40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 --2- 172.21.15.2:0/3243921645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7df41035a0 0x7f7df4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 >> 172.21.15.2:0/3243921645 conn(0x7f7df40f8790 msgr2=0x7f7df40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:27.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 shutdown_connections 2023-12-17T11:55:27.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:27.186+0000 7f7dfa326700 1 -- 172.21.15.2:0/3243921645 wait complete. 2023-12-17T11:55:27.393 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:27 smithi002 ceph-mon[107131]: pgmap v168: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-17T11:55:27.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:27 smithi119 ceph-mon[117414]: pgmap v168: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-17T11:55:27.575 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:55:27.576 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-17T11:55:27.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:27.576 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-12-17T11:55:27.630 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:55:27.630 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:55:27.630 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:55:27.630 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:55:27.630 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 41820sec preferred_lft 41820sec 2023-12-17T11:55:27.631 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-12-17T11:55:27.632 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:55:27.632 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-17T11:55:27.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-17T11:55:27.633 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-17T11:55:28.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:28.170 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:55:28.242 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-12-17T11:55:28.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:28.245 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-12-17T11:55:28.317 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-12-17T11:55:28.317 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:55:28.317 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-17T11:55:28.317 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-17T11:55:28.317 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:55:28.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:28.318 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-17T11:55:28.319 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-17T11:55:28.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-17T11:55:28.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-17T11:55:28.319 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-17T11:55:28.319 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-17T11:55:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:28 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3243921645' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-17T11:55:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:28 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3243921645' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-17T11:55:28.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:28.990 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-17T11:55:29.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:29.038 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-12-17T11:55:29.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:29.086 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-17T11:55:29.086 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-17T11:55:29.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-17T11:55:29.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-17T11:55:29.086 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-17T11:55:29.232 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-17T11:55:29.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-17T11:55:29.233 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-17T11:55:29.337 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:29 smithi119 ceph-mon[117414]: pgmap v169: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 1 op/s 2023-12-17T11:55:29.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:29 smithi002 ceph-mon[107131]: pgmap v169: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 1 op/s 2023-12-17T11:55:29.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:29.500 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-12-17T11:55:29.501 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-12-17T11:55:29.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-12-17T11:55:29.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2023-12-17T11:55:29.501 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-12-17T11:55:29.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:55:29.676 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:29.723 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-17T11:55:29.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:55:29.723 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:29.769 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:55:29.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:29.770 DEBUG:teuthology.orchestra.run.smithi119:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:55:29.883 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:55:29.884 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-17T11:55:29.884 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2023-12-17T11:55:30.312 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:55:30.312 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-17T11:55:30.312 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2023-12-17T11:55:30.313 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.119:3300" 2023-12-17T11:55:30.313 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:55:30.337 INFO:teuthology.orchestra.run.smithi119.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:invalid new device string format 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.119:3300" 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: resolved to: "172.21.15.2:6789,172.21.15.119:6789" 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:6789,172.21.15.119:6789:/ 2023-12-17T11:55:30.338 INFO:teuthology.orchestra.run.smithi119.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=1a404768-9cd2-11ee-95a5-87774f69a715" will pass to kernel 2023-12-17T11:55:30.343 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:55:30.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:30.343 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:30.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:30.414 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:55:30.529 INFO:teuthology.orchestra.run.smithi119.stdout:client14558 2023-12-17T11:55:30.529 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:55:30.529 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:55:30.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:30.577 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:55:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:30 smithi119 ceph-mon[117414]: pgmap v170: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-17T11:55:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:30.706 INFO:teuthology.orchestra.run.smithi119.stdout:client14558 2023-12-17T11:55:30.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:30.707 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:55:30.835 INFO:teuthology.orchestra.run.smithi119.stdout:client14558 2023-12-17T11:55:30.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:55:30.836 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/1a404768-9cd2-11ee-95a5-87774f69a715.client14558/status') 2023-12-17T11:55:30.944 INFO:teuthology.orchestra.run.smithi119.stdout:instance: client.14558 (3)172.21.15.119:0/717764389 2023-12-17T11:55:30.944 INFO:teuthology.orchestra.run.smithi119.stdout:blocklisted: false 2023-12-17T11:55:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:0+1 records in 2023-12-17T11:55:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:0+1 records out 2023-12-17T11:55:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:71 bytes copied, 6.663e-05 s, 1.1 MB/s 2023-12-17T11:55:30.947 INFO:teuthology.run_tasks:Running task print... 2023-12-17T11:55:30.959 INFO:teuthology.task.print:**** done client 2023-12-17T11:55:30.959 INFO:teuthology.run_tasks:Running task parallel... 2023-12-17T11:55:30.974 INFO:teuthology.task.parallel:starting parallel... 2023-12-17T11:55:30.974 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-17T11:55:30.975 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-17T11:55:30.976 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T11:55:30.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-17T11:55:30.976 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-17T11:55:30.977 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-17T11:55:30.980 INFO:tasks.workunit:Pulling workunits from ref a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:55:30.981 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-17T11:55:30.981 INFO:tasks.workunit:timeout=3h 2023-12-17T11:55:30.981 INFO:tasks.workunit:cleanup=True 2023-12-17T11:55:30.981 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:30.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:30 smithi002 ceph-mon[107131]: pgmap v170: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-17T11:55:30.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:31.038 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:31.038 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-17T11:55:31.038 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 94h/148d Inode: 1 Links: 2 2023-12-17T11:55:31.038 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:55:31.038 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-17T11:55:31.038 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-17T11:55:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-12-17 11:54:59.506676615 +0000 2023-12-17T11:55:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-12-17 11:55:24.853536957 +0000 2023-12-17T11:55:31.039 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-12-17 11:54:59.506676615 +0000 2023-12-17T11:55:31.039 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-17T11:55:31.039 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-17T11:55:31.161 DEBUG:teuthology.orchestra.run.smithi119:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:31.212 INFO:teuthology.orchestra.run.smithi119.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 75h/117d Inode: 1 Links: 3 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-12-17 11:55:31.149397818 +0000 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-12-17 11:55:31.149397818 +0000 2023-12-17T11:55:31.213 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-12-17 11:54:59.506676615 +0000 2023-12-17T11:55:31.213 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-17T11:55:31.213 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-17T11:55:31.290 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:55:31.291 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:55:31.340 INFO:tasks.workunit.client.1.smithi119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-17T11:55:31.343 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-17T11:55:31.459 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3152575159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fcbf0 msgr2=0x7fdcb40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3152575159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fcbf0 0x7fdcb40fd000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0004940 tx=0x7fdcb0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3152575159 shutdown_connections 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3152575159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb40fde00 0x7fdcb40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3152575159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fcbf0 0x7fdcb40fd000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3152575159 >> 172.21.15.2:0/3152575159 conn(0x7fdcb40f82d0 msgr2=0x7fdcb40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3152575159 shutdown_connections 2023-12-17T11:55:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.606+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3152575159 wait complete. 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.607+0000 7fdcbbdb4700 1 Processor -- start 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.607+0000 7fdcbbdb4700 1 -- start start 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcbbdb4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb40fcbf0 0x7fdcb4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcbbdb4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 0x7fdcb406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcbbdb4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb4111240 con 0x7fdcb40fde00 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcbbdb4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb41113b0 con 0x7fdcb40fcbf0 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb934f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 0x7fdcb406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb934f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 0x7fdcb406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32824/0 (socket says 172.21.15.2:32824) 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb934f700 1 -- 172.21.15.2:0/3587517362 learned_addr learned my addr 172.21.15.2:0/3587517362 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb9b50700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb40fcbf0 0x7fdcb4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb934f700 1 -- 172.21.15.2:0/3587517362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb40fcbf0 msgr2=0x7fdcb4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb934f700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb40fcbf0 0x7fdcb4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.608+0000 7fdcb934f700 1 -- 172.21.15.2:0/3587517362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0005040 con 0x7fdcb40fde00 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.609+0000 7fdcb934f700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 0x7fdcb406ff90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdca4002a50 tx=0x7fdca40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.609+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca4007cc0 con 0x7fdcb40fde00 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.609+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdca400f040 con 0x7fdcb40fde00 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.609+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb40705f0 con 0x7fdcb40fde00 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.609+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdca4009540 con 0x7fdcb40fde00 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.609+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb4070b30 con 0x7fdcb40fde00 2023-12-17T11:55:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.610+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb404bb80 con 0x7fdcb40fde00 2023-12-17T11:55:32.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.611+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fdca40096a0 con 0x7fdcb40fde00 2023-12-17T11:55:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.612+0000 7fdcaa7fc700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdca0068f70 0x7fdca006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.613+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdca4086cc0 con 0x7fdcb40fde00 2023-12-17T11:55:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.613+0000 7fdcb9b50700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdca0068f70 0x7fdca006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.613+0000 7fdcb9b50700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdca0068f70 0x7fdca006b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000b7d0 tx=0x7fdcb0009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.617+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdca408c020 con 0x7fdcb40fde00 2023-12-17T11:55:32.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.823+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fdcb4070d50 con 0x7fdcb40fde00 2023-12-17T11:55:32.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.823+0000 7fdcaa7fc700 1 -- 172.21.15.2:0/3587517362 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fdca4056ab0 con 0x7fdcb40fde00 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.825+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdca0068f70 msgr2=0x7fdca006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.825+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdca0068f70 0x7fdca006b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000b7d0 tx=0x7fdcb0009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.825+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 msgr2=0x7fdcb406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.825+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 0x7fdcb406ff90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdca4002a50 tx=0x7fdca40046b0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 shutdown_connections 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fdca0068f70 0x7fdca006b420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb40fcbf0 0x7fdcb4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 --2- 172.21.15.2:0/3587517362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcb40fde00 0x7fdcb406ff90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 >> 172.21.15.2:0/3587517362 conn(0x7fdcb40f82d0 msgr2=0x7fdcb4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 shutdown_connections 2023-12-17T11:55:32.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:32.826+0000 7fdcbbdb4700 1 -- 172.21.15.2:0/3587517362 wait complete. 2023-12-17T11:55:33.151 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:33 smithi002 ceph-mon[107131]: pgmap v171: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-17T11:55:33.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-17T11:55:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:33 smithi119 ceph-mon[117414]: pgmap v171: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-17T11:55:33.613 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 -- 172.21.15.2:0/3426112231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0071bc0 msgr2=0x7fc8f0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 --2- 172.21.15.2:0/3426112231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0071bc0 0x7fc8f0070030 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec004940 tx=0x7fc8ec009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 -- 172.21.15.2:0/3426112231 shutdown_connections 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 --2- 172.21.15.2:0/3426112231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8f0070570 0x7fc8f00709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 --2- 172.21.15.2:0/3426112231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0071bc0 0x7fc8f0070030 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 -- 172.21.15.2:0/3426112231 >> 172.21.15.2:0/3426112231 conn(0x7fc8f00f82d0 msgr2=0x7fc8f00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 -- 172.21.15.2:0/3426112231 shutdown_connections 2023-12-17T11:55:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.773+0000 7fc8f7848700 1 -- 172.21.15.2:0/3426112231 wait complete. 2023-12-17T11:55:34.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.774+0000 7fc8f7848700 1 Processor -- start 2023-12-17T11:55:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.774+0000 7fc8f7848700 1 -- start start 2023-12-17T11:55:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.774+0000 7fc8f7848700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 0x7fc8f010f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.774+0000 7fc8f7848700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8f0071bc0 0x7fc8f010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.774+0000 7fc8f7848700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01102c0 con 0x7fc8f0070570 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.774+0000 7fc8f7848700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0110b60 con 0x7fc8f0071bc0 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 0x7fc8f010f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 0x7fc8f010f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32840/0 (socket says 172.21.15.2:32840) 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 -- 172.21.15.2:0/244459320 learned_addr learned my addr 172.21.15.2:0/244459320 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f4de3700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8f0071bc0 0x7fc8f010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 -- 172.21.15.2:0/244459320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8f0071bc0 msgr2=0x7fc8f010fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8f0071bc0 0x7fc8f010fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 -- 172.21.15.2:0/244459320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec005040 con 0x7fc8f0070570 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8f55e4700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 0x7fc8f010f780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec000c00 tx=0x7fc8ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.775+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec00e040 con 0x7fc8f0070570 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.776+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f0110de0 con 0x7fc8f0070570 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.776+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8ec004290 con 0x7fc8f0070570 2023-12-17T11:55:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.776+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec01c3f0 con 0x7fc8f0070570 2023-12-17T11:55:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.776+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f0111320 con 0x7fc8f0070570 2023-12-17T11:55:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.777+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f01097e0 con 0x7fc8f0070570 2023-12-17T11:55:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.778+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fc8ec00bbf0 con 0x7fc8f0070570 2023-12-17T11:55:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.779+0000 7fc8e5ffb700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc8dc068f60 0x7fc8dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.779+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc8ec088210 con 0x7fc8f0070570 2023-12-17T11:55:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.779+0000 7fc8f4de3700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc8dc068f60 0x7fc8dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.780+0000 7fc8f4de3700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc8dc068f60 0x7fc8dc06b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009fd0 tx=0x7fc8e0009f20 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.784+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc8ec058120 con 0x7fc8f0070570 2023-12-17T11:55:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.991+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc8f01077a0 con 0x7fc8f0070570 2023-12-17T11:55:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.992+0000 7fc8e5ffb700 1 -- 172.21.15.2:0/244459320 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc8ec057cb0 con 0x7fc8f0070570 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc8dc068f60 msgr2=0x7fc8dc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc8dc068f60 0x7fc8dc06b410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009fd0 tx=0x7fc8e0009f20 comp rx=0 tx=0).stop 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 msgr2=0x7fc8f010f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 0x7fc8f010f780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec000c00 tx=0x7fc8ec009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 shutdown_connections 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fc8dc068f60 0x7fc8dc06b410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:34.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8f0070570 0x7fc8f010f780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 --2- 172.21.15.2:0/244459320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8f0071bc0 0x7fc8f010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 >> 172.21.15.2:0/244459320 conn(0x7fc8f00f82d0 msgr2=0x7fc8f00fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 shutdown_connections 2023-12-17T11:55:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:34.994+0000 7fc8f7848700 1 -- 172.21.15.2:0/244459320 wait complete. 2023-12-17T11:55:35.303 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:35 smithi002 ceph-mon[107131]: pgmap v172: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-17T11:55:35.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-17T11:55:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:35 smithi119 ceph-mon[117414]: pgmap v172: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-17T11:55:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 -- 172.21.15.2:0/1342837201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 msgr2=0x7f97b80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/1342837201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b80fd000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f97a8004940 tx=0x7f97a8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 -- 172.21.15.2:0/1342837201 shutdown_connections 2023-12-17T11:55:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/1342837201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97b80fde00 0x7f97b80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:36.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/1342837201 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b80fd000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 -- 172.21.15.2:0/1342837201 >> 172.21.15.2:0/1342837201 conn(0x7f97b80f82d0 msgr2=0x7f97b80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 -- 172.21.15.2:0/1342837201 shutdown_connections 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.945+0000 7f97bcf3c700 1 -- 172.21.15.2:0/1342837201 wait complete. 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97bcf3c700 1 Processor -- start 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97bcf3c700 1 -- start start 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97bcf3c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97bcf3c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97b80fde00 0x7f97b810fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97bcf3c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b81102a0 con 0x7f97b80fcbf0 2023-12-17T11:55:36.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97bcf3c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8110b40 con 0x7f97b80fde00 2023-12-17T11:55:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.946+0000 7f97b659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:36.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b810f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32866/0 (socket says 172.21.15.2:32866) 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b659c700 1 -- 172.21.15.2:0/775302538 learned_addr learned my addr 172.21.15.2:0/775302538 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97b80fde00 0x7f97b810fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b659c700 1 -- 172.21.15.2:0/775302538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97b80fde00 msgr2=0x7f97b810fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b659c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97b80fde00 0x7f97b810fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b659c700 1 -- 172.21.15.2:0/775302538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8005040 con 0x7f97b80fcbf0 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.947+0000 7f97b659c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b810f760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009360 tx=0x7f97a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.948+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a800e040 con 0x7f97b80fcbf0 2023-12-17T11:55:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.948+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8110dc0 con 0x7f97b80fcbf0 2023-12-17T11:55:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.948+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97a8004290 con 0x7f97b80fcbf0 2023-12-17T11:55:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.948+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a801c3f0 con 0x7f97b80fcbf0 2023-12-17T11:55:36.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.948+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b8111300 con 0x7f97b80fcbf0 2023-12-17T11:55:36.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.949+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b8101ea0 con 0x7f97b80fcbf0 2023-12-17T11:55:36.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.950+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f97a80137e0 con 0x7f97b80fcbf0 2023-12-17T11:55:36.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.951+0000 7f97a6ffd700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f97a0068f70 0x7f97a006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:36.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.951+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f97a80881c0 con 0x7f97b80fcbf0 2023-12-17T11:55:36.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.951+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f97a0068f70 0x7f97a006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:36.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.952+0000 7f97b5d9b700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f97a0068f70 0x7f97a006b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97ac004f40 tx=0x7f97ac00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:36.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:36.955+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f97a8057fb0 con 0x7f97b80fcbf0 2023-12-17T11:55:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.161+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f97b804bb80 con 0x7f97b80fcbf0 2023-12-17T11:55:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.161+0000 7f97a6ffd700 1 -- 172.21.15.2:0/775302538 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f97a805d030 con 0x7f97b80fcbf0 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f97a0068f70 msgr2=0x7f97a006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f97a0068f70 0x7f97a006b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97ac004f40 tx=0x7f97ac00b040 comp rx=0 tx=0).stop 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 msgr2=0x7f97b810f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b810f760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009360 tx=0x7f97a8009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 shutdown_connections 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f97a0068f70 0x7f97a006b420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f97b80fcbf0 0x7f97b810f760 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 --2- 172.21.15.2:0/775302538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f97b80fde00 0x7f97b810fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 >> 172.21.15.2:0/775302538 conn(0x7f97b80f82d0 msgr2=0x7f97b80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 shutdown_connections 2023-12-17T11:55:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:37.164+0000 7f97bcf3c700 1 -- 172.21.15.2:0/775302538 wait complete. 2023-12-17T11:55:37.350 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:37 smithi002 ceph-mon[107131]: pgmap v173: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-17T11:55:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:37 smithi119 ceph-mon[117414]: pgmap v173: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2023-12-17T11:55:37.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-17T11:55:37.975 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3354641098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 msgr2=0x7fd0bc070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3354641098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc070030 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac004940 tx=0x7fd0ac009e30 comp rx=0 tx=0).stop 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3354641098 shutdown_connections 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3354641098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc070570 0x7fd0bc0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3354641098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc070030 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3354641098 >> 172.21.15.2:0/3354641098 conn(0x7fd0bc0f82d0 msgr2=0x7fd0bc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3354641098 shutdown_connections 2023-12-17T11:55:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.288+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3354641098 wait complete. 2023-12-17T11:55:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.289+0000 7fd0c12ea700 1 Processor -- start 2023-12-17T11:55:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.290+0000 7fd0c12ea700 1 -- start start 2023-12-17T11:55:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.290+0000 7fd0c12ea700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc070570 0x7fd0bc113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.290+0000 7fd0c12ea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.290+0000 7fd0c12ea700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc114660 con 0x7fd0bc071bc0 2023-12-17T11:55:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.290+0000 7fd0c12ea700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc114f00 con 0x7fd0bc070570 2023-12-17T11:55:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43706/0 (socket says 172.21.15.2:43706) 2023-12-17T11:55:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 -- 172.21.15.2:0/3084160341 learned_addr learned my addr 172.21.15.2:0/3084160341 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:55:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0baffd700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc070570 0x7fd0bc113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 -- 172.21.15.2:0/3084160341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc070570 msgr2=0x7fd0bc113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc070570 0x7fd0bc113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 -- 172.21.15.2:0/3084160341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac005040 con 0x7fd0bc071bc0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0ba7fc700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc114060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0002a50 tx=0x7fd0b00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.291+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b0007cc0 con 0x7fd0bc071bc0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.292+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0b000f040 con 0x7fd0bc071bc0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.292+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc1151e0 con 0x7fd0bc071bc0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.292+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b000d9c0 con 0x7fd0bc071bc0 2023-12-17T11:55:39.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.292+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc115720 con 0x7fd0bc071bc0 2023-12-17T11:55:39.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.293+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc10dbb0 con 0x7fd0bc071bc0 2023-12-17T11:55:39.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.294+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7fd0b000db20 con 0x7fd0bc071bc0 2023-12-17T11:55:39.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.294+0000 7fd0a37fe700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd0a4068f70 0x7fd0a406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:39.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.295+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd0b0086a30 con 0x7fd0bc071bc0 2023-12-17T11:55:39.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.295+0000 7fd0baffd700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd0a4068f70 0x7fd0a406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:39.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.295+0000 7fd0baffd700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd0a4068f70 0x7fd0a406b420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0043d0 tx=0x7fd0ac009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.299+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0b0056940 con 0x7fd0bc071bc0 2023-12-17T11:55:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:39 smithi119 ceph-mon[117414]: pgmap v174: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-17T11:55:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:39 smithi002 ceph-mon[107131]: pgmap v174: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-17T11:55:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:55:39.522+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0bc115ab0 con 0x7fd0a4068f70 2023-12-17T11:55:40.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:40 smithi119 ceph-mon[117414]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:55:40.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:40 smithi119 ceph-mon[117414]: pgmap v175: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:55:40.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:40 smithi002 ceph-mon[107131]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:55:40.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:40 smithi002 ceph-mon[107131]: pgmap v175: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:55:43.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:43 smithi119 ceph-mon[117414]: pgmap v176: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:55:43.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:43 smithi002 ceph-mon[107131]: pgmap v176: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:55:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:45 smithi119 ceph-mon[117414]: pgmap v177: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:55:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:45.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:45 smithi002 ceph-mon[107131]: pgmap v177: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:55:45.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:55:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:47 smithi119 ceph-mon[117414]: pgmap v178: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:55:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:47 smithi002 ceph-mon[107131]: pgmap v178: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:55:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:49 smithi119 ceph-mon[117414]: pgmap v179: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:55:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:49 smithi002 ceph-mon[107131]: pgmap v179: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:55:50.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:50 smithi119 ceph-mon[117414]: pgmap v180: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:50.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:50 smithi002 ceph-mon[107131]: pgmap v180: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:53 smithi119 ceph-mon[117414]: pgmap v181: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:53.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:53 smithi002 ceph-mon[107131]: pgmap v181: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:55 smithi119 ceph-mon[117414]: pgmap v182: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:55.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:55 smithi002 ceph-mon[107131]: pgmap v182: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:57.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:57 smithi119 ceph-mon[117414]: pgmap v183: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:57.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:57 smithi002 ceph-mon[107131]: pgmap v183: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:55:59 smithi119 ceph-mon[117414]: pgmap v184: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:55:59.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:55:59 smithi002 ceph-mon[107131]: pgmap v184: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:00.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:00 smithi119 ceph-mon[117414]: pgmap v185: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:00.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:00 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:00.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:00 smithi002 ceph-mon[107131]: pgmap v185: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:00.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:00 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:03.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:03 smithi119 ceph-mon[117414]: pgmap v186: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:03.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:03 smithi002 ceph-mon[107131]: pgmap v186: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:05.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:05 smithi119 ceph-mon[117414]: pgmap v187: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:05.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:05 smithi002 ceph-mon[107131]: pgmap v187: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:07.366 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:07 smithi002 ceph-mon[107131]: pgmap v188: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:07.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:07 smithi119 ceph-mon[117414]: pgmap v188: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:08.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.038+0000 7fd0a37fe700 1 -- 172.21.15.2:0/3084160341 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fd0bc115ab0 con 0x7fd0a4068f70 2023-12-17T11:56:08.041 INFO:teuthology.orchestra.run.smithi002.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:56:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd0a4068f70 msgr2=0x7fd0a406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd0a4068f70 0x7fd0a406b420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0043d0 tx=0x7fd0ac009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:08.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 msgr2=0x7fd0bc114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc114060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0002a50 tx=0x7fd0b00046b0 comp rx=0 tx=0).stop 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 shutdown_connections 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7fd0a4068f70 0x7fd0a406b420 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0bc070570 0x7fd0bc113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 --2- 172.21.15.2:0/3084160341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0bc071bc0 0x7fd0bc114060 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 >> 172.21.15.2:0/3084160341 conn(0x7fd0bc0f82d0 msgr2=0x7fd0bc0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 shutdown_connections 2023-12-17T11:56:08.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:08.041+0000 7fd0c12ea700 1 -- 172.21.15.2:0/3084160341 wait complete. 2023-12-17T11:56:08.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-17T11:56:08.942 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T11:56:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:09 smithi119 ceph-mon[117414]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:56:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:09 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:09 smithi119 ceph-mon[117414]: pgmap v189: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:09 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:09.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:09 smithi002 ceph-mon[107131]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:56:09.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:09 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:09.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:09 smithi002 ceph-mon[107131]: pgmap v189: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:09.463 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:09 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:10.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:10.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:56:10.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:10 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:10.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:10 smithi002 ceph-mon[107131]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:56:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.261+0000 7effc2259700 1 -- 172.21.15.2:0/1243543599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc070510 msgr2=0x7effbc070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.261+0000 7effc2259700 1 --2- 172.21.15.2:0/1243543599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc070510 0x7effbc070980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7effb0004940 tx=0x7effb0009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.262+0000 7effc2259700 1 -- 172.21.15.2:0/1243543599 shutdown_connections 2023-12-17T11:56:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.262+0000 7effc2259700 1 --2- 172.21.15.2:0/1243543599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc070510 0x7effbc070980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.262+0000 7effc2259700 1 --2- 172.21.15.2:0/1243543599 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc071b60 0x7effbc06ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.262+0000 7effc2259700 1 -- 172.21.15.2:0/1243543599 >> 172.21.15.2:0/1243543599 conn(0x7effbc0f82d0 msgr2=0x7effbc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.262+0000 7effc2259700 1 -- 172.21.15.2:0/1243543599 shutdown_connections 2023-12-17T11:56:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.262+0000 7effc2259700 1 -- 172.21.15.2:0/1243543599 wait complete. 2023-12-17T11:56:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.263+0000 7effc2259700 1 Processor -- start 2023-12-17T11:56:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.263+0000 7effc2259700 1 -- start start 2023-12-17T11:56:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.263+0000 7effc2259700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc070510 0x7effbc10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.263+0000 7effc2259700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 0x7effbc10fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.263+0000 7effc2259700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1102c0 con 0x7effbc071b60 2023-12-17T11:56:10.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.263+0000 7effc2259700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc110b60 con 0x7effbc070510 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 0x7effbc10fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc070510 0x7effbc10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc070510 0x7effbc10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:39646/0 (socket says 172.21.15.2:39646) 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbaffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 0x7effbc10fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50602/0 (socket says 172.21.15.2:50602) 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbb7fe700 1 -- 172.21.15.2:0/3958768117 learned_addr learned my addr 172.21.15.2:0/3958768117 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbaffd700 1 -- 172.21.15.2:0/3958768117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc070510 msgr2=0x7effbc10f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbaffd700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc070510 0x7effbc10f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbaffd700 1 -- 172.21.15.2:0/3958768117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0005040 con 0x7effbc071b60 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.264+0000 7effbaffd700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 0x7effbc10fcc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7effb0009fd0 tx=0x7effb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.265+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb000e070 con 0x7effbc071b60 2023-12-17T11:56:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.265+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc110de0 con 0x7effbc071b60 2023-12-17T11:56:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.265+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effb001c400 con 0x7effbc071b60 2023-12-17T11:56:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.265+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effb000b650 con 0x7effbc071b60 2023-12-17T11:56:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.265+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc1112c0 con 0x7effbc071b60 2023-12-17T11:56:10.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.266+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc1096f0 con 0x7effbc071b60 2023-12-17T11:56:10.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.267+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7effb001c570 con 0x7effbc071b60 2023-12-17T11:56:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.268+0000 7effa3fff700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7effa4068f70 0x7effa406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.269+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7effb0088410 con 0x7effbc071b60 2023-12-17T11:56:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.269+0000 7effbb7fe700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7effa4068f70 0x7effa406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.269+0000 7effbb7fe700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7effa4068f70 0x7effa406b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7effac008fd0 tx=0x7effac00b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.273+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7effb0058300 con 0x7effbc071b60 2023-12-17T11:56:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:56:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:10 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:10 smithi119 ceph-mon[117414]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:56:10.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.543+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effbc1114e0 con 0x7effa4068f70 2023-12-17T11:56:10.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.544+0000 7effa3fff700 1 -- 172.21.15.2:0/3958768117 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7effbc1114e0 con 0x7effa4068f70 2023-12-17T11:56:10.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7effa4068f70 msgr2=0x7effa406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7effa4068f70 0x7effa406b420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7effac008fd0 tx=0x7effac00b040 comp rx=0 tx=0).stop 2023-12-17T11:56:10.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 msgr2=0x7effbc10fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 0x7effbc10fcc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7effb0009fd0 tx=0x7effb0009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:10.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 shutdown_connections 2023-12-17T11:56:10.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7effa4068f70 0x7effa406b420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effbc070510 0x7effbc10f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 --2- 172.21.15.2:0/3958768117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effbc071b60 0x7effbc10fcc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.547+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 >> 172.21.15.2:0/3958768117 conn(0x7effbc0f82d0 msgr2=0x7effbc0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:10.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.548+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 shutdown_connections 2023-12-17T11:56:10.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.548+0000 7effc2259700 1 -- 172.21.15.2:0/3958768117 wait complete. 2023-12-17T11:56:10.567 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:56:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.709+0000 7f75b39c9700 1 -- 172.21.15.2:0/3362483894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 msgr2=0x7f75ac070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.709+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3362483894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac070980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f759c004880 tx=0x7f759c009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.709+0000 7f75b39c9700 1 -- 172.21.15.2:0/3362483894 shutdown_connections 2023-12-17T11:56:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.709+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3362483894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac070980 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.709+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3362483894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 0x7f75ac06ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.709+0000 7f75b39c9700 1 -- 172.21.15.2:0/3362483894 >> 172.21.15.2:0/3362483894 conn(0x7f75ac0f82d0 msgr2=0x7f75ac0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:10.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.710+0000 7f75b39c9700 1 -- 172.21.15.2:0/3362483894 shutdown_connections 2023-12-17T11:56:10.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.710+0000 7f75b39c9700 1 -- 172.21.15.2:0/3362483894 wait complete. 2023-12-17T11:56:10.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.711+0000 7f75b39c9700 1 Processor -- start 2023-12-17T11:56:10.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.711+0000 7f75b39c9700 1 -- start start 2023-12-17T11:56:10.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b39c9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac10f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b39c9700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 0x7f75ac10fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b39c9700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1102c0 con 0x7f75ac070510 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b39c9700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac110b60 con 0x7f75ac071b60 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b1765700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac10f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b1765700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac10f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50614/0 (socket says 172.21.15.2:50614) 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b1765700 1 -- 172.21.15.2:0/3115980601 learned_addr learned my addr 172.21.15.2:0/3115980601 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:10.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.712+0000 7f75b0f64700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 0x7f75ac10fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:10.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b1765700 1 -- 172.21.15.2:0/3115980601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 msgr2=0x7f75ac10fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b1765700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 0x7f75ac10fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b1765700 1 -- 172.21.15.2:0/3115980601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c005040 con 0x7f75ac070510 2023-12-17T11:56:10.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b0f64700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 0x7f75ac10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:56:10.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b1765700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac10f780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f75a80041d0 tx=0x7f75a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:10.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a8007cc0 con 0x7f75ac070510 2023-12-17T11:56:10.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75a800f040 con 0x7f75ac070510 2023-12-17T11:56:10.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a800c990 con 0x7f75ac070510 2023-12-17T11:56:10.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac110de0 con 0x7f75ac070510 2023-12-17T11:56:10.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.713+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac1112d0 con 0x7f75ac070510 2023-12-17T11:56:10.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.715+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac1096f0 con 0x7f75ac070510 2023-12-17T11:56:10.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.716+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f75a800cc00 con 0x7f75ac070510 2023-12-17T11:56:10.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.717+0000 7f75a1ffb700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7598068f70 0x7f759806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:10.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.717+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f75a80868e0 con 0x7f75ac070510 2023-12-17T11:56:10.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.718+0000 7f75b0f64700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7598068f70 0x7f759806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:10.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.718+0000 7f75b0f64700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7598068f70 0x7f759806b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f759c0135d0 tx=0x7f759c009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:10.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.722+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f75a804da00 con 0x7f75ac070510 2023-12-17T11:56:10.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.961+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75ac111540 con 0x7f7598068f70 2023-12-17T11:56:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.962+0000 7f75a1ffb700 1 -- 172.21.15.2:0/3115980601 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f75ac111540 con 0x7f7598068f70 2023-12-17T11:56:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7598068f70 msgr2=0x7f759806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7598068f70 0x7f759806b420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f759c0135d0 tx=0x7f759c009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 msgr2=0x7f75ac10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac10f780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f75a80041d0 tx=0x7f75a800b040 comp rx=0 tx=0).stop 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 shutdown_connections 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f7598068f70 0x7f759806b420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac070510 0x7f75ac10f780 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 --2- 172.21.15.2:0/3115980601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75ac071b60 0x7f75ac10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 >> 172.21.15.2:0/3115980601 conn(0x7f75ac0f82d0 msgr2=0x7f75ac0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 shutdown_connections 2023-12-17T11:56:10.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:10.965+0000 7f75b39c9700 1 -- 172.21.15.2:0/3115980601 wait complete. 2023-12-17T11:56:11.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 -- 172.21.15.2:0/1069795491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fcbf0 msgr2=0x7f3ea40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 --2- 172.21.15.2:0/1069795491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea40fd000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0004940 tx=0x7f3ea0009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:11.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 -- 172.21.15.2:0/1069795491 shutdown_connections 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 --2- 172.21.15.2:0/1069795491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fde00 0x7f3ea40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 --2- 172.21.15.2:0/1069795491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea40fd000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 -- 172.21.15.2:0/1069795491 >> 172.21.15.2:0/1069795491 conn(0x7f3ea40f82d0 msgr2=0x7f3ea40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 -- 172.21.15.2:0/1069795491 shutdown_connections 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.122+0000 7f3eab439700 1 -- 172.21.15.2:0/1069795491 wait complete. 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.123+0000 7f3eab439700 1 Processor -- start 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.123+0000 7f3eab439700 1 -- start start 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.123+0000 7f3eab439700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3eab439700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fde00 0x7f3ea406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3eab439700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4070590 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3eab439700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4070700 con 0x7f3ea40fde00 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea91d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea91d5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50638/0 (socket says 172.21.15.2:50638) 2023-12-17T11:56:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea91d5700 1 -- 172.21.15.2:0/174749895 learned_addr learned my addr 172.21.15.2:0/174749895 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea89d4700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fde00 0x7f3ea406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea91d5700 1 -- 172.21.15.2:0/174749895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fde00 msgr2=0x7f3ea406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea91d5700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fde00 0x7f3ea406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.124+0000 7f3ea91d5700 1 -- 172.21.15.2:0/174749895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea0005040 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.125+0000 7f3ea91d5700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea4071b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0008f80 tx=0x7f3ea0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.125+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea0021070 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.125+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea4070980 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.125+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ea001c400 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.125+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea000e070 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.125+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea4115500 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.126+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea404bb80 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.127+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f3ea001c950 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.129+0000 7f3e99ffb700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3e90068f70 0x7f3e9006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.129+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3ea0087f90 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.129+0000 7f3ea89d4700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3e90068f70 0x7f3e9006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.130+0000 7f3ea89d4700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3e90068f70 0x7f3e9006b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009b80 tx=0x7f3e9400b040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:11.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.133+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3ea0057e80 con 0x7f3ea40fcbf0 2023-12-17T11:56:11.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:11 smithi119 ceph-mon[117414]: pgmap v190: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:11.205 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:11 smithi002 ceph-mon[107131]: pgmap v190: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:11.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.361+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ea4102750 con 0x7f3e90068f70 2023-12-17T11:56:11.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.371+0000 7f3e99ffb700 1 -- 172.21.15.2:0/174749895 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f3ea4102750 con 0x7f3e90068f70 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (4m) 53s ago 5m 14.8M - 0.25.0 c8568f914cd2 ede7a91db214 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (6m) 53s ago 6m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (4m) 56s ago 4m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 53s ago 5m 79.0M - 9.4.7 954c08fa6188 43eb0083cc6a 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (66s) 53s ago 66s 13.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (72s) 53s ago 72s 12.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (70s) 56s ago 69s 15.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (64s) 56s ago 63s 11.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:9283 running (7m) 53s ago 7m 501M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ae71c0243acd 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283 running (4m) 56s ago 4m 442M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4765879e3e64 2023-12-17T11:56:11.374 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (7m) 53s ago 7m 70.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (4m) 56s ago 4m 48.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 53s ago 6m 8590k - 1.5.0 0da6a335fe13 5a889148dac0 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (4m) 56s ago 4m 8384k - 1.5.0 0da6a335fe13 db4c4aade2ec 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (4m) 53s ago 4m 55.6M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (3m) 53s ago 3m 59.2M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (3m) 53s ago 3m 56.8M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (3m) 56s ago 3m 55.0M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (2m) 56s ago 2m 49.2M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (2m) 56s ago 2m 49.6M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:56:11.375 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 53s ago 5m 44.7M - 2.43.0 a07b618ecd1d 29a015410237 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3e90068f70 msgr2=0x7f3e9006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3e90068f70 0x7f3e9006b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009b80 tx=0x7f3e9400b040 comp rx=0 tx=0).stop 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 msgr2=0x7f3ea4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea4071b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0008f80 tx=0x7f3ea0009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 shutdown_connections 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f3e90068f70 0x7f3e9006b420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea40fcbf0 0x7f3ea4071b10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 --2- 172.21.15.2:0/174749895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea40fde00 0x7f3ea406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 >> 172.21.15.2:0/174749895 conn(0x7f3ea40f82d0 msgr2=0x7f3ea4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:11.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 shutdown_connections 2023-12-17T11:56:11.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.374+0000 7f3eab439700 1 -- 172.21.15.2:0/174749895 wait complete. 2023-12-17T11:56:11.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.515+0000 7efd34aa5700 1 -- 172.21.15.2:0/3916227761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd300ffdd0 msgr2=0x7efd301021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.515+0000 7efd34aa5700 1 --2- 172.21.15.2:0/3916227761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd300ffdd0 0x7efd301021d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd24004940 tx=0x7efd24009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.516+0000 7efd34aa5700 1 -- 172.21.15.2:0/3916227761 shutdown_connections 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.516+0000 7efd34aa5700 1 --2- 172.21.15.2:0/3916227761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd300ffdd0 0x7efd301021d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.516+0000 7efd34aa5700 1 --2- 172.21.15.2:0/3916227761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd30066030 0x7efd300ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.516+0000 7efd34aa5700 1 -- 172.21.15.2:0/3916227761 >> 172.21.15.2:0/3916227761 conn(0x7efd300f7190 msgr2=0x7efd300f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.516+0000 7efd34aa5700 1 -- 172.21.15.2:0/3916227761 shutdown_connections 2023-12-17T11:56:11.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.516+0000 7efd34aa5700 1 -- 172.21.15.2:0/3916227761 wait complete. 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.517+0000 7efd34aa5700 1 Processor -- start 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.517+0000 7efd34aa5700 1 -- start start 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd34aa5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 0x7efd3010f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd34aa5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd300ffdd0 0x7efd3010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd34aa5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd30110240 con 0x7efd30066030 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd34aa5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd30110ae0 con 0x7efd300ffdd0 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 0x7efd3010f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 0x7efd3010f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50664/0 (socket says 172.21.15.2:50664) 2023-12-17T11:56:11.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2e59c700 1 -- 172.21.15.2:0/4021641192 learned_addr learned my addr 172.21.15.2:0/4021641192 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:11.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2dd9b700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd300ffdd0 0x7efd3010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2e59c700 1 -- 172.21.15.2:0/4021641192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd300ffdd0 msgr2=0x7efd3010fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2e59c700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd300ffdd0 0x7efd3010fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.518+0000 7efd2e59c700 1 -- 172.21.15.2:0/4021641192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd24005040 con 0x7efd30066030 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.519+0000 7efd2e59c700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 0x7efd3010f700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efd2000eb40 tx=0x7efd2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.519+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd20007cc0 con 0x7efd30066030 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.519+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd2000f040 con 0x7efd30066030 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.519+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2000c990 con 0x7efd30066030 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.519+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd30110d60 con 0x7efd30066030 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.519+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd30111250 con 0x7efd30066030 2023-12-17T11:56:11.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.520+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd300f8d30 con 0x7efd30066030 2023-12-17T11:56:11.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.522+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7efd2000cc00 con 0x7efd30066030 2023-12-17T11:56:11.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.522+0000 7efd1effd700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efd18068f70 0x7efd1806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.523+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efd20086a80 con 0x7efd30066030 2023-12-17T11:56:11.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.523+0000 7efd2dd9b700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efd18068f70 0x7efd1806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.523+0000 7efd2dd9b700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efd18068f70 0x7efd1806b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd2400b0d0 tx=0x7efd24009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:11.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.527+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efd2004da00 con 0x7efd30066030 2023-12-17T11:56:11.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.820+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd3002b0e0 con 0x7efd30066030 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.821+0000 7efd1effd700 1 -- 172.21.15.2:0/4021641192 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7efd20056920 con 0x7efd30066030 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:56:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:56:11.824 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:56:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efd18068f70 msgr2=0x7efd1806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efd18068f70 0x7efd1806b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efd2400b0d0 tx=0x7efd24009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 msgr2=0x7efd3010f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 0x7efd3010f700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efd2000eb40 tx=0x7efd2000b040 comp rx=0 tx=0).stop 2023-12-17T11:56:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 shutdown_connections 2023-12-17T11:56:11.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efd18068f70 0x7efd1806b420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd30066030 0x7efd3010f700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 --2- 172.21.15.2:0/4021641192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd300ffdd0 0x7efd3010fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 >> 172.21.15.2:0/4021641192 conn(0x7efd300f7190 msgr2=0x7efd30100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 shutdown_connections 2023-12-17T11:56:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.823+0000 7efd34aa5700 1 -- 172.21.15.2:0/4021641192 wait complete. 2023-12-17T11:56:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 -- 172.21.15.2:0/2367882171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fde00 msgr2=0x7f6cc40fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 --2- 172.21.15.2:0/2367882171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fde00 0x7f6cc40fe250 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8004940 tx=0x7f6cb8009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 -- 172.21.15.2:0/2367882171 shutdown_connections 2023-12-17T11:56:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 --2- 172.21.15.2:0/2367882171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fde00 0x7f6cc40fe250 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 --2- 172.21.15.2:0/2367882171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc40fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 -- 172.21.15.2:0/2367882171 >> 172.21.15.2:0/2367882171 conn(0x7f6cc40f82d0 msgr2=0x7f6cc40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:11.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.966+0000 7f6cca064700 1 -- 172.21.15.2:0/2367882171 shutdown_connections 2023-12-17T11:56:11.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.967+0000 7f6cca064700 1 -- 172.21.15.2:0/2367882171 wait complete. 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.968+0000 7f6cca064700 1 Processor -- start 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.968+0000 7f6cca064700 1 -- start start 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.968+0000 7f6cca064700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.968+0000 7f6cca064700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fde00 0x7f6cc410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.968+0000 7f6cca064700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc410e030 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.968+0000 7f6cca064700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc410e8d0 con 0x7f6cc40fde00 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc410d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50682/0 (socket says 172.21.15.2:50682) 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 -- 172.21.15.2:0/2635218243 learned_addr learned my addr 172.21.15.2:0/2635218243 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc2ffd700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fde00 0x7f6cc410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 -- 172.21.15.2:0/2635218243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fde00 msgr2=0x7f6cc410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fde00 0x7f6cc410da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 -- 172.21.15.2:0/2635218243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8005040 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc2ffd700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fde00 0x7f6cc410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.969+0000 7f6cc37fe700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc410d4f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400eb70 tx=0x7f6cb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.970+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb4007cc0 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.970+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cb400f040 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.970+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc410eb50 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.970+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cb400c9d0 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.970+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc410f090 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.971+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc404bb80 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.973+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f6cb400cb30 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.974+0000 7f6cabfff700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6cac068f70 0x7f6cac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:11.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.974+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6cb40868a0 con 0x7f6cc40fcbf0 2023-12-17T11:56:11.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.974+0000 7f6cc2ffd700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6cac068f70 0x7f6cac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:11.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.975+0000 7f6cc2ffd700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6cac068f70 0x7f6cac06b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8013600 tx=0x7f6cb8009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:11.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:11.978+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6cb404da00 con 0x7f6cc40fcbf0 2023-12-17T11:56:12.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.350+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cc410f530 con 0x7f6cac068f70 2023-12-17T11:56:12.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.352+0000 7f6cabfff700 1 -- 172.21.15.2:0/2635218243 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f6cc410f530 con 0x7f6cac068f70 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40 image on host smithi119", 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:56:12.354 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6cac068f70 msgr2=0x7f6cac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6cac068f70 0x7f6cac06b420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8013600 tx=0x7f6cb8009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 msgr2=0x7f6cc410d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc410d4f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400eb70 tx=0x7f6cb400b040 comp rx=0 tx=0).stop 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 shutdown_connections 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6cac068f70 0x7f6cac06b420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cc40fcbf0 0x7f6cc410d4f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 --2- 172.21.15.2:0/2635218243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40fde00 0x7f6cc410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 >> 172.21.15.2:0/2635218243 conn(0x7f6cc40f82d0 msgr2=0x7f6cc4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 shutdown_connections 2023-12-17T11:56:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:12.354+0000 7f6cca064700 1 -- 172.21.15.2:0/2635218243 wait complete. 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: Upgrade: Target is version 19.0.0-119-ga62fda73 (unknown) 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40, digests ['quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40'] 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:12.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: Upgrade: Need to upgrade myself (mgr.smithi002.cqnuqs) 2023-12-17T11:56:12.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:12.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:12 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/4021641192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:56:12.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: Upgrade: Target is version 19.0.0-119-ga62fda73 (unknown) 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40, digests ['quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40'] 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: Upgrade: Need to upgrade myself (mgr.smithi002.cqnuqs) 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:12.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:12 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4021641192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:56:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:13 smithi119 ceph-mon[117414]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40 on smithi119 2023-12-17T11:56:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:13 smithi119 ceph-mon[117414]: pgmap v191: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:13 smithi119 ceph-mon[117414]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:13 smithi002 ceph-mon[107131]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40 on smithi119 2023-12-17T11:56:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:13 smithi002 ceph-mon[107131]: pgmap v191: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:13 smithi002 ceph-mon[107131]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:15 smithi119 ceph-mon[117414]: pgmap v192: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:15.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:15 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:15 smithi002 ceph-mon[107131]: pgmap v192: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:15.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:15 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:17.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:17 smithi119 ceph-mon[117414]: pgmap v193: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:17.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:17 smithi002 ceph-mon[107131]: pgmap v193: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T11:56:19.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:19 smithi119 ceph-mon[117414]: pgmap v194: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-17T11:56:19.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:19 smithi002 ceph-mon[107131]: pgmap v194: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-17T11:56:20.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:20 smithi119 ceph-mon[117414]: pgmap v195: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:20.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:20 smithi002 ceph-mon[107131]: pgmap v195: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:23.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:23 smithi119 ceph-mon[117414]: pgmap v196: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:23.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:23 smithi002 ceph-mon[107131]: pgmap v196: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:25.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:25 smithi119 ceph-mon[117414]: pgmap v197: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:25.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:25 smithi002 ceph-mon[107131]: pgmap v197: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:27.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:27 smithi119 ceph-mon[117414]: pgmap v198: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:27.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:27 smithi002 ceph-mon[107131]: pgmap v198: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:29 smithi119 ceph-mon[117414]: pgmap v199: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:29.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:29 smithi002 ceph-mon[107131]: pgmap v199: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-17T11:56:30.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:30 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:30.886 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:30 smithi119 ceph-mon[117414]: pgmap v200: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:30.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:30 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:30.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:30 smithi002 ceph-mon[107131]: pgmap v200: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:33 smithi119 ceph-mon[117414]: pgmap v201: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:33.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:33 smithi002 ceph-mon[107131]: pgmap v201: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:35.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:35 smithi119 ceph-mon[117414]: pgmap v202: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:35.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:35 smithi002 ceph-mon[107131]: pgmap v202: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:37.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:37 smithi119 ceph-mon[117414]: pgmap v203: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:37.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:37 smithi002 ceph-mon[107131]: pgmap v203: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:39 smithi119 ceph-mon[117414]: pgmap v204: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:39 smithi002 ceph-mon[107131]: pgmap v204: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:40.883 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:40 smithi119 ceph-mon[117414]: pgmap v205: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:40.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:40 smithi002 ceph-mon[107131]: pgmap v205: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 -- 172.21.15.2:0/2723336626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4071bc0 msgr2=0x7f2ca4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 --2- 172.21.15.2:0/2723336626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4071bc0 0x7f2ca4070030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0004940 tx=0x7f2ca0009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 -- 172.21.15.2:0/2723336626 shutdown_connections 2023-12-17T11:56:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 --2- 172.21.15.2:0/2723336626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca4070570 0x7f2ca40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 --2- 172.21.15.2:0/2723336626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4071bc0 0x7f2ca4070030 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 -- 172.21.15.2:0/2723336626 >> 172.21.15.2:0/2723336626 conn(0x7f2ca40f82d0 msgr2=0x7f2ca40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:42.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 -- 172.21.15.2:0/2723336626 shutdown_connections 2023-12-17T11:56:42.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.508+0000 7f2cab958700 1 -- 172.21.15.2:0/2723336626 wait complete. 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.509+0000 7f2cab958700 1 Processor -- start 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2cab958700 1 -- start start 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2cab958700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 0x7f2ca4113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2cab958700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca4071bc0 0x7f2ca4114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2cab958700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4114680 con 0x7f2ca4070570 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2cab958700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4114f20 con 0x7f2ca4071bc0 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2ca96f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 0x7f2ca4113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2ca96f4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 0x7f2ca4113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36284/0 (socket says 172.21.15.2:36284) 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.510+0000 7f2ca96f4700 1 -- 172.21.15.2:0/859390465 learned_addr learned my addr 172.21.15.2:0/859390465 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:42.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.511+0000 7f2ca8ef3700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca4071bc0 0x7f2ca4114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.511+0000 7f2ca96f4700 1 -- 172.21.15.2:0/859390465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca4071bc0 msgr2=0x7f2ca4114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.511+0000 7f2ca96f4700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca4071bc0 0x7f2ca4114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.511+0000 7f2ca96f4700 1 -- 172.21.15.2:0/859390465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0005040 con 0x7f2ca4070570 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.511+0000 7f2ca96f4700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 0x7f2ca4113b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000b3b0 tx=0x7f2ca0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.511+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca000e040 con 0x7f2ca4070570 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.512+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca41151a0 con 0x7f2ca4070570 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.512+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ca000bcd0 con 0x7f2ca4070570 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.512+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca001c630 con 0x7f2ca4070570 2023-12-17T11:56:42.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.512+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca41156e0 con 0x7f2ca4070570 2023-12-17T11:56:42.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.513+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca410dbd0 con 0x7f2ca4070570 2023-12-17T11:56:42.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.514+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f2ca0013420 con 0x7f2ca4070570 2023-12-17T11:56:42.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.515+0000 7f2c99ffb700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f2c90068f70 0x7f2c9006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.515+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2ca0088e30 con 0x7f2ca4070570 2023-12-17T11:56:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.515+0000 7f2ca8ef3700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f2c90068f70 0x7f2c9006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.516+0000 7f2ca8ef3700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f2c90068f70 0x7f2c9006b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009fd0 tx=0x7f2c94009f20 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:42.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.523+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2ca0058ca0 con 0x7f2ca4070570 2023-12-17T11:56:42.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.749+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ca4115a30 con 0x7f2c90068f70 2023-12-17T11:56:42.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.750+0000 7f2c99ffb700 1 -- 172.21.15.2:0/859390465 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f2ca4115a30 con 0x7f2c90068f70 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f2c90068f70 msgr2=0x7f2c9006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f2c90068f70 0x7f2c9006b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009fd0 tx=0x7f2c94009f20 comp rx=0 tx=0).stop 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 msgr2=0x7f2ca4113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 0x7f2ca4113b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000b3b0 tx=0x7f2ca0009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 shutdown_connections 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f2c90068f70 0x7f2c9006b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca4070570 0x7f2ca4113b40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 --2- 172.21.15.2:0/859390465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca4071bc0 0x7f2ca4114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.752+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 >> 172.21.15.2:0/859390465 conn(0x7f2ca40f82d0 msgr2=0x7f2ca40fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:42.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.753+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 shutdown_connections 2023-12-17T11:56:42.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.753+0000 7f2cab958700 1 -- 172.21.15.2:0/859390465 wait complete. 2023-12-17T11:56:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 -- 172.21.15.2:0/1777620923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c070570 msgr2=0x7f4e9c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 --2- 172.21.15.2:0/1777620923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c070570 0x7f4e9c0709c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c004940 tx=0x7f4e8c009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 -- 172.21.15.2:0/1777620923 shutdown_connections 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 --2- 172.21.15.2:0/1777620923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c070570 0x7f4e9c0709c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 --2- 172.21.15.2:0/1777620923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 -- 172.21.15.2:0/1777620923 >> 172.21.15.2:0/1777620923 conn(0x7f4e9c0f82d0 msgr2=0x7f4e9c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.892+0000 7f4ea446c700 1 -- 172.21.15.2:0/1777620923 shutdown_connections 2023-12-17T11:56:42.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.893+0000 7f4ea446c700 1 -- 172.21.15.2:0/1777620923 wait complete. 2023-12-17T11:56:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.893+0000 7f4ea446c700 1 Processor -- start 2023-12-17T11:56:42.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea446c700 1 -- start start 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea446c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e9c070570 0x7f4e9c113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea446c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea446c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1146f0 con 0x7f4e9c071bc0 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea446c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c114f30 con 0x7f4e9c070570 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea1a07700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea1a07700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c114060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36296/0 (socket says 172.21.15.2:36296) 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea1a07700 1 -- 172.21.15.2:0/530956547 learned_addr learned my addr 172.21.15.2:0/530956547 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.894+0000 7f4ea2208700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e9c070570 0x7f4e9c113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4ea1a07700 1 -- 172.21.15.2:0/530956547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e9c070570 msgr2=0x7f4e9c113b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4ea1a07700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e9c070570 0x7f4e9c113b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4ea1a07700 1 -- 172.21.15.2:0/530956547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c005040 con 0x7f4e9c071bc0 2023-12-17T11:56:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4ea1a07700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c114060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b3b0 tx=0x7f4e8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c00e040 con 0x7f4e9c071bc0 2023-12-17T11:56:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e8c00bc50 con 0x7f4e9c071bc0 2023-12-17T11:56:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c1151b0 con 0x7f4e9c071bc0 2023-12-17T11:56:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c01c630 con 0x7f4e9c071bc0 2023-12-17T11:56:42.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.895+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c1156f0 con 0x7f4e9c071bc0 2023-12-17T11:56:42.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.897+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c04bb80 con 0x7f4e9c071bc0 2023-12-17T11:56:42.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.897+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f4e8c013420 con 0x7f4e9c071bc0 2023-12-17T11:56:42.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.898+0000 7f4e92ffd700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4e88068f70 0x7f4e8806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.898+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4e8c0882a0 con 0x7f4e9c071bc0 2023-12-17T11:56:42.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.899+0000 7f4ea2208700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4e88068f70 0x7f4e8806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.899+0000 7f4ea2208700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4e88068f70 0x7f4e8806b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009bf0 tx=0x7f4e980091a0 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:42.906+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4e8c058110 con 0x7f4e9c071bc0 2023-12-17T11:56:43.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.133+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e9c115b80 con 0x7f4e88068f70 2023-12-17T11:56:43.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.134+0000 7f4e92ffd700 1 -- 172.21.15.2:0/530956547 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4e9c115b80 con 0x7f4e88068f70 2023-12-17T11:56:43.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4e88068f70 msgr2=0x7f4e8806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4e88068f70 0x7f4e8806b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009bf0 tx=0x7f4e980091a0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 msgr2=0x7f4e9c114060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c114060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00b3b0 tx=0x7f4e8c009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 shutdown_connections 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4e88068f70 0x7f4e8806b420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e9c070570 0x7f4e9c113b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.136+0000 7f4ea446c700 1 --2- 172.21.15.2:0/530956547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e9c071bc0 0x7f4e9c114060 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.137+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 >> 172.21.15.2:0/530956547 conn(0x7f4e9c0f82d0 msgr2=0x7f4e9c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.137+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 shutdown_connections 2023-12-17T11:56:43.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.137+0000 7f4ea446c700 1 -- 172.21.15.2:0/530956547 wait complete. 2023-12-17T11:56:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.281+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1261533865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 msgr2=0x7f4cf40709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.281+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1261533865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf40709c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4004940 tx=0x7f4ce4009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.282+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1261533865 shutdown_connections 2023-12-17T11:56:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.282+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1261533865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf40709c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.282+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1261533865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cf4071bc0 0x7f4cf4070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.282+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1261533865 >> 172.21.15.2:0/1261533865 conn(0x7f4cf40f82d0 msgr2=0x7f4cf40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.282+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1261533865 shutdown_connections 2023-12-17T11:56:43.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.282+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1261533865 wait complete. 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfc7b1700 1 Processor -- start 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfc7b1700 1 -- start start 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfc7b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfc7b1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cf4071bc0 0x7f4cf410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfc7b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41103a0 con 0x7f4cf4070570 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfc7b1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4110c40 con 0x7f4cf4071bc0 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfa54d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfa54d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf410f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36314/0 (socket says 172.21.15.2:36314) 2023-12-17T11:56:43.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cfa54d700 1 -- 172.21.15.2:0/1201827899 learned_addr learned my addr 172.21.15.2:0/1201827899 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.283+0000 7f4cf9d4c700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cf4071bc0 0x7f4cf410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4cfa54d700 1 -- 172.21.15.2:0/1201827899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cf4071bc0 msgr2=0x7f4cf410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4cfa54d700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cf4071bc0 0x7f4cf410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4cfa54d700 1 -- 172.21.15.2:0/1201827899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4005040 con 0x7f4cf4070570 2023-12-17T11:56:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4cfa54d700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf410f860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000eb40 tx=0x7f4cf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:43.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf0007cc0 con 0x7f4cf4070570 2023-12-17T11:56:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4cf000f040 con 0x7f4cf4070570 2023-12-17T11:56:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf000c990 con 0x7f4cf4070570 2023-12-17T11:56:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.284+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf4110ec0 con 0x7f4cf4070570 2023-12-17T11:56:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.285+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf4111400 con 0x7f4cf4070570 2023-12-17T11:56:43.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.286+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf41096f0 con 0x7f4cf4070570 2023-12-17T11:56:43.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.287+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f4cf000caf0 con 0x7f4cf4070570 2023-12-17T11:56:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.288+0000 7f4ceaffd700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4ce0069040 0x7f4ce006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.288+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4cf00869c0 con 0x7f4cf4070570 2023-12-17T11:56:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.288+0000 7f4cf9d4c700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4ce0069040 0x7f4ce006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:43.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.289+0000 7f4cf9d4c700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4ce0069040 0x7f4ce006b4f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b0d0 tx=0x7f4ce4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:43.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.292+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4cf004da00 con 0x7f4cf4070570 2023-12-17T11:56:43.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:43 smithi119 ceph-mon[117414]: pgmap v206: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:43.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:43 smithi002 ceph-mon[107131]: pgmap v206: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:43.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.508+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf4111670 con 0x7f4ce0069040 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.522+0000 7f4ceaffd700 1 -- 172.21.15.2:0/1201827899 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4cf4111670 con 0x7f4ce0069040 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 86s ago 6m 14.8M - 0.25.0 c8568f914cd2 ede7a91db214 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (6m) 86s ago 6m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (5m) 88s ago 5m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 86s ago 6m 79.0M - 9.4.7 954c08fa6188 43eb0083cc6a 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (98s) 86s ago 98s 13.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:56:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (104s) 86s ago 104s 12.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (102s) 88s ago 101s 15.0M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (96s) 88s ago 96s 11.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:9283 running (7m) 86s ago 7m 501M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ae71c0243acd 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283 running (5m) 88s ago 5m 442M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 4765879e3e64 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (7m) 86s ago 7m 70.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (5m) 88s ago 5m 48.8M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 86s ago 6m 8590k - 1.5.0 0da6a335fe13 5a889148dac0 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 88s ago 5m 8384k - 1.5.0 0da6a335fe13 db4c4aade2ec 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (4m) 86s ago 4m 55.6M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (4m) 86s ago 4m 59.2M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (3m) 86s ago 3m 56.8M 4350M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (3m) 88s ago 3m 55.0M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (3m) 88s ago 3m 49.2M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (2m) 88s ago 2m 49.6M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:56:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 86s ago 5m 44.7M - 2.43.0 a07b618ecd1d 29a015410237 2023-12-17T11:56:43.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4ce0069040 msgr2=0x7f4ce006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4ce0069040 0x7f4ce006b4f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b0d0 tx=0x7f4ce4009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 msgr2=0x7f4cf410f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf410f860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000eb40 tx=0x7f4cf000b040 comp rx=0 tx=0).stop 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 shutdown_connections 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f4ce0069040 0x7f4ce006b4f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4cf4070570 0x7f4cf410f860 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 --2- 172.21.15.2:0/1201827899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4cf4071bc0 0x7f4cf410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 >> 172.21.15.2:0/1201827899 conn(0x7f4cf40f82d0 msgr2=0x7f4cf4103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 shutdown_connections 2023-12-17T11:56:43.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.524+0000 7f4cfc7b1700 1 -- 172.21.15.2:0/1201827899 wait complete. 2023-12-17T11:56:43.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 -- 172.21.15.2:0/3998961295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fde00 msgr2=0x7f68b00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 --2- 172.21.15.2:0/3998961295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fde00 0x7f68b00fe250 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68a4004940 tx=0x7f68a4009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 -- 172.21.15.2:0/3998961295 shutdown_connections 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 --2- 172.21.15.2:0/3998961295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fde00 0x7f68b00fe250 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 --2- 172.21.15.2:0/3998961295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b00fcbf0 0x7f68b00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 -- 172.21.15.2:0/3998961295 >> 172.21.15.2:0/3998961295 conn(0x7f68b00f82d0 msgr2=0x7f68b00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 -- 172.21.15.2:0/3998961295 shutdown_connections 2023-12-17T11:56:43.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.665+0000 7f68b6802700 1 -- 172.21.15.2:0/3998961295 wait complete. 2023-12-17T11:56:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.666+0000 7f68b6802700 1 Processor -- start 2023-12-17T11:56:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.666+0000 7f68b6802700 1 -- start start 2023-12-17T11:56:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.666+0000 7f68b6802700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 0x7f68b010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.666+0000 7f68b6802700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b00fde00 0x7f68b010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:43.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.666+0000 7f68b6802700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0110230 con 0x7f68b00fcbf0 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.666+0000 7f68b6802700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0110ad0 con 0x7f68b00fde00 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 0x7f68b010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 0x7f68b010f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36326/0 (socket says 172.21.15.2:36326) 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 -- 172.21.15.2:0/122490246 learned_addr learned my addr 172.21.15.2:0/122490246 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68af7fe700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b00fde00 0x7f68b010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 -- 172.21.15.2:0/122490246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b00fde00 msgr2=0x7f68b010fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b00fde00 0x7f68b010fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 -- 172.21.15.2:0/122490246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4005040 con 0x7f68b00fcbf0 2023-12-17T11:56:43.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.667+0000 7f68affff700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 0x7f68b010f6f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68a000eb70 tx=0x7f68a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.668+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a0007cc0 con 0x7f68b00fcbf0 2023-12-17T11:56:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.668+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68a000f040 con 0x7f68b00fcbf0 2023-12-17T11:56:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.668+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b0110d50 con 0x7f68b00fcbf0 2023-12-17T11:56:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.668+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a000c9d0 con 0x7f68b00fcbf0 2023-12-17T11:56:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.668+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b0111290 con 0x7f68b00fcbf0 2023-12-17T11:56:43.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.669+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b0101ea0 con 0x7f68b00fcbf0 2023-12-17T11:56:43.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.670+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7f68a000cb30 con 0x7f68b00fcbf0 2023-12-17T11:56:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.671+0000 7f68acff9700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6898068f60 0x7f689806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:43.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.671+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f68a00867d0 con 0x7f68b00fcbf0 2023-12-17T11:56:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.672+0000 7f68af7fe700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6898068f60 0x7f689806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:43.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.672+0000 7f68af7fe700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6898068f60 0x7f689806b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68a4013600 tx=0x7f68a4009e30 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:43.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.676+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68a00566e0 con 0x7f68b00fcbf0 2023-12-17T11:56:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.965+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f68b0105590 con 0x7f68b00fcbf0 2023-12-17T11:56:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.966+0000 7f68acff9700 1 -- 172.21.15.2:0/122490246 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f68a0019290 con 0x7f68b00fcbf0 2023-12-17T11:56:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:56:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:56:43.968 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 14 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:56:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6898068f60 msgr2=0x7f689806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6898068f60 0x7f689806b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f68a4013600 tx=0x7f68a4009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 msgr2=0x7f68b010f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 0x7f68b010f6f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68a000eb70 tx=0x7f68a000b040 comp rx=0 tx=0).stop 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 shutdown_connections 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7f6898068f60 0x7f689806b410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68b00fcbf0 0x7f68b010f6f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 --2- 172.21.15.2:0/122490246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b00fde00 0x7f68b010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:43.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 >> 172.21.15.2:0/122490246 conn(0x7f68b00f82d0 msgr2=0x7f68b00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:43.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 shutdown_connections 2023-12-17T11:56:43.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:43.969+0000 7f68b6802700 1 -- 172.21.15.2:0/122490246 wait complete. 2023-12-17T11:56:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 -- 172.21.15.2:0/4197052121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 msgr2=0x7efef40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 --2- 172.21.15.2:0/4197052121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef40fd000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efee4004940 tx=0x7efee4009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:44.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 -- 172.21.15.2:0/4197052121 shutdown_connections 2023-12-17T11:56:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 --2- 172.21.15.2:0/4197052121 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 0x7efef40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 --2- 172.21.15.2:0/4197052121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef40fd000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 -- 172.21.15.2:0/4197052121 >> 172.21.15.2:0/4197052121 conn(0x7efef40f82d0 msgr2=0x7efef40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 -- 172.21.15.2:0/4197052121 shutdown_connections 2023-12-17T11:56:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.112+0000 7efefa186700 1 -- 172.21.15.2:0/4197052121 wait complete. 2023-12-17T11:56:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.113+0000 7efefa186700 1 Processor -- start 2023-12-17T11:56:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.113+0000 7efefa186700 1 -- start start 2023-12-17T11:56:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efefa186700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef410f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efefa186700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 0x7efef410fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efefa186700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef4110380 con 0x7efef40fcbf0 2023-12-17T11:56:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efefa186700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef4110bc0 con 0x7efef40fde00 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efef37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef410f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efef37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef410f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36342/0 (socket says 172.21.15.2:36342) 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efef37fe700 1 -- 172.21.15.2:0/2537796676 learned_addr learned my addr 172.21.15.2:0/2537796676 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efef2ffd700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 0x7efef410fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efef37fe700 1 -- 172.21.15.2:0/2537796676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 msgr2=0x7efef410fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.114+0000 7efef37fe700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 0x7efef410fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efef37fe700 1 -- 172.21.15.2:0/2537796676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4005040 con 0x7efef40fcbf0 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efef2ffd700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 0x7efef410fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:56:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efef37fe700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef410f7b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efee4009360 tx=0x7efee4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee400e040 con 0x7efef40fcbf0 2023-12-17T11:56:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efee400bc50 con 0x7efef40fcbf0 2023-12-17T11:56:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee401c630 con 0x7efef40fcbf0 2023-12-17T11:56:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.115+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef4110e40 con 0x7efef40fcbf0 2023-12-17T11:56:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.116+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef4111380 con 0x7efef40fcbf0 2023-12-17T11:56:44.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.117+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef4101ea0 con 0x7efef40fcbf0 2023-12-17T11:56:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.118+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 19) v1 ==== 86445+0+0 (secure 0 0 0) 0x7efee4013420 con 0x7efef40fcbf0 2023-12-17T11:56:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.119+0000 7efedbfff700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efedc068f70 0x7efedc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.119+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efee40881e0 con 0x7efef40fcbf0 2023-12-17T11:56:44.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.119+0000 7efef2ffd700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efedc068f70 0x7efedc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:44.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.120+0000 7efef2ffd700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efedc068f70 0x7efedc06b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efee8009b10 tx=0x7efee8008040 comp rx=0 tx=0).ready entity=mgr.14218 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:44.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.124+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efee40580d0 con 0x7efef40fcbf0 2023-12-17T11:56:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.347+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 --> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efef4111770 con 0x7efedc068f70 2023-12-17T11:56:44.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.348+0000 7efedbfff700 1 -- 172.21.15.2:0/2537796676 <== mgr.14218 v2:172.21.15.2:6800/3359833978 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7efef4111770 con 0x7efedc068f70 2023-12-17T11:56:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "0/2 daemons upgraded", 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40 image on host smithi119", 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:56:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.350+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efedc068f70 msgr2=0x7efedc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.350+0000 7efefa186700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efedc068f70 0x7efedc06b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efee8009b10 tx=0x7efee8008040 comp rx=0 tx=0).stop 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.350+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 msgr2=0x7efef410f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.350+0000 7efefa186700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef410f7b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efee4009360 tx=0x7efee4009e30 comp rx=0 tx=0).stop 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 shutdown_connections 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:6800/3359833978,v1:172.21.15.2:6801/3359833978] conn(0x7efedc068f70 0x7efedc06b420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efef40fcbf0 0x7efef410f7b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 --2- 172.21.15.2:0/2537796676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efef40fde00 0x7efef410fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 >> 172.21.15.2:0/2537796676 conn(0x7efef40f82d0 msgr2=0x7efef40ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 shutdown_connections 2023-12-17T11:56:44.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:56:44.351+0000 7efefa186700 1 -- 172.21.15.2:0/2537796676 wait complete. 2023-12-17T11:56:44.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:44 smithi119 ceph-mon[117414]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:44.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:44 smithi119 ceph-mon[117414]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:44.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:44 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/122490246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:56:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:44 smithi002 ceph-mon[107131]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:44 smithi002 ceph-mon[107131]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:44 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/122490246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:56:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 62% (7576/12173) Updating files: 63% (7669/12173) Updating files: 64% (7791/12173) Updating files: 65% (7913/12173) Updating files: 66% (8035/12173) Updating files: 67% (8156/12173) Updating files: 68% (8278/12173) Updating files: 69% (8400/12173) Updating files: 70% (8522/12173) Updating files: 71% (8643/12173) Updating files: 72% (8765/12173) Updating files: 73% (8887/12173) Updating files: 74% (9009/12173) Updating files: 75% (9130/12173) Updating files: 76% (9252/12173) Updating files: 77% (9374/12173) Updating files: 78% (9495/12173) Updating files: 79% (9617/12173) Updating files: 80% (9739/12173) Updating files: 81% (9861/12173) Updating files: 82% (9982/12173) Updating files: 83% (10104/12173) Updating files: 84% (10226/12173) Updating files: 85% (10348/12173) Updating files: 86% (10469/12173) Updating files: 87% (10591/12173) Updating files: 88% (10713/12173) Updating files: 89% (10834/12173) Updating files: 90% (10956/12173) Updating files: 91% (11078/12173) Updating files: 92% (11200/12173) Updating files: 93% (11321/12173) Updating files: 94% (11443/12173) Updating files: 95% (11565/12173) Updating files: 96% (11687/12173) Updating files: 97% (11808/12173) Updating files: 98% (11930/12173) Updating files: 99% (12052/12173) Updating files: 100% (12173/12173) Updating files: 100% (12173/12173), done. 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to 'a62fda73efba5520d409bb5a21bd8373289dda5d'. 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.011 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: 2023-12-17T11:56:45.012 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at a62fda73efb Merge remote-tracking branch 'milind/mds-enqueue-all-child-frags-for-scrub-for-a-given-fragset' into rishabh-2023dec11 2023-12-17T11:56:45.017 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-17T11:56:45.069 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-17T11:56:45.075 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-17T11:56:45.075 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-17T11:56:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:45 smithi119 ceph-mon[117414]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:45 smithi119 ceph-mon[117414]: pgmap v207: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:45 smithi119 ceph-mon[117414]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:45.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:45 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:45 smithi002 ceph-mon[107131]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:45 smithi002 ceph-mon[107131]: pgmap v207: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:45 smithi002 ceph-mon[107131]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:45.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:45 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:56:45.706 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-17T11:56:45.796 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-17T11:56:45.862 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-17T11:56:45.866 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-17T11:56:45.866 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-17T11:56:45.932 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-17T11:56:45.939 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T11:56:45.939 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-17T11:56:45.986 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-17T11:56:45.987 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-17T11:56:45.987 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a62fda73efba5520d409bb5a21bd8373289dda5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-17T11:56:46.087 INFO:tasks.workunit.client.0.smithi002.stderr:+ mkdir -p fsstress 2023-12-17T11:56:46.090 INFO:tasks.workunit.client.0.smithi002.stderr:+ pushd fsstress 2023-12-17T11:56:46.091 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-17T11:56:46.091 INFO:tasks.workunit.client.0.smithi002.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-17T11:56:46.666 INFO:tasks.workunit.client.0.smithi002.stderr:+ tar xzf ltp-full.tgz 2023-12-17T11:56:47.398 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:47 smithi119 ceph-mon[117414]: pgmap v208: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:47.398 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:47 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:47.398 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:47 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:56:47.398 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:47 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:56:47.398 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:47 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:47 smithi002 ceph-mon[107131]: pgmap v208: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T11:56:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:47 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:47 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:56:47.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:47 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:56:47.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:47 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:48 smithi119 ceph-mon[117414]: Upgrade: Updating mgr.smithi119.nzblpy 2023-12-17T11:56:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:48 smithi119 ceph-mon[117414]: Deploying daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:56:48.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:48 smithi002 ceph-mon[107131]: Upgrade: Updating mgr.smithi119.nzblpy 2023-12-17T11:56:48.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:48 smithi002 ceph-mon[107131]: Deploying daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:56:49.285 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:49 smithi119 ceph-mon[117414]: pgmap v209: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-17T11:56:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:49 smithi002 ceph-mon[107131]: pgmap v209: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-17T11:56:51.356 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:51 smithi119 ceph-mon[117414]: pgmap v210: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-17T11:56:51.356 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:51 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:51.356 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:51 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:51.356 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:51 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:51.356 INFO:tasks.workunit.client.1.smithi119.stderr:Updating files: 60% (7367/12173) Updating files: 61% (7426/12173) Updating files: 62% (7548/12173) Updating files: 63% (7669/12173) Updating files: 64% (7791/12173) Updating files: 65% (7913/12173) Updating files: 66% (8035/12173) Updating files: 67% (8156/12173) Updating files: 68% (8278/12173) Updating files: 69% (8400/12173) Updating files: 70% (8522/12173) Updating files: 71% (8643/12173) Updating files: 72% (8765/12173) Updating files: 73% (8887/12173) Updating files: 74% (9009/12173) Updating files: 75% (9130/12173) Updating files: 76% (9252/12173) Updating files: 77% (9374/12173) Updating files: 78% (9495/12173) Updating files: 79% (9617/12173) Updating files: 80% (9739/12173) Updating files: 81% (9861/12173) Updating files: 82% (9982/12173) Updating files: 83% (10104/12173) Updating files: 84% (10226/12173) Updating files: 85% (10348/12173) Updating files: 86% (10469/12173) Updating files: 87% (10591/12173) Updating files: 88% (10713/12173) Updating files: 89% (10834/12173) Updating files: 90% (10956/12173) Updating files: 91% (11078/12173) Updating files: 92% (11200/12173) Updating files: 93% (11321/12173) Updating files: 94% (11443/12173) Updating files: 95% (11565/12173) Updating files: 95% (11585/12173) Updating files: 96% (11687/12173) Updating files: 97% (11808/12173) Updating files: 98% (11930/12173) Updating files: 99% (12052/12173) Updating files: 100% (12173/12173) Updating files: 100% (12173/12173), done. 2023-12-17T11:56:51.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:51 smithi002 ceph-mon[107131]: pgmap v210: 65 pgs: 65 active+clean; 598 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2023-12-17T11:56:51.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:51 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:51 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:51.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:51 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr:Note: switching to 'a62fda73efba5520d409bb5a21bd8373289dda5d'. 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr:state without impacting any branches by switching back to a branch. 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-17T11:56:51.833 INFO:tasks.workunit.client.1.smithi119.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: git switch -c 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr:Or undo this operation with: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: git switch - 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr: 2023-12-17T11:56:51.834 INFO:tasks.workunit.client.1.smithi119.stderr:HEAD is now at a62fda73efb Merge remote-tracking branch 'milind/mds-enqueue-all-child-frags-for-scrub-for-a-given-fragset' into rishabh-2023dec11 2023-12-17T11:56:51.840 DEBUG:teuthology.orchestra.run.smithi119:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-17T11:56:51.902 INFO:tasks.workunit.client.1.smithi119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-17T11:56:51.907 INFO:tasks.workunit.client.1.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-17T11:56:51.908 INFO:tasks.workunit.client.1.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-17T11:56:52.929 INFO:tasks.workunit.client.1.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-17T11:56:53.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:53 smithi119 ceph-mon[117414]: pgmap v211: 65 pgs: 65 active+clean; 8.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 KiB/s wr, 0 op/s 2023-12-17T11:56:53.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:53 smithi002 ceph-mon[107131]: pgmap v211: 65 pgs: 65 active+clean; 8.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 KiB/s wr, 0 op/s 2023-12-17T11:56:54.107 INFO:tasks.workunit.client.1.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-17T11:56:54.588 INFO:tasks.workunit.client.1.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-17T11:56:54.592 INFO:tasks.workunit.client.1.smithi119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-17T11:56:54.593 INFO:tasks.workunit.client.1.smithi119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-17T11:56:54.658 INFO:tasks.workunit.client.1.smithi119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-17T11:56:54.665 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T11:56:54.666 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-17T11:56:54.714 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-17T11:56:54.715 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-17T11:56:54.715 DEBUG:teuthology.orchestra.run.smithi119:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a62fda73efba5520d409bb5a21bd8373289dda5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-17T11:56:54.815 INFO:tasks.workunit.client.1.smithi119.stderr:+ mkdir -p fsstress 2023-12-17T11:56:54.819 INFO:tasks.workunit.client.1.smithi119.stderr:+ pushd fsstress 2023-12-17T11:56:54.820 INFO:tasks.workunit.client.1.smithi119.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-17T11:56:54.820 INFO:tasks.workunit.client.1.smithi119.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-17T11:56:54.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:54 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:54.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:54 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:54.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:54 smithi119 ceph-mon[117414]: pgmap v212: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s wr, 42 op/s 2023-12-17T11:56:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:54 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:54 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:54 smithi002 ceph-mon[107131]: pgmap v212: 65 pgs: 65 active+clean; 26 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s wr, 42 op/s 2023-12-17T11:56:55.604 INFO:tasks.workunit.client.1.smithi119.stderr:+ tar xzf ltp-full.tgz 2023-12-17T11:56:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:56.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:55 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:56.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:55 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:57.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:56 smithi002 ceph-mon[107131]: pgmap v213: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s wr, 60 op/s 2023-12-17T11:56:57.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:56 smithi119 ceph-mon[117414]: pgmap v213: 65 pgs: 65 active+clean; 31 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s wr, 60 op/s 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: pgmap v214: 65 pgs: 65 active+clean; 43 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 151 op/s 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr fail", "who": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: osdmap e48: 6 total, 6 up, 6 in 2023-12-17T11:56:59.220 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "mgr fail", "who": "smithi002.cqnuqs"}]': finished 2023-12-17T11:56:59.221 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:56:59 smithi002 ceph-mon[107131]: mgrmap e20: smithi119.nzblpy(active, starting, since 0.0100043s) 2023-12-17T11:56:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: pgmap v214: 65 pgs: 65 active+clean; 43 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 151 op/s 2023-12-17T11:56:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:56:59.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:56:59.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:59.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr fail", "who": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:56:59.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: osdmap e48: 6 total, 6 up, 6 in 2023-12-17T11:56:59.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: from='mgr.14218 172.21.15.2:0/3535940321' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "mgr fail", "who": "smithi002.cqnuqs"}]': finished 2023-12-17T11:56:59.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:56:59 smithi119 ceph-mon[117414]: mgrmap e20: smithi119.nzblpy(active, starting, since 0.0100043s) 2023-12-17T11:57:00.894 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: Active manager daemon smithi119.nzblpy restarted 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: Activating manager daemon smithi119.nzblpy 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: osdmap e49: 6 total, 6 up, 6 in 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: mgrmap e21: smithi119.nzblpy(active, starting, since 0.00743745s) 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T11:57:00.895 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: Manager daemon smithi119.nzblpy is now available 2023-12-17T11:57:00.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/trash_purge_schedule"}]: dispatch 2023-12-17T11:57:00.897 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:00 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/trash_purge_schedule"}]: dispatch 2023-12-17T11:57:00.958 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: Active manager daemon smithi119.nzblpy restarted 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: Activating manager daemon smithi119.nzblpy 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: osdmap e49: 6 total, 6 up, 6 in 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: mgrmap e21: smithi119.nzblpy(active, starting, since 0.00743745s) 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T11:57:00.959 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:00.960 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: Manager daemon smithi119.nzblpy is now available 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/trash_purge_schedule"}]: dispatch 2023-12-17T11:57:00.961 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:00 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi119.nzblpy/trash_purge_schedule"}]: dispatch 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: Deploying cephadm binary to smithi119 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: mgrmap e22: smithi119.nzblpy(active, since 1.01225s) 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: pgmap v3: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:02.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:01 smithi119 ceph-mon[117414]: Deploying cephadm binary to smithi002 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: Deploying cephadm binary to smithi119 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: mgrmap e22: smithi119.nzblpy(active, since 1.01225s) 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: pgmap v3: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:02.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:01 smithi002 ceph-mon[107131]: Deploying cephadm binary to smithi002 2023-12-17T11:57:03.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:02 smithi002 ceph-mon[107131]: [17/Dec/2023:11:57:01] ENGINE Bus STARTING 2023-12-17T11:57:03.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:02 smithi002 ceph-mon[107131]: [17/Dec/2023:11:57:01] ENGINE Serving on https://172.21.15.119:7150 2023-12-17T11:57:03.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:02 smithi002 ceph-mon[107131]: pgmap v4: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:03.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:02 smithi002 ceph-mon[107131]: [17/Dec/2023:11:57:01] ENGINE Serving on http://172.21.15.119:8765 2023-12-17T11:57:03.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:02 smithi002 ceph-mon[107131]: [17/Dec/2023:11:57:01] ENGINE Bus STARTED 2023-12-17T11:57:03.115 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:02 smithi002 ceph-mon[107131]: mgrmap e23: smithi119.nzblpy(active, since 2s) 2023-12-17T11:57:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:02 smithi119 ceph-mon[117414]: [17/Dec/2023:11:57:01] ENGINE Bus STARTING 2023-12-17T11:57:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:02 smithi119 ceph-mon[117414]: [17/Dec/2023:11:57:01] ENGINE Serving on https://172.21.15.119:7150 2023-12-17T11:57:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:02 smithi119 ceph-mon[117414]: pgmap v4: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:02 smithi119 ceph-mon[117414]: [17/Dec/2023:11:57:01] ENGINE Serving on http://172.21.15.119:8765 2023-12-17T11:57:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:02 smithi119 ceph-mon[117414]: [17/Dec/2023:11:57:01] ENGINE Bus STARTED 2023-12-17T11:57:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:02 smithi119 ceph-mon[117414]: mgrmap e23: smithi119.nzblpy(active, since 2s) 2023-12-17T11:57:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:04 smithi119 ceph-mon[117414]: pgmap v5: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:04 smithi119 ceph-mon[117414]: mgrmap e24: smithi119.nzblpy(active, since 4s) 2023-12-17T11:57:05.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:04 smithi002 ceph-mon[107131]: pgmap v5: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:05.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:04 smithi002 ceph-mon[107131]: mgrmap e24: smithi119.nzblpy(active, since 4s) 2023-12-17T11:57:07.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:06 smithi119 ceph-mon[117414]: pgmap v6: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:07.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:06 smithi002 ceph-mon[107131]: pgmap v6: 65 pgs: 65 active+clean; 79 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T11:57:09.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:08 smithi119 ceph-mon[117414]: pgmap v7: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 34 op/s 2023-12-17T11:57:09.175 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:08 smithi002 ceph-mon[107131]: pgmap v7: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 34 op/s 2023-12-17T11:57:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:10 smithi119 ceph-mon[117414]: pgmap v8: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-12-17T11:57:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:10 smithi119 ceph-mon[117414]: Standby manager daemon smithi002.cqnuqs started 2023-12-17T11:57:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:10 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/crt"}]: dispatch 2023-12-17T11:57:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:10 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:10 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/key"}]: dispatch 2023-12-17T11:57:10.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:10 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:10 smithi002 ceph-mon[107131]: pgmap v8: 65 pgs: 65 active+clean; 92 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.4 MiB/s wr, 26 op/s 2023-12-17T11:57:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:10 smithi002 ceph-mon[107131]: Standby manager daemon smithi002.cqnuqs started 2023-12-17T11:57:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:10 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/crt"}]: dispatch 2023-12-17T11:57:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:10 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:10 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/key"}]: dispatch 2023-12-17T11:57:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:10 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.2:0/392212183' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:11 smithi119 ceph-mon[117414]: mgrmap e25: smithi119.nzblpy(active, since 10s), standbys: smithi002.cqnuqs 2023-12-17T11:57:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:11 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:57:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:11 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:11 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:11 smithi002 ceph-mon[107131]: mgrmap e25: smithi119.nzblpy(active, since 10s), standbys: smithi002.cqnuqs 2023-12-17T11:57:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:11 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:57:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:11 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:11.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:11 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:12 smithi119 ceph-mon[117414]: pgmap v9: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-12-17T11:57:12.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:12 smithi002 ceph-mon[107131]: pgmap v9: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.7 MiB/s wr, 269 op/s 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi002 to 1620M 2023-12-17T11:57:14.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:13 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi002 to 1620M 2023-12-17T11:57:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:13 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.510+0000 7f6c98a2f700 1 -- 172.21.15.2:0/3734558267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 msgr2=0x7f6c94102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.510+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/3734558267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 0x7f6c94102230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c88004940 tx=0x7f6c88009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.510+0000 7f6c98a2f700 1 -- 172.21.15.2:0/3734558267 shutdown_connections 2023-12-17T11:57:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.511+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/3734558267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 0x7f6c94102230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.511+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/3734558267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c940ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.511+0000 7f6c98a2f700 1 -- 172.21.15.2:0/3734558267 >> 172.21.15.2:0/3734558267 conn(0x7f6c940f6f70 msgr2=0x7f6c940f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.511+0000 7f6c98a2f700 1 -- 172.21.15.2:0/3734558267 shutdown_connections 2023-12-17T11:57:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.511+0000 7f6c98a2f700 1 -- 172.21.15.2:0/3734558267 wait complete. 2023-12-17T11:57:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.512+0000 7f6c98a2f700 1 Processor -- start 2023-12-17T11:57:14.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.512+0000 7f6c98a2f700 1 -- start start 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c98a2f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c9410f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c98a2f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 0x7f6c9410f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c98a2f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9410ff50 con 0x7f6c940fd530 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c98a2f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c941107f0 con 0x7f6c940ffe50 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c9410f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c937fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c9410f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33876/0 (socket says 172.21.15.2:33876) 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c937fe700 1 -- 172.21.15.2:0/651595235 learned_addr learned my addr 172.21.15.2:0/651595235 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c92ffd700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 0x7f6c9410f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c937fe700 1 -- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 msgr2=0x7f6c9410f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c937fe700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 0x7f6c9410f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.513+0000 7f6c937fe700 1 -- 172.21.15.2:0/651595235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88005040 con 0x7f6c940fd530 2023-12-17T11:57:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.514+0000 7f6c937fe700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c9410f410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400eb40 tx=0x7f6c8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.514+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c84007cc0 con 0x7f6c940fd530 2023-12-17T11:57:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.514+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6c8400f040 con 0x7f6c940fd530 2023-12-17T11:57:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.514+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8400c990 con 0x7f6c940fd530 2023-12-17T11:57:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.514+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c94110a70 con 0x7f6c940fd530 2023-12-17T11:57:14.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.514+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94110fb0 con 0x7f6c940fd530 2023-12-17T11:57:14.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.516+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c940f8b30 con 0x7f6c940fd530 2023-12-17T11:57:14.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.518+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f6c8400caf0 con 0x7f6c940fd530 2023-12-17T11:57:14.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.519+0000 7f6c7bfff700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f6c7c06ae40 0x7f6c7c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:14.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.520+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6c84089390 con 0x7f6c940fd530 2023-12-17T11:57:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.520+0000 7f6c92ffd700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f6c7c06ae40 0x7f6c7c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:14.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.521+0000 7f6c92ffd700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f6c7c06ae40 0x7f6c7c06d2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6c88013600 tx=0x7f6c88009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:14.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.526+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6c8404ece0 con 0x7f6c940fd530 2023-12-17T11:57:14.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.807+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c9402b2a0 con 0x7f6c7c06ae40 2023-12-17T11:57:14.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.809+0000 7f6c7bfff700 1 -- 172.21.15.2:0/651595235 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6c9402b2a0 con 0x7f6c7c06ae40 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f6c7c06ae40 msgr2=0x7f6c7c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f6c7c06ae40 0x7f6c7c06d2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6c88013600 tx=0x7f6c88009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 msgr2=0x7f6c9410f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c9410f410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400eb40 tx=0x7f6c8400b040 comp rx=0 tx=0).stop 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 shutdown_connections 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f6c7c06ae40 0x7f6c7c06d2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c940fd530 0x7f6c9410f410 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 --2- 172.21.15.2:0/651595235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c940ffe50 0x7f6c9410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.811+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 >> 172.21.15.2:0/651595235 conn(0x7f6c940f6f70 msgr2=0x7f6c940fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.812+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 shutdown_connections 2023-12-17T11:57:14.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.812+0000 7f6c98a2f700 1 -- 172.21.15.2:0/651595235 wait complete. 2023-12-17T11:57:14.828 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:57:14.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.979+0000 7f91d3fff700 1 -- 172.21.15.2:0/4075792615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d4066090 msgr2=0x7f91d40ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:14.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.979+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4075792615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d4066090 0x7f91d40ff5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f91c4004940 tx=0x7f91c4009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:14.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.980+0000 7f91d3fff700 1 -- 172.21.15.2:0/4075792615 shutdown_connections 2023-12-17T11:57:14.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.980+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4075792615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d40ffb70 0x7f91d4101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.980+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4075792615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d4066090 0x7f91d40ff5a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.980+0000 7f91d3fff700 1 -- 172.21.15.2:0/4075792615 >> 172.21.15.2:0/4075792615 conn(0x7f91d40f6f70 msgr2=0x7f91d40f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:14.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.980+0000 7f91d3fff700 1 -- 172.21.15.2:0/4075792615 shutdown_connections 2023-12-17T11:57:14.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.980+0000 7f91d3fff700 1 -- 172.21.15.2:0/4075792615 wait complete. 2023-12-17T11:57:14.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.982+0000 7f91d3fff700 1 Processor -- start 2023-12-17T11:57:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.982+0000 7f91d3fff700 1 -- start start 2023-12-17T11:57:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.982+0000 7f91d3fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 0x7f91d40fd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.982+0000 7f91d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d40ffb70 0x7f91d40fb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.982+0000 7f91d3fff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40fbaa0 con 0x7f91d40ffb70 2023-12-17T11:57:14.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.982+0000 7f91d3fff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40fbc10 con 0x7f91d4066090 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d2ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 0x7f91d40fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d27fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d40ffb70 0x7f91d40fb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d2ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 0x7f91d40fd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:57570/0 (socket says 172.21.15.2:57570) 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d2ffd700 1 -- 172.21.15.2:0/4273381115 learned_addr learned my addr 172.21.15.2:0/4273381115 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d2ffd700 1 -- 172.21.15.2:0/4273381115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d40ffb70 msgr2=0x7f91d40fb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d2ffd700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d40ffb70 0x7f91d40fb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:14.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d2ffd700 1 -- 172.21.15.2:0/4273381115 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4005040 con 0x7f91d4066090 2023-12-17T11:57:14.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.983+0000 7f91d27fc700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d40ffb70 0x7f91d40fb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:57:14.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.984+0000 7f91d2ffd700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 0x7f91d40fd020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000c00 tx=0x7f91c4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:14.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.984+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c4021070 con 0x7f91d4066090 2023-12-17T11:57:14.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.984+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91c401c400 con 0x7f91d4066090 2023-12-17T11:57:14.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.984+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91c400e070 con 0x7f91d4066090 2023-12-17T11:57:14.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.984+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40fbe90 con 0x7f91d4066090 2023-12-17T11:57:14.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.984+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d41152d0 con 0x7f91d4066090 2023-12-17T11:57:14.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.985+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d41073e0 con 0x7f91d4066090 2023-12-17T11:57:14.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.987+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f91c401ca00 con 0x7f91d4066090 2023-12-17T11:57:14.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.988+0000 7f91bb7fe700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f91bc06ae40 0x7f91bc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.989+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f91c408a990 con 0x7f91d4066090 2023-12-17T11:57:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.989+0000 7f91d27fc700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f91bc06ae40 0x7f91bc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:14.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.990+0000 7f91d27fc700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f91bc06ae40 0x7f91bc06d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009b80 tx=0x7f91c800b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:14.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:14.994+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f91c4058860 con 0x7f91d4066090 2023-12-17T11:57:15.090 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:14 smithi119 ceph-mon[117414]: pgmap v10: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 246 op/s 2023-12-17T11:57:15.090 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:14 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:15.090 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:14 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:15.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:14 smithi002 ceph-mon[107131]: pgmap v10: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 246 op/s 2023-12-17T11:57:15.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:14 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:15.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:14 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.290+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91d402b1f0 con 0x7f91bc06ae40 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.291+0000 7f91bb7fe700 1 -- 172.21.15.2:0/4273381115 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f91d402b1f0 con 0x7f91bc06ae40 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.293+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f91bc06ae40 msgr2=0x7f91bc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.293+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f91bc06ae40 0x7f91bc06d2f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009b80 tx=0x7f91c800b040 comp rx=0 tx=0).stop 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.293+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 msgr2=0x7f91d40fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.293+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 0x7f91d40fd020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f91c4000c00 tx=0x7f91c4009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 shutdown_connections 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f91bc06ae40 0x7f91bc06d2f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91d4066090 0x7f91d40fd020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 --2- 172.21.15.2:0/4273381115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91d40ffb70 0x7f91d40fb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 >> 172.21.15.2:0/4273381115 conn(0x7f91d40f6f70 msgr2=0x7f91d40f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:15.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 shutdown_connections 2023-12-17T11:57:15.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.294+0000 7f91d3fff700 1 -- 172.21.15.2:0/4273381115 wait complete. 2023-12-17T11:57:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 -- 172.21.15.2:0/398812859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fcbf0 msgr2=0x7f23ec0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 --2- 172.21.15.2:0/398812859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fcbf0 0x7f23ec0fd000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f23e8004940 tx=0x7f23e8009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:15.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 -- 172.21.15.2:0/398812859 shutdown_connections 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 --2- 172.21.15.2:0/398812859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23ec0fde00 0x7f23ec0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 --2- 172.21.15.2:0/398812859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fcbf0 0x7f23ec0fd000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 -- 172.21.15.2:0/398812859 >> 172.21.15.2:0/398812859 conn(0x7f23ec0f82d0 msgr2=0x7f23ec0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 -- 172.21.15.2:0/398812859 shutdown_connections 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.456+0000 7f23f3586700 1 -- 172.21.15.2:0/398812859 wait complete. 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.457+0000 7f23f3586700 1 Processor -- start 2023-12-17T11:57:15.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.457+0000 7f23f3586700 1 -- start start 2023-12-17T11:57:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f3586700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23ec0fcbf0 0x7f23ec071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f3586700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 0x7f23ec06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f3586700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec070590 con 0x7f23ec0fde00 2023-12-17T11:57:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f3586700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec070700 con 0x7f23ec0fcbf0 2023-12-17T11:57:15.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f0b21700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 0x7f23ec06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f0b21700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 0x7f23ec06ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33912/0 (socket says 172.21.15.2:33912) 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f0b21700 1 -- 172.21.15.2:0/2189938235 learned_addr learned my addr 172.21.15.2:0/2189938235 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f1322700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23ec0fcbf0 0x7f23ec071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f0b21700 1 -- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23ec0fcbf0 msgr2=0x7f23ec071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f0b21700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23ec0fcbf0 0x7f23ec071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.458+0000 7f23f0b21700 1 -- 172.21.15.2:0/2189938235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8005040 con 0x7f23ec0fde00 2023-12-17T11:57:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.459+0000 7f23f0b21700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 0x7f23ec06ff90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00eb40 tx=0x7f23dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:15.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.459+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23dc007cc0 con 0x7f23ec0fde00 2023-12-17T11:57:15.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.459+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23dc00f040 con 0x7f23ec0fde00 2023-12-17T11:57:15.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.459+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23dc00c910 con 0x7f23ec0fde00 2023-12-17T11:57:15.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.459+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec070980 con 0x7f23ec0fde00 2023-12-17T11:57:15.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.459+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec115500 con 0x7f23ec0fde00 2023-12-17T11:57:15.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.460+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec04bb80 con 0x7f23ec0fde00 2023-12-17T11:57:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.462+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f23dc0090d0 con 0x7f23ec0fde00 2023-12-17T11:57:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.463+0000 7f23e1ffb700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f23d806ae90 0x7f23d806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.463+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f23dc089370 con 0x7f23ec0fde00 2023-12-17T11:57:15.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.464+0000 7f23f1322700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f23d806ae90 0x7f23d806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.465+0000 7f23f1322700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f23d806ae90 0x7f23d806d340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0718a0 tx=0x7f23e8009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.468+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f23dc04ece0 con 0x7f23ec0fde00 2023-12-17T11:57:15.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.727+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f23ec102750 con 0x7f23d806ae90 2023-12-17T11:57:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.740+0000 7f23e1ffb700 1 -- 172.21.15.2:0/2189938235 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f23ec102750 con 0x7f23d806ae90 2023-12-17T11:57:15.742 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:57:15.742 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 4s ago 6m 14.5M - 0.25.0 c8568f914cd2 ede7a91db214 2023-12-17T11:57:15.742 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (7m) 4s ago 7m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (6m) 3s ago 6m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 4s ago 6m 78.4M - 9.4.7 954c08fa6188 43eb0083cc6a 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (2m) 4s ago 2m 1560M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (2m) 4s ago 2m 13.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (2m) 3s ago 2m 143M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (2m) 3s ago 2m 12.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:9283 running (8m) 4s ago 8m 355M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ae71c0243acd 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283 running (25s) 3s ago 5m 495M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 22ff493c069a 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (8m) 4s ago 8m 81.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (5m) 3s ago 5m 56.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 4s ago 7m 9445k - 1.5.0 0da6a335fe13 5a889148dac0 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 3s ago 5m 8845k - 1.5.0 0da6a335fe13 db4c4aade2ec 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 4s ago 5m 137M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:57:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (4m) 4s ago 4m 143M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:57:15.744 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (4m) 4s ago 4m 120M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:57:15.744 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (4m) 3s ago 4m 139M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:57:15.744 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (3m) 3s ago 3m 119M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:57:15.744 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (3m) 3s ago 3m 132M 5373M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:57:15.744 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 4s ago 6m 49.1M - 2.43.0 a07b618ecd1d 29a015410237 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f23d806ae90 msgr2=0x7f23d806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f23d806ae90 0x7f23d806d340 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0718a0 tx=0x7f23e8009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 msgr2=0x7f23ec06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 0x7f23ec06ff90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00eb40 tx=0x7f23dc00b040 comp rx=0 tx=0).stop 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 shutdown_connections 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f23d806ae90 0x7f23d806d340 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23ec0fcbf0 0x7f23ec071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 --2- 172.21.15.2:0/2189938235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f23ec0fde00 0x7f23ec06ff90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 >> 172.21.15.2:0/2189938235 conn(0x7f23ec0f82d0 msgr2=0x7f23ec101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 shutdown_connections 2023-12-17T11:57:15.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.744+0000 7f23f3586700 1 -- 172.21.15.2:0/2189938235 wait complete. 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.897+0000 7f3a4f59e700 1 -- 172.21.15.2:0/2942605282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50071b60 msgr2=0x7f3a5006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.897+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/2942605282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50071b60 0x7f3a5006ffd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a40004940 tx=0x7f3a40009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.897+0000 7f3a4f59e700 1 -- 172.21.15.2:0/2942605282 shutdown_connections 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.897+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/2942605282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50070510 0x7f3a50070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.897+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/2942605282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50071b60 0x7f3a5006ffd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.897+0000 7f3a4f59e700 1 -- 172.21.15.2:0/2942605282 >> 172.21.15.2:0/2942605282 conn(0x7f3a500f8100 msgr2=0x7f3a500fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.898+0000 7f3a4f59e700 1 -- 172.21.15.2:0/2942605282 shutdown_connections 2023-12-17T11:57:15.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.898+0000 7f3a4f59e700 1 -- 172.21.15.2:0/2942605282 wait complete. 2023-12-17T11:57:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4f59e700 1 Processor -- start 2023-12-17T11:57:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4f59e700 1 -- start start 2023-12-17T11:57:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4f59e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50070510 0x7f3a5010f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4f59e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 0x7f3a5010f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4f59e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5010ffd0 con 0x7f3a50071b60 2023-12-17T11:57:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4f59e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a50110870 con 0x7f3a50070510 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.899+0000 7f3a4dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 0x7f3a5010f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 0x7f3a5010f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33928/0 (socket says 172.21.15.2:33928) 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4dd9b700 1 -- 172.21.15.2:0/4051782105 learned_addr learned my addr 172.21.15.2:0/4051782105 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4e59c700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50070510 0x7f3a5010f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4dd9b700 1 -- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50070510 msgr2=0x7f3a5010f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4dd9b700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50070510 0x7f3a5010f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4dd9b700 1 -- 172.21.15.2:0/4051782105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40005040 con 0x7f3a50071b60 2023-12-17T11:57:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.900+0000 7f3a4dd9b700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 0x7f3a5010f9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400eb40 tx=0x7f3a4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.901+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a44007cc0 con 0x7f3a50071b60 2023-12-17T11:57:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.901+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50110af0 con 0x7f3a50071b60 2023-12-17T11:57:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.901+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a4400f040 con 0x7f3a50071b60 2023-12-17T11:57:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.901+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a4400c990 con 0x7f3a50071b60 2023-12-17T11:57:15.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.901+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a50111030 con 0x7f3a50071b60 2023-12-17T11:57:15.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.902+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5004bb80 con 0x7f3a50071b60 2023-12-17T11:57:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.903+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f3a4400cc00 con 0x7f3a50071b60 2023-12-17T11:57:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.904+0000 7f3a3effd700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f3a3806ae40 0x7f3a3806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:15.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.904+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3a440894c0 con 0x7f3a50071b60 2023-12-17T11:57:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.905+0000 7f3a4e59c700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f3a3806ae40 0x7f3a3806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:15.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.906+0000 7f3a4e59c700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f3a3806ae40 0x7f3a3806d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a40013680 tx=0x7f3a40009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:15.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:15.909+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3a4404ece0 con 0x7f3a50071b60 2023-12-17T11:57:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:15 smithi119 ceph-mon[117414]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:15 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:16.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:15 smithi002 ceph-mon[107131]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:16.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:15 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.257+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a50111310 con 0x7f3a50071b60 2023-12-17T11:57:16.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.258+0000 7f3a3effd700 1 -- 172.21.15.2:0/4051782105 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f3a44057220 con 0x7f3a50071b60 2023-12-17T11:57:16.260 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:57:16.260 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:57:16.260 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-17T11:57:16.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T11:57:16.262 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:57:16.262 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:57:16.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f3a3806ae40 msgr2=0x7f3a3806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f3a3806ae40 0x7f3a3806d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a40013680 tx=0x7f3a40009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 msgr2=0x7f3a5010f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 0x7f3a5010f9d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400eb40 tx=0x7f3a4400b040 comp rx=0 tx=0).stop 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 shutdown_connections 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f3a3806ae40 0x7f3a3806d2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a50070510 0x7f3a5010f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 --2- 172.21.15.2:0/4051782105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a50071b60 0x7f3a5010f9d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.261+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 >> 172.21.15.2:0/4051782105 conn(0x7f3a500f8100 msgr2=0x7f3a50102930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.262+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 shutdown_connections 2023-12-17T11:57:16.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.262+0000 7f3a4f59e700 1 -- 172.21.15.2:0/4051782105 wait complete. 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.417+0000 7f9e6178f700 1 -- 172.21.15.2:0/4140631167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0fec60 msgr2=0x7f9e5c0ff070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.417+0000 7f9e6178f700 1 --2- 172.21.15.2:0/4140631167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c0ff070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c004940 tx=0x7f9e4c009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.417+0000 7f9e6178f700 1 -- 172.21.15.2:0/4140631167 shutdown_connections 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.417+0000 7f9e6178f700 1 --2- 172.21.15.2:0/4140631167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0ffe70 0x7f9e5c1002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.417+0000 7f9e6178f700 1 --2- 172.21.15.2:0/4140631167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c0ff070 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.417+0000 7f9e6178f700 1 -- 172.21.15.2:0/4140631167 >> 172.21.15.2:0/4140631167 conn(0x7f9e5c0fa410 msgr2=0x7f9e5c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:16.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.418+0000 7f9e6178f700 1 -- 172.21.15.2:0/4140631167 shutdown_connections 2023-12-17T11:57:16.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.418+0000 7f9e6178f700 1 -- 172.21.15.2:0/4140631167 wait complete. 2023-12-17T11:57:16.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.419+0000 7f9e6178f700 1 Processor -- start 2023-12-17T11:57:16.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.419+0000 7f9e6178f700 1 -- start start 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.419+0000 7f9e6178f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c10f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e6178f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0ffe70 0x7f9e5c10fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e6178f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c110020 con 0x7f9e5c0fec60 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e6178f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c1108c0 con 0x7f9e5c0ffe70 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c10f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5b7fe700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0ffe70 0x7f9e5c10fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c10f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33940/0 (socket says 172.21.15.2:33940) 2023-12-17T11:57:16.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5bfff700 1 -- 172.21.15.2:0/3790341858 learned_addr learned my addr 172.21.15.2:0/3790341858 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5bfff700 1 -- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0ffe70 msgr2=0x7f9e5c10fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5bfff700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0ffe70 0x7f9e5c10fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5bfff700 1 -- 172.21.15.2:0/3790341858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c005040 con 0x7f9e5c0fec60 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.420+0000 7f9e5b7fe700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0ffe70 0x7f9e5c10fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.421+0000 7f9e5bfff700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c10f4e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c008f80 tx=0x7f9e4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.421+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4c021070 con 0x7f9e5c0fec60 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.421+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e4c01c400 con 0x7f9e5c0fec60 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.421+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4c00e070 con 0x7f9e5c0fec60 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.421+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5c110b40 con 0x7f9e5c0fec60 2023-12-17T11:57:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.422+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c111020 con 0x7f9e5c0fec60 2023-12-17T11:57:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.423+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c04bb80 con 0x7f9e5c0fec60 2023-12-17T11:57:16.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.425+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f9e4c01c950 con 0x7f9e5c0fec60 2023-12-17T11:57:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.427+0000 7f9e58ff9700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f9e4406ae40 0x7f9e4406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:16.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.427+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9e4c08a9c0 con 0x7f9e5c0fec60 2023-12-17T11:57:16.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.428+0000 7f9e5b7fe700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f9e4406ae40 0x7f9e4406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.428+0000 7f9e5b7fe700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f9e4406ae40 0x7f9e4406d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009b80 tx=0x7f9e5000b040 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:16.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.432+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f9e4c058770 con 0x7f9e5c0fec60 2023-12-17T11:57:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.695+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e5c111550 con 0x7f9e4406ae40 2023-12-17T11:57:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.696+0000 7f9e58ff9700 1 -- 172.21.15.2:0/3790341858 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f9e5c111550 con 0x7f9e4406ae40 2023-12-17T11:57:16.698 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:57:16.698 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "1/2 daemons upgraded", 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:57:16.699 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.698+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f9e4406ae40 msgr2=0x7f9e4406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.698+0000 7f9e6178f700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f9e4406ae40 0x7f9e4406d2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009b80 tx=0x7f9e5000b040 comp rx=0 tx=0).stop 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.698+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 msgr2=0x7f9e5c10f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.698+0000 7f9e6178f700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c10f4e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c008f80 tx=0x7f9e4c009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 shutdown_connections 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f9e4406ae40 0x7f9e4406d2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e5c0fec60 0x7f9e5c10f4e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 --2- 172.21.15.2:0/3790341858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e5c0ffe70 0x7f9e5c10fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 >> 172.21.15.2:0/3790341858 conn(0x7f9e5c0fa410 msgr2=0x7f9e5c1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 shutdown_connections 2023-12-17T11:57:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:16.699+0000 7f9e6178f700 1 -- 172.21.15.2:0/3790341858 wait complete. 2023-12-17T11:57:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:16 smithi119 ceph-mon[117414]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:16 smithi119 ceph-mon[117414]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:16 smithi119 ceph-mon[117414]: pgmap v11: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 246 op/s 2023-12-17T11:57:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:16 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/4051782105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:57:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:16 smithi002 ceph-mon[107131]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:16 smithi002 ceph-mon[107131]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:16 smithi002 ceph-mon[107131]: pgmap v11: 65 pgs: 65 active+clean; 117 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 246 op/s 2023-12-17T11:57:17.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:16 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4051782105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:57:18.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:17 smithi119 ceph-mon[117414]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:18.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:17 smithi002 ceph-mon[107131]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:19.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:18 smithi119 ceph-mon[117414]: pgmap v12: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 5.8 MiB/s wr, 459 op/s 2023-12-17T11:57:19.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:18 smithi002 ceph-mon[107131]: pgmap v12: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 5.8 MiB/s wr, 459 op/s 2023-12-17T11:57:20.885 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:20 smithi119 ceph-mon[117414]: pgmap v13: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 439 op/s 2023-12-17T11:57:20.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:20 smithi002 ceph-mon[107131]: pgmap v13: 65 pgs: 65 active+clean; 145 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 439 op/s 2023-12-17T11:57:21.181 INFO:tasks.workunit.client.0.smithi002.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-17T11:57:21.192 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-17T11:57:21.192 INFO:tasks.workunit.client.0.smithi002.stderr:+ make 2023-12-17T11:57:21.292 INFO:tasks.workunit.client.0.smithi002.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: Adjusting osd_memory_target on smithi119 to 2642M 2023-12-17T11:57:21.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:21.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:21.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:21.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:57:21.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:21 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:57:21.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: Adjusting osd_memory_target on smithi119 to 2642M 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:57:21.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:21 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:57:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:22 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:22 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:22 smithi119 ceph-mon[117414]: pgmap v14: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s wr, 721 op/s 2023-12-17T11:57:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:22 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:22.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:22 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:22.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:22 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:22.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:22 smithi002 ceph-mon[107131]: pgmap v14: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 8.2 MiB/s wr, 721 op/s 2023-12-17T11:57:22.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:22 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:24.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:24 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:24.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:24 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:24.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:24 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:24 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:24 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:24 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:24.599 INFO:tasks.workunit.client.1.smithi119.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-17T11:57:24.599 INFO:tasks.workunit.client.1.smithi119.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-17T11:57:24.599 INFO:tasks.workunit.client.1.smithi119.stderr:+ make 2023-12-17T11:57:24.664 INFO:tasks.workunit.client.1.smithi119.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-17T11:57:24.990 INFO:tasks.workunit.client.1.smithi119.stderr:++ readlink -f fsstress 2023-12-17T11:57:24.991 INFO:tasks.workunit.client.1.smithi119.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-17T11:57:24.991 INFO:tasks.workunit.client.1.smithi119.stderr:+ popd 2023-12-17T11:57:24.992 INFO:tasks.workunit.client.1.smithi119.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-17T11:57:24.992 INFO:tasks.workunit.client.1.smithi119.stderr:+ popd 2023-12-17T11:57:24.992 INFO:tasks.workunit.client.1.smithi119.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-17T11:57:24.992 INFO:tasks.workunit.client.1.smithi119.stderr:++ mktemp -d -p . 2023-12-17T11:57:24.995 INFO:tasks.workunit.client.1.smithi119.stderr:+ T=./tmp.wYjjqJzn2L 2023-12-17T11:57:24.995 INFO:tasks.workunit.client.1.smithi119.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.wYjjqJzn2L -l 1 -n 1000 -p 10 -v 2023-12-17T11:57:24.998 INFO:tasks.workunit.client.1.smithi119.stdout:seed = 1701959055 2023-12-17T11:57:25.002 INFO:tasks.workunit.client.1.smithi119.stdout:0/0: creat f0 x:0 0 0 2023-12-17T11:57:25.002 INFO:tasks.workunit.client.1.smithi119.stdout:0/1: write f0 [281291,130140] 0 2023-12-17T11:57:25.008 INFO:tasks.workunit.client.1.smithi119.stdout:1/0: creat f0 x:0 0 0 2023-12-17T11:57:25.014 INFO:tasks.workunit.client.1.smithi119.stdout:4/0: rmdir - no directory 2023-12-17T11:57:25.014 INFO:tasks.workunit.client.1.smithi119.stdout:3/0: creat f0 x:0 0 0 2023-12-17T11:57:25.014 INFO:tasks.workunit.client.1.smithi119.stdout:3/1: creat f1 x:0 0 0 2023-12-17T11:57:25.023 INFO:tasks.workunit.client.1.smithi119.stdout:5/0: link - no file 2023-12-17T11:57:25.024 INFO:tasks.workunit.client.1.smithi119.stdout:5/1: fsync - no filename 2023-12-17T11:57:25.025 INFO:tasks.workunit.client.1.smithi119.stdout:4/1: creat f0 x:0 0 0 2023-12-17T11:57:25.025 INFO:tasks.workunit.client.1.smithi119.stdout:4/2: truncate f0 824381 0 2023-12-17T11:57:25.035 INFO:tasks.workunit.client.1.smithi119.stdout:5/2: mknod c0 0 2023-12-17T11:57:25.035 INFO:tasks.workunit.client.1.smithi119.stdout:5/3: read - no filename 2023-12-17T11:57:25.036 INFO:tasks.workunit.client.1.smithi119.stdout:5/4: dwrite - no filename 2023-12-17T11:57:25.038 INFO:tasks.workunit.client.1.smithi119.stdout:5/5: mkdir d1 0 2023-12-17T11:57:25.039 INFO:tasks.workunit.client.1.smithi119.stdout:7/0: getdents . 0 2023-12-17T11:57:25.039 INFO:tasks.workunit.client.1.smithi119.stdout:7/1: dread - no filename 2023-12-17T11:57:25.039 INFO:tasks.workunit.client.1.smithi119.stdout:7/2: chown . 5 1 2023-12-17T11:57:25.039 INFO:tasks.workunit.client.1.smithi119.stdout:7/3: dread - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/4: fdatasync - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/5: dwrite - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/6: fsync - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/7: rename - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/8: dwrite - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/9: rmdir - no directory 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:7/10: dwrite - no filename 2023-12-17T11:57:25.040 INFO:tasks.workunit.client.1.smithi119.stdout:6/0: mknod c0 0 2023-12-17T11:57:25.041 INFO:tasks.workunit.client.1.smithi119.stdout:7/11: mknod c0 0 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:7/12: chown c0 241278908 1 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:7/13: dread - no filename 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:7/14: dwrite - no filename 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:7/15: dwrite - no filename 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:7/16: fdatasync - no filename 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:5/6: mknod d1/c2 0 2023-12-17T11:57:25.042 INFO:tasks.workunit.client.1.smithi119.stdout:5/7: dwrite - no filename 2023-12-17T11:57:25.054 INFO:tasks.workunit.client.1.smithi119.stdout:6/1: rename c0 to c1 0 2023-12-17T11:57:25.054 INFO:tasks.workunit.client.1.smithi119.stdout:7/17: creat f1 x:0 0 0 2023-12-17T11:57:25.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/8: rmdir d1 39 2023-12-17T11:57:25.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/9: stat d1/c2 0 2023-12-17T11:57:25.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/10: dread - no filename 2023-12-17T11:57:25.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/11: dwrite - no filename 2023-12-17T11:57:25.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/12: write - no filename 2023-12-17T11:57:25.055 INFO:tasks.workunit.client.1.smithi119.stdout:8/0: symlink l0 0 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/1: truncate - no filename 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/2: dread - no filename 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/3: dread - no filename 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/4: rmdir - no directory 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/5: write - no filename 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/6: rmdir - no directory 2023-12-17T11:57:25.056 INFO:tasks.workunit.client.1.smithi119.stdout:8/7: readlink l0 0 2023-12-17T11:57:25.064 INFO:tasks.workunit.client.1.smithi119.stdout:7/18: mkdir d2 0 2023-12-17T11:57:25.064 INFO:tasks.workunit.client.1.smithi119.stdout:7/19: chown d2 0 1 2023-12-17T11:57:25.064 INFO:tasks.workunit.client.1.smithi119.stdout:7/20: readlink - no filename 2023-12-17T11:57:25.064 INFO:tasks.workunit.client.1.smithi119.stdout:9/0: creat f0 x:0 0 0 2023-12-17T11:57:25.064 INFO:tasks.workunit.client.1.smithi119.stdout:5/13: creat d1/f3 x:0 0 0 2023-12-17T11:57:25.064 INFO:tasks.workunit.client.1.smithi119.stdout:9/1: truncate f0 526418 0 2023-12-17T11:57:25.065 INFO:tasks.workunit.client.1.smithi119.stdout:9/2: chown f0 0 1 2023-12-17T11:57:25.081 INFO:tasks.workunit.client.1.smithi119.stdout:9/3: unlink f0 0 2023-12-17T11:57:25.081 INFO:tasks.workunit.client.1.smithi119.stdout:9/4: dread - no filename 2023-12-17T11:57:25.109 INFO:tasks.workunit.client.1.smithi119.stdout:9/5: mknod c1 0 2023-12-17T11:57:25.191 INFO:tasks.workunit.client.1.smithi119.stdout:4/3: dread f0 [0,4194304] 0 2023-12-17T11:57:25.192 INFO:tasks.workunit.client.1.smithi119.stdout:4/4: creat f1 x:0 0 0 2023-12-17T11:57:25.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:25 smithi119 ceph-mon[117414]: pgmap v15: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 494 op/s 2023-12-17T11:57:25.429 INFO:tasks.workunit.client.1.smithi119.stdout:3/2: dwrite f0 [0,4194304] 0 2023-12-17T11:57:25.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:25 smithi002 ceph-mon[107131]: pgmap v15: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 494 op/s 2023-12-17T11:57:26.186 INFO:tasks.workunit.client.1.smithi119.stdout:3/3: link f0 f2 0 2023-12-17T11:57:26.303 INFO:tasks.workunit.client.1.smithi119.stdout:7/21: dwrite f1 [0,4194304] 0 2023-12-17T11:57:26.830 INFO:tasks.workunit.client.1.smithi119.stdout:0/2: dwrite f0 [0,4194304] 0 2023-12-17T11:57:26.830 INFO:tasks.workunit.client.1.smithi119.stdout:0/3: creat f1 x:0 0 0 2023-12-17T11:57:26.830 INFO:tasks.workunit.client.1.smithi119.stdout:0/4: truncate f1 164258 0 2023-12-17T11:57:26.845 INFO:tasks.workunit.client.1.smithi119.stdout:0/5: dread f0 [0,4194304] 0 2023-12-17T11:57:26.913 INFO:tasks.workunit.client.1.smithi119.stdout:3/4: dread f0 [0,4194304] 0 2023-12-17T11:57:26.913 INFO:tasks.workunit.client.1.smithi119.stdout:3/5: truncate f1 669783 0 2023-12-17T11:57:27.018 INFO:tasks.workunit.client.1.smithi119.stdout:0/6: fsync f0 0 2023-12-17T11:57:27.058 INFO:tasks.workunit.client.1.smithi119.stdout:0/7: dwrite f1 [0,4194304] 0 2023-12-17T11:57:27.059 INFO:tasks.workunit.client.1.smithi119.stdout:5/14: fsync d1/f3 0 2023-12-17T11:57:27.059 INFO:tasks.workunit.client.1.smithi119.stdout:5/15: chown d1/c2 162 1 2023-12-17T11:57:27.059 INFO:tasks.workunit.client.1.smithi119.stdout:5/16: truncate d1/f3 364815 0 2023-12-17T11:57:27.059 INFO:tasks.workunit.client.1.smithi119.stdout:5/17: fsync d1/f3 0 2023-12-17T11:57:27.060 INFO:tasks.workunit.client.1.smithi119.stdout:5/18: chown c0 4836379 1 2023-12-17T11:57:27.065 INFO:tasks.workunit.client.1.smithi119.stdout:7/22: dwrite f1 [0,4194304] 0 2023-12-17T11:57:27.090 INFO:tasks.workunit.client.1.smithi119.stdout:9/6: getdents . 0 2023-12-17T11:57:27.252 INFO:tasks.workunit.client.1.smithi119.stdout:4/5: getdents . 0 2023-12-17T11:57:27.252 INFO:tasks.workunit.client.1.smithi119.stdout:4/6: fsync f0 0 2023-12-17T11:57:27.299 INFO:tasks.workunit.client.1.smithi119.stdout:4/7: dwrite f1 [0,4194304] 0 2023-12-17T11:57:27.314 INFO:tasks.workunit.client.1.smithi119.stdout:4/8: dread f1 [0,4194304] 0 2023-12-17T11:57:27.314 INFO:tasks.workunit.client.1.smithi119.stdout:4/9: getdents . 0 2023-12-17T11:57:27.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:27 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:27.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:27 smithi119 ceph-mon[117414]: pgmap v16: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 494 op/s 2023-12-17T11:57:27.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:27 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:27.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:27 smithi002 ceph-mon[107131]: pgmap v16: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s wr, 494 op/s 2023-12-17T11:57:27.758 INFO:tasks.workunit.client.0.smithi002.stderr:++ readlink -f fsstress 2023-12-17T11:57:27.759 INFO:tasks.workunit.client.0.smithi002.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-17T11:57:27.759 INFO:tasks.workunit.client.0.smithi002.stderr:+ popd 2023-12-17T11:57:27.762 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-17T11:57:27.763 INFO:tasks.workunit.client.0.smithi002.stderr:+ popd 2023-12-17T11:57:27.763 INFO:tasks.workunit.client.0.smithi002.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-17T11:57:27.763 INFO:tasks.workunit.client.0.smithi002.stderr:++ mktemp -d -p . 2023-12-17T11:57:27.767 INFO:tasks.workunit.client.0.smithi002.stderr:+ T=./tmp.zCoIgMnCl9 2023-12-17T11:57:27.767 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.zCoIgMnCl9 -l 1 -n 1000 -p 10 -v 2023-12-17T11:57:27.844 INFO:tasks.workunit.client.0.smithi002.stdout:seed = 1701985597 2023-12-17T11:57:27.850 INFO:tasks.workunit.client.0.smithi002.stdout:9/0: write - no filename 2023-12-17T11:57:27.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/0: mkdir d0 0 2023-12-17T11:57:27.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/1: chown d0 1 1 2023-12-17T11:57:27.851 INFO:tasks.workunit.client.0.smithi002.stdout:0/2: truncate - no filename 2023-12-17T11:57:27.851 INFO:tasks.workunit.client.0.smithi002.stdout:0/3: chown d0 1479 1 2023-12-17T11:57:27.851 INFO:tasks.workunit.client.0.smithi002.stdout:0/4: write - no filename 2023-12-17T11:57:27.851 INFO:tasks.workunit.client.0.smithi002.stdout:0/5: stat d0 0 2023-12-17T11:57:27.880 INFO:tasks.workunit.client.0.smithi002.stdout:1/0: truncate - no filename 2023-12-17T11:57:27.880 INFO:tasks.workunit.client.0.smithi002.stdout:1/1: dread - no filename 2023-12-17T11:57:27.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/1: creat f0 x:0 0 0 2023-12-17T11:57:27.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/2: read - f0 zero size 2023-12-17T11:57:27.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/3: dread - f0 zero size 2023-12-17T11:57:27.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/4: creat f1 x:0 0 0 2023-12-17T11:57:27.881 INFO:tasks.workunit.client.0.smithi002.stdout:9/5: dread - f0 zero size 2023-12-17T11:57:27.881 INFO:tasks.workunit.client.0.smithi002.stdout:9/6: write f1 [113379,86860] 0 2023-12-17T11:57:27.881 INFO:tasks.workunit.client.0.smithi002.stdout:9/7: stat f0 0 2023-12-17T11:57:27.881 INFO:tasks.workunit.client.0.smithi002.stdout:0/6: mknod d0/c1 0 2023-12-17T11:57:27.881 INFO:tasks.workunit.client.0.smithi002.stdout:1/2: mknod c0 0 2023-12-17T11:57:27.882 INFO:tasks.workunit.client.0.smithi002.stdout:0/7: rename d0/c1 to d0/c2 0 2023-12-17T11:57:27.884 INFO:tasks.workunit.client.0.smithi002.stdout:2/0: creat f0 x:0 0 0 2023-12-17T11:57:27.884 INFO:tasks.workunit.client.0.smithi002.stdout:2/1: creat f1 x:0 0 0 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/0: dread - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/1: write - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/2: unlink - no file 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/3: chown . 16 1 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/4: fsync - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/5: dwrite - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/6: dwrite - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/7: chown . 1334470 1 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/8: rename - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/9: unlink - no file 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/10: dread - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/11: write - no filename 2023-12-17T11:57:27.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/12: dwrite - no filename 2023-12-17T11:57:27.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/13: dread - no filename 2023-12-17T11:57:27.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/14: dwrite - no filename 2023-12-17T11:57:27.887 INFO:tasks.workunit.client.0.smithi002.stdout:4/15: dwrite - no filename 2023-12-17T11:57:27.888 INFO:tasks.workunit.client.0.smithi002.stdout:3/0: mknod c0 0 2023-12-17T11:57:27.888 INFO:tasks.workunit.client.0.smithi002.stdout:3/1: write - no filename 2023-12-17T11:57:27.888 INFO:tasks.workunit.client.0.smithi002.stdout:2/2: mknod c2 0 2023-12-17T11:57:27.888 INFO:tasks.workunit.client.0.smithi002.stdout:3/2: truncate - no filename 2023-12-17T11:57:27.888 INFO:tasks.workunit.client.0.smithi002.stdout:3/3: truncate - no filename 2023-12-17T11:57:27.889 INFO:tasks.workunit.client.0.smithi002.stdout:5/0: write - no filename 2023-12-17T11:57:27.891 INFO:tasks.workunit.client.0.smithi002.stdout:3/4: symlink l1 0 2023-12-17T11:57:27.891 INFO:tasks.workunit.client.0.smithi002.stdout:3/5: write - no filename 2023-12-17T11:57:27.891 INFO:tasks.workunit.client.0.smithi002.stdout:3/6: read - no filename 2023-12-17T11:57:27.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/0: read - no filename 2023-12-17T11:57:27.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/1: read - no filename 2023-12-17T11:57:27.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/2: read - no filename 2023-12-17T11:57:27.895 INFO:tasks.workunit.client.0.smithi002.stdout:6/3: mkdir d0 0 2023-12-17T11:57:27.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/0: write - no filename 2023-12-17T11:57:27.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/1: rename - no filename 2023-12-17T11:57:27.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/2: unlink - no file 2023-12-17T11:57:27.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/3: dwrite - no filename 2023-12-17T11:57:27.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/4: getdents . 0 2023-12-17T11:57:27.897 INFO:tasks.workunit.client.0.smithi002.stdout:7/5: truncate - no filename 2023-12-17T11:57:27.897 INFO:tasks.workunit.client.0.smithi002.stdout:6/4: mkdir d0/d1 0 2023-12-17T11:57:27.898 INFO:tasks.workunit.client.0.smithi002.stdout:8/0: chown . 119 1 2023-12-17T11:57:27.898 INFO:tasks.workunit.client.0.smithi002.stdout:8/1: truncate - no filename 2023-12-17T11:57:27.898 INFO:tasks.workunit.client.0.smithi002.stdout:8/2: fdatasync - no filename 2023-12-17T11:57:27.898 INFO:tasks.workunit.client.0.smithi002.stdout:8/3: readlink - no filename 2023-12-17T11:57:27.900 INFO:tasks.workunit.client.0.smithi002.stdout:8/4: mknod c0 0 2023-12-17T11:57:27.900 INFO:tasks.workunit.client.0.smithi002.stdout:8/5: dread - no filename 2023-12-17T11:57:27.902 INFO:tasks.workunit.client.0.smithi002.stdout:8/6: mknod c1 0 2023-12-17T11:57:27.902 INFO:tasks.workunit.client.0.smithi002.stdout:8/7: truncate - no filename 2023-12-17T11:57:27.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/8: rename c0 to c2 0 2023-12-17T11:57:27.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/9: dread - no filename 2023-12-17T11:57:27.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/10: write - no filename 2023-12-17T11:57:27.936 INFO:tasks.workunit.client.0.smithi002.stdout:8/11: mkdir d3 0 2023-12-17T11:57:27.988 INFO:tasks.workunit.client.0.smithi002.stdout:8/12: mknod d3/c4 0 2023-12-17T11:57:28.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/3: getdents . 0 2023-12-17T11:57:28.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/4: write f0 [653641,7340] 0 2023-12-17T11:57:28.055 INFO:tasks.workunit.client.0.smithi002.stdout:2/5: truncate f1 1039017 0 2023-12-17T11:57:28.077 INFO:tasks.workunit.client.0.smithi002.stdout:8/13: creat d3/f5 x:0 0 0 2023-12-17T11:57:28.077 INFO:tasks.workunit.client.0.smithi002.stdout:8/14: dread - d3/f5 zero size 2023-12-17T11:57:28.101 INFO:tasks.workunit.client.0.smithi002.stdout:2/6: mkdir d3 0 2023-12-17T11:57:28.141 INFO:tasks.workunit.client.0.smithi002.stdout:2/7: mkdir d3/d4 0 2023-12-17T11:57:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:28 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:28.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.479 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.479 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.479 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:28.479 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:28 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:29.187 INFO:tasks.workunit.client.1.smithi119.stdout:5/19: mknod d1/c4 0 2023-12-17T11:57:29.187 INFO:tasks.workunit.client.1.smithi119.stdout:5/20: readlink - no filename 2023-12-17T11:57:29.187 INFO:tasks.workunit.client.1.smithi119.stdout:5/21: rename d1 to d1/d5 22 2023-12-17T11:57:29.188 INFO:tasks.workunit.client.1.smithi119.stdout:5/22: rename d1 to d1/d6 22 2023-12-17T11:57:29.188 INFO:tasks.workunit.client.1.smithi119.stdout:5/23: fsync d1/f3 0 2023-12-17T11:57:29.188 INFO:tasks.workunit.client.1.smithi119.stdout:7/23: creat d2/f3 x:0 0 0 2023-12-17T11:57:29.189 INFO:tasks.workunit.client.1.smithi119.stdout:9/7: creat f2 x:0 0 0 2023-12-17T11:57:29.192 INFO:tasks.workunit.client.1.smithi119.stdout:3/6: unlink f1 0 2023-12-17T11:57:29.192 INFO:tasks.workunit.client.1.smithi119.stdout:3/7: truncate f0 4393919 0 2023-12-17T11:57:29.193 INFO:tasks.workunit.client.1.smithi119.stdout:3/8: creat f3 x:0 0 0 2023-12-17T11:57:29.193 INFO:tasks.workunit.client.1.smithi119.stdout:3/9: chown f2 7 1 2023-12-17T11:57:29.193 INFO:tasks.workunit.client.1.smithi119.stdout:5/24: mkdir d1/d7 0 2023-12-17T11:57:29.194 INFO:tasks.workunit.client.1.smithi119.stdout:7/24: mkdir d2/d4 0 2023-12-17T11:57:29.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/8: link c1 c3 0 2023-12-17T11:57:29.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/9: truncate f2 398108 0 2023-12-17T11:57:29.196 INFO:tasks.workunit.client.1.smithi119.stdout:9/10: creat f4 x:0 0 0 2023-12-17T11:57:29.196 INFO:tasks.workunit.client.1.smithi119.stdout:9/11: creat f5 x:0 0 0 2023-12-17T11:57:29.196 INFO:tasks.workunit.client.1.smithi119.stdout:9/12: truncate f2 527235 0 2023-12-17T11:57:29.197 INFO:tasks.workunit.client.1.smithi119.stdout:5/25: rmdir d1/d7 0 2023-12-17T11:57:29.197 INFO:tasks.workunit.client.1.smithi119.stdout:5/26: creat d1/f8 x:0 0 0 2023-12-17T11:57:29.197 INFO:tasks.workunit.client.1.smithi119.stdout:7/25: symlink d2/d4/l5 0 2023-12-17T11:57:29.202 INFO:tasks.workunit.client.1.smithi119.stdout:7/26: symlink d2/l6 0 2023-12-17T11:57:29.202 INFO:tasks.workunit.client.1.smithi119.stdout:5/27: dread d1/f3 [0,4194304] 0 2023-12-17T11:57:29.203 INFO:tasks.workunit.client.1.smithi119.stdout:5/28: write d1/f8 [929765,37921] 0 2023-12-17T11:57:29.204 INFO:tasks.workunit.client.1.smithi119.stdout:7/27: rename f1 to d2/d4/f7 0 2023-12-17T11:57:29.204 INFO:tasks.workunit.client.1.smithi119.stdout:5/29: symlink d1/l9 0 2023-12-17T11:57:29.205 INFO:tasks.workunit.client.1.smithi119.stdout:7/28: unlink c0 0 2023-12-17T11:57:29.206 INFO:tasks.workunit.client.1.smithi119.stdout:7/29: write d2/f3 [889668,125964] 0 2023-12-17T11:57:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:29 smithi002 ceph-mon[107131]: Reconfiguring node-exporter.smithi002 (dependencies changed)... 2023-12-17T11:57:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:29 smithi002 ceph-mon[107131]: Reconfiguring daemon node-exporter.smithi002 on smithi002 2023-12-17T11:57:29.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:29 smithi002 ceph-mon[107131]: pgmap v17: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.7 MiB/s wr, 793 op/s 2023-12-17T11:57:29.261 INFO:tasks.workunit.client.1.smithi119.stdout:5/30: dwrite d1/f3 [0,4194304] 0 2023-12-17T11:57:29.261 INFO:tasks.workunit.client.1.smithi119.stdout:5/31: creat d1/fa x:0 0 0 2023-12-17T11:57:29.261 INFO:tasks.workunit.client.1.smithi119.stdout:5/32: fdatasync d1/f3 0 2023-12-17T11:57:29.261 INFO:tasks.workunit.client.1.smithi119.stdout:5/33: dread - d1/fa zero size 2023-12-17T11:57:29.261 INFO:tasks.workunit.client.1.smithi119.stdout:5/34: fsync d1/f3 0 2023-12-17T11:57:29.261 INFO:tasks.workunit.client.1.smithi119.stdout:5/35: truncate d1/fa 625947 0 2023-12-17T11:57:29.284 INFO:tasks.workunit.client.1.smithi119.stdout:7/30: dwrite d2/f3 [0,4194304] 0 2023-12-17T11:57:29.288 INFO:tasks.workunit.client.1.smithi119.stdout:7/31: mknod d2/d4/c8 0 2023-12-17T11:57:29.301 INFO:tasks.workunit.client.1.smithi119.stdout:5/36: dwrite d1/f3 [0,4194304] 0 2023-12-17T11:57:29.302 INFO:tasks.workunit.client.1.smithi119.stdout:5/37: rename d1/c4 to d1/cb 0 2023-12-17T11:57:29.303 INFO:tasks.workunit.client.1.smithi119.stdout:5/38: chown d1/l9 4384221 1 2023-12-17T11:57:29.309 INFO:tasks.workunit.client.1.smithi119.stdout:5/39: dread d1/fa [0,4194304] 0 2023-12-17T11:57:29.309 INFO:tasks.workunit.client.1.smithi119.stdout:5/40: creat d1/fc x:0 0 0 2023-12-17T11:57:29.324 INFO:tasks.workunit.client.1.smithi119.stdout:5/41: dread d1/f8 [0,4194304] 0 2023-12-17T11:57:29.324 INFO:tasks.workunit.client.1.smithi119.stdout:5/42: write d1/fc [1034080,67307] 0 2023-12-17T11:57:29.356 INFO:tasks.workunit.client.1.smithi119.stdout:5/43: dwrite d1/fc [0,4194304] 0 2023-12-17T11:57:29.356 INFO:tasks.workunit.client.1.smithi119.stdout:5/44: creat d1/fd x:0 0 0 2023-12-17T11:57:29.356 INFO:tasks.workunit.client.1.smithi119.stdout:5/45: creat d1/fe x:0 0 0 2023-12-17T11:57:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:29 smithi119 ceph-mon[117414]: Reconfiguring node-exporter.smithi002 (dependencies changed)... 2023-12-17T11:57:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:29 smithi119 ceph-mon[117414]: Reconfiguring daemon node-exporter.smithi002 on smithi002 2023-12-17T11:57:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:29 smithi119 ceph-mon[117414]: pgmap v17: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.7 MiB/s wr, 793 op/s 2023-12-17T11:57:29.499 INFO:tasks.workunit.client.1.smithi119.stdout:7/32: dwrite d2/d4/f7 [4194304,4194304] 0 2023-12-17T11:57:29.513 INFO:tasks.workunit.client.1.smithi119.stdout:7/33: dread d2/d4/f7 [0,4194304] 0 2023-12-17T11:57:29.542 INFO:tasks.workunit.client.1.smithi119.stdout:7/34: write d2/d4/f7 [4345841,4052] 0 2023-12-17T11:57:29.542 INFO:tasks.workunit.client.1.smithi119.stdout:7/35: rename d2 to d2/d4/d9 22 2023-12-17T11:57:29.582 INFO:tasks.workunit.client.1.smithi119.stdout:7/36: dwrite d2/f3 [0,4194304] 0 2023-12-17T11:57:29.649 INFO:tasks.workunit.client.1.smithi119.stdout:0/8: truncate f0 2109520 0 2023-12-17T11:57:29.650 INFO:tasks.workunit.client.1.smithi119.stdout:0/9: chown f1 31515 1 2023-12-17T11:57:29.651 INFO:tasks.workunit.client.1.smithi119.stdout:0/10: getdents . 0 2023-12-17T11:57:29.651 INFO:tasks.workunit.client.1.smithi119.stdout:0/11: readlink - no filename 2023-12-17T11:57:29.691 INFO:tasks.workunit.client.1.smithi119.stdout:9/13: fsync f5 0 2023-12-17T11:57:29.692 INFO:tasks.workunit.client.1.smithi119.stdout:9/14: chown f4 30996359 1 2023-12-17T11:57:29.693 INFO:tasks.workunit.client.1.smithi119.stdout:9/15: getdents . 0 2023-12-17T11:57:29.694 INFO:tasks.workunit.client.1.smithi119.stdout:9/16: rename f4 to f6 0 2023-12-17T11:57:29.699 INFO:tasks.workunit.client.1.smithi119.stdout:5/46: rmdir d1 39 2023-12-17T11:57:29.700 INFO:tasks.workunit.client.1.smithi119.stdout:0/12: unlink f0 0 2023-12-17T11:57:29.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/17: dread f2 [0,4194304] 0 2023-12-17T11:57:29.705 INFO:tasks.workunit.client.1.smithi119.stdout:9/18: write f5 [601050,67655] 0 2023-12-17T11:57:29.706 INFO:tasks.workunit.client.1.smithi119.stdout:9/19: chown c3 1857 1 2023-12-17T11:57:29.707 INFO:tasks.workunit.client.1.smithi119.stdout:5/47: dread d1/f8 [0,4194304] 0 2023-12-17T11:57:29.708 INFO:tasks.workunit.client.1.smithi119.stdout:9/20: link f2 f7 0 2023-12-17T11:57:29.710 INFO:tasks.workunit.client.1.smithi119.stdout:9/21: rename f2 to f8 0 2023-12-17T11:57:29.710 INFO:tasks.workunit.client.1.smithi119.stdout:9/22: chown f8 3957 1 2023-12-17T11:57:29.711 INFO:tasks.workunit.client.1.smithi119.stdout:9/23: creat f9 x:0 0 0 2023-12-17T11:57:29.752 INFO:tasks.workunit.client.1.smithi119.stdout:4/10: dwrite f1 [4194304,4194304] 0 2023-12-17T11:57:29.752 INFO:tasks.workunit.client.1.smithi119.stdout:4/11: chown f1 142680 1 2023-12-17T11:57:29.752 INFO:tasks.workunit.client.1.smithi119.stdout:4/12: rmdir - no directory 2023-12-17T11:57:29.752 INFO:tasks.workunit.client.1.smithi119.stdout:4/13: fsync f1 0 2023-12-17T11:57:29.753 INFO:tasks.workunit.client.1.smithi119.stdout:4/14: creat f2 x:0 0 0 2023-12-17T11:57:29.753 INFO:tasks.workunit.client.1.smithi119.stdout:4/15: truncate f2 737436 0 2023-12-17T11:57:29.754 INFO:tasks.workunit.client.1.smithi119.stdout:4/16: mknod c3 0 2023-12-17T11:57:29.755 INFO:tasks.workunit.client.1.smithi119.stdout:5/48: dwrite d1/fc [0,4194304] 0 2023-12-17T11:57:29.755 INFO:tasks.workunit.client.1.smithi119.stdout:7/37: dwrite d2/f3 [4194304,4194304] 0 2023-12-17T11:57:29.756 INFO:tasks.workunit.client.1.smithi119.stdout:7/38: chown d2/f3 10 1 2023-12-17T11:57:29.756 INFO:tasks.workunit.client.1.smithi119.stdout:7/39: chown d2 13929761 1 2023-12-17T11:57:29.756 INFO:tasks.workunit.client.1.smithi119.stdout:4/17: rename f0 to f4 0 2023-12-17T11:57:29.759 INFO:tasks.workunit.client.1.smithi119.stdout:4/18: mknod c5 0 2023-12-17T11:57:29.766 INFO:tasks.workunit.client.1.smithi119.stdout:9/24: dwrite f9 [0,4194304] 0 2023-12-17T11:57:29.774 INFO:tasks.workunit.client.1.smithi119.stdout:9/25: creat fa x:0 0 0 2023-12-17T11:57:29.774 INFO:tasks.workunit.client.1.smithi119.stdout:9/26: write fa [306158,36721] 0 2023-12-17T11:57:29.774 INFO:tasks.workunit.client.1.smithi119.stdout:7/40: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:29.774 INFO:tasks.workunit.client.1.smithi119.stdout:4/19: truncate f2 684738 0 2023-12-17T11:57:29.774 INFO:tasks.workunit.client.1.smithi119.stdout:4/20: fsync f4 0 2023-12-17T11:57:29.779 INFO:tasks.workunit.client.1.smithi119.stdout:4/21: dread f4 [0,4194304] 0 2023-12-17T11:57:29.781 INFO:tasks.workunit.client.1.smithi119.stdout:4/22: mknod c6 0 2023-12-17T11:57:29.787 INFO:tasks.workunit.client.1.smithi119.stdout:9/27: dread f9 [0,4194304] 0 2023-12-17T11:57:29.792 INFO:tasks.workunit.client.1.smithi119.stdout:7/41: dread d2/f3 [4194304,4194304] 0 2023-12-17T11:57:29.793 INFO:tasks.workunit.client.1.smithi119.stdout:4/23: write f1 [1859889,73119] 0 2023-12-17T11:57:29.793 INFO:tasks.workunit.client.1.smithi119.stdout:4/24: stat c3 0 2023-12-17T11:57:29.793 INFO:tasks.workunit.client.1.smithi119.stdout:7/42: mknod d2/ca 0 2023-12-17T11:57:29.793 INFO:tasks.workunit.client.1.smithi119.stdout:7/43: chown d2/d4 49511276 1 2023-12-17T11:57:29.794 INFO:tasks.workunit.client.1.smithi119.stdout:4/25: symlink l7 0 2023-12-17T11:57:29.795 INFO:tasks.workunit.client.1.smithi119.stdout:7/44: truncate d2/f3 3914933 0 2023-12-17T11:57:29.795 INFO:tasks.workunit.client.1.smithi119.stdout:7/45: rename d2 to d2/db 22 2023-12-17T11:57:29.805 INFO:tasks.workunit.client.1.smithi119.stdout:7/46: link d2/l6 d2/lc 0 2023-12-17T11:57:29.818 INFO:tasks.workunit.client.1.smithi119.stdout:7/47: read d2/d4/f7 [2304291,43317] 0 2023-12-17T11:57:29.820 INFO:tasks.workunit.client.1.smithi119.stdout:7/48: getdents d2/d4 0 2023-12-17T11:57:29.820 INFO:tasks.workunit.client.1.smithi119.stdout:7/49: creat d2/fd x:0 0 0 2023-12-17T11:57:29.820 INFO:tasks.workunit.client.1.smithi119.stdout:7/50: write d2/fd [298927,101226] 0 2023-12-17T11:57:29.821 INFO:tasks.workunit.client.1.smithi119.stdout:7/51: creat d2/fe x:0 0 0 2023-12-17T11:57:29.824 INFO:tasks.workunit.client.1.smithi119.stdout:7/52: rename d2/fd to d2/d4/ff 0 2023-12-17T11:57:29.824 INFO:tasks.workunit.client.1.smithi119.stdout:7/53: write d2/fe [889073,27573] 0 2023-12-17T11:57:29.825 INFO:tasks.workunit.client.1.smithi119.stdout:7/54: rename d2/d4/f7 to d2/f10 0 2023-12-17T11:57:29.837 INFO:tasks.workunit.client.1.smithi119.stdout:9/28: dwrite f8 [0,4194304] 0 2023-12-17T11:57:29.841 INFO:tasks.workunit.client.1.smithi119.stdout:4/26: dwrite f2 [0,4194304] 0 2023-12-17T11:57:29.841 INFO:tasks.workunit.client.1.smithi119.stdout:4/27: creat f8 x:0 0 0 2023-12-17T11:57:29.848 INFO:tasks.workunit.client.1.smithi119.stdout:9/29: read f9 [30201,87072] 0 2023-12-17T11:57:29.892 INFO:tasks.workunit.client.1.smithi119.stdout:7/55: dwrite d2/d4/ff [0,4194304] 0 2023-12-17T11:57:29.898 INFO:tasks.workunit.client.1.smithi119.stdout:9/30: dwrite f6 [0,4194304] 0 2023-12-17T11:57:29.944 INFO:tasks.workunit.client.1.smithi119.stdout:7/56: dwrite d2/f3 [0,4194304] 0 2023-12-17T11:57:29.944 INFO:tasks.workunit.client.1.smithi119.stdout:7/57: chown d2/l6 15582 1 2023-12-17T11:57:29.962 INFO:tasks.workunit.client.1.smithi119.stdout:9/31: dwrite f9 [0,4194304] 0 2023-12-17T11:57:29.964 INFO:tasks.workunit.client.1.smithi119.stdout:9/32: mknod cb 0 2023-12-17T11:57:29.965 INFO:tasks.workunit.client.1.smithi119.stdout:9/33: rename f6 to fc 0 2023-12-17T11:57:30.020 INFO:tasks.workunit.client.1.smithi119.stdout:9/34: dwrite fc [0,4194304] 0 2023-12-17T11:57:30.021 INFO:tasks.workunit.client.1.smithi119.stdout:9/35: truncate f8 1914577 0 2023-12-17T11:57:30.023 INFO:tasks.workunit.client.1.smithi119.stdout:9/36: symlink ld 0 2023-12-17T11:57:30.024 INFO:tasks.workunit.client.1.smithi119.stdout:9/37: unlink f5 0 2023-12-17T11:57:30.029 INFO:tasks.workunit.client.1.smithi119.stdout:9/38: getdents . 0 2023-12-17T11:57:30.031 INFO:tasks.workunit.client.1.smithi119.stdout:9/39: rename f8 to fe 0 2023-12-17T11:57:30.032 INFO:tasks.workunit.client.1.smithi119.stdout:9/40: creat ff x:0 0 0 2023-12-17T11:57:30.033 INFO:tasks.workunit.client.1.smithi119.stdout:9/41: rename fa to f10 0 2023-12-17T11:57:30.033 INFO:tasks.workunit.client.1.smithi119.stdout:9/42: creat f11 x:0 0 0 2023-12-17T11:57:30.034 INFO:tasks.workunit.client.1.smithi119.stdout:9/43: mkdir d12 0 2023-12-17T11:57:30.040 INFO:tasks.workunit.client.1.smithi119.stdout:9/44: read f7 [1819645,7806] 0 2023-12-17T11:57:30.041 INFO:tasks.workunit.client.1.smithi119.stdout:9/45: unlink fc 0 2023-12-17T11:57:30.042 INFO:tasks.workunit.client.1.smithi119.stdout:9/46: mknod d12/c13 0 2023-12-17T11:57:30.048 INFO:tasks.workunit.client.1.smithi119.stdout:9/47: getdents d12 0 2023-12-17T11:57:30.053 INFO:tasks.workunit.client.1.smithi119.stdout:9/48: dread f10 [0,4194304] 0 2023-12-17T11:57:30.054 INFO:tasks.workunit.client.1.smithi119.stdout:9/49: symlink d12/l14 0 2023-12-17T11:57:30.054 INFO:tasks.workunit.client.1.smithi119.stdout:9/50: fdatasync f10 0 2023-12-17T11:57:30.055 INFO:tasks.workunit.client.1.smithi119.stdout:9/51: chown c3 62003521 1 2023-12-17T11:57:30.055 INFO:tasks.workunit.client.1.smithi119.stdout:9/52: symlink d12/l15 0 2023-12-17T11:57:30.056 INFO:tasks.workunit.client.1.smithi119.stdout:9/53: rmdir d12 39 2023-12-17T11:57:30.056 INFO:tasks.workunit.client.1.smithi119.stdout:9/54: fdatasync f9 0 2023-12-17T11:57:30.057 INFO:tasks.workunit.client.1.smithi119.stdout:9/55: rename d12/l14 to d12/l16 0 2023-12-17T11:57:30.058 INFO:tasks.workunit.client.1.smithi119.stdout:9/56: unlink f9 0 2023-12-17T11:57:30.058 INFO:tasks.workunit.client.1.smithi119.stdout:9/57: read fe [389858,81433] 0 2023-12-17T11:57:30.058 INFO:tasks.workunit.client.1.smithi119.stdout:9/58: chown d12/c13 79 1 2023-12-17T11:57:30.064 INFO:tasks.workunit.client.1.smithi119.stdout:9/59: creat d12/f17 x:0 0 0 2023-12-17T11:57:30.064 INFO:tasks.workunit.client.1.smithi119.stdout:9/60: dread - ff zero size 2023-12-17T11:57:30.098 INFO:tasks.workunit.client.1.smithi119.stdout:9/61: dwrite f11 [0,4194304] 0 2023-12-17T11:57:30.099 INFO:tasks.workunit.client.1.smithi119.stdout:9/62: chown d12/l15 7004327 1 2023-12-17T11:57:30.100 INFO:tasks.workunit.client.1.smithi119.stdout:9/63: symlink d12/l18 0 2023-12-17T11:57:30.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:30 smithi119 ceph-mon[117414]: pgmap v18: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 580 op/s 2023-12-17T11:57:30.884 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:30 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:30.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:30 smithi002 ceph-mon[107131]: pgmap v18: 65 pgs: 65 active+clean; 217 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 580 op/s 2023-12-17T11:57:30.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:30 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:31.646 INFO:tasks.workunit.client.0.smithi002.stdout:5/1: sync 2023-12-17T11:57:31.646 INFO:tasks.workunit.client.0.smithi002.stdout:7/6: sync 2023-12-17T11:57:31.646 INFO:tasks.workunit.client.0.smithi002.stdout:3/7: sync 2023-12-17T11:57:31.646 INFO:tasks.workunit.client.0.smithi002.stdout:7/7: dwrite - no filename 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:5/2: fsync - no filename 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:8/15: sync 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:2/8: sync 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/16: sync 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:4/17: write - no filename 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:9/8: sync 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:0/8: sync 2023-12-17T11:57:31.647 INFO:tasks.workunit.client.0.smithi002.stdout:0/9: write - no filename 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:0/10: write - no filename 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:9/9: chown f1 27 1 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:1/3: sync 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:9/10: creat f2 x:0 0 0 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:6/5: sync 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:6/6: readlink - no filename 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:6/7: getdents d0/d1 0 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:7/8: creat f0 x:0 0 0 2023-12-17T11:57:31.648 INFO:tasks.workunit.client.0.smithi002.stdout:7/9: rmdir - no directory 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:5/3: creat f0 x:0 0 0 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:2/9: write f1 [221835,69566] 0 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/8: unlink c0 0 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/9: write - no filename 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/10: truncate - no filename 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:4/18: mkdir d0 0 2023-12-17T11:57:31.649 INFO:tasks.workunit.client.0.smithi002.stdout:4/19: truncate - no filename 2023-12-17T11:57:31.651 INFO:tasks.workunit.client.0.smithi002.stdout:1/4: creat f1 x:0 0 0 2023-12-17T11:57:31.651 INFO:tasks.workunit.client.0.smithi002.stdout:1/5: chown c0 32253 1 2023-12-17T11:57:31.651 INFO:tasks.workunit.client.0.smithi002.stdout:1/6: write f1 [754086,36331] 0 2023-12-17T11:57:31.651 INFO:tasks.workunit.client.0.smithi002.stdout:1/7: rmdir - no directory 2023-12-17T11:57:31.652 INFO:tasks.workunit.client.0.smithi002.stdout:6/8: mkdir d0/d1/d2 0 2023-12-17T11:57:31.654 INFO:tasks.workunit.client.0.smithi002.stdout:8/16: rename c2 to d3/c6 0 2023-12-17T11:57:31.655 INFO:tasks.workunit.client.0.smithi002.stdout:7/10: symlink l1 0 2023-12-17T11:57:31.655 INFO:tasks.workunit.client.0.smithi002.stdout:0/11: rename d0 to d0/d3 22 2023-12-17T11:57:31.655 INFO:tasks.workunit.client.0.smithi002.stdout:5/4: mknod c1 0 2023-12-17T11:57:31.659 INFO:tasks.workunit.client.0.smithi002.stdout:2/10: link f0 d3/d4/f5 0 2023-12-17T11:57:31.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/11: rename l1 to l2 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/8: symlink l2 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/9: fsync f1 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/20: creat d0/f1 x:0 0 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:9/11: getdents . 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:8/17: mkdir d3/d7 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/11: mknod c2 0 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/12: rmdir - no directory 2023-12-17T11:57:31.665 INFO:tasks.workunit.client.0.smithi002.stdout:7/13: chown l1 6 1 2023-12-17T11:57:31.666 INFO:tasks.workunit.client.0.smithi002.stdout:9/12: creat f3 x:0 0 0 2023-12-17T11:57:31.666 INFO:tasks.workunit.client.0.smithi002.stdout:0/12: rename d0/c2 to d0/c4 0 2023-12-17T11:57:31.667 INFO:tasks.workunit.client.0.smithi002.stdout:3/12: creat f3 x:0 0 0 2023-12-17T11:57:31.667 INFO:tasks.workunit.client.0.smithi002.stdout:8/18: mkdir d3/d8 0 2023-12-17T11:57:31.668 INFO:tasks.workunit.client.0.smithi002.stdout:8/19: rename d3/d7 to d3/d7/d9 22 2023-12-17T11:57:31.668 INFO:tasks.workunit.client.0.smithi002.stdout:8/20: dread - d3/f5 zero size 2023-12-17T11:57:31.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/14: link c2 c3 0 2023-12-17T11:57:31.670 INFO:tasks.workunit.client.0.smithi002.stdout:7/15: write f0 [453327,87628] 0 2023-12-17T11:57:31.670 INFO:tasks.workunit.client.0.smithi002.stdout:7/16: write f0 [1016856,81743] 0 2023-12-17T11:57:31.670 INFO:tasks.workunit.client.0.smithi002.stdout:9/13: rename f3 to f4 0 2023-12-17T11:57:31.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/14: stat f4 0 2023-12-17T11:57:31.673 INFO:tasks.workunit.client.0.smithi002.stdout:3/13: symlink l4 0 2023-12-17T11:57:31.673 INFO:tasks.workunit.client.0.smithi002.stdout:3/14: chown l4 3060038 1 2023-12-17T11:57:31.673 INFO:tasks.workunit.client.0.smithi002.stdout:3/15: write f3 [136283,9284] 0 2023-12-17T11:57:31.673 INFO:tasks.workunit.client.0.smithi002.stdout:3/16: creat f5 x:0 0 0 2023-12-17T11:57:31.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/17: chown f5 264621677 1 2023-12-17T11:57:31.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/18: creat f6 x:0 0 0 2023-12-17T11:57:31.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/19: write f3 [451726,85890] 0 2023-12-17T11:57:31.674 INFO:tasks.workunit.client.0.smithi002.stdout:8/21: mkdir d3/d8/da 0 2023-12-17T11:57:31.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/20: creat f7 x:0 0 0 2023-12-17T11:57:31.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/21: readlink l4 0 2023-12-17T11:57:31.677 INFO:tasks.workunit.client.0.smithi002.stdout:7/17: rename c3 to c4 0 2023-12-17T11:57:31.678 INFO:tasks.workunit.client.0.smithi002.stdout:9/15: link f0 f5 0 2023-12-17T11:57:31.679 INFO:tasks.workunit.client.0.smithi002.stdout:9/16: readlink - no filename 2023-12-17T11:57:31.679 INFO:tasks.workunit.client.0.smithi002.stdout:9/17: creat f6 x:0 0 0 2023-12-17T11:57:31.679 INFO:tasks.workunit.client.0.smithi002.stdout:9/18: chown f6 50 1 2023-12-17T11:57:31.679 INFO:tasks.workunit.client.0.smithi002.stdout:9/19: fdatasync f4 0 2023-12-17T11:57:31.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/13: rename d0/c4 to d0/c5 0 2023-12-17T11:57:31.684 INFO:tasks.workunit.client.0.smithi002.stdout:8/22: symlink d3/d8/lb 0 2023-12-17T11:57:31.684 INFO:tasks.workunit.client.0.smithi002.stdout:8/23: write d3/f5 [912345,51194] 0 2023-12-17T11:57:31.692 INFO:tasks.workunit.client.0.smithi002.stdout:9/20: symlink l7 0 2023-12-17T11:57:31.692 INFO:tasks.workunit.client.0.smithi002.stdout:0/14: mkdir d0/d6 0 2023-12-17T11:57:31.693 INFO:tasks.workunit.client.0.smithi002.stdout:7/18: symlink l5 0 2023-12-17T11:57:31.694 INFO:tasks.workunit.client.0.smithi002.stdout:9/21: symlink l8 0 2023-12-17T11:57:31.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/15: mknod d0/c7 0 2023-12-17T11:57:31.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/16: dread - no filename 2023-12-17T11:57:31.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/10: dread f1 [0,4194304] 0 2023-12-17T11:57:31.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/11: chown c0 13 1 2023-12-17T11:57:31.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/12: stat c0 0 2023-12-17T11:57:31.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/13: chown c0 185337567 1 2023-12-17T11:57:31.698 INFO:tasks.workunit.client.0.smithi002.stdout:9/22: rename f5 to f9 0 2023-12-17T11:57:31.698 INFO:tasks.workunit.client.0.smithi002.stdout:9/23: creat fa x:0 0 0 2023-12-17T11:57:31.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/24: creat fb x:0 0 0 2023-12-17T11:57:31.699 INFO:tasks.workunit.client.0.smithi002.stdout:7/19: mkdir d6 0 2023-12-17T11:57:31.700 INFO:tasks.workunit.client.0.smithi002.stdout:0/17: mkdir d0/d6/d8 0 2023-12-17T11:57:31.700 INFO:tasks.workunit.client.0.smithi002.stdout:0/18: dread - no filename 2023-12-17T11:57:31.702 INFO:tasks.workunit.client.0.smithi002.stdout:3/22: getdents . 0 2023-12-17T11:57:31.708 INFO:tasks.workunit.client.0.smithi002.stdout:2/11: dwrite d3/d4/f5 [0,4194304] 0 2023-12-17T11:57:31.709 INFO:tasks.workunit.client.0.smithi002.stdout:9/25: mkdir dc 0 2023-12-17T11:57:31.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/20: mknod d6/c7 0 2023-12-17T11:57:31.709 INFO:tasks.workunit.client.0.smithi002.stdout:0/19: stat d0/c5 0 2023-12-17T11:57:31.709 INFO:tasks.workunit.client.0.smithi002.stdout:3/23: creat f8 x:0 0 0 2023-12-17T11:57:31.711 INFO:tasks.workunit.client.0.smithi002.stdout:2/12: creat d3/d4/f6 x:0 0 0 2023-12-17T11:57:31.711 INFO:tasks.workunit.client.0.smithi002.stdout:0/20: symlink d0/l9 0 2023-12-17T11:57:31.712 INFO:tasks.workunit.client.0.smithi002.stdout:9/26: mkdir dc/dd 0 2023-12-17T11:57:31.716 INFO:tasks.workunit.client.0.smithi002.stdout:7/21: rmdir d6 39 2023-12-17T11:57:31.716 INFO:tasks.workunit.client.0.smithi002.stdout:3/24: write f5 [827707,85935] 0 2023-12-17T11:57:31.717 INFO:tasks.workunit.client.0.smithi002.stdout:3/25: write f8 [854051,12277] 0 2023-12-17T11:57:31.717 INFO:tasks.workunit.client.0.smithi002.stdout:9/27: symlink dc/le 0 2023-12-17T11:57:31.718 INFO:tasks.workunit.client.0.smithi002.stdout:7/22: mkdir d6/d8 0 2023-12-17T11:57:31.718 INFO:tasks.workunit.client.0.smithi002.stdout:9/28: stat dc 0 2023-12-17T11:57:31.718 INFO:tasks.workunit.client.0.smithi002.stdout:7/23: write f0 [1989937,78294] 0 2023-12-17T11:57:31.720 INFO:tasks.workunit.client.0.smithi002.stdout:9/29: rmdir dc/dd 0 2023-12-17T11:57:31.720 INFO:tasks.workunit.client.0.smithi002.stdout:9/30: stat dc 0 2023-12-17T11:57:31.722 INFO:tasks.workunit.client.0.smithi002.stdout:7/24: link c2 d6/c9 0 2023-12-17T11:57:31.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/31: creat dc/ff x:0 0 0 2023-12-17T11:57:31.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/32: creat dc/f10 x:0 0 0 2023-12-17T11:57:31.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/33: fdatasync fb 0 2023-12-17T11:57:31.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/34: dread - fb zero size 2023-12-17T11:57:31.729 INFO:tasks.workunit.client.0.smithi002.stdout:4/21: dwrite d0/f1 [0,4194304] 0 2023-12-17T11:57:31.734 INFO:tasks.workunit.client.0.smithi002.stdout:3/26: fsync f8 0 2023-12-17T11:57:31.737 INFO:tasks.workunit.client.0.smithi002.stdout:3/27: write f7 [947410,122041] 0 2023-12-17T11:57:31.740 INFO:tasks.workunit.client.0.smithi002.stdout:3/28: mkdir d9 0 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/35: fsync dc/f10 0 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/36: creat dc/f11 x:0 0 0 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/37: chown f0 3144 1 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/38: fdatasync fb 0 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/39: fsync f1 0 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/40: creat dc/f12 x:0 0 0 2023-12-17T11:57:31.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/41: creat dc/f13 x:0 0 0 2023-12-17T11:57:31.751 INFO:tasks.workunit.client.0.smithi002.stdout:9/42: chown dc 9129372 1 2023-12-17T11:57:31.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/43: link dc/ff dc/f14 0 2023-12-17T11:57:31.799 INFO:tasks.workunit.client.0.smithi002.stdout:3/29: dwrite f7 [0,4194304] 0 2023-12-17T11:57:31.800 INFO:tasks.workunit.client.0.smithi002.stdout:3/30: mknod d9/ca 0 2023-12-17T11:57:31.801 INFO:tasks.workunit.client.0.smithi002.stdout:3/31: truncate f6 772037 0 2023-12-17T11:57:31.802 INFO:tasks.workunit.client.0.smithi002.stdout:3/32: write f3 [926536,26918] 0 2023-12-17T11:57:31.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/33: mknod d9/cb 0 2023-12-17T11:57:31.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/34: fsync f7 0 2023-12-17T11:57:31.815 INFO:tasks.workunit.client.0.smithi002.stdout:8/24: dwrite d3/f5 [0,4194304] 0 2023-12-17T11:57:31.815 INFO:tasks.workunit.client.0.smithi002.stdout:1/14: dwrite f1 [0,4194304] 0 2023-12-17T11:57:31.815 INFO:tasks.workunit.client.0.smithi002.stdout:8/25: creat d3/fc x:0 0 0 2023-12-17T11:57:31.825 INFO:tasks.workunit.client.0.smithi002.stdout:3/35: write f3 [424968,108800] 0 2023-12-17T11:57:31.826 INFO:tasks.workunit.client.0.smithi002.stdout:3/36: chown l4 1 1 2023-12-17T11:57:31.838 INFO:tasks.workunit.client.0.smithi002.stdout:9/44: dwrite dc/ff [0,4194304] 0 2023-12-17T11:57:31.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/45: write dc/f10 [663458,106298] 0 2023-12-17T11:57:31.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/46: fdatasync f1 0 2023-12-17T11:57:31.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/47: chown f6 188 1 2023-12-17T11:57:31.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/48: write dc/f13 [869349,7624] 0 2023-12-17T11:57:31.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/49: creat dc/f15 x:0 0 0 2023-12-17T11:57:31.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/50: chown dc 104014743 1 2023-12-17T11:57:31.849 INFO:tasks.workunit.client.0.smithi002.stdout:9/51: rename fa to dc/f16 0 2023-12-17T11:57:31.849 INFO:tasks.workunit.client.0.smithi002.stdout:9/52: truncate dc/f16 76339 0 2023-12-17T11:57:31.849 INFO:tasks.workunit.client.0.smithi002.stdout:9/53: chown f6 425257 1 2023-12-17T11:57:31.849 INFO:tasks.workunit.client.0.smithi002.stdout:9/54: creat dc/f17 x:0 0 0 2023-12-17T11:57:31.850 INFO:tasks.workunit.client.0.smithi002.stdout:9/55: mknod dc/c18 0 2023-12-17T11:57:31.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/22: write d0/f1 [421826,49887] 0 2023-12-17T11:57:31.869 INFO:tasks.workunit.client.0.smithi002.stdout:2/13: dwrite d3/d4/f5 [4194304,4194304] 0 2023-12-17T11:57:31.877 INFO:tasks.workunit.client.0.smithi002.stdout:2/14: mkdir d3/d4/d7 0 2023-12-17T11:57:31.878 INFO:tasks.workunit.client.0.smithi002.stdout:2/15: write f0 [9365731,119350] 0 2023-12-17T11:57:31.878 INFO:tasks.workunit.client.0.smithi002.stdout:2/16: stat f0 0 2023-12-17T11:57:31.878 INFO:tasks.workunit.client.0.smithi002.stdout:2/17: stat f0 0 2023-12-17T11:57:31.889 INFO:tasks.workunit.client.0.smithi002.stdout:3/37: dwrite f6 [0,4194304] 0 2023-12-17T11:57:31.896 INFO:tasks.workunit.client.0.smithi002.stdout:2/18: getdents d3/d4 0 2023-12-17T11:57:31.897 INFO:tasks.workunit.client.0.smithi002.stdout:2/19: truncate f0 9940391 0 2023-12-17T11:57:31.898 INFO:tasks.workunit.client.0.smithi002.stdout:2/20: symlink d3/d4/l8 0 2023-12-17T11:57:31.903 INFO:tasks.workunit.client.0.smithi002.stdout:2/21: symlink d3/d4/l9 0 2023-12-17T11:57:31.904 INFO:tasks.workunit.client.0.smithi002.stdout:2/22: chown c2 57725 1 2023-12-17T11:57:31.906 INFO:tasks.workunit.client.0.smithi002.stdout:2/23: rename d3/d4/l8 to d3/d4/d7/la 0 2023-12-17T11:57:31.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/24: mknod d3/cb 0 2023-12-17T11:57:31.909 INFO:tasks.workunit.client.0.smithi002.stdout:2/25: rename f0 to d3/fc 0 2023-12-17T11:57:31.911 INFO:tasks.workunit.client.0.smithi002.stdout:2/26: unlink d3/cb 0 2023-12-17T11:57:31.918 INFO:tasks.workunit.client.0.smithi002.stdout:2/27: rename d3/fc to d3/d4/fd 0 2023-12-17T11:57:31.919 INFO:tasks.workunit.client.0.smithi002.stdout:1/15: dwrite f1 [0,4194304] 0 2023-12-17T11:57:31.919 INFO:tasks.workunit.client.0.smithi002.stdout:8/26: dwrite d3/fc [0,4194304] 0 2023-12-17T11:57:31.919 INFO:tasks.workunit.client.0.smithi002.stdout:8/27: getdents d3/d8/da 0 2023-12-17T11:57:31.921 INFO:tasks.workunit.client.0.smithi002.stdout:2/28: creat d3/d4/fe x:0 0 0 2023-12-17T11:57:31.927 INFO:tasks.workunit.client.0.smithi002.stdout:1/16: mkdir d3 0 2023-12-17T11:57:31.948 INFO:tasks.workunit.client.0.smithi002.stdout:9/56: dwrite f9 [0,4194304] 0 2023-12-17T11:57:31.948 INFO:tasks.workunit.client.0.smithi002.stdout:9/57: truncate fb 583368 0 2023-12-17T11:57:31.948 INFO:tasks.workunit.client.0.smithi002.stdout:8/28: dread d3/f5 [0,4194304] 0 2023-12-17T11:57:31.948 INFO:tasks.workunit.client.0.smithi002.stdout:3/38: dwrite f7 [0,4194304] 0 2023-12-17T11:57:31.948 INFO:tasks.workunit.client.0.smithi002.stdout:3/39: chown l4 31 1 2023-12-17T11:57:31.948 INFO:tasks.workunit.client.0.smithi002.stdout:3/40: fsync f3 0 2023-12-17T11:57:31.954 INFO:tasks.workunit.client.0.smithi002.stdout:1/17: write f1 [4047503,43584] 0 2023-12-17T11:57:31.960 INFO:tasks.workunit.client.0.smithi002.stdout:3/41: unlink f8 0 2023-12-17T11:57:31.963 INFO:tasks.workunit.client.0.smithi002.stdout:8/29: truncate d3/fc 4029158 0 2023-12-17T11:57:31.965 INFO:tasks.workunit.client.0.smithi002.stdout:3/42: creat d9/fc x:0 0 0 2023-12-17T11:57:31.966 INFO:tasks.workunit.client.0.smithi002.stdout:3/43: truncate f7 4348415 0 2023-12-17T11:57:31.966 INFO:tasks.workunit.client.0.smithi002.stdout:8/30: mkdir d3/d8/da/dd 0 2023-12-17T11:57:31.969 INFO:tasks.workunit.client.0.smithi002.stdout:9/58: write dc/f14 [72908,130020] 0 2023-12-17T11:57:31.969 INFO:tasks.workunit.client.0.smithi002.stdout:9/59: fsync fb 0 2023-12-17T11:57:31.970 INFO:tasks.workunit.client.0.smithi002.stdout:2/29: dwrite d3/d4/fe [0,4194304] 0 2023-12-17T11:57:31.977 INFO:tasks.workunit.client.0.smithi002.stdout:3/44: mknod d9/cd 0 2023-12-17T11:57:31.977 INFO:tasks.workunit.client.0.smithi002.stdout:3/45: fdatasync f3 0 2023-12-17T11:57:31.978 INFO:tasks.workunit.client.0.smithi002.stdout:9/60: mknod dc/c19 0 2023-12-17T11:57:31.982 INFO:tasks.workunit.client.0.smithi002.stdout:2/30: unlink f1 0 2023-12-17T11:57:31.983 INFO:tasks.workunit.client.0.smithi002.stdout:3/46: symlink d9/le 0 2023-12-17T11:57:31.983 INFO:tasks.workunit.client.0.smithi002.stdout:3/47: creat d9/ff x:0 0 0 2023-12-17T11:57:31.984 INFO:tasks.workunit.client.0.smithi002.stdout:9/61: mknod dc/c1a 0 2023-12-17T11:57:31.984 INFO:tasks.workunit.client.0.smithi002.stdout:9/62: creat dc/f1b x:0 0 0 2023-12-17T11:57:31.984 INFO:tasks.workunit.client.0.smithi002.stdout:2/31: rmdir d3/d4/d7 39 2023-12-17T11:57:31.984 INFO:tasks.workunit.client.0.smithi002.stdout:2/32: creat d3/d4/ff x:0 0 0 2023-12-17T11:57:31.985 INFO:tasks.workunit.client.0.smithi002.stdout:3/48: symlink d9/l10 0 2023-12-17T11:57:31.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/33: mkdir d3/d4/d10 0 2023-12-17T11:57:31.990 INFO:tasks.workunit.client.0.smithi002.stdout:2/34: creat d3/d4/d7/f11 x:0 0 0 2023-12-17T11:57:31.990 INFO:tasks.workunit.client.0.smithi002.stdout:2/35: readlink d3/d4/l9 0 2023-12-17T11:57:31.990 INFO:tasks.workunit.client.0.smithi002.stdout:2/36: dread - d3/d4/d7/f11 zero size 2023-12-17T11:57:31.990 INFO:tasks.workunit.client.0.smithi002.stdout:2/37: chown d3/d4/d7/la 260169 1 2023-12-17T11:57:31.992 INFO:tasks.workunit.client.0.smithi002.stdout:2/38: rmdir d3/d4/d10 0 2023-12-17T11:57:31.995 INFO:tasks.workunit.client.0.smithi002.stdout:2/39: rename d3/d4/d7/la to d3/d4/l12 0 2023-12-17T11:57:32.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/49: truncate f7 2832398 0 2023-12-17T11:57:32.016 INFO:tasks.workunit.client.0.smithi002.stdout:9/63: dread dc/f14 [0,4194304] 0 2023-12-17T11:57:32.016 INFO:tasks.workunit.client.0.smithi002.stdout:9/64: chown dc/c18 387949973 1 2023-12-17T11:57:32.017 INFO:tasks.workunit.client.0.smithi002.stdout:3/50: read f7 [1750395,35955] 0 2023-12-17T11:57:32.017 INFO:tasks.workunit.client.0.smithi002.stdout:3/51: truncate d9/ff 382257 0 2023-12-17T11:57:32.018 INFO:tasks.workunit.client.0.smithi002.stdout:3/52: creat d9/f11 x:0 0 0 2023-12-17T11:57:32.018 INFO:tasks.workunit.client.0.smithi002.stdout:3/53: creat d9/f12 x:0 0 0 2023-12-17T11:57:32.020 INFO:tasks.workunit.client.0.smithi002.stdout:3/54: rename d9/ff to d9/f13 0 2023-12-17T11:57:32.020 INFO:tasks.workunit.client.0.smithi002.stdout:3/55: read - d9/f12 zero size 2023-12-17T11:57:32.020 INFO:tasks.workunit.client.0.smithi002.stdout:3/56: creat d9/f14 x:0 0 0 2023-12-17T11:57:32.024 INFO:tasks.workunit.client.0.smithi002.stdout:3/57: getdents d9 0 2023-12-17T11:57:32.024 INFO:tasks.workunit.client.0.smithi002.stdout:3/58: dread - d9/f11 zero size 2023-12-17T11:57:32.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/23: dwrite d0/f1 [0,4194304] 0 2023-12-17T11:57:32.029 INFO:tasks.workunit.client.0.smithi002.stdout:4/24: unlink d0/f1 0 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/25: symlink d0/l2 0 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/26: rename d0 to d0/d3 22 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/27: dwrite - no filename 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/28: fsync - no filename 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/29: dwrite - no filename 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/30: readlink d0/l2 0 2023-12-17T11:57:32.032 INFO:tasks.workunit.client.0.smithi002.stdout:4/31: chown d0/l2 104913149 1 2023-12-17T11:57:32.045 INFO:tasks.workunit.client.0.smithi002.stdout:1/18: dread f1 [0,4194304] 0 2023-12-17T11:57:32.050 INFO:tasks.workunit.client.0.smithi002.stdout:2/40: dread d3/d4/f5 [4194304,4194304] 0 2023-12-17T11:57:32.050 INFO:tasks.workunit.client.0.smithi002.stdout:8/31: dwrite d3/fc [4194304,4194304] 0 2023-12-17T11:57:32.053 INFO:tasks.workunit.client.0.smithi002.stdout:2/41: truncate d3/d4/f5 9426077 0 2023-12-17T11:57:32.055 INFO:tasks.workunit.client.0.smithi002.stdout:8/32: unlink d3/c6 0 2023-12-17T11:57:32.064 INFO:tasks.workunit.client.0.smithi002.stdout:6/9: sync 2023-12-17T11:57:32.064 INFO:tasks.workunit.client.0.smithi002.stdout:7/25: sync 2023-12-17T11:57:32.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/5: sync 2023-12-17T11:57:32.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/6: truncate f0 111124 0 2023-12-17T11:57:32.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/7: truncate f0 300184 0 2023-12-17T11:57:32.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/8: stat c1 0 2023-12-17T11:57:32.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/9: write f0 [1136175,17528] 0 2023-12-17T11:57:32.066 INFO:tasks.workunit.client.0.smithi002.stdout:0/21: sync 2023-12-17T11:57:32.067 INFO:tasks.workunit.client.0.smithi002.stdout:7/26: rename d6/d8 to d6/da 0 2023-12-17T11:57:32.069 INFO:tasks.workunit.client.0.smithi002.stdout:6/10: creat d0/f3 x:0 0 0 2023-12-17T11:57:32.069 INFO:tasks.workunit.client.0.smithi002.stdout:6/11: dread - d0/f3 zero size 2023-12-17T11:57:32.069 INFO:tasks.workunit.client.0.smithi002.stdout:7/27: truncate f0 1329983 0 2023-12-17T11:57:32.070 INFO:tasks.workunit.client.0.smithi002.stdout:6/12: symlink d0/l4 0 2023-12-17T11:57:32.071 INFO:tasks.workunit.client.0.smithi002.stdout:6/13: fdatasync d0/f3 0 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/14: link d0/l4 d0/d1/l5 0 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/15: chown d0/d1/d2 1661843 1 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/16: fdatasync d0/f3 0 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/17: chown d0/f3 7432 1 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/18: chown d0/l4 53298067 1 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/19: dread - d0/f3 zero size 2023-12-17T11:57:32.073 INFO:tasks.workunit.client.0.smithi002.stdout:6/20: write d0/f3 [120258,122606] 0 2023-12-17T11:57:32.080 INFO:tasks.workunit.client.0.smithi002.stdout:9/65: dwrite dc/f16 [0,4194304] 0 2023-12-17T11:57:32.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/59: dwrite d9/f13 [0,4194304] 0 2023-12-17T11:57:32.080 INFO:tasks.workunit.client.0.smithi002.stdout:3/60: read f7 [2271772,22842] 0 2023-12-17T11:57:32.081 INFO:tasks.workunit.client.0.smithi002.stdout:3/61: read - d9/f11 zero size 2023-12-17T11:57:32.082 INFO:tasks.workunit.client.0.smithi002.stdout:6/21: fdatasync d0/f3 0 2023-12-17T11:57:32.082 INFO:tasks.workunit.client.0.smithi002.stdout:6/22: chown d0/d1 2080 1 2023-12-17T11:57:32.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/62: readlink l2 0 2023-12-17T11:57:32.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/63: stat d9/cd 0 2023-12-17T11:57:32.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/64: getdents d9 0 2023-12-17T11:57:32.083 INFO:tasks.workunit.client.0.smithi002.stdout:3/65: chown l4 51 1 2023-12-17T11:57:32.083 INFO:tasks.workunit.client.0.smithi002.stdout:6/23: symlink d0/d1/l6 0 2023-12-17T11:57:32.084 INFO:tasks.workunit.client.0.smithi002.stdout:3/66: rmdir d9 39 2023-12-17T11:57:32.087 INFO:tasks.workunit.client.0.smithi002.stdout:6/24: mknod d0/c7 0 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:4/28: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:8/8: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:9/64: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:3/10: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:0/13: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:4/29: chown f1 4040381 1 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:1/1: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:2/0: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:7/58: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:6/2: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:5/49: sync 2023-12-17T11:57:32.095 INFO:tasks.workunit.client.1.smithi119.stdout:9/65: creat d12/f19 x:0 0 0 2023-12-17T11:57:32.096 INFO:tasks.workunit.client.1.smithi119.stdout:9/66: read f7 [1167928,48787] 0 2023-12-17T11:57:32.097 INFO:tasks.workunit.client.0.smithi002.stdout:3/67: mkdir d9/d15 0 2023-12-17T11:57:32.099 INFO:tasks.workunit.client.0.smithi002.stdout:8/33: read d3/fc [7713198,21444] 0 2023-12-17T11:57:32.100 INFO:tasks.workunit.client.0.smithi002.stdout:8/34: rename d3/d8/da to d3/d8/da/de 22 2023-12-17T11:57:32.100 INFO:tasks.workunit.client.0.smithi002.stdout:8/35: readlink d3/d8/lb 0 2023-12-17T11:57:32.100 INFO:tasks.workunit.client.1.smithi119.stdout:8/9: symlink l1 0 2023-12-17T11:57:32.100 INFO:tasks.workunit.client.1.smithi119.stdout:8/10: truncate - no filename 2023-12-17T11:57:32.100 INFO:tasks.workunit.client.1.smithi119.stdout:8/11: fsync - no filename 2023-12-17T11:57:32.100 INFO:tasks.workunit.client.1.smithi119.stdout:8/12: dread - no filename 2023-12-17T11:57:32.101 INFO:tasks.workunit.client.1.smithi119.stdout:4/30: symlink l9 0 2023-12-17T11:57:32.103 INFO:tasks.workunit.client.1.smithi119.stdout:2/1: symlink l0 0 2023-12-17T11:57:32.103 INFO:tasks.workunit.client.1.smithi119.stdout:2/2: dwrite - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/3: unlink c1 0 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/4: dwrite - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/5: truncate - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/6: read - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/7: stat - no entries 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/8: truncate - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/9: dread - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/10: write - no filename 2023-12-17T11:57:32.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/11: write - no filename 2023-12-17T11:57:32.106 INFO:tasks.workunit.client.1.smithi119.stdout:5/50: link c0 d1/cf 0 2023-12-17T11:57:32.107 INFO:tasks.workunit.client.1.smithi119.stdout:7/59: mkdir d2/d4/d11 0 2023-12-17T11:57:32.109 INFO:tasks.workunit.client.0.smithi002.stdout:5/10: read f0 [964083,114994] 0 2023-12-17T11:57:32.109 INFO:tasks.workunit.client.0.smithi002.stdout:5/11: fsync f0 0 2023-12-17T11:57:32.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/36: symlink d3/d8/da/lf 0 2023-12-17T11:57:32.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/37: stat d3/d8/lb 0 2023-12-17T11:57:32.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/38: truncate d3/f5 4709617 0 2023-12-17T11:57:32.110 INFO:tasks.workunit.client.0.smithi002.stdout:5/12: mknod c2 0 2023-12-17T11:57:32.111 INFO:tasks.workunit.client.1.smithi119.stdout:0/14: mkdir d2 0 2023-12-17T11:57:32.111 INFO:tasks.workunit.client.1.smithi119.stdout:6/12: mkdir d2 0 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.1.smithi119.stdout:8/13: rename l1 to l2 0 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.1.smithi119.stdout:5/51: creat d1/f10 x:0 0 0 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.1.smithi119.stdout:8/14: fdatasync - no filename 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.1.smithi119.stdout:3/11: getdents . 0 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.1.smithi119.stdout:2/3: mkdir d1 0 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.1.smithi119.stdout:2/4: write - no filename 2023-12-17T11:57:32.112 INFO:tasks.workunit.client.0.smithi002.stdout:5/13: write f0 [2154153,116567] 0 2023-12-17T11:57:32.113 INFO:tasks.workunit.client.0.smithi002.stdout:5/14: chown c2 7 1 2023-12-17T11:57:32.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/15: mkdir d2/d3 0 2023-12-17T11:57:32.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/16: stat d2/d3 0 2023-12-17T11:57:32.114 INFO:tasks.workunit.client.1.smithi119.stdout:0/17: chown d2 13857 1 2023-12-17T11:57:32.115 INFO:tasks.workunit.client.1.smithi119.stdout:6/13: symlink d2/l3 0 2023-12-17T11:57:32.115 INFO:tasks.workunit.client.1.smithi119.stdout:2/5: rmdir d1 0 2023-12-17T11:57:32.115 INFO:tasks.workunit.client.1.smithi119.stdout:2/6: fsync - no filename 2023-12-17T11:57:32.115 INFO:tasks.workunit.client.1.smithi119.stdout:2/7: write - no filename 2023-12-17T11:57:32.116 INFO:tasks.workunit.client.1.smithi119.stdout:6/14: creat d2/f4 x:0 0 0 2023-12-17T11:57:32.116 INFO:tasks.workunit.client.1.smithi119.stdout:6/15: creat d2/f5 x:0 0 0 2023-12-17T11:57:32.117 INFO:tasks.workunit.client.1.smithi119.stdout:6/16: fdatasync d2/f4 0 2023-12-17T11:57:32.117 INFO:tasks.workunit.client.1.smithi119.stdout:6/17: dread - d2/f4 zero size 2023-12-17T11:57:32.118 INFO:tasks.workunit.client.1.smithi119.stdout:5/52: read d1/f8 [207271,19773] 0 2023-12-17T11:57:32.118 INFO:tasks.workunit.client.1.smithi119.stdout:5/53: creat d1/f11 x:0 0 0 2023-12-17T11:57:32.118 INFO:tasks.workunit.client.1.smithi119.stdout:5/54: creat d1/f12 x:0 0 0 2023-12-17T11:57:32.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/8: symlink l2 0 2023-12-17T11:57:32.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/9: dwrite - no filename 2023-12-17T11:57:32.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/10: read - no filename 2023-12-17T11:57:32.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/11: chown l2 30798085 1 2023-12-17T11:57:32.125 INFO:tasks.workunit.client.1.smithi119.stdout:2/12: rename l2 to l3 0 2023-12-17T11:57:32.127 INFO:tasks.workunit.client.1.smithi119.stdout:7/60: read d2/f3 [1842,89128] 0 2023-12-17T11:57:32.127 INFO:tasks.workunit.client.1.smithi119.stdout:7/61: write d2/f3 [681670,110074] 0 2023-12-17T11:57:32.128 INFO:tasks.workunit.client.1.smithi119.stdout:2/13: creat f4 x:0 0 0 2023-12-17T11:57:32.128 INFO:tasks.workunit.client.1.smithi119.stdout:2/14: creat f5 x:0 0 0 2023-12-17T11:57:32.128 INFO:tasks.workunit.client.1.smithi119.stdout:2/15: chown l0 124895 1 2023-12-17T11:57:32.129 INFO:tasks.workunit.client.1.smithi119.stdout:7/62: symlink d2/d4/l12 0 2023-12-17T11:57:32.135 INFO:tasks.workunit.client.1.smithi119.stdout:7/63: creat d2/d4/d11/f13 x:0 0 0 2023-12-17T11:57:32.135 INFO:tasks.workunit.client.1.smithi119.stdout:7/64: truncate d2/d4/ff 4402024 0 2023-12-17T11:57:32.135 INFO:tasks.workunit.client.1.smithi119.stdout:7/65: write d2/fe [1383183,1712] 0 2023-12-17T11:57:32.139 INFO:tasks.workunit.client.0.smithi002.stdout:8/39: read d3/fc [3690775,27807] 0 2023-12-17T11:57:32.145 INFO:tasks.workunit.client.0.smithi002.stdout:1/19: dwrite f1 [0,4194304] 0 2023-12-17T11:57:32.145 INFO:tasks.workunit.client.0.smithi002.stdout:1/20: chown f1 413578 1 2023-12-17T11:57:32.147 INFO:tasks.workunit.client.0.smithi002.stdout:2/42: dwrite d3/d4/f5 [8388608,4194304] 0 2023-12-17T11:57:32.147 INFO:tasks.workunit.client.0.smithi002.stdout:2/43: creat d3/d4/f13 x:0 0 0 2023-12-17T11:57:32.149 INFO:tasks.workunit.client.0.smithi002.stdout:1/21: mknod d3/c4 0 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.0.smithi002.stdout:1/22: readlink l2 0 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.0.smithi002.stdout:1/23: chown d3/c4 37607 1 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/15: getdents . 0 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/16: fsync - no filename 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/17: write - no filename 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/18: fsync - no filename 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/19: dread - no filename 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/20: read - no filename 2023-12-17T11:57:32.150 INFO:tasks.workunit.client.1.smithi119.stdout:8/21: dwrite - no filename 2023-12-17T11:57:32.151 INFO:tasks.workunit.client.1.smithi119.stdout:8/22: readlink l0 0 2023-12-17T11:57:32.151 INFO:tasks.workunit.client.1.smithi119.stdout:0/18: getdents d2 0 2023-12-17T11:57:32.154 INFO:tasks.workunit.client.1.smithi119.stdout:8/23: unlink l2 0 2023-12-17T11:57:32.157 INFO:tasks.workunit.client.0.smithi002.stdout:9/66: dwrite dc/f10 [0,4194304] 0 2023-12-17T11:57:32.161 INFO:tasks.workunit.client.0.smithi002.stdout:9/67: symlink dc/l1c 0 2023-12-17T11:57:32.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/68: read - f6 zero size 2023-12-17T11:57:32.164 INFO:tasks.workunit.client.0.smithi002.stdout:9/69: mkdir dc/d1d 0 2023-12-17T11:57:32.165 INFO:tasks.workunit.client.1.smithi119.stdout:1/2: dwrite f0 [0,4194304] 0 2023-12-17T11:57:32.165 INFO:tasks.workunit.client.1.smithi119.stdout:1/3: rmdir - no directory 2023-12-17T11:57:32.165 INFO:tasks.workunit.client.1.smithi119.stdout:1/4: symlink l1 0 2023-12-17T11:57:32.166 INFO:tasks.workunit.client.0.smithi002.stdout:9/70: rename dc/f17 to dc/f1e 0 2023-12-17T11:57:32.169 INFO:tasks.workunit.client.0.smithi002.stdout:9/71: truncate dc/f14 2822672 0 2023-12-17T11:57:32.169 INFO:tasks.workunit.client.0.smithi002.stdout:9/72: dread - dc/f1b zero size 2023-12-17T11:57:32.170 INFO:tasks.workunit.client.0.smithi002.stdout:7/28: dwrite f0 [0,4194304] 0 2023-12-17T11:57:32.170 INFO:tasks.workunit.client.0.smithi002.stdout:7/29: chown d6/da 239 1 2023-12-17T11:57:32.170 INFO:tasks.workunit.client.0.smithi002.stdout:7/30: chown d6/da 35863 1 2023-12-17T11:57:32.175 INFO:tasks.workunit.client.1.smithi119.stdout:9/67: dwrite d12/f17 [0,4194304] 0 2023-12-17T11:57:32.176 INFO:tasks.workunit.client.1.smithi119.stdout:9/68: dread - d12/f19 zero size 2023-12-17T11:57:32.178 INFO:tasks.workunit.client.0.smithi002.stdout:9/73: rename dc/f10 to dc/f1f 0 2023-12-17T11:57:32.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/31: symlink d6/da/lb 0 2023-12-17T11:57:32.179 INFO:tasks.workunit.client.1.smithi119.stdout:9/69: rename d12/l18 to d12/l1a 0 2023-12-17T11:57:32.179 INFO:tasks.workunit.client.0.smithi002.stdout:5/15: dread f0 [0,4194304] 0 2023-12-17T11:57:32.179 INFO:tasks.workunit.client.0.smithi002.stdout:5/16: read f0 [959838,117896] 0 2023-12-17T11:57:32.181 INFO:tasks.workunit.client.0.smithi002.stdout:7/32: mkdir d6/da/dc 0 2023-12-17T11:57:32.182 INFO:tasks.workunit.client.0.smithi002.stdout:9/74: mknod dc/d1d/c20 0 2023-12-17T11:57:32.182 INFO:tasks.workunit.client.0.smithi002.stdout:9/75: fsync fb 0 2023-12-17T11:57:32.182 INFO:tasks.workunit.client.0.smithi002.stdout:9/76: creat dc/f21 x:0 0 0 2023-12-17T11:57:32.182 INFO:tasks.workunit.client.1.smithi119.stdout:9/70: symlink d12/l1b 0 2023-12-17T11:57:32.183 INFO:tasks.workunit.client.1.smithi119.stdout:9/71: chown ld 1757 1 2023-12-17T11:57:32.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/17: rename f0 to f3 0 2023-12-17T11:57:32.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/18: chown f3 43 1 2023-12-17T11:57:32.184 INFO:tasks.workunit.client.0.smithi002.stdout:1/24: dread f1 [0,4194304] 0 2023-12-17T11:57:32.187 INFO:tasks.workunit.client.1.smithi119.stdout:9/72: rename f7 to d12/f1c 0 2023-12-17T11:57:32.190 INFO:tasks.workunit.client.0.smithi002.stdout:9/77: unlink f6 0 2023-12-17T11:57:32.190 INFO:tasks.workunit.client.0.smithi002.stdout:9/78: creat dc/f22 x:0 0 0 2023-12-17T11:57:32.194 INFO:tasks.workunit.client.0.smithi002.stdout:8/40: rmdir d3 39 2023-12-17T11:57:32.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/73: dread d12/f1c [0,4194304] 0 2023-12-17T11:57:32.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/74: fsync f11 0 2023-12-17T11:57:32.196 INFO:tasks.workunit.client.1.smithi119.stdout:7/66: getdents d2/d4/d11 0 2023-12-17T11:57:32.196 INFO:tasks.workunit.client.1.smithi119.stdout:7/67: mknod d2/d4/c14 0 2023-12-17T11:57:32.197 INFO:tasks.workunit.client.1.smithi119.stdout:7/68: mknod d2/c15 0 2023-12-17T11:57:32.197 INFO:tasks.workunit.client.1.smithi119.stdout:7/69: readlink d2/d4/l5 0 2023-12-17T11:57:32.198 INFO:tasks.workunit.client.0.smithi002.stdout:8/41: truncate d3/fc 1803545 0 2023-12-17T11:57:32.199 INFO:tasks.workunit.client.1.smithi119.stdout:7/70: creat d2/d4/f16 x:0 0 0 2023-12-17T11:57:32.199 INFO:tasks.workunit.client.1.smithi119.stdout:7/71: chown d2/d4/l12 2628049 1 2023-12-17T11:57:32.199 INFO:tasks.workunit.client.1.smithi119.stdout:7/72: chown d2/d4/d11/f13 4417968 1 2023-12-17T11:57:32.199 INFO:tasks.workunit.client.1.smithi119.stdout:7/73: chown d2/d4/ff 7095634 1 2023-12-17T11:57:32.203 INFO:tasks.workunit.client.1.smithi119.stdout:6/18: dwrite d2/f5 [0,4194304] 0 2023-12-17T11:57:32.207 INFO:tasks.workunit.client.1.smithi119.stdout:5/55: dwrite d1/f3 [0,4194304] 0 2023-12-17T11:57:32.208 INFO:tasks.workunit.client.1.smithi119.stdout:5/56: mknod d1/c13 0 2023-12-17T11:57:32.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/68: dwrite f5 [0,4194304] 0 2023-12-17T11:57:32.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/69: chown f7 693 1 2023-12-17T11:57:32.212 INFO:tasks.workunit.client.0.smithi002.stdout:1/25: getdents d3 0 2023-12-17T11:57:32.213 INFO:tasks.workunit.client.0.smithi002.stdout:2/44: dwrite d3/d4/f6 [0,4194304] 0 2023-12-17T11:57:32.213 INFO:tasks.workunit.client.1.smithi119.stdout:3/12: dwrite f2 [4194304,4194304] 0 2023-12-17T11:57:32.214 INFO:tasks.workunit.client.1.smithi119.stdout:3/13: fdatasync f0 0 2023-12-17T11:57:32.214 INFO:tasks.workunit.client.1.smithi119.stdout:3/14: readlink - no filename 2023-12-17T11:57:32.214 INFO:tasks.workunit.client.1.smithi119.stdout:1/5: write f0 [4425521,114785] 0 2023-12-17T11:57:32.215 INFO:tasks.workunit.client.1.smithi119.stdout:2/16: dwrite f4 [0,4194304] 0 2023-12-17T11:57:32.217 INFO:tasks.workunit.client.1.smithi119.stdout:3/15: creat f4 x:0 0 0 2023-12-17T11:57:32.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/74: getdents d2/d4 0 2023-12-17T11:57:32.221 INFO:tasks.workunit.client.0.smithi002.stdout:3/70: rename d9/fc to d9/d15/f16 0 2023-12-17T11:57:32.221 INFO:tasks.workunit.client.1.smithi119.stdout:6/19: write d2/f5 [4524891,112107] 0 2023-12-17T11:57:32.221 INFO:tasks.workunit.client.1.smithi119.stdout:6/20: dread - d2/f4 zero size 2023-12-17T11:57:32.231 INFO:tasks.workunit.client.1.smithi119.stdout:2/17: mkdir d6 0 2023-12-17T11:57:32.232 INFO:tasks.workunit.client.0.smithi002.stdout:2/45: mkdir d3/d4/d7/d14 0 2023-12-17T11:57:32.233 INFO:tasks.workunit.client.0.smithi002.stdout:7/33: write f0 [1052819,20628] 0 2023-12-17T11:57:32.234 INFO:tasks.workunit.client.0.smithi002.stdout:7/34: readlink l5 0 2023-12-17T11:57:32.234 INFO:tasks.workunit.client.0.smithi002.stdout:1/26: dread f1 [0,4194304] 0 2023-12-17T11:57:32.234 INFO:tasks.workunit.client.0.smithi002.stdout:3/71: mknod d9/d15/c17 0 2023-12-17T11:57:32.235 INFO:tasks.workunit.client.0.smithi002.stdout:3/72: write f3 [391171,38133] 0 2023-12-17T11:57:32.238 INFO:tasks.workunit.client.1.smithi119.stdout:6/21: rename d2/l3 to d2/l6 0 2023-12-17T11:57:32.240 INFO:tasks.workunit.client.0.smithi002.stdout:2/46: mknod d3/d4/d7/d14/c15 0 2023-12-17T11:57:32.240 INFO:tasks.workunit.client.0.smithi002.stdout:2/47: truncate d3/d4/d7/f11 118521 0 2023-12-17T11:57:32.241 INFO:tasks.workunit.client.0.smithi002.stdout:7/35: unlink d6/da/lb 0 2023-12-17T11:57:32.243 INFO:tasks.workunit.client.1.smithi119.stdout:2/18: mknod d6/c7 0 2023-12-17T11:57:32.244 INFO:tasks.workunit.client.1.smithi119.stdout:7/75: truncate d2/f3 1922841 0 2023-12-17T11:57:32.244 INFO:tasks.workunit.client.1.smithi119.stdout:7/76: chown d2/f3 1254448585 1 2023-12-17T11:57:32.245 INFO:tasks.workunit.client.0.smithi002.stdout:3/73: rmdir d9/d15 39 2023-12-17T11:57:32.245 INFO:tasks.workunit.client.1.smithi119.stdout:6/22: link d2/f4 d2/f7 0 2023-12-17T11:57:32.246 INFO:tasks.workunit.client.1.smithi119.stdout:3/16: getdents . 0 2023-12-17T11:57:32.248 INFO:tasks.workunit.client.0.smithi002.stdout:9/79: dwrite f4 [0,4194304] 0 2023-12-17T11:57:32.251 INFO:tasks.workunit.client.0.smithi002.stdout:1/27: truncate f1 414688 0 2023-12-17T11:57:32.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/80: dread fb [0,4194304] 0 2023-12-17T11:57:32.253 INFO:tasks.workunit.client.1.smithi119.stdout:1/6: write f0 [892597,99441] 0 2023-12-17T11:57:32.254 INFO:tasks.workunit.client.1.smithi119.stdout:1/7: creat f2 x:0 0 0 2023-12-17T11:57:32.254 INFO:tasks.workunit.client.1.smithi119.stdout:1/8: write f0 [3440053,127366] 0 2023-12-17T11:57:32.254 INFO:tasks.workunit.client.0.smithi002.stdout:9/81: mkdir dc/d1d/d23 0 2023-12-17T11:57:32.254 INFO:tasks.workunit.client.0.smithi002.stdout:9/82: chown dc/d1d/d23 26 1 2023-12-17T11:57:32.255 INFO:tasks.workunit.client.0.smithi002.stdout:9/83: mkdir dc/d1d/d23/d24 0 2023-12-17T11:57:32.255 INFO:tasks.workunit.client.0.smithi002.stdout:9/84: fdatasync fb 0 2023-12-17T11:57:32.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/85: mkdir dc/d1d/d25 0 2023-12-17T11:57:32.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/86: fsync f9 0 2023-12-17T11:57:32.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/87: chown dc/d1d/d25 23 1 2023-12-17T11:57:32.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/88: chown dc/f13 0 1 2023-12-17T11:57:32.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/89: write dc/f21 [60804,96767] 0 2023-12-17T11:57:32.257 INFO:tasks.workunit.client.1.smithi119.stdout:1/9: write f2 [116273,91649] 0 2023-12-17T11:57:32.257 INFO:tasks.workunit.client.0.smithi002.stdout:9/90: mknod dc/d1d/d23/d24/c26 0 2023-12-17T11:57:32.257 INFO:tasks.workunit.client.0.smithi002.stdout:9/91: read - f2 zero size 2023-12-17T11:57:32.262 INFO:tasks.workunit.client.1.smithi119.stdout:5/57: dwrite d1/f10 [0,4194304] 0 2023-12-17T11:57:32.263 INFO:tasks.workunit.client.0.smithi002.stdout:7/36: rmdir d6/da 39 2023-12-17T11:57:32.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/19: dwrite f3 [0,4194304] 0 2023-12-17T11:57:32.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/92: getdents dc/d1d/d23/d24 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:6/23: rename d2/l6 to d2/l8 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/58: unlink d1/f10 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/59: write d1/f11 [269667,48360] 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/60: symlink d1/l14 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/61: chown d1/fe 219710 1 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/62: chown d1/fc 138615 1 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/63: readlink d1/l9 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:5/64: mkdir d1/d15 0 2023-12-17T11:57:32.275 INFO:tasks.workunit.client.1.smithi119.stdout:2/19: dread f4 [0,4194304] 0 2023-12-17T11:57:32.277 INFO:tasks.workunit.client.1.smithi119.stdout:2/20: getdents d6 0 2023-12-17T11:57:32.279 INFO:tasks.workunit.client.0.smithi002.stdout:9/93: symlink dc/d1d/d25/l27 0 2023-12-17T11:57:32.293 INFO:tasks.workunit.client.0.smithi002.stdout:5/20: dread f3 [0,4194304] 0 2023-12-17T11:57:32.297 INFO:tasks.workunit.client.1.smithi119.stdout:6/24: read d2/f5 [4079094,12405] 0 2023-12-17T11:57:32.301 INFO:tasks.workunit.client.0.smithi002.stdout:4/32: sync 2023-12-17T11:57:32.301 INFO:tasks.workunit.client.0.smithi002.stdout:4/33: chown d0 1 1 2023-12-17T11:57:32.301 INFO:tasks.workunit.client.0.smithi002.stdout:4/34: creat d0/f4 x:0 0 0 2023-12-17T11:57:32.307 INFO:tasks.workunit.client.0.smithi002.stdout:4/35: symlink d0/l5 0 2023-12-17T11:57:32.310 INFO:tasks.workunit.client.0.smithi002.stdout:4/36: rename d0/l2 to d0/l6 0 2023-12-17T11:57:32.310 INFO:tasks.workunit.client.0.smithi002.stdout:4/37: creat d0/f7 x:0 0 0 2023-12-17T11:57:32.328 INFO:tasks.workunit.client.1.smithi119.stdout:1/10: dwrite f2 [0,4194304] 0 2023-12-17T11:57:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:5/21: dread f3 [0,4194304] 0 2023-12-17T11:57:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:5/22: fdatasync f3 0 2023-12-17T11:57:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:5/23: creat f4 x:0 0 0 2023-12-17T11:57:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:5/24: fdatasync f3 0 2023-12-17T11:57:32.329 INFO:tasks.workunit.client.0.smithi002.stdout:5/25: write f4 [242624,76441] 0 2023-12-17T11:57:32.330 INFO:tasks.workunit.client.0.smithi002.stdout:5/26: fdatasync f3 0 2023-12-17T11:57:32.332 INFO:tasks.workunit.client.1.smithi119.stdout:1/11: unlink f0 0 2023-12-17T11:57:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/48: dwrite d3/d4/f6 [4194304,4194304] 0 2023-12-17T11:57:32.332 INFO:tasks.workunit.client.0.smithi002.stdout:2/49: fsync d3/d4/fe 0 2023-12-17T11:57:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:2/50: creat d3/d4/f16 x:0 0 0 2023-12-17T11:57:32.333 INFO:tasks.workunit.client.0.smithi002.stdout:5/27: truncate f3 3955854 0 2023-12-17T11:57:32.336 INFO:tasks.workunit.client.1.smithi119.stdout:7/77: dwrite d2/d4/f16 [0,4194304] 0 2023-12-17T11:57:32.336 INFO:tasks.workunit.client.0.smithi002.stdout:2/51: mkdir d3/d4/d17 0 2023-12-17T11:57:32.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/78: mknod d2/c17 0 2023-12-17T11:57:32.340 INFO:tasks.workunit.client.0.smithi002.stdout:1/28: dwrite f1 [0,4194304] 0 2023-12-17T11:57:32.340 INFO:tasks.workunit.client.1.smithi119.stdout:7/79: mknod d2/d4/c18 0 2023-12-17T11:57:32.341 INFO:tasks.workunit.client.1.smithi119.stdout:7/80: readlink d2/lc 0 2023-12-17T11:57:32.341 INFO:tasks.workunit.client.1.smithi119.stdout:7/81: creat d2/f19 x:0 0 0 2023-12-17T11:57:32.341 INFO:tasks.workunit.client.1.smithi119.stdout:3/17: dwrite f2 [4194304,4194304] 0 2023-12-17T11:57:32.342 INFO:tasks.workunit.client.0.smithi002.stdout:3/74: dwrite f6 [0,4194304] 0 2023-12-17T11:57:32.342 INFO:tasks.workunit.client.0.smithi002.stdout:3/75: fdatasync f6 0 2023-12-17T11:57:32.342 INFO:tasks.workunit.client.1.smithi119.stdout:5/65: dwrite d1/fd [0,4194304] 0 2023-12-17T11:57:32.344 INFO:tasks.workunit.client.1.smithi119.stdout:7/82: link d2/d4/c8 d2/d4/d11/c1a 0 2023-12-17T11:57:32.344 INFO:tasks.workunit.client.0.smithi002.stdout:3/76: mknod d9/c18 0 2023-12-17T11:57:32.344 INFO:tasks.workunit.client.1.smithi119.stdout:2/21: dwrite f5 [0,4194304] 0 2023-12-17T11:57:32.346 INFO:tasks.workunit.client.1.smithi119.stdout:3/18: creat f5 x:0 0 0 2023-12-17T11:57:32.347 INFO:tasks.workunit.client.1.smithi119.stdout:7/83: write d2/fe [1148245,112412] 0 2023-12-17T11:57:32.349 INFO:tasks.workunit.client.1.smithi119.stdout:6/25: truncate d2/f5 3436463 0 2023-12-17T11:57:32.349 INFO:tasks.workunit.client.1.smithi119.stdout:6/26: readlink d2/l8 0 2023-12-17T11:57:32.352 INFO:tasks.workunit.client.0.smithi002.stdout:7/37: dwrite f0 [0,4194304] 0 2023-12-17T11:57:32.355 INFO:tasks.workunit.client.0.smithi002.stdout:7/38: mknod d6/da/cd 0 2023-12-17T11:57:32.355 INFO:tasks.workunit.client.0.smithi002.stdout:7/39: fsync f0 0 2023-12-17T11:57:32.360 INFO:tasks.workunit.client.1.smithi119.stdout:2/22: dread f4 [0,4194304] 0 2023-12-17T11:57:32.362 INFO:tasks.workunit.client.1.smithi119.stdout:2/23: rename l0 to d6/l8 0 2023-12-17T11:57:32.365 INFO:tasks.workunit.client.1.smithi119.stdout:2/24: mkdir d6/d9 0 2023-12-17T11:57:32.365 INFO:tasks.workunit.client.1.smithi119.stdout:2/25: getdents d6/d9 0 2023-12-17T11:57:32.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/28: write f3 [461243,110684] 0 2023-12-17T11:57:32.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/29: write f3 [2089984,117959] 0 2023-12-17T11:57:32.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/30: write f3 [3567331,106238] 0 2023-12-17T11:57:32.369 INFO:tasks.workunit.client.0.smithi002.stdout:7/40: creat d6/fe x:0 0 0 2023-12-17T11:57:32.369 INFO:tasks.workunit.client.0.smithi002.stdout:3/77: write f5 [607429,46963] 0 2023-12-17T11:57:32.369 INFO:tasks.workunit.client.0.smithi002.stdout:4/38: dwrite d0/f7 [0,4194304] 0 2023-12-17T11:57:32.371 INFO:tasks.workunit.client.1.smithi119.stdout:5/66: dread d1/f3 [0,4194304] 0 2023-12-17T11:57:32.375 INFO:tasks.workunit.client.0.smithi002.stdout:5/31: rename c2 to c5 0 2023-12-17T11:57:32.376 INFO:tasks.workunit.client.1.smithi119.stdout:6/27: rmdir d2 39 2023-12-17T11:57:32.377 INFO:tasks.workunit.client.1.smithi119.stdout:2/26: truncate f5 473897 0 2023-12-17T11:57:32.377 INFO:tasks.workunit.client.1.smithi119.stdout:3/19: dread f2 [4194304,4194304] 0 2023-12-17T11:57:32.380 INFO:tasks.workunit.client.1.smithi119.stdout:3/20: rename f2 to f6 0 2023-12-17T11:57:32.380 INFO:tasks.workunit.client.1.smithi119.stdout:3/21: creat f7 x:0 0 0 2023-12-17T11:57:32.384 INFO:tasks.workunit.client.1.smithi119.stdout:7/84: dwrite d2/d4/f16 [0,4194304] 0 2023-12-17T11:57:32.385 INFO:tasks.workunit.client.1.smithi119.stdout:5/67: read d1/f3 [297225,37356] 0 2023-12-17T11:57:32.385 INFO:tasks.workunit.client.1.smithi119.stdout:5/68: chown d1/f11 48 1 2023-12-17T11:57:32.386 INFO:tasks.workunit.client.1.smithi119.stdout:7/85: mknod d2/d4/c1b 0 2023-12-17T11:57:32.386 INFO:tasks.workunit.client.1.smithi119.stdout:7/86: dread - d2/f19 zero size 2023-12-17T11:57:32.386 INFO:tasks.workunit.client.0.smithi002.stdout:3/78: rmdir d9 39 2023-12-17T11:57:32.386 INFO:tasks.workunit.client.0.smithi002.stdout:7/41: mknod d6/da/cf 0 2023-12-17T11:57:32.387 INFO:tasks.workunit.client.0.smithi002.stdout:7/42: truncate d6/fe 701219 0 2023-12-17T11:57:32.391 INFO:tasks.workunit.client.1.smithi119.stdout:3/22: fsync f6 0 2023-12-17T11:57:32.392 INFO:tasks.workunit.client.0.smithi002.stdout:3/79: unlink d9/cb 0 2023-12-17T11:57:32.394 INFO:tasks.workunit.client.1.smithi119.stdout:3/23: symlink l8 0 2023-12-17T11:57:32.394 INFO:tasks.workunit.client.1.smithi119.stdout:3/24: chown f5 64 1 2023-12-17T11:57:32.394 INFO:tasks.workunit.client.1.smithi119.stdout:3/25: stat f4 0 2023-12-17T11:57:32.396 INFO:tasks.workunit.client.0.smithi002.stdout:2/52: dwrite d3/d4/d7/f11 [0,4194304] 0 2023-12-17T11:57:32.396 INFO:tasks.workunit.client.0.smithi002.stdout:2/53: fdatasync d3/d4/f5 0 2023-12-17T11:57:32.396 INFO:tasks.workunit.client.0.smithi002.stdout:2/54: readlink d3/d4/l12 0 2023-12-17T11:57:32.396 INFO:tasks.workunit.client.1.smithi119.stdout:6/28: truncate d2/f5 3158968 0 2023-12-17T11:57:32.396 INFO:tasks.workunit.client.1.smithi119.stdout:3/26: mkdir d9 0 2023-12-17T11:57:32.396 INFO:tasks.workunit.client.1.smithi119.stdout:3/27: truncate f4 862354 0 2023-12-17T11:57:32.398 INFO:tasks.workunit.client.0.smithi002.stdout:2/55: link c2 d3/c18 0 2023-12-17T11:57:32.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/56: write d3/d4/f16 [61868,22461] 0 2023-12-17T11:57:32.399 INFO:tasks.workunit.client.0.smithi002.stdout:7/43: write f0 [662296,58829] 0 2023-12-17T11:57:32.399 INFO:tasks.workunit.client.0.smithi002.stdout:7/44: stat f0 0 2023-12-17T11:57:32.399 INFO:tasks.workunit.client.0.smithi002.stdout:1/29: dwrite f1 [0,4194304] 0 2023-12-17T11:57:32.405 INFO:tasks.workunit.client.0.smithi002.stdout:2/57: mkdir d3/d4/d17/d19 0 2023-12-17T11:57:32.406 INFO:tasks.workunit.client.1.smithi119.stdout:2/27: read f5 [461280,63870] 0 2023-12-17T11:57:32.407 INFO:tasks.workunit.client.0.smithi002.stdout:3/80: dread d9/f13 [0,4194304] 0 2023-12-17T11:57:32.407 INFO:tasks.workunit.client.0.smithi002.stdout:3/81: fsync f7 0 2023-12-17T11:57:32.407 INFO:tasks.workunit.client.0.smithi002.stdout:3/82: fdatasync d9/f11 0 2023-12-17T11:57:32.407 INFO:tasks.workunit.client.0.smithi002.stdout:7/45: link l5 d6/da/l10 0 2023-12-17T11:57:32.407 INFO:tasks.workunit.client.1.smithi119.stdout:2/28: symlink d6/la 0 2023-12-17T11:57:32.409 INFO:tasks.workunit.client.1.smithi119.stdout:2/29: write f5 [1077409,118299] 0 2023-12-17T11:57:32.410 INFO:tasks.workunit.client.0.smithi002.stdout:1/30: mknod d3/c5 0 2023-12-17T11:57:32.411 INFO:tasks.workunit.client.0.smithi002.stdout:3/83: link d9/f14 d9/d15/f19 0 2023-12-17T11:57:32.416 INFO:tasks.workunit.client.0.smithi002.stdout:2/58: read d3/d4/d7/f11 [2773925,53371] 0 2023-12-17T11:57:32.427 INFO:tasks.workunit.client.1.smithi119.stdout:6/29: truncate d2/f5 3873254 0 2023-12-17T11:57:32.431 INFO:tasks.workunit.client.1.smithi119.stdout:6/30: creat d2/f9 x:0 0 0 2023-12-17T11:57:32.431 INFO:tasks.workunit.client.1.smithi119.stdout:6/31: fsync d2/f4 0 2023-12-17T11:57:32.431 INFO:tasks.workunit.client.1.smithi119.stdout:6/32: truncate d2/f4 774043 0 2023-12-17T11:57:32.435 INFO:tasks.workunit.client.1.smithi119.stdout:6/33: unlink d2/l8 0 2023-12-17T11:57:32.436 INFO:tasks.workunit.client.1.smithi119.stdout:6/34: creat d2/fa x:0 0 0 2023-12-17T11:57:32.436 INFO:tasks.workunit.client.0.smithi002.stdout:1/31: truncate f1 1898315 0 2023-12-17T11:57:32.438 INFO:tasks.workunit.client.1.smithi119.stdout:5/69: dwrite d1/f11 [0,4194304] 0 2023-12-17T11:57:32.438 INFO:tasks.workunit.client.1.smithi119.stdout:2/30: dread f4 [0,4194304] 0 2023-12-17T11:57:32.441 INFO:tasks.workunit.client.0.smithi002.stdout:0/22: sync 2023-12-17T11:57:32.441 INFO:tasks.workunit.client.0.smithi002.stdout:0/23: dread - no filename 2023-12-17T11:57:32.441 INFO:tasks.workunit.client.0.smithi002.stdout:0/24: write - no filename 2023-12-17T11:57:32.441 INFO:tasks.workunit.client.1.smithi119.stdout:5/70: rmdir d1/d15 0 2023-12-17T11:57:32.442 INFO:tasks.workunit.client.0.smithi002.stdout:3/84: rmdir d9 39 2023-12-17T11:57:32.445 INFO:tasks.workunit.client.0.smithi002.stdout:0/25: rename d0/l9 to d0/d6/la 0 2023-12-17T11:57:32.446 INFO:tasks.workunit.client.0.smithi002.stdout:0/26: creat d0/d6/fb x:0 0 0 2023-12-17T11:57:32.447 INFO:tasks.workunit.client.0.smithi002.stdout:0/27: rename d0 to d0/d6/dc 22 2023-12-17T11:57:32.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/28: creat d0/fd x:0 0 0 2023-12-17T11:57:32.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/29: stat d0/d6 0 2023-12-17T11:57:32.452 INFO:tasks.workunit.client.1.smithi119.stdout:2/31: write f4 [1933587,14013] 0 2023-12-17T11:57:32.452 INFO:tasks.workunit.client.0.smithi002.stdout:4/39: dwrite d0/f7 [0,4194304] 0 2023-12-17T11:57:32.455 INFO:tasks.workunit.client.0.smithi002.stdout:4/40: rename d0/f4 to d0/f8 0 2023-12-17T11:57:32.456 INFO:tasks.workunit.client.0.smithi002.stdout:4/41: dread - d0/f8 zero size 2023-12-17T11:57:32.456 INFO:tasks.workunit.client.0.smithi002.stdout:4/42: chown d0/f8 24953 1 2023-12-17T11:57:32.456 INFO:tasks.workunit.client.0.smithi002.stdout:4/43: mknod d0/c9 0 2023-12-17T11:57:32.457 INFO:tasks.workunit.client.0.smithi002.stdout:4/44: mknod d0/ca 0 2023-12-17T11:57:32.458 INFO:tasks.workunit.client.0.smithi002.stdout:4/45: creat d0/fb x:0 0 0 2023-12-17T11:57:32.460 INFO:tasks.workunit.client.0.smithi002.stdout:4/46: symlink d0/lc 0 2023-12-17T11:57:32.460 INFO:tasks.workunit.client.0.smithi002.stdout:4/47: creat d0/fd x:0 0 0 2023-12-17T11:57:32.460 INFO:tasks.workunit.client.0.smithi002.stdout:4/48: chown d0/f8 26586 1 2023-12-17T11:57:32.460 INFO:tasks.workunit.client.0.smithi002.stdout:4/49: truncate d0/fd 406563 0 2023-12-17T11:57:32.460 INFO:tasks.workunit.client.0.smithi002.stdout:4/50: creat d0/fe x:0 0 0 2023-12-17T11:57:32.460 INFO:tasks.workunit.client.0.smithi002.stdout:4/51: fdatasync d0/fb 0 2023-12-17T11:57:32.461 INFO:tasks.workunit.client.1.smithi119.stdout:3/28: dwrite f6 [4194304,4194304] 0 2023-12-17T11:57:32.462 INFO:tasks.workunit.client.1.smithi119.stdout:3/29: mkdir d9/da 0 2023-12-17T11:57:32.463 INFO:tasks.workunit.client.0.smithi002.stdout:7/46: dwrite d6/fe [0,4194304] 0 2023-12-17T11:57:32.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/87: dwrite d2/f19 [0,4194304] 0 2023-12-17T11:57:32.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/88: readlink d2/d4/l12 0 2023-12-17T11:57:32.467 INFO:tasks.workunit.client.0.smithi002.stdout:1/32: fsync f1 0 2023-12-17T11:57:32.467 INFO:tasks.workunit.client.0.smithi002.stdout:7/47: unlink f0 0 2023-12-17T11:57:32.470 INFO:tasks.workunit.client.0.smithi002.stdout:1/33: unlink d3/c4 0 2023-12-17T11:57:32.471 INFO:tasks.workunit.client.0.smithi002.stdout:7/48: mknod d6/c11 0 2023-12-17T11:57:32.472 INFO:tasks.workunit.client.1.smithi119.stdout:7/89: mknod d2/c1c 0 2023-12-17T11:57:32.473 INFO:tasks.workunit.client.1.smithi119.stdout:7/90: chown d2/d4/f16 12704032 1 2023-12-17T11:57:32.478 INFO:tasks.workunit.client.1.smithi119.stdout:3/30: write f0 [3507728,8475] 0 2023-12-17T11:57:32.478 INFO:tasks.workunit.client.1.smithi119.stdout:3/31: chown d9 1736 1 2023-12-17T11:57:32.479 INFO:tasks.workunit.client.1.smithi119.stdout:3/32: symlink d9/lb 0 2023-12-17T11:57:32.480 INFO:tasks.workunit.client.1.smithi119.stdout:6/35: dwrite d2/fa [0,4194304] 0 2023-12-17T11:57:32.481 INFO:tasks.workunit.client.1.smithi119.stdout:6/36: chown d2 1275 1 2023-12-17T11:57:32.481 INFO:tasks.workunit.client.1.smithi119.stdout:6/37: link d2/f9 d2/fb 0 2023-12-17T11:57:32.484 INFO:tasks.workunit.client.0.smithi002.stdout:4/52: dread d0/f7 [0,4194304] 0 2023-12-17T11:57:32.484 INFO:tasks.workunit.client.0.smithi002.stdout:4/53: creat d0/ff x:0 0 0 2023-12-17T11:57:32.490 INFO:tasks.workunit.client.0.smithi002.stdout:4/54: unlink d0/l6 0 2023-12-17T11:57:32.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/55: mkdir d0/d10 0 2023-12-17T11:57:32.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/56: stat d0/lc 0 2023-12-17T11:57:32.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/57: write d0/f8 [332352,120599] 0 2023-12-17T11:57:32.495 INFO:tasks.workunit.client.0.smithi002.stdout:4/58: creat d0/d10/f11 x:0 0 0 2023-12-17T11:57:32.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/59: symlink d0/l12 0 2023-12-17T11:57:32.504 INFO:tasks.workunit.client.1.smithi119.stdout:2/32: dwrite f4 [4194304,4194304] 0 2023-12-17T11:57:32.506 INFO:tasks.workunit.client.0.smithi002.stdout:1/34: dwrite f1 [0,4194304] 0 2023-12-17T11:57:32.509 INFO:tasks.workunit.client.1.smithi119.stdout:2/33: creat d6/d9/fb x:0 0 0 2023-12-17T11:57:32.510 INFO:tasks.workunit.client.1.smithi119.stdout:2/34: readlink d6/la 0 2023-12-17T11:57:32.510 INFO:tasks.workunit.client.1.smithi119.stdout:7/91: write d2/d4/ff [1793261,80586] 0 2023-12-17T11:57:32.512 INFO:tasks.workunit.client.0.smithi002.stdout:1/35: rmdir d3 39 2023-12-17T11:57:32.512 INFO:tasks.workunit.client.0.smithi002.stdout:1/36: write f1 [4481380,15472] 0 2023-12-17T11:57:32.514 INFO:tasks.workunit.client.0.smithi002.stdout:1/37: rmdir d3 39 2023-12-17T11:57:32.514 INFO:tasks.workunit.client.0.smithi002.stdout:1/38: write f1 [5449014,8210] 0 2023-12-17T11:57:32.516 INFO:tasks.workunit.client.0.smithi002.stdout:1/39: mkdir d3/d6 0 2023-12-17T11:57:32.518 INFO:tasks.workunit.client.0.smithi002.stdout:1/40: unlink d3/c5 0 2023-12-17T11:57:32.519 INFO:tasks.workunit.client.0.smithi002.stdout:1/41: readlink l2 0 2023-12-17T11:57:32.525 INFO:tasks.workunit.client.1.smithi119.stdout:2/35: dread f4 [0,4194304] 0 2023-12-17T11:57:32.528 INFO:tasks.workunit.client.0.smithi002.stdout:7/49: dwrite d6/fe [0,4194304] 0 2023-12-17T11:57:32.529 INFO:tasks.workunit.client.0.smithi002.stdout:7/50: mknod d6/da/c12 0 2023-12-17T11:57:32.529 INFO:tasks.workunit.client.0.smithi002.stdout:7/51: chown c4 5088337 1 2023-12-17T11:57:32.530 INFO:tasks.workunit.client.1.smithi119.stdout:6/38: dwrite d2/fb [0,4194304] 0 2023-12-17T11:57:32.530 INFO:tasks.workunit.client.1.smithi119.stdout:6/39: write d2/f5 [3275801,128025] 0 2023-12-17T11:57:32.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/52: mkdir d6/da/dc/d13 0 2023-12-17T11:57:32.534 INFO:tasks.workunit.client.0.smithi002.stdout:1/42: getdents d3 0 2023-12-17T11:57:32.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/43: mknod d3/c7 0 2023-12-17T11:57:32.541 INFO:tasks.workunit.client.0.smithi002.stdout:7/53: truncate d6/fe 723954 0 2023-12-17T11:57:32.556 INFO:tasks.workunit.client.0.smithi002.stdout:4/60: dwrite d0/d10/f11 [0,4194304] 0 2023-12-17T11:57:32.556 INFO:tasks.workunit.client.0.smithi002.stdout:1/44: write f1 [2184601,62964] 0 2023-12-17T11:57:32.557 INFO:tasks.workunit.client.0.smithi002.stdout:1/45: write f1 [4516904,66207] 0 2023-12-17T11:57:32.557 INFO:tasks.workunit.client.0.smithi002.stdout:1/46: read f1 [1406384,47409] 0 2023-12-17T11:57:32.557 INFO:tasks.workunit.client.0.smithi002.stdout:1/47: chown l2 472049 1 2023-12-17T11:57:32.558 INFO:tasks.workunit.client.0.smithi002.stdout:1/48: read f1 [5192894,43388] 0 2023-12-17T11:57:32.559 INFO:tasks.workunit.client.0.smithi002.stdout:4/61: unlink d0/f7 0 2023-12-17T11:57:32.559 INFO:tasks.workunit.client.0.smithi002.stdout:4/62: chown d0/fd 1017 1 2023-12-17T11:57:32.560 INFO:tasks.workunit.client.0.smithi002.stdout:1/49: symlink d3/l8 0 2023-12-17T11:57:32.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/54: dread d6/fe [0,4194304] 0 2023-12-17T11:57:32.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/55: write d6/fe [1080459,33028] 0 2023-12-17T11:57:32.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/56: readlink l1 0 2023-12-17T11:57:32.564 INFO:tasks.workunit.client.0.smithi002.stdout:7/57: write d6/fe [1531871,127751] 0 2023-12-17T11:57:32.565 INFO:tasks.workunit.client.0.smithi002.stdout:7/58: creat d6/da/dc/d13/f14 x:0 0 0 2023-12-17T11:57:32.568 INFO:tasks.workunit.client.1.smithi119.stdout:7/92: dwrite d2/d4/d11/f13 [0,4194304] 0 2023-12-17T11:57:32.570 INFO:tasks.workunit.client.1.smithi119.stdout:2/36: dwrite f5 [0,4194304] 0 2023-12-17T11:57:32.572 INFO:tasks.workunit.client.1.smithi119.stdout:2/37: symlink d6/d9/lc 0 2023-12-17T11:57:32.572 INFO:tasks.workunit.client.1.smithi119.stdout:2/38: creat d6/d9/fd x:0 0 0 2023-12-17T11:57:32.574 INFO:tasks.workunit.client.1.smithi119.stdout:2/39: symlink d6/le 0 2023-12-17T11:57:32.576 INFO:tasks.workunit.client.1.smithi119.stdout:2/40: unlink d6/d9/lc 0 2023-12-17T11:57:32.577 INFO:tasks.workunit.client.1.smithi119.stdout:7/93: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:32.578 INFO:tasks.workunit.client.1.smithi119.stdout:7/94: fdatasync d2/d4/f16 0 2023-12-17T11:57:32.578 INFO:tasks.workunit.client.1.smithi119.stdout:2/41: creat d6/ff x:0 0 0 2023-12-17T11:57:32.580 INFO:tasks.workunit.client.1.smithi119.stdout:2/42: symlink d6/d9/l10 0 2023-12-17T11:57:32.580 INFO:tasks.workunit.client.1.smithi119.stdout:2/43: creat d6/f11 x:0 0 0 2023-12-17T11:57:32.582 INFO:tasks.workunit.client.0.smithi002.stdout:1/50: dread f1 [0,4194304] 0 2023-12-17T11:57:32.599 INFO:tasks.workunit.client.1.smithi119.stdout:2/44: dread f4 [4194304,4194304] 0 2023-12-17T11:57:32.601 INFO:tasks.workunit.client.0.smithi002.stdout:4/63: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:32.603 INFO:tasks.workunit.client.1.smithi119.stdout:7/95: dread d2/d4/ff [0,4194304] 0 2023-12-17T11:57:32.603 INFO:tasks.workunit.client.1.smithi119.stdout:7/96: chown d2/d4/c8 13 1 2023-12-17T11:57:32.603 INFO:tasks.workunit.client.1.smithi119.stdout:7/97: write d2/f3 [1659474,43031] 0 2023-12-17T11:57:32.603 INFO:tasks.workunit.client.1.smithi119.stdout:7/98: creat d2/f1d x:0 0 0 2023-12-17T11:57:32.604 INFO:tasks.workunit.client.1.smithi119.stdout:6/40: dwrite d2/f5 [0,4194304] 0 2023-12-17T11:57:32.606 INFO:tasks.workunit.client.1.smithi119.stdout:7/99: link d2/fe d2/d4/f1e 0 2023-12-17T11:57:32.606 INFO:tasks.workunit.client.1.smithi119.stdout:7/100: truncate d2/f1d 393948 0 2023-12-17T11:57:32.606 INFO:tasks.workunit.client.1.smithi119.stdout:7/101: truncate d2/f3 2069238 0 2023-12-17T11:57:32.606 INFO:tasks.workunit.client.1.smithi119.stdout:7/102: chown d2/c15 10 1 2023-12-17T11:57:32.608 INFO:tasks.workunit.client.1.smithi119.stdout:7/103: mkdir d2/d4/d1f 0 2023-12-17T11:57:32.608 INFO:tasks.workunit.client.1.smithi119.stdout:2/45: getdents d6/d9 0 2023-12-17T11:57:32.611 INFO:tasks.workunit.client.1.smithi119.stdout:2/46: getdents d6 0 2023-12-17T11:57:32.613 INFO:tasks.workunit.client.0.smithi002.stdout:8/42: sync 2023-12-17T11:57:32.613 INFO:tasks.workunit.client.0.smithi002.stdout:6/25: sync 2023-12-17T11:57:32.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/59: dwrite d6/fe [0,4194304] 0 2023-12-17T11:57:32.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/60: creat d6/f15 x:0 0 0 2023-12-17T11:57:32.620 INFO:tasks.workunit.client.0.smithi002.stdout:8/43: unlink c1 0 2023-12-17T11:57:32.622 INFO:tasks.workunit.client.0.smithi002.stdout:6/26: creat d0/d1/d2/f8 x:0 0 0 2023-12-17T11:57:32.622 INFO:tasks.workunit.client.0.smithi002.stdout:6/27: fdatasync d0/f3 0 2023-12-17T11:57:32.624 INFO:tasks.workunit.client.0.smithi002.stdout:7/61: mkdir d6/da/d16 0 2023-12-17T11:57:32.626 INFO:tasks.workunit.client.1.smithi119.stdout:7/104: read d2/d4/f16 [843479,51911] 0 2023-12-17T11:57:32.627 INFO:tasks.workunit.client.1.smithi119.stdout:7/105: mknod d2/d4/d1f/c20 0 2023-12-17T11:57:32.627 INFO:tasks.workunit.client.1.smithi119.stdout:7/106: fsync d2/d4/f16 0 2023-12-17T11:57:32.628 INFO:tasks.workunit.client.0.smithi002.stdout:8/44: unlink d3/f5 0 2023-12-17T11:57:32.629 INFO:tasks.workunit.client.1.smithi119.stdout:7/107: creat d2/d4/d11/f21 x:0 0 0 2023-12-17T11:57:32.630 INFO:tasks.workunit.client.0.smithi002.stdout:6/28: mknod d0/d1/d2/c9 0 2023-12-17T11:57:32.634 INFO:tasks.workunit.client.0.smithi002.stdout:8/45: unlink d3/d8/da/lf 0 2023-12-17T11:57:32.636 INFO:tasks.workunit.client.0.smithi002.stdout:6/29: rename d0/d1/l6 to d0/la 0 2023-12-17T11:57:32.636 INFO:tasks.workunit.client.0.smithi002.stdout:6/30: write d0/f3 [1229861,115746] 0 2023-12-17T11:57:32.637 INFO:tasks.workunit.client.0.smithi002.stdout:6/31: chown d0/f3 0 1 2023-12-17T11:57:32.637 INFO:tasks.workunit.client.0.smithi002.stdout:6/32: write d0/d1/d2/f8 [62160,721] 0 2023-12-17T11:57:32.637 INFO:tasks.workunit.client.0.smithi002.stdout:6/33: truncate d0/f3 2035464 0 2023-12-17T11:57:32.637 INFO:tasks.workunit.client.0.smithi002.stdout:8/46: creat d3/d8/da/f10 x:0 0 0 2023-12-17T11:57:32.638 INFO:tasks.workunit.client.0.smithi002.stdout:7/62: getdents d6/da 0 2023-12-17T11:57:32.638 INFO:tasks.workunit.client.0.smithi002.stdout:7/63: chown d6/da/c12 254 1 2023-12-17T11:57:32.638 INFO:tasks.workunit.client.0.smithi002.stdout:7/64: chown d6/da 6 1 2023-12-17T11:57:32.638 INFO:tasks.workunit.client.0.smithi002.stdout:7/65: write d6/f15 [342862,128181] 0 2023-12-17T11:57:32.639 INFO:tasks.workunit.client.0.smithi002.stdout:8/47: symlink d3/d8/da/l11 0 2023-12-17T11:57:32.639 INFO:tasks.workunit.client.0.smithi002.stdout:8/48: stat d3/d8/da/f10 0 2023-12-17T11:57:32.639 INFO:tasks.workunit.client.0.smithi002.stdout:8/49: chown d3/d8/da/f10 8 1 2023-12-17T11:57:32.639 INFO:tasks.workunit.client.0.smithi002.stdout:8/50: write d3/d8/da/f10 [321056,62433] 0 2023-12-17T11:57:32.641 INFO:tasks.workunit.client.0.smithi002.stdout:7/66: unlink d6/fe 0 2023-12-17T11:57:32.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/67: write d6/f15 [70506,113380] 0 2023-12-17T11:57:32.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/68: stat l1 0 2023-12-17T11:57:32.643 INFO:tasks.workunit.client.1.smithi119.stdout:7/108: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:32.645 INFO:tasks.workunit.client.1.smithi119.stdout:7/109: creat d2/d4/d1f/f22 x:0 0 0 2023-12-17T11:57:32.645 INFO:tasks.workunit.client.1.smithi119.stdout:7/110: creat d2/d4/d1f/f23 x:0 0 0 2023-12-17T11:57:32.645 INFO:tasks.workunit.client.1.smithi119.stdout:7/111: creat d2/f24 x:0 0 0 2023-12-17T11:57:32.646 INFO:tasks.workunit.client.1.smithi119.stdout:7/112: write d2/d4/ff [3445146,129736] 0 2023-12-17T11:57:32.650 INFO:tasks.workunit.client.0.smithi002.stdout:8/51: dread d3/d8/da/f10 [0,4194304] 0 2023-12-17T11:57:32.650 INFO:tasks.workunit.client.0.smithi002.stdout:8/52: chown d3/d8/da/l11 17 1 2023-12-17T11:57:32.651 INFO:tasks.workunit.client.0.smithi002.stdout:8/53: symlink d3/l12 0 2023-12-17T11:57:32.651 INFO:tasks.workunit.client.0.smithi002.stdout:8/54: write d3/d8/da/f10 [379096,48836] 0 2023-12-17T11:57:32.652 INFO:tasks.workunit.client.0.smithi002.stdout:8/55: unlink d3/d8/lb 0 2023-12-17T11:57:32.653 INFO:tasks.workunit.client.0.smithi002.stdout:8/56: mkdir d3/d8/da/d13 0 2023-12-17T11:57:32.654 INFO:tasks.workunit.client.0.smithi002.stdout:8/57: mknod d3/d7/c14 0 2023-12-17T11:57:32.654 INFO:tasks.workunit.client.0.smithi002.stdout:8/58: write d3/d8/da/f10 [749125,59802] 0 2023-12-17T11:57:32.655 INFO:tasks.workunit.client.0.smithi002.stdout:7/69: dread d6/f15 [0,4194304] 0 2023-12-17T11:57:32.655 INFO:tasks.workunit.client.0.smithi002.stdout:8/59: mknod d3/d8/da/dd/c15 0 2023-12-17T11:57:32.655 INFO:tasks.workunit.client.0.smithi002.stdout:8/60: read d3/fc [1514247,38544] 0 2023-12-17T11:57:32.658 INFO:tasks.workunit.client.1.smithi119.stdout:2/47: dwrite d6/d9/fd [0,4194304] 0 2023-12-17T11:57:32.658 INFO:tasks.workunit.client.1.smithi119.stdout:2/48: dread - d6/d9/fb zero size 2023-12-17T11:57:32.664 INFO:tasks.workunit.client.1.smithi119.stdout:6/41: dwrite d2/fb [4194304,4194304] 0 2023-12-17T11:57:32.674 INFO:tasks.workunit.client.1.smithi119.stdout:6/42: truncate d2/fb 6276953 0 2023-12-17T11:57:32.674 INFO:tasks.workunit.client.1.smithi119.stdout:6/43: creat d2/fc x:0 0 0 2023-12-17T11:57:32.679 INFO:tasks.workunit.client.0.smithi002.stdout:6/34: dwrite d0/d1/d2/f8 [0,4194304] 0 2023-12-17T11:57:32.685 INFO:tasks.workunit.client.0.smithi002.stdout:6/35: truncate d0/f3 46408 0 2023-12-17T11:57:32.688 INFO:tasks.workunit.client.0.smithi002.stdout:6/36: symlink d0/d1/d2/lb 0 2023-12-17T11:57:32.697 INFO:tasks.workunit.client.1.smithi119.stdout:7/113: dwrite d2/d4/f1e [0,4194304] 0 2023-12-17T11:57:32.701 INFO:tasks.workunit.client.0.smithi002.stdout:6/37: dread d0/f3 [0,4194304] 0 2023-12-17T11:57:32.705 INFO:tasks.workunit.client.1.smithi119.stdout:7/114: dread d2/d4/ff [4194304,4194304] 0 2023-12-17T11:57:32.707 INFO:tasks.workunit.client.0.smithi002.stdout:8/61: dwrite d3/d8/da/f10 [0,4194304] 0 2023-12-17T11:57:32.707 INFO:tasks.workunit.client.0.smithi002.stdout:8/62: truncate d3/fc 2119342 0 2023-12-17T11:57:32.707 INFO:tasks.workunit.client.0.smithi002.stdout:6/38: rename d0/d1/d2 to d0/d1/dc 0 2023-12-17T11:57:32.709 INFO:tasks.workunit.client.1.smithi119.stdout:7/115: link d2/d4/f16 d2/f25 0 2023-12-17T11:57:32.711 INFO:tasks.workunit.client.0.smithi002.stdout:8/63: mknod d3/d8/da/dd/c16 0 2023-12-17T11:57:32.713 INFO:tasks.workunit.client.0.smithi002.stdout:8/64: mknod d3/d8/c17 0 2023-12-17T11:57:32.713 INFO:tasks.workunit.client.1.smithi119.stdout:7/116: rename d2/d4/d1f/f22 to d2/f26 0 2023-12-17T11:57:32.713 INFO:tasks.workunit.client.1.smithi119.stdout:7/117: readlink d2/lc 0 2023-12-17T11:57:32.721 INFO:tasks.workunit.client.0.smithi002.stdout:6/39: write d0/d1/dc/f8 [5211749,58175] 0 2023-12-17T11:57:32.730 INFO:tasks.workunit.client.0.smithi002.stdout:7/70: dwrite d6/da/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:32.730 INFO:tasks.workunit.client.0.smithi002.stdout:7/71: write d6/f15 [1447059,75223] 0 2023-12-17T11:57:32.731 INFO:tasks.workunit.client.1.smithi119.stdout:6/44: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:57:32.739 INFO:tasks.workunit.client.1.smithi119.stdout:6/45: write d2/fb [4732205,59769] 0 2023-12-17T11:57:32.739 INFO:tasks.workunit.client.1.smithi119.stdout:6/46: stat d2/f7 0 2023-12-17T11:57:32.741 INFO:tasks.workunit.client.1.smithi119.stdout:6/47: unlink d2/fc 0 2023-12-17T11:57:32.747 INFO:tasks.workunit.client.0.smithi002.stdout:9/94: sync 2023-12-17T11:57:32.748 INFO:tasks.workunit.client.0.smithi002.stdout:9/95: mknod dc/d1d/d23/d24/c28 0 2023-12-17T11:57:32.749 INFO:tasks.workunit.client.0.smithi002.stdout:9/96: chown dc/f1e 62541287 1 2023-12-17T11:57:32.749 INFO:tasks.workunit.client.0.smithi002.stdout:9/97: write f1 [394823,44964] 0 2023-12-17T11:57:32.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/72: read d6/f15 [844073,81729] 0 2023-12-17T11:57:32.751 INFO:tasks.workunit.client.0.smithi002.stdout:9/98: creat dc/d1d/d23/f29 x:0 0 0 2023-12-17T11:57:32.753 INFO:tasks.workunit.client.0.smithi002.stdout:9/99: getdents dc/d1d 0 2023-12-17T11:57:32.754 INFO:tasks.workunit.client.1.smithi119.stdout:7/118: dwrite d2/d4/f1e [0,4194304] 0 2023-12-17T11:57:32.754 INFO:tasks.workunit.client.1.smithi119.stdout:7/119: creat d2/d4/d1f/f27 x:0 0 0 2023-12-17T11:57:32.755 INFO:tasks.workunit.client.0.smithi002.stdout:7/73: rename d6/da to d6/d17 0 2023-12-17T11:57:32.759 INFO:tasks.workunit.client.0.smithi002.stdout:7/74: mknod d6/c18 0 2023-12-17T11:57:32.765 INFO:tasks.workunit.client.1.smithi119.stdout:6/48: dread d2/fa [0,4194304] 0 2023-12-17T11:57:32.765 INFO:tasks.workunit.client.0.smithi002.stdout:8/65: dwrite d3/d8/da/f10 [0,4194304] 0 2023-12-17T11:57:32.766 INFO:tasks.workunit.client.1.smithi119.stdout:6/49: symlink d2/ld 0 2023-12-17T11:57:32.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/66: mkdir d3/d7/d18 0 2023-12-17T11:57:32.768 INFO:tasks.workunit.client.0.smithi002.stdout:8/67: stat d3/d8/c17 0 2023-12-17T11:57:32.768 INFO:tasks.workunit.client.1.smithi119.stdout:6/50: rename d2/ld to d2/le 0 2023-12-17T11:57:32.770 INFO:tasks.workunit.client.0.smithi002.stdout:8/68: link d3/c4 d3/d7/d18/c19 0 2023-12-17T11:57:32.771 INFO:tasks.workunit.client.0.smithi002.stdout:8/69: chown d3/d7/d18/c19 0 1 2023-12-17T11:57:32.772 INFO:tasks.workunit.client.0.smithi002.stdout:8/70: mkdir d3/d7/d1a 0 2023-12-17T11:57:32.773 INFO:tasks.workunit.client.0.smithi002.stdout:8/71: symlink d3/d7/d1a/l1b 0 2023-12-17T11:57:32.776 INFO:tasks.workunit.client.0.smithi002.stdout:6/40: dwrite d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:32.776 INFO:tasks.workunit.client.0.smithi002.stdout:6/41: stat d0/d1/dc/f8 0 2023-12-17T11:57:32.778 INFO:tasks.workunit.client.0.smithi002.stdout:6/42: creat d0/d1/fd x:0 0 0 2023-12-17T11:57:32.782 INFO:tasks.workunit.client.0.smithi002.stdout:6/43: mknod d0/d1/dc/ce 0 2023-12-17T11:57:32.782 INFO:tasks.workunit.client.0.smithi002.stdout:2/59: sync 2023-12-17T11:57:32.782 INFO:tasks.workunit.client.0.smithi002.stdout:5/32: sync 2023-12-17T11:57:32.782 INFO:tasks.workunit.client.0.smithi002.stdout:5/33: rmdir - no directory 2023-12-17T11:57:32.782 INFO:tasks.workunit.client.0.smithi002.stdout:3/85: sync 2023-12-17T11:57:32.783 INFO:tasks.workunit.client.0.smithi002.stdout:4/64: sync 2023-12-17T11:57:32.783 INFO:tasks.workunit.client.0.smithi002.stdout:4/65: write d0/ff [215202,3049] 0 2023-12-17T11:57:32.783 INFO:tasks.workunit.client.0.smithi002.stdout:0/30: sync 2023-12-17T11:57:32.783 INFO:tasks.workunit.client.0.smithi002.stdout:0/31: read - d0/fd zero size 2023-12-17T11:57:32.783 INFO:tasks.workunit.client.0.smithi002.stdout:1/51: sync 2023-12-17T11:57:32.783 INFO:tasks.workunit.client.0.smithi002.stdout:2/60: creat d3/d4/d7/f1a x:0 0 0 2023-12-17T11:57:32.785 INFO:tasks.workunit.client.0.smithi002.stdout:2/61: write d3/d4/d7/f1a [344695,96314] 0 2023-12-17T11:57:32.785 INFO:tasks.workunit.client.0.smithi002.stdout:6/44: link d0/d1/dc/f8 d0/d1/dc/ff 0 2023-12-17T11:57:32.786 INFO:tasks.workunit.client.0.smithi002.stdout:6/45: truncate d0/f3 603755 0 2023-12-17T11:57:32.787 INFO:tasks.workunit.client.0.smithi002.stdout:5/34: rename f3 to f6 0 2023-12-17T11:57:32.787 INFO:tasks.workunit.client.0.smithi002.stdout:5/35: chown c5 2 1 2023-12-17T11:57:32.787 INFO:tasks.workunit.client.0.smithi002.stdout:5/36: chown f4 24 1 2023-12-17T11:57:32.788 INFO:tasks.workunit.client.0.smithi002.stdout:3/86: mknod d9/c1a 0 2023-12-17T11:57:32.788 INFO:tasks.workunit.client.1.smithi119.stdout:6/51: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:32.789 INFO:tasks.workunit.client.0.smithi002.stdout:4/66: symlink d0/l13 0 2023-12-17T11:57:32.789 INFO:tasks.workunit.client.0.smithi002.stdout:4/67: readlink d0/l13 0 2023-12-17T11:57:32.790 INFO:tasks.workunit.client.0.smithi002.stdout:1/52: truncate f1 2994259 0 2023-12-17T11:57:32.794 INFO:tasks.workunit.client.0.smithi002.stdout:2/62: mkdir d3/d4/d7/d14/d1b 0 2023-12-17T11:57:32.795 INFO:tasks.workunit.client.0.smithi002.stdout:8/72: read d3/d8/da/f10 [839194,18559] 0 2023-12-17T11:57:32.796 INFO:tasks.workunit.client.0.smithi002.stdout:8/73: rmdir d3/d7/d1a 39 2023-12-17T11:57:32.796 INFO:tasks.workunit.client.0.smithi002.stdout:8/74: write d3/d8/da/f10 [3383480,48919] 0 2023-12-17T11:57:32.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/37: truncate f6 1923308 0 2023-12-17T11:57:32.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/38: chown c5 36 1 2023-12-17T11:57:32.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/39: chown f4 642 1 2023-12-17T11:57:32.797 INFO:tasks.workunit.client.0.smithi002.stdout:4/68: mkdir d0/d10/d14 0 2023-12-17T11:57:32.797 INFO:tasks.workunit.client.0.smithi002.stdout:1/53: mkdir d3/d6/d9 0 2023-12-17T11:57:32.801 INFO:tasks.workunit.client.1.smithi119.stdout:6/52: write d2/f7 [3436813,73178] 0 2023-12-17T11:57:32.801 INFO:tasks.workunit.client.1.smithi119.stdout:6/53: truncate d2/f7 4662195 0 2023-12-17T11:57:32.802 INFO:tasks.workunit.client.0.smithi002.stdout:5/40: creat f7 x:0 0 0 2023-12-17T11:57:32.802 INFO:tasks.workunit.client.0.smithi002.stdout:5/41: write f7 [208581,128112] 0 2023-12-17T11:57:32.802 INFO:tasks.workunit.client.1.smithi119.stdout:7/120: dwrite d2/f24 [0,4194304] 0 2023-12-17T11:57:32.802 INFO:tasks.workunit.client.1.smithi119.stdout:7/121: stat d2/f1d 0 2023-12-17T11:57:32.806 INFO:tasks.workunit.client.1.smithi119.stdout:7/122: creat d2/d4/f28 x:0 0 0 2023-12-17T11:57:32.806 INFO:tasks.workunit.client.1.smithi119.stdout:7/123: creat d2/d4/f29 x:0 0 0 2023-12-17T11:57:32.811 INFO:tasks.workunit.client.0.smithi002.stdout:5/42: link f6 f8 0 2023-12-17T11:57:32.811 INFO:tasks.workunit.client.0.smithi002.stdout:5/43: chown c1 166 1 2023-12-17T11:57:32.812 INFO:tasks.workunit.client.1.smithi119.stdout:6/54: fdatasync d2/f9 0 2023-12-17T11:57:32.814 INFO:tasks.workunit.client.1.smithi119.stdout:7/124: fsync d2/d4/d1f/f27 0 2023-12-17T11:57:32.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/100: dwrite dc/d1d/d23/f29 [0,4194304] 0 2023-12-17T11:57:32.814 INFO:tasks.workunit.client.0.smithi002.stdout:1/54: truncate f1 3430288 0 2023-12-17T11:57:32.814 INFO:tasks.workunit.client.0.smithi002.stdout:9/101: write f4 [5099845,87216] 0 2023-12-17T11:57:32.820 INFO:tasks.workunit.client.1.smithi119.stdout:7/125: mkdir d2/d4/d1f/d2a 0 2023-12-17T11:57:32.823 INFO:tasks.workunit.client.1.smithi119.stdout:7/126: getdents d2 0 2023-12-17T11:57:32.823 INFO:tasks.workunit.client.1.smithi119.stdout:7/127: truncate d2/d4/d1f/f23 704205 0 2023-12-17T11:57:32.824 INFO:tasks.workunit.client.0.smithi002.stdout:5/44: getdents . 0 2023-12-17T11:57:32.826 INFO:tasks.workunit.client.0.smithi002.stdout:8/75: truncate d3/d8/da/f10 316024 0 2023-12-17T11:57:32.826 INFO:tasks.workunit.client.1.smithi119.stdout:7/128: link d2/d4/f16 d2/d4/d1f/d2a/f2b 0 2023-12-17T11:57:32.827 INFO:tasks.workunit.client.0.smithi002.stdout:5/45: creat f9 x:0 0 0 2023-12-17T11:57:32.829 INFO:tasks.workunit.client.1.smithi119.stdout:7/129: mkdir d2/d4/d11/d2c 0 2023-12-17T11:57:32.830 INFO:tasks.workunit.client.1.smithi119.stdout:7/130: stat d2/d4/f28 0 2023-12-17T11:57:32.832 INFO:tasks.workunit.client.0.smithi002.stdout:6/46: read d0/d1/dc/f8 [4836872,27869] 0 2023-12-17T11:57:32.833 INFO:tasks.workunit.client.0.smithi002.stdout:5/46: stat f8 0 2023-12-17T11:57:32.839 INFO:tasks.workunit.client.1.smithi119.stdout:7/131: dread d2/d4/d1f/f23 [0,4194304] 0 2023-12-17T11:57:32.843 INFO:tasks.workunit.client.1.smithi119.stdout:7/132: rename d2/d4/f1e to d2/d4/d11/f2d 0 2023-12-17T11:57:32.843 INFO:tasks.workunit.client.1.smithi119.stdout:7/133: creat d2/d4/d1f/f2e x:0 0 0 2023-12-17T11:57:32.843 INFO:tasks.workunit.client.1.smithi119.stdout:7/134: write d2/fe [5101362,119156] 0 2023-12-17T11:57:32.845 INFO:tasks.workunit.client.0.smithi002.stdout:2/63: dread d3/d4/f5 [0,4194304] 0 2023-12-17T11:57:32.849 INFO:tasks.workunit.client.0.smithi002.stdout:5/47: getdents . 0 2023-12-17T11:57:32.849 INFO:tasks.workunit.client.0.smithi002.stdout:5/48: chown f8 1860 1 2023-12-17T11:57:32.849 INFO:tasks.workunit.client.0.smithi002.stdout:1/55: dread f1 [0,4194304] 0 2023-12-17T11:57:32.850 INFO:tasks.workunit.client.0.smithi002.stdout:2/64: symlink d3/d4/d7/l1c 0 2023-12-17T11:57:32.850 INFO:tasks.workunit.client.0.smithi002.stdout:7/75: dwrite d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:32.851 INFO:tasks.workunit.client.0.smithi002.stdout:8/76: rename d3/d8/da/f10 to d3/d7/d1a/f1c 0 2023-12-17T11:57:32.854 INFO:tasks.workunit.client.0.smithi002.stdout:1/56: creat d3/d6/fa x:0 0 0 2023-12-17T11:57:32.856 INFO:tasks.workunit.client.0.smithi002.stdout:2/65: symlink d3/d4/d7/d14/d1b/l1d 0 2023-12-17T11:57:32.857 INFO:tasks.workunit.client.0.smithi002.stdout:8/77: creat d3/d8/da/dd/f1d x:0 0 0 2023-12-17T11:57:32.857 INFO:tasks.workunit.client.0.smithi002.stdout:8/78: write d3/d7/d1a/f1c [564378,21066] 0 2023-12-17T11:57:32.862 INFO:tasks.workunit.client.0.smithi002.stdout:8/79: fsync d3/d8/da/dd/f1d 0 2023-12-17T11:57:32.863 INFO:tasks.workunit.client.0.smithi002.stdout:8/80: symlink d3/d7/l1e 0 2023-12-17T11:57:32.865 INFO:tasks.workunit.client.0.smithi002.stdout:5/49: dread f8 [0,4194304] 0 2023-12-17T11:57:32.865 INFO:tasks.workunit.client.0.smithi002.stdout:5/50: readlink - no filename 2023-12-17T11:57:32.865 INFO:tasks.workunit.client.0.smithi002.stdout:5/51: fdatasync f8 0 2023-12-17T11:57:32.867 INFO:tasks.workunit.client.0.smithi002.stdout:5/52: creat fa x:0 0 0 2023-12-17T11:57:32.867 INFO:tasks.workunit.client.0.smithi002.stdout:5/53: creat fb x:0 0 0 2023-12-17T11:57:32.874 INFO:tasks.workunit.client.0.smithi002.stdout:1/57: dread f1 [0,4194304] 0 2023-12-17T11:57:32.874 INFO:tasks.workunit.client.1.smithi119.stdout:7/135: truncate d2/fe 2433856 0 2023-12-17T11:57:32.875 INFO:tasks.workunit.client.0.smithi002.stdout:1/58: symlink d3/d6/lb 0 2023-12-17T11:57:32.877 INFO:tasks.workunit.client.0.smithi002.stdout:1/59: creat d3/fc x:0 0 0 2023-12-17T11:57:32.877 INFO:tasks.workunit.client.0.smithi002.stdout:1/60: dread - d3/d6/fa zero size 2023-12-17T11:57:32.878 INFO:tasks.workunit.client.1.smithi119.stdout:6/55: dwrite d2/fb [4194304,4194304] 0 2023-12-17T11:57:32.879 INFO:tasks.workunit.client.0.smithi002.stdout:1/61: rename l2 to d3/d6/ld 0 2023-12-17T11:57:32.888 INFO:tasks.workunit.client.0.smithi002.stdout:0/32: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:32.888 INFO:tasks.workunit.client.0.smithi002.stdout:0/33: creat d0/d6/fe x:0 0 0 2023-12-17T11:57:32.888 INFO:tasks.workunit.client.0.smithi002.stdout:0/34: creat d0/ff x:0 0 0 2023-12-17T11:57:32.888 INFO:tasks.workunit.client.0.smithi002.stdout:0/35: write d0/ff [672666,12708] 0 2023-12-17T11:57:32.888 INFO:tasks.workunit.client.0.smithi002.stdout:7/76: write d6/d17/dc/d13/f14 [1610838,52696] 0 2023-12-17T11:57:32.888 INFO:tasks.workunit.client.0.smithi002.stdout:6/47: dwrite d0/d1/dc/ff [0,4194304] 0 2023-12-17T11:57:32.889 INFO:tasks.workunit.client.1.smithi119.stdout:4/31: sync 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:9/75: sync 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:9/76: chown d12/l16 4031 1 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:1/12: sync 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:8/24: sync 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:8/25: write - no filename 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:8/26: fsync - no filename 2023-12-17T11:57:32.890 INFO:tasks.workunit.client.1.smithi119.stdout:0/19: sync 2023-12-17T11:57:32.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/102: dread fb [0,4194304] 0 2023-12-17T11:57:32.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/103: chown dc/f1b 17 1 2023-12-17T11:57:32.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/104: write dc/f1b [931691,630] 0 2023-12-17T11:57:32.894 INFO:tasks.workunit.client.0.smithi002.stdout:9/105: fdatasync dc/f21 0 2023-12-17T11:57:32.895 INFO:tasks.workunit.client.0.smithi002.stdout:7/77: symlink d6/d17/l19 0 2023-12-17T11:57:32.895 INFO:tasks.workunit.client.0.smithi002.stdout:7/78: chown d6/d17/cf 33406317 1 2023-12-17T11:57:32.895 INFO:tasks.workunit.client.0.smithi002.stdout:6/48: mkdir d0/d1/dc/d10 0 2023-12-17T11:57:32.895 INFO:tasks.workunit.client.0.smithi002.stdout:6/49: write d0/f3 [1647789,54527] 0 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:4/32: rename l9 to la 0 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:9/77: mkdir d12/d1d 0 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:9/78: chown cb 0 1 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:4/33: read - f8 zero size 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:9/79: readlink ld 0 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:9/80: write f10 [370625,51275] 0 2023-12-17T11:57:32.896 INFO:tasks.workunit.client.1.smithi119.stdout:1/13: mkdir d3 0 2023-12-17T11:57:32.897 INFO:tasks.workunit.client.1.smithi119.stdout:6/56: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:32.897 INFO:tasks.workunit.client.1.smithi119.stdout:0/20: fsync f1 0 2023-12-17T11:57:32.897 INFO:tasks.workunit.client.1.smithi119.stdout:4/34: mknod cb 0 2023-12-17T11:57:32.898 INFO:tasks.workunit.client.0.smithi002.stdout:9/106: mknod dc/d1d/d23/d24/c2a 0 2023-12-17T11:57:32.898 INFO:tasks.workunit.client.0.smithi002.stdout:9/107: creat dc/d1d/d23/f2b x:0 0 0 2023-12-17T11:57:32.898 INFO:tasks.workunit.client.0.smithi002.stdout:9/108: write dc/d1d/d23/f2b [547280,112082] 0 2023-12-17T11:57:32.899 INFO:tasks.workunit.client.1.smithi119.stdout:6/57: mkdir d2/df 0 2023-12-17T11:57:32.905 INFO:tasks.workunit.client.0.smithi002.stdout:4/69: dwrite d0/fb [0,4194304] 0 2023-12-17T11:57:32.906 INFO:tasks.workunit.client.0.smithi002.stdout:7/79: rename d6/f15 to d6/d17/f1a 0 2023-12-17T11:57:32.906 INFO:tasks.workunit.client.0.smithi002.stdout:9/109: mkdir dc/d1d/d25/d2c 0 2023-12-17T11:57:32.908 INFO:tasks.workunit.client.1.smithi119.stdout:9/81: getdents d12 0 2023-12-17T11:57:32.909 INFO:tasks.workunit.client.0.smithi002.stdout:7/80: symlink d6/d17/d16/l1b 0 2023-12-17T11:57:32.910 INFO:tasks.workunit.client.0.smithi002.stdout:9/110: unlink dc/l1c 0 2023-12-17T11:57:32.911 INFO:tasks.workunit.client.1.smithi119.stdout:9/82: creat d12/f1e x:0 0 0 2023-12-17T11:57:32.917 INFO:tasks.workunit.client.0.smithi002.stdout:4/70: dread d0/f8 [0,4194304] 0 2023-12-17T11:57:32.921 INFO:tasks.workunit.client.0.smithi002.stdout:4/71: rename d0/fe to d0/d10/f15 0 2023-12-17T11:57:32.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/72: mknod d0/d10/c16 0 2023-12-17T11:57:32.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/73: stat d0/fd 0 2023-12-17T11:57:32.925 INFO:tasks.workunit.client.1.smithi119.stdout:4/35: dread f2 [0,4194304] 0 2023-12-17T11:57:32.927 INFO:tasks.workunit.client.1.smithi119.stdout:4/36: symlink lc 0 2023-12-17T11:57:32.930 INFO:tasks.workunit.client.0.smithi002.stdout:4/74: rename d0/l12 to d0/l17 0 2023-12-17T11:57:32.941 INFO:tasks.workunit.client.0.smithi002.stdout:4/75: dread d0/ff [0,4194304] 0 2023-12-17T11:57:32.942 INFO:tasks.workunit.client.0.smithi002.stdout:2/66: dwrite d3/d4/fd [8388608,4194304] 0 2023-12-17T11:57:32.946 INFO:tasks.workunit.client.0.smithi002.stdout:4/76: symlink d0/d10/d14/l18 0 2023-12-17T11:57:32.948 INFO:tasks.workunit.client.0.smithi002.stdout:9/111: getdents dc/d1d/d23 0 2023-12-17T11:57:32.949 INFO:tasks.workunit.client.0.smithi002.stdout:0/36: dwrite d0/d6/fe [0,4194304] 0 2023-12-17T11:57:32.949 INFO:tasks.workunit.client.0.smithi002.stdout:0/37: truncate d0/ff 1392792 0 2023-12-17T11:57:32.949 INFO:tasks.workunit.client.0.smithi002.stdout:0/38: chown d0/d6/la 10 1 2023-12-17T11:57:32.950 INFO:tasks.workunit.client.1.smithi119.stdout:0/21: dwrite f1 [4194304,4194304] 0 2023-12-17T11:57:32.951 INFO:tasks.workunit.client.0.smithi002.stdout:1/62: dwrite f1 [0,4194304] 0 2023-12-17T11:57:32.953 INFO:tasks.workunit.client.1.smithi119.stdout:4/37: write f2 [2614085,68470] 0 2023-12-17T11:57:32.957 INFO:tasks.workunit.client.1.smithi119.stdout:1/14: write f2 [3306171,93717] 0 2023-12-17T11:57:32.957 INFO:tasks.workunit.client.0.smithi002.stdout:0/39: rmdir d0/d6 39 2023-12-17T11:57:32.960 INFO:tasks.workunit.client.0.smithi002.stdout:0/40: symlink d0/l10 0 2023-12-17T11:57:32.965 INFO:tasks.workunit.client.1.smithi119.stdout:6/58: dwrite d2/f7 [0,4194304] 0 2023-12-17T11:57:32.970 INFO:tasks.workunit.client.1.smithi119.stdout:0/22: write f1 [1938521,75030] 0 2023-12-17T11:57:32.970 INFO:tasks.workunit.client.0.smithi002.stdout:8/81: dwrite d3/d7/d1a/f1c [0,4194304] 0 2023-12-17T11:57:32.970 INFO:tasks.workunit.client.0.smithi002.stdout:8/82: write d3/d8/da/dd/f1d [583666,108621] 0 2023-12-17T11:57:32.971 INFO:tasks.workunit.client.0.smithi002.stdout:8/83: fsync d3/d7/d1a/f1c 0 2023-12-17T11:57:32.971 INFO:tasks.workunit.client.0.smithi002.stdout:8/84: mkdir d3/d8/da/dd/d1f 0 2023-12-17T11:57:32.973 INFO:tasks.workunit.client.1.smithi119.stdout:6/59: mknod d2/c10 0 2023-12-17T11:57:32.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/85: rmdir d3/d8/da/dd/d1f 0 2023-12-17T11:57:32.974 INFO:tasks.workunit.client.1.smithi119.stdout:9/83: write f11 [476284,115274] 0 2023-12-17T11:57:32.975 INFO:tasks.workunit.client.0.smithi002.stdout:8/86: mknod d3/d8/c20 0 2023-12-17T11:57:32.977 INFO:tasks.workunit.client.0.smithi002.stdout:1/63: write f1 [336385,25801] 0 2023-12-17T11:57:32.980 INFO:tasks.workunit.client.1.smithi119.stdout:4/38: dread f1 [4194304,4194304] 0 2023-12-17T11:57:32.986 INFO:tasks.workunit.client.1.smithi119.stdout:0/23: rmdir d2 39 2023-12-17T11:57:32.986 INFO:tasks.workunit.client.1.smithi119.stdout:6/60: unlink d2/fa 0 2023-12-17T11:57:32.988 INFO:tasks.workunit.client.1.smithi119.stdout:0/24: creat d2/f4 x:0 0 0 2023-12-17T11:57:33.004 INFO:tasks.workunit.client.0.smithi002.stdout:1/64: fsync f1 0 2023-12-17T11:57:33.005 INFO:tasks.workunit.client.0.smithi002.stdout:1/65: fdatasync f1 0 2023-12-17T11:57:33.016 INFO:tasks.workunit.client.1.smithi119.stdout:5/71: sync 2023-12-17T11:57:33.016 INFO:tasks.workunit.client.1.smithi119.stdout:2/49: sync 2023-12-17T11:57:33.016 INFO:tasks.workunit.client.1.smithi119.stdout:3/33: sync 2023-12-17T11:57:33.017 INFO:tasks.workunit.client.1.smithi119.stdout:3/34: fdatasync f6 0 2023-12-17T11:57:33.018 INFO:tasks.workunit.client.1.smithi119.stdout:5/72: rename d1/c2 to d1/c16 0 2023-12-17T11:57:33.020 INFO:tasks.workunit.client.1.smithi119.stdout:3/35: creat d9/fc x:0 0 0 2023-12-17T11:57:33.020 INFO:tasks.workunit.client.1.smithi119.stdout:3/36: fsync f3 0 2023-12-17T11:57:33.020 INFO:tasks.workunit.client.1.smithi119.stdout:5/73: rename d1/f11 to d1/f17 0 2023-12-17T11:57:33.022 INFO:tasks.workunit.client.1.smithi119.stdout:3/37: creat d9/da/fd x:0 0 0 2023-12-17T11:57:33.022 INFO:tasks.workunit.client.1.smithi119.stdout:5/74: unlink d1/f3 0 2023-12-17T11:57:33.025 INFO:tasks.workunit.client.1.smithi119.stdout:5/75: symlink d1/l18 0 2023-12-17T11:57:33.026 INFO:tasks.workunit.client.0.smithi002.stdout:2/67: dwrite d3/d4/fd [0,4194304] 0 2023-12-17T11:57:33.026 INFO:tasks.workunit.client.0.smithi002.stdout:2/68: chown d3/d4/f13 0 1 2023-12-17T11:57:33.029 INFO:tasks.workunit.client.0.smithi002.stdout:4/77: dwrite d0/ff [0,4194304] 0 2023-12-17T11:57:33.029 INFO:tasks.workunit.client.0.smithi002.stdout:2/69: mknod d3/d4/d7/d14/d1b/c1e 0 2023-12-17T11:57:33.030 INFO:tasks.workunit.client.0.smithi002.stdout:2/70: rename d3 to d3/d4/d17/d19/d1f 22 2023-12-17T11:57:33.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/50: dwrite d0/f3 [0,4194304] 0 2023-12-17T11:57:33.031 INFO:tasks.workunit.client.0.smithi002.stdout:6/51: fdatasync d0/d1/dc/ff 0 2023-12-17T11:57:33.036 INFO:tasks.workunit.client.1.smithi119.stdout:6/61: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:33.038 INFO:tasks.workunit.client.1.smithi119.stdout:6/62: creat d2/f11 x:0 0 0 2023-12-17T11:57:33.038 INFO:tasks.workunit.client.1.smithi119.stdout:6/63: fdatasync d2/f9 0 2023-12-17T11:57:33.038 INFO:tasks.workunit.client.0.smithi002.stdout:6/52: unlink d0/d1/l5 0 2023-12-17T11:57:33.038 INFO:tasks.workunit.client.0.smithi002.stdout:4/78: rmdir d0/d10 39 2023-12-17T11:57:33.038 INFO:tasks.workunit.client.0.smithi002.stdout:4/79: creat d0/f19 x:0 0 0 2023-12-17T11:57:33.039 INFO:tasks.workunit.client.0.smithi002.stdout:4/80: creat d0/f1a x:0 0 0 2023-12-17T11:57:33.039 INFO:tasks.workunit.client.0.smithi002.stdout:4/81: readlink d0/l13 0 2023-12-17T11:57:33.039 INFO:tasks.workunit.client.0.smithi002.stdout:4/82: fdatasync d0/f8 0 2023-12-17T11:57:33.039 INFO:tasks.workunit.client.0.smithi002.stdout:4/83: fdatasync d0/d10/f11 0 2023-12-17T11:57:33.041 INFO:tasks.workunit.client.1.smithi119.stdout:2/50: dread f4 [0,4194304] 0 2023-12-17T11:57:33.042 INFO:tasks.workunit.client.1.smithi119.stdout:2/51: symlink d6/l12 0 2023-12-17T11:57:33.044 INFO:tasks.workunit.client.1.smithi119.stdout:2/52: mkdir d6/d9/d13 0 2023-12-17T11:57:33.044 INFO:tasks.workunit.client.1.smithi119.stdout:2/53: read - d6/f11 zero size 2023-12-17T11:57:33.046 INFO:tasks.workunit.client.0.smithi002.stdout:2/71: write d3/d4/fe [2341410,7245] 0 2023-12-17T11:57:33.046 INFO:tasks.workunit.client.0.smithi002.stdout:2/72: chown d3/d4/d7/d14/c15 1 1 2023-12-17T11:57:33.048 INFO:tasks.workunit.client.0.smithi002.stdout:2/73: link d3/d4/d7/f1a d3/d4/d17/f20 0 2023-12-17T11:57:33.049 INFO:tasks.workunit.client.0.smithi002.stdout:2/74: mknod d3/d4/c21 0 2023-12-17T11:57:33.050 INFO:tasks.workunit.client.0.smithi002.stdout:2/75: readlink d3/d4/l9 0 2023-12-17T11:57:33.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/87: truncate d3/d8/da/dd/f1d 627648 0 2023-12-17T11:57:33.051 INFO:tasks.workunit.client.0.smithi002.stdout:2/76: link d3/d4/d7/l1c d3/d4/d7/d14/l22 0 2023-12-17T11:57:33.054 INFO:tasks.workunit.client.0.smithi002.stdout:4/84: write d0/ff [1356323,105560] 0 2023-12-17T11:57:33.056 INFO:tasks.workunit.client.0.smithi002.stdout:4/85: mknod d0/d10/d14/c1b 0 2023-12-17T11:57:33.059 INFO:tasks.workunit.client.0.smithi002.stdout:6/53: dread d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:33.066 INFO:tasks.workunit.client.0.smithi002.stdout:2/77: read d3/d4/f5 [526798,20274] 0 2023-12-17T11:57:33.069 INFO:tasks.workunit.client.0.smithi002.stdout:8/88: dread d3/d7/d1a/f1c [0,4194304] 0 2023-12-17T11:57:33.069 INFO:tasks.workunit.client.0.smithi002.stdout:6/54: mknod d0/d1/dc/d10/c11 0 2023-12-17T11:57:33.070 INFO:tasks.workunit.client.0.smithi002.stdout:6/55: write d0/d1/fd [25899,73987] 0 2023-12-17T11:57:33.070 INFO:tasks.workunit.client.0.smithi002.stdout:6/56: stat d0/d1/dc/ce 0 2023-12-17T11:57:33.071 INFO:tasks.workunit.client.1.smithi119.stdout:4/39: dwrite f4 [0,4194304] 0 2023-12-17T11:57:33.071 INFO:tasks.workunit.client.1.smithi119.stdout:0/25: dwrite f1 [0,4194304] 0 2023-12-17T11:57:33.071 INFO:tasks.workunit.client.0.smithi002.stdout:0/41: dwrite d0/ff [0,4194304] 0 2023-12-17T11:57:33.073 INFO:tasks.workunit.client.0.smithi002.stdout:4/86: fdatasync d0/ff 0 2023-12-17T11:57:33.073 INFO:tasks.workunit.client.0.smithi002.stdout:4/87: stat d0/d10/f11 0 2023-12-17T11:57:33.073 INFO:tasks.workunit.client.0.smithi002.stdout:8/89: rename d3/d7/l1e to d3/d7/l21 0 2023-12-17T11:57:33.074 INFO:tasks.workunit.client.1.smithi119.stdout:9/84: dwrite f11 [4194304,4194304] 0 2023-12-17T11:57:33.074 INFO:tasks.workunit.client.1.smithi119.stdout:9/85: dread - ff zero size 2023-12-17T11:57:33.074 INFO:tasks.workunit.client.1.smithi119.stdout:9/86: dread - d12/f19 zero size 2023-12-17T11:57:33.075 INFO:tasks.workunit.client.1.smithi119.stdout:3/38: rmdir d9 39 2023-12-17T11:57:33.075 INFO:tasks.workunit.client.1.smithi119.stdout:2/54: dread d6/d9/fd [0,4194304] 0 2023-12-17T11:57:33.075 INFO:tasks.workunit.client.0.smithi002.stdout:8/90: write d3/fc [504566,2906] 0 2023-12-17T11:57:33.075 INFO:tasks.workunit.client.0.smithi002.stdout:8/91: chown d3/d8/da/dd/c15 61 1 2023-12-17T11:57:33.077 INFO:tasks.workunit.client.0.smithi002.stdout:1/66: dwrite d3/fc [0,4194304] 0 2023-12-17T11:57:33.077 INFO:tasks.workunit.client.1.smithi119.stdout:0/26: mkdir d2/d3/d5 0 2023-12-17T11:57:33.079 INFO:tasks.workunit.client.1.smithi119.stdout:0/27: symlink d2/l6 0 2023-12-17T11:57:33.082 INFO:tasks.workunit.client.1.smithi119.stdout:0/28: mknod d2/c7 0 2023-12-17T11:57:33.085 INFO:tasks.workunit.client.0.smithi002.stdout:4/88: mknod d0/d10/c1c 0 2023-12-17T11:57:33.089 INFO:tasks.workunit.client.1.smithi119.stdout:6/64: dwrite d2/f5 [0,4194304] 0 2023-12-17T11:57:33.089 INFO:tasks.workunit.client.0.smithi002.stdout:0/42: write d0/d6/fe [3388391,3571] 0 2023-12-17T11:57:33.090 INFO:tasks.workunit.client.1.smithi119.stdout:6/65: mknod d2/df/c12 0 2023-12-17T11:57:33.091 INFO:tasks.workunit.client.1.smithi119.stdout:6/66: fdatasync d2/fb 0 2023-12-17T11:57:33.091 INFO:tasks.workunit.client.0.smithi002.stdout:8/92: symlink d3/d7/l22 0 2023-12-17T11:57:33.091 INFO:tasks.workunit.client.1.smithi119.stdout:6/67: symlink d2/df/l13 0 2023-12-17T11:57:33.093 INFO:tasks.workunit.client.0.smithi002.stdout:3/87: sync 2023-12-17T11:57:33.094 INFO:tasks.workunit.client.1.smithi119.stdout:4/40: read f4 [2859291,68745] 0 2023-12-17T11:57:33.095 INFO:tasks.workunit.client.1.smithi119.stdout:6/68: symlink d2/l14 0 2023-12-17T11:57:33.096 INFO:tasks.workunit.client.1.smithi119.stdout:1/15: sync 2023-12-17T11:57:33.096 INFO:tasks.workunit.client.1.smithi119.stdout:8/27: sync 2023-12-17T11:57:33.097 INFO:tasks.workunit.client.1.smithi119.stdout:0/29: truncate f1 5443838 0 2023-12-17T11:57:33.098 INFO:tasks.workunit.client.1.smithi119.stdout:6/69: truncate d2/f9 5163356 0 2023-12-17T11:57:33.099 INFO:tasks.workunit.client.1.smithi119.stdout:8/28: creat f3 x:0 0 0 2023-12-17T11:57:33.100 INFO:tasks.workunit.client.1.smithi119.stdout:8/29: rmdir - no directory 2023-12-17T11:57:33.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/136: sync 2023-12-17T11:57:33.102 INFO:tasks.workunit.client.1.smithi119.stdout:0/30: symlink d2/l8 0 2023-12-17T11:57:33.102 INFO:tasks.workunit.client.1.smithi119.stdout:0/31: write d2/f4 [695556,59413] 0 2023-12-17T11:57:33.102 INFO:tasks.workunit.client.1.smithi119.stdout:0/32: chown d2/l8 297 1 2023-12-17T11:57:33.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/67: read d3/fc [1349344,61967] 0 2023-12-17T11:57:33.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/68: creat d3/d6/fe x:0 0 0 2023-12-17T11:57:33.104 INFO:tasks.workunit.client.1.smithi119.stdout:6/70: mknod d2/df/c15 0 2023-12-17T11:57:33.106 INFO:tasks.workunit.client.0.smithi002.stdout:6/57: getdents d0/d1 0 2023-12-17T11:57:33.110 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:32 smithi002 ceph-mon[107131]: pgmap v19: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.02k op/s 2023-12-17T11:57:33.111 INFO:tasks.workunit.client.0.smithi002.stdout:4/89: creat d0/d10/f1d x:0 0 0 2023-12-17T11:57:33.112 INFO:tasks.workunit.client.1.smithi119.stdout:8/30: mknod c4 0 2023-12-17T11:57:33.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/33: mknod d2/d3/c9 0 2023-12-17T11:57:33.113 INFO:tasks.workunit.client.1.smithi119.stdout:8/31: dread - f3 zero size 2023-12-17T11:57:33.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/34: readlink d2/l8 0 2023-12-17T11:57:33.113 INFO:tasks.workunit.client.1.smithi119.stdout:8/32: dread - f3 zero size 2023-12-17T11:57:33.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/43: creat d0/d6/f11 x:0 0 0 2023-12-17T11:57:33.117 INFO:tasks.workunit.client.0.smithi002.stdout:8/93: symlink d3/d7/d1a/l23 0 2023-12-17T11:57:33.118 INFO:tasks.workunit.client.1.smithi119.stdout:7/137: mkdir d2/d4/d11/d2f 0 2023-12-17T11:57:33.118 INFO:tasks.workunit.client.1.smithi119.stdout:3/39: dwrite d9/fc [0,4194304] 0 2023-12-17T11:57:33.119 INFO:tasks.workunit.client.1.smithi119.stdout:4/41: write f1 [7583677,118406] 0 2023-12-17T11:57:33.123 INFO:tasks.workunit.client.0.smithi002.stdout:6/58: link d0/l4 d0/d1/l12 0 2023-12-17T11:57:33.123 INFO:tasks.workunit.client.0.smithi002.stdout:1/69: dread d3/fc [0,4194304] 0 2023-12-17T11:57:33.123 INFO:tasks.workunit.client.0.smithi002.stdout:1/70: fdatasync d3/fc 0 2023-12-17T11:57:33.123 INFO:tasks.workunit.client.0.smithi002.stdout:1/71: truncate d3/d6/fe 74583 0 2023-12-17T11:57:33.123 INFO:tasks.workunit.client.0.smithi002.stdout:1/72: stat f1 0 2023-12-17T11:57:33.124 INFO:tasks.workunit.client.1.smithi119.stdout:3/40: mknod d9/da/ce 0 2023-12-17T11:57:33.125 INFO:tasks.workunit.client.1.smithi119.stdout:4/42: mkdir dd 0 2023-12-17T11:57:33.129 INFO:tasks.workunit.client.0.smithi002.stdout:4/90: symlink d0/d10/l1e 0 2023-12-17T11:57:33.134 INFO:tasks.workunit.client.0.smithi002.stdout:4/91: symlink d0/d10/l1f 0 2023-12-17T11:57:33.137 INFO:tasks.workunit.client.0.smithi002.stdout:0/44: truncate d0/ff 1748238 0 2023-12-17T11:57:33.139 INFO:tasks.workunit.client.0.smithi002.stdout:4/92: mknod d0/d10/d14/c20 0 2023-12-17T11:57:33.146 INFO:tasks.workunit.client.1.smithi119.stdout:9/87: dwrite d12/f17 [0,4194304] 0 2023-12-17T11:57:33.146 INFO:tasks.workunit.client.0.smithi002.stdout:6/59: write d0/d1/dc/f8 [2129404,77499] 0 2023-12-17T11:57:33.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/60: chown d0/d1/dc/ff 600513379 1 2023-12-17T11:57:33.147 INFO:tasks.workunit.client.0.smithi002.stdout:6/61: write d0/d1/dc/f8 [2262489,26783] 0 2023-12-17T11:57:33.149 INFO:tasks.workunit.client.0.smithi002.stdout:4/93: mkdir d0/d10/d21 0 2023-12-17T11:57:33.149 INFO:tasks.workunit.client.0.smithi002.stdout:4/94: truncate d0/f8 973175 0 2023-12-17T11:57:33.150 INFO:tasks.workunit.client.0.smithi002.stdout:5/54: sync 2023-12-17T11:57:33.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/95: symlink d0/l22 0 2023-12-17T11:57:33.154 INFO:tasks.workunit.client.1.smithi119.stdout:9/88: symlink d12/l1f 0 2023-12-17T11:57:33.154 INFO:tasks.workunit.client.1.smithi119.stdout:3/41: dread f6 [4194304,4194304] 0 2023-12-17T11:57:33.154 INFO:tasks.workunit.client.1.smithi119.stdout:3/42: readlink d9/lb 0 2023-12-17T11:57:33.160 INFO:tasks.workunit.client.1.smithi119.stdout:9/89: rename cb to d12/d1d/c20 0 2023-12-17T11:57:33.160 INFO:tasks.workunit.client.1.smithi119.stdout:3/43: mkdir d9/da/df 0 2023-12-17T11:57:33.163 INFO:tasks.workunit.client.1.smithi119.stdout:3/44: rename d9/lb to d9/da/l10 0 2023-12-17T11:57:33.175 INFO:tasks.workunit.client.0.smithi002.stdout:0/45: rmdir d0 39 2023-12-17T11:57:33.179 INFO:tasks.workunit.client.0.smithi002.stdout:0/46: mknod d0/d6/d8/c12 0 2023-12-17T11:57:33.179 INFO:tasks.workunit.client.0.smithi002.stdout:0/47: truncate d0/d6/fe 5209132 0 2023-12-17T11:57:33.180 INFO:tasks.workunit.client.0.smithi002.stdout:0/48: link d0/d6/fe d0/f13 0 2023-12-17T11:57:33.181 INFO:tasks.workunit.client.1.smithi119.stdout:0/35: dwrite f1 [0,4194304] 0 2023-12-17T11:57:33.182 INFO:tasks.workunit.client.0.smithi002.stdout:0/49: mkdir d0/d6/d8/d14 0 2023-12-17T11:57:33.188 INFO:tasks.workunit.client.0.smithi002.stdout:3/88: dwrite f7 [0,4194304] 0 2023-12-17T11:57:33.189 INFO:tasks.workunit.client.0.smithi002.stdout:6/62: fsync d0/d1/dc/ff 0 2023-12-17T11:57:33.191 INFO:tasks.workunit.client.0.smithi002.stdout:0/50: dread d0/d6/fe [4194304,4194304] 0 2023-12-17T11:57:33.195 INFO:tasks.workunit.client.0.smithi002.stdout:3/89: mkdir d9/d1b 0 2023-12-17T11:57:33.198 INFO:tasks.workunit.client.0.smithi002.stdout:6/63: truncate d0/f3 1247070 0 2023-12-17T11:57:33.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/90: creat d9/d1b/f1c x:0 0 0 2023-12-17T11:57:33.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/91: chown d9/l10 8307 1 2023-12-17T11:57:33.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/92: readlink d9/le 0 2023-12-17T11:57:33.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/93: truncate d9/d15/f16 881264 0 2023-12-17T11:57:33.201 INFO:tasks.workunit.client.1.smithi119.stdout:2/55: dwrite d6/ff [0,4194304] 0 2023-12-17T11:57:33.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/64: creat d0/d1/f13 x:0 0 0 2023-12-17T11:57:33.203 INFO:tasks.workunit.client.0.smithi002.stdout:3/94: creat d9/f1d x:0 0 0 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/95: write d9/f12 [235495,62419] 0 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:6/65: write d0/d1/dc/ff [5957114,91867] 0 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:6/66: chown d0/d1 70706296 1 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/96: creat d9/f1e x:0 0 0 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/97: read - d9/f1d zero size 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/98: chown d9/f12 1531 1 2023-12-17T11:57:33.204 INFO:tasks.workunit.client.0.smithi002.stdout:3/99: readlink l4 0 2023-12-17T11:57:33.206 INFO:tasks.workunit.client.1.smithi119.stdout:3/45: getdents d9 0 2023-12-17T11:57:33.207 INFO:tasks.workunit.client.1.smithi119.stdout:3/46: dread - f5 zero size 2023-12-17T11:57:33.208 INFO:tasks.workunit.client.0.smithi002.stdout:3/100: symlink d9/d15/l1f 0 2023-12-17T11:57:33.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/101: rename d9/f12 to d9/d15/f20 0 2023-12-17T11:57:33.216 INFO:tasks.workunit.client.0.smithi002.stdout:3/102: mknod d9/d1b/c21 0 2023-12-17T11:57:33.216 INFO:tasks.workunit.client.0.smithi002.stdout:3/103: truncate d9/f1d 886485 0 2023-12-17T11:57:33.217 INFO:tasks.workunit.client.1.smithi119.stdout:3/47: mkdir d9/d11 0 2023-12-17T11:57:33.218 INFO:tasks.workunit.client.0.smithi002.stdout:3/104: creat d9/d15/f22 x:0 0 0 2023-12-17T11:57:33.219 INFO:tasks.workunit.client.1.smithi119.stdout:3/48: symlink d9/d11/l12 0 2023-12-17T11:57:33.220 INFO:tasks.workunit.client.1.smithi119.stdout:3/49: symlink d9/da/l13 0 2023-12-17T11:57:33.222 INFO:tasks.workunit.client.1.smithi119.stdout:3/50: symlink d9/d11/l14 0 2023-12-17T11:57:33.225 INFO:tasks.workunit.client.1.smithi119.stdout:3/51: rename f0 to d9/da/df/f15 0 2023-12-17T11:57:33.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/94: dread d3/fc [0,4194304] 0 2023-12-17T11:57:33.242 INFO:tasks.workunit.client.0.smithi002.stdout:8/95: write d3/d7/d1a/f1c [472845,58278] 0 2023-12-17T11:57:33.242 INFO:tasks.workunit.client.0.smithi002.stdout:8/96: fsync d3/fc 0 2023-12-17T11:57:33.244 INFO:tasks.workunit.client.0.smithi002.stdout:8/97: creat d3/d8/da/d13/f24 x:0 0 0 2023-12-17T11:57:33.244 INFO:tasks.workunit.client.0.smithi002.stdout:8/98: write d3/d8/da/dd/f1d [750483,37362] 0 2023-12-17T11:57:33.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/73: dwrite d3/fc [0,4194304] 0 2023-12-17T11:57:33.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/74: write f1 [1166169,65905] 0 2023-12-17T11:57:33.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/75: creat d3/ff x:0 0 0 2023-12-17T11:57:33.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/76: dread - d3/d6/fa zero size 2023-12-17T11:57:33.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/77: fdatasync d3/fc 0 2023-12-17T11:57:33.247 INFO:tasks.workunit.client.1.smithi119.stdout:2/56: dread f5 [0,4194304] 0 2023-12-17T11:57:33.247 INFO:tasks.workunit.client.1.smithi119.stdout:2/57: getdents d6/d9/d13 0 2023-12-17T11:57:33.253 INFO:tasks.workunit.client.0.smithi002.stdout:1/78: mknod d3/d6/d9/c10 0 2023-12-17T11:57:33.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/99: dread d3/fc [0,4194304] 0 2023-12-17T11:57:33.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/100: write d3/d7/d1a/f1c [3855963,15873] 0 2023-12-17T11:57:33.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/101: dread - d3/d8/da/d13/f24 zero size 2023-12-17T11:57:33.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/79: symlink d3/d6/d9/l11 0 2023-12-17T11:57:33.255 INFO:tasks.workunit.client.0.smithi002.stdout:8/102: creat d3/f25 x:0 0 0 2023-12-17T11:57:33.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/55: dwrite f7 [0,4194304] 0 2023-12-17T11:57:33.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/56: readlink - no filename 2023-12-17T11:57:33.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/96: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:33.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/57: chown f9 6056197 1 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:9/90: dwrite d12/f17 [4194304,4194304] 0 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:9/91: dread - d12/f19 zero size 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:8/33: dwrite f3 [0,4194304] 0 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:0/36: dwrite f1 [0,4194304] 0 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:1/16: dwrite f2 [4194304,4194304] 0 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:6/71: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:57:33.265 INFO:tasks.workunit.client.1.smithi119.stdout:1/17: chown l1 1728997 1 2023-12-17T11:57:33.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/51: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:33.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/52: dread - d0/d6/f11 zero size 2023-12-17T11:57:33.269 INFO:tasks.workunit.client.1.smithi119.stdout:7/138: dwrite d2/d4/d1f/f2e [0,4194304] 0 2023-12-17T11:57:33.269 INFO:tasks.workunit.client.1.smithi119.stdout:7/139: fdatasync d2/d4/d1f/d2a/f2b 0 2023-12-17T11:57:33.269 INFO:tasks.workunit.client.1.smithi119.stdout:7/140: fsync d2/d4/d1f/d2a/f2b 0 2023-12-17T11:57:33.270 INFO:tasks.workunit.client.1.smithi119.stdout:9/92: symlink d12/l21 0 2023-12-17T11:57:33.270 INFO:tasks.workunit.client.1.smithi119.stdout:8/34: symlink l5 0 2023-12-17T11:57:33.270 INFO:tasks.workunit.client.1.smithi119.stdout:8/35: fsync f3 0 2023-12-17T11:57:33.270 INFO:tasks.workunit.client.1.smithi119.stdout:0/37: link d2/d3/c9 d2/d3/ca 0 2023-12-17T11:57:33.272 INFO:tasks.workunit.client.1.smithi119.stdout:5/76: sync 2023-12-17T11:57:33.272 INFO:tasks.workunit.client.1.smithi119.stdout:5/77: creat d1/f19 x:0 0 0 2023-12-17T11:57:33.274 INFO:tasks.workunit.client.0.smithi002.stdout:4/97: mknod d0/c23 0 2023-12-17T11:57:33.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/58: mkdir dc 0 2023-12-17T11:57:33.277 INFO:tasks.workunit.client.0.smithi002.stdout:3/105: getdents d9/d15 0 2023-12-17T11:57:33.283 INFO:tasks.workunit.client.0.smithi002.stdout:7/81: sync 2023-12-17T11:57:33.283 INFO:tasks.workunit.client.0.smithi002.stdout:7/82: chown d6/d17/dc/d13 1587 1 2023-12-17T11:57:33.284 INFO:tasks.workunit.client.0.smithi002.stdout:7/83: getdents d6/d17/dc 0 2023-12-17T11:57:33.284 INFO:tasks.workunit.client.0.smithi002.stdout:7/84: creat d6/f1c x:0 0 0 2023-12-17T11:57:33.286 INFO:tasks.workunit.client.0.smithi002.stdout:7/85: mkdir d6/d17/d16/d1d 0 2023-12-17T11:57:33.287 INFO:tasks.workunit.client.0.smithi002.stdout:8/103: rmdir d3 39 2023-12-17T11:57:33.288 INFO:tasks.workunit.client.0.smithi002.stdout:7/86: mknod d6/d17/c1e 0 2023-12-17T11:57:33.290 INFO:tasks.workunit.client.0.smithi002.stdout:8/104: creat d3/d7/f26 x:0 0 0 2023-12-17T11:57:33.291 INFO:tasks.workunit.client.0.smithi002.stdout:8/105: write d3/d7/f26 [838028,104590] 0 2023-12-17T11:57:33.291 INFO:tasks.workunit.client.0.smithi002.stdout:8/106: creat d3/d7/f27 x:0 0 0 2023-12-17T11:57:33.292 INFO:tasks.workunit.client.0.smithi002.stdout:7/87: truncate d6/d17/dc/d13/f14 1601236 0 2023-12-17T11:57:33.292 INFO:tasks.workunit.client.0.smithi002.stdout:7/88: readlink d6/d17/l19 0 2023-12-17T11:57:33.293 INFO:tasks.workunit.client.0.smithi002.stdout:9/112: sync 2023-12-17T11:57:33.294 INFO:tasks.workunit.client.0.smithi002.stdout:8/107: mkdir d3/d8/d28 0 2023-12-17T11:57:33.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/89: link c2 d6/d17/d16/c1f 0 2023-12-17T11:57:33.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/90: dread - d6/f1c zero size 2023-12-17T11:57:33.300 INFO:tasks.workunit.client.0.smithi002.stdout:9/113: mknod dc/d1d/d23/c2d 0 2023-12-17T11:57:33.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/78: sync 2023-12-17T11:57:33.301 INFO:tasks.workunit.client.0.smithi002.stdout:2/79: creat d3/d4/f23 x:0 0 0 2023-12-17T11:57:33.302 INFO:tasks.workunit.client.0.smithi002.stdout:8/108: truncate d3/d7/d1a/f1c 2073408 0 2023-12-17T11:57:33.302 INFO:tasks.workunit.client.0.smithi002.stdout:2/80: write d3/d4/d7/f1a [268356,94135] 0 2023-12-17T11:57:33.305 INFO:tasks.workunit.client.0.smithi002.stdout:7/91: symlink d6/d17/d16/d1d/l20 0 2023-12-17T11:57:33.305 INFO:tasks.workunit.client.0.smithi002.stdout:9/114: rmdir dc/d1d/d23 39 2023-12-17T11:57:33.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/109: mkdir d3/d8/da/d29 0 2023-12-17T11:57:33.307 INFO:tasks.workunit.client.0.smithi002.stdout:7/92: mkdir d6/d17/dc/d13/d21 0 2023-12-17T11:57:33.309 INFO:tasks.workunit.client.0.smithi002.stdout:8/110: mkdir d3/d7/d18/d2a 0 2023-12-17T11:57:33.309 INFO:tasks.workunit.client.1.smithi119.stdout:9/93: dwrite d12/f1e [0,4194304] 0 2023-12-17T11:57:33.309 INFO:tasks.workunit.client.1.smithi119.stdout:9/94: chown c3 0 1 2023-12-17T11:57:33.312 INFO:tasks.workunit.client.0.smithi002.stdout:8/111: chown d3/d7/f26 136670923 1 2023-12-17T11:57:33.312 INFO:tasks.workunit.client.0.smithi002.stdout:8/112: truncate d3/f25 980597 0 2023-12-17T11:57:33.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/93: rename d6/c9 to d6/d17/dc/d13/d21/c22 0 2023-12-17T11:57:33.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/94: fsync d6/f1c 0 2023-12-17T11:57:33.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/95: read d6/d17/f1a [661907,20035] 0 2023-12-17T11:57:33.318 INFO:tasks.workunit.client.1.smithi119.stdout:9/95: dread fe [0,4194304] 0 2023-12-17T11:57:33.335 INFO:tasks.workunit.client.1.smithi119.stdout:7/141: dwrite d2/d4/f28 [0,4194304] 0 2023-12-17T11:57:33.354 INFO:tasks.workunit.client.1.smithi119.stdout:6/72: mknod d2/df/c16 0 2023-12-17T11:57:33.355 INFO:tasks.workunit.client.0.smithi002.stdout:5/59: dwrite f6 [0,4194304] 0 2023-12-17T11:57:33.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/106: dwrite d9/d1b/f1c [0,4194304] 0 2023-12-17T11:57:33.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/107: truncate d9/d15/f20 348475 0 2023-12-17T11:57:33.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/108: fsync d9/d1b/f1c 0 2023-12-17T11:57:33.361 INFO:tasks.workunit.client.1.smithi119.stdout:8/36: rename l0 to l6 0 2023-12-17T11:57:33.362 INFO:tasks.workunit.client.0.smithi002.stdout:4/98: dwrite d0/fb [0,4194304] 0 2023-12-17T11:57:33.362 INFO:tasks.workunit.client.0.smithi002.stdout:4/99: dread - d0/d10/f15 zero size 2023-12-17T11:57:33.363 INFO:tasks.workunit.client.0.smithi002.stdout:4/100: creat d0/d10/d14/f24 x:0 0 0 2023-12-17T11:57:33.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/109: dread d9/d15/f16 [0,4194304] 0 2023-12-17T11:57:33.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/110: write f5 [1886769,58198] 0 2023-12-17T11:57:33.371 INFO:tasks.workunit.client.0.smithi002.stdout:3/111: fdatasync f7 0 2023-12-17T11:57:33.373 INFO:tasks.workunit.client.0.smithi002.stdout:3/112: symlink d9/d15/l23 0 2023-12-17T11:57:33.373 INFO:tasks.workunit.client.0.smithi002.stdout:3/113: chown d9/ca 426 1 2023-12-17T11:57:33.374 INFO:tasks.workunit.client.0.smithi002.stdout:9/115: dwrite f9 [0,4194304] 0 2023-12-17T11:57:33.374 INFO:tasks.workunit.client.0.smithi002.stdout:3/114: mkdir d9/d24 0 2023-12-17T11:57:33.374 INFO:tasks.workunit.client.0.smithi002.stdout:3/115: write d9/f1e [786996,60407] 0 2023-12-17T11:57:33.375 INFO:tasks.workunit.client.1.smithi119.stdout:7/142: unlink d2/d4/d11/f13 0 2023-12-17T11:57:33.375 INFO:tasks.workunit.client.0.smithi002.stdout:3/116: fdatasync d9/d15/f22 0 2023-12-17T11:57:33.376 INFO:tasks.workunit.client.0.smithi002.stdout:9/116: rmdir dc/d1d/d25/d2c 0 2023-12-17T11:57:33.377 INFO:tasks.workunit.client.1.smithi119.stdout:6/73: mkdir d2/df/d17 0 2023-12-17T11:57:33.377 INFO:tasks.workunit.client.1.smithi119.stdout:6/74: readlink d2/df/l13 0 2023-12-17T11:57:33.377 INFO:tasks.workunit.client.1.smithi119.stdout:6/75: chown d2/df/c16 762 1 2023-12-17T11:57:33.377 INFO:tasks.workunit.client.0.smithi002.stdout:2/81: dwrite d3/d4/fe [0,4194304] 0 2023-12-17T11:57:33.378 INFO:tasks.workunit.client.0.smithi002.stdout:3/117: link d9/f13 d9/d24/f25 0 2023-12-17T11:57:33.378 INFO:tasks.workunit.client.0.smithi002.stdout:3/118: rename d9 to d9/d15/d26 22 2023-12-17T11:57:33.379 INFO:tasks.workunit.client.1.smithi119.stdout:9/96: rmdir d12 39 2023-12-17T11:57:33.382 INFO:tasks.workunit.client.1.smithi119.stdout:7/143: creat d2/d4/d1f/d2a/f30 x:0 0 0 2023-12-17T11:57:33.382 INFO:tasks.workunit.client.1.smithi119.stdout:4/43: sync 2023-12-17T11:57:33.382 INFO:tasks.workunit.client.1.smithi119.stdout:4/44: write f4 [3920755,51515] 0 2023-12-17T11:57:33.382 INFO:tasks.workunit.client.1.smithi119.stdout:4/45: fdatasync f2 0 2023-12-17T11:57:33.384 INFO:tasks.workunit.client.1.smithi119.stdout:4/46: mknod dd/ce 0 2023-12-17T11:57:33.385 INFO:tasks.workunit.client.0.smithi002.stdout:9/117: link f4 dc/d1d/d23/f2e 0 2023-12-17T11:57:33.385 INFO:tasks.workunit.client.0.smithi002.stdout:9/118: stat dc/f14 0 2023-12-17T11:57:33.385 INFO:tasks.workunit.client.0.smithi002.stdout:2/82: creat d3/d4/d17/d19/f24 x:0 0 0 2023-12-17T11:57:33.386 INFO:tasks.workunit.client.0.smithi002.stdout:3/119: symlink d9/l27 0 2023-12-17T11:57:33.386 INFO:tasks.workunit.client.1.smithi119.stdout:5/78: rmdir d1 39 2023-12-17T11:57:33.387 INFO:tasks.workunit.client.1.smithi119.stdout:3/52: sync 2023-12-17T11:57:33.387 INFO:tasks.workunit.client.1.smithi119.stdout:3/53: truncate d9/fc 4730012 0 2023-12-17T11:57:33.387 INFO:tasks.workunit.client.1.smithi119.stdout:4/47: symlink dd/lf 0 2023-12-17T11:57:33.389 INFO:tasks.workunit.client.1.smithi119.stdout:8/37: dread f3 [0,4194304] 0 2023-12-17T11:57:33.389 INFO:tasks.workunit.client.1.smithi119.stdout:8/38: rmdir - no directory 2023-12-17T11:57:33.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/101: dread d0/fd [0,4194304] 0 2023-12-17T11:57:33.390 INFO:tasks.workunit.client.0.smithi002.stdout:4/102: readlink d0/l13 0 2023-12-17T11:57:33.391 INFO:tasks.workunit.client.0.smithi002.stdout:4/103: creat d0/d10/f25 x:0 0 0 2023-12-17T11:57:33.391 INFO:tasks.workunit.client.0.smithi002.stdout:4/104: dread - d0/d10/f15 zero size 2023-12-17T11:57:33.394 INFO:tasks.workunit.client.1.smithi119.stdout:3/54: symlink d9/d11/l16 0 2023-12-17T11:57:33.394 INFO:tasks.workunit.client.1.smithi119.stdout:4/48: symlink dd/l10 0 2023-12-17T11:57:33.394 INFO:tasks.workunit.client.1.smithi119.stdout:6/76: rmdir d2 39 2023-12-17T11:57:33.394 INFO:tasks.workunit.client.1.smithi119.stdout:4/49: mkdir dd/d11 0 2023-12-17T11:57:33.394 INFO:tasks.workunit.client.1.smithi119.stdout:9/97: dread d12/f17 [0,4194304] 0 2023-12-17T11:57:33.396 INFO:tasks.workunit.client.1.smithi119.stdout:4/50: link la dd/d11/l12 0 2023-12-17T11:57:33.396 INFO:tasks.workunit.client.1.smithi119.stdout:9/98: symlink d12/l22 0 2023-12-17T11:57:33.398 INFO:tasks.workunit.client.1.smithi119.stdout:7/144: dread d2/d4/d1f/f2e [0,4194304] 0 2023-12-17T11:57:33.398 INFO:tasks.workunit.client.1.smithi119.stdout:6/77: rename d2/df/l13 to d2/df/l18 0 2023-12-17T11:57:33.398 INFO:tasks.workunit.client.1.smithi119.stdout:6/78: getdents d2/df/d17 0 2023-12-17T11:57:33.398 INFO:tasks.workunit.client.1.smithi119.stdout:6/79: chown d2/df 1 1 2023-12-17T11:57:33.398 INFO:tasks.workunit.client.1.smithi119.stdout:6/80: chown d2/l14 108636094 1 2023-12-17T11:57:33.400 INFO:tasks.workunit.client.1.smithi119.stdout:9/99: rename f10 to d12/f23 0 2023-12-17T11:57:33.403 INFO:tasks.workunit.client.0.smithi002.stdout:9/119: getdents dc/d1d/d25 0 2023-12-17T11:57:33.404 INFO:tasks.workunit.client.1.smithi119.stdout:3/55: write f4 [624682,93088] 0 2023-12-17T11:57:33.404 INFO:tasks.workunit.client.1.smithi119.stdout:6/81: rename d2/fb to d2/f19 0 2023-12-17T11:57:33.404 INFO:tasks.workunit.client.1.smithi119.stdout:3/56: read - d9/da/fd zero size 2023-12-17T11:57:33.404 INFO:tasks.workunit.client.1.smithi119.stdout:6/82: rename d2/l14 to d2/df/l1a 0 2023-12-17T11:57:33.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:32 smithi119 ceph-mon[117414]: pgmap v19: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 18 MiB/s wr, 1.02k op/s 2023-12-17T11:57:33.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/60: dwrite fa [0,4194304] 0 2023-12-17T11:57:33.410 INFO:tasks.workunit.client.0.smithi002.stdout:3/120: dread f7 [0,4194304] 0 2023-12-17T11:57:33.415 INFO:tasks.workunit.client.0.smithi002.stdout:3/121: rmdir d9/d24 39 2023-12-17T11:57:33.415 INFO:tasks.workunit.client.0.smithi002.stdout:3/122: creat d9/d1b/f28 x:0 0 0 2023-12-17T11:57:33.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/113: dwrite d3/f25 [0,4194304] 0 2023-12-17T11:57:33.422 INFO:tasks.workunit.client.1.smithi119.stdout:7/145: dread d2/f24 [0,4194304] 0 2023-12-17T11:57:33.422 INFO:tasks.workunit.client.0.smithi002.stdout:3/123: getdents d9 0 2023-12-17T11:57:33.430 INFO:tasks.workunit.client.1.smithi119.stdout:6/83: dread d2/f19 [0,4194304] 0 2023-12-17T11:57:33.430 INFO:tasks.workunit.client.1.smithi119.stdout:6/84: truncate d2/f4 5606264 0 2023-12-17T11:57:33.430 INFO:tasks.workunit.client.1.smithi119.stdout:9/100: dread f11 [4194304,4194304] 0 2023-12-17T11:57:33.439 INFO:tasks.workunit.client.1.smithi119.stdout:6/85: write d2/f9 [2640745,4134] 0 2023-12-17T11:57:33.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/67: sync 2023-12-17T11:57:33.443 INFO:tasks.workunit.client.1.smithi119.stdout:6/86: creat d2/f1b x:0 0 0 2023-12-17T11:57:33.447 INFO:tasks.workunit.client.1.smithi119.stdout:7/146: dread d2/fe [0,4194304] 0 2023-12-17T11:57:33.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/68: creat d0/d1/dc/d10/f14 x:0 0 0 2023-12-17T11:57:33.449 INFO:tasks.workunit.client.1.smithi119.stdout:6/87: mknod d2/df/c1c 0 2023-12-17T11:57:33.450 INFO:tasks.workunit.client.1.smithi119.stdout:5/79: dwrite d1/f17 [4194304,4194304] 0 2023-12-17T11:57:33.452 INFO:tasks.workunit.client.1.smithi119.stdout:5/80: truncate d1/f8 816693 0 2023-12-17T11:57:33.455 INFO:tasks.workunit.client.1.smithi119.stdout:5/81: getdents d1 0 2023-12-17T11:57:33.463 INFO:tasks.workunit.client.1.smithi119.stdout:5/82: rename d1/f19 to d1/f1a 0 2023-12-17T11:57:33.463 INFO:tasks.workunit.client.1.smithi119.stdout:5/83: chown d1/c16 508605994 1 2023-12-17T11:57:33.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/147: dread d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:33.469 INFO:tasks.workunit.client.1.smithi119.stdout:9/101: dread d12/f1e [0,4194304] 0 2023-12-17T11:57:33.469 INFO:tasks.workunit.client.1.smithi119.stdout:8/39: dwrite f3 [0,4194304] 0 2023-12-17T11:57:33.471 INFO:tasks.workunit.client.1.smithi119.stdout:9/102: mkdir d12/d1d/d24 0 2023-12-17T11:57:33.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/61: dwrite fa [0,4194304] 0 2023-12-17T11:57:33.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/62: write f9 [814270,95084] 0 2023-12-17T11:57:33.475 INFO:tasks.workunit.client.1.smithi119.stdout:3/57: dwrite d9/fc [0,4194304] 0 2023-12-17T11:57:33.476 INFO:tasks.workunit.client.0.smithi002.stdout:5/63: creat dc/fd x:0 0 0 2023-12-17T11:57:33.478 INFO:tasks.workunit.client.1.smithi119.stdout:3/58: creat d9/da/df/f17 x:0 0 0 2023-12-17T11:57:33.478 INFO:tasks.workunit.client.1.smithi119.stdout:6/88: dread d2/f7 [0,4194304] 0 2023-12-17T11:57:33.478 INFO:tasks.workunit.client.1.smithi119.stdout:6/89: write d2/f19 [2118903,25917] 0 2023-12-17T11:57:33.479 INFO:tasks.workunit.client.0.smithi002.stdout:5/64: symlink dc/le 0 2023-12-17T11:57:33.480 INFO:tasks.workunit.client.0.smithi002.stdout:2/83: dwrite d3/d4/d7/f1a [0,4194304] 0 2023-12-17T11:57:33.480 INFO:tasks.workunit.client.0.smithi002.stdout:2/84: read - d3/d4/d17/d19/f24 zero size 2023-12-17T11:57:33.480 INFO:tasks.workunit.client.0.smithi002.stdout:3/124: dwrite f5 [0,4194304] 0 2023-12-17T11:57:33.481 INFO:tasks.workunit.client.0.smithi002.stdout:8/114: dwrite d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:33.481 INFO:tasks.workunit.client.1.smithi119.stdout:3/59: creat d9/da/f18 x:0 0 0 2023-12-17T11:57:33.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/65: symlink dc/lf 0 2023-12-17T11:57:33.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/66: write dc/fd [326912,128585] 0 2023-12-17T11:57:33.483 INFO:tasks.workunit.client.0.smithi002.stdout:2/85: mknod d3/d4/d17/c25 0 2023-12-17T11:57:33.486 INFO:tasks.workunit.client.1.smithi119.stdout:6/90: mknod d2/df/d17/c1d 0 2023-12-17T11:57:33.486 INFO:tasks.workunit.client.1.smithi119.stdout:6/91: readlink d2/df/l18 0 2023-12-17T11:57:33.486 INFO:tasks.workunit.client.0.smithi002.stdout:8/115: symlink d3/d7/l2b 0 2023-12-17T11:57:33.486 INFO:tasks.workunit.client.0.smithi002.stdout:8/116: write d3/d7/d1a/f1c [1350320,5493] 0 2023-12-17T11:57:33.487 INFO:tasks.workunit.client.0.smithi002.stdout:5/67: rename dc/le to dc/l10 0 2023-12-17T11:57:33.488 INFO:tasks.workunit.client.1.smithi119.stdout:6/92: mknod d2/df/d17/c1e 0 2023-12-17T11:57:33.489 INFO:tasks.workunit.client.0.smithi002.stdout:2/86: creat d3/d4/d7/d14/d1b/f26 x:0 0 0 2023-12-17T11:57:33.489 INFO:tasks.workunit.client.0.smithi002.stdout:3/125: rmdir d9/d1b 39 2023-12-17T11:57:33.492 INFO:tasks.workunit.client.0.smithi002.stdout:8/117: link d3/d7/d1a/l23 d3/d7/d18/l2c 0 2023-12-17T11:57:33.492 INFO:tasks.workunit.client.1.smithi119.stdout:6/93: creat d2/df/f1f x:0 0 0 2023-12-17T11:57:33.498 INFO:tasks.workunit.client.0.smithi002.stdout:5/68: symlink dc/l11 0 2023-12-17T11:57:33.501 INFO:tasks.workunit.client.1.smithi119.stdout:8/40: dread f3 [0,4194304] 0 2023-12-17T11:57:33.505 INFO:tasks.workunit.client.0.smithi002.stdout:2/87: unlink d3/d4/f13 0 2023-12-17T11:57:33.505 INFO:tasks.workunit.client.1.smithi119.stdout:8/41: mkdir d7 0 2023-12-17T11:57:33.505 INFO:tasks.workunit.client.1.smithi119.stdout:8/42: truncate f3 4639816 0 2023-12-17T11:57:33.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/69: dwrite d0/d1/fd [0,4194304] 0 2023-12-17T11:57:33.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/70: chown d0 15758290 1 2023-12-17T11:57:33.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/71: creat d0/f15 x:0 0 0 2023-12-17T11:57:33.506 INFO:tasks.workunit.client.0.smithi002.stdout:3/126: link d9/d1b/f1c d9/f29 0 2023-12-17T11:57:33.509 INFO:tasks.workunit.client.1.smithi119.stdout:8/43: link l5 d7/l8 0 2023-12-17T11:57:33.514 INFO:tasks.workunit.client.1.smithi119.stdout:6/94: getdents d2/df 0 2023-12-17T11:57:33.518 INFO:tasks.workunit.client.0.smithi002.stdout:3/127: mknod d9/d24/c2a 0 2023-12-17T11:57:33.518 INFO:tasks.workunit.client.0.smithi002.stdout:6/72: creat d0/d1/dc/f16 x:0 0 0 2023-12-17T11:57:33.518 INFO:tasks.workunit.client.0.smithi002.stdout:2/88: link d3/d4/d17/f20 d3/d4/d7/d14/d1b/f27 0 2023-12-17T11:57:33.519 INFO:tasks.workunit.client.0.smithi002.stdout:6/73: mkdir d0/d1/dc/d17 0 2023-12-17T11:57:33.520 INFO:tasks.workunit.client.0.smithi002.stdout:3/128: creat d9/d15/f2b x:0 0 0 2023-12-17T11:57:33.522 INFO:tasks.workunit.client.0.smithi002.stdout:2/89: symlink d3/d4/d17/l28 0 2023-12-17T11:57:33.524 INFO:tasks.workunit.client.0.smithi002.stdout:2/90: fdatasync d3/d4/d17/d19/f24 0 2023-12-17T11:57:33.524 INFO:tasks.workunit.client.0.smithi002.stdout:2/91: readlink d3/d4/d17/l28 0 2023-12-17T11:57:33.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/129: mknod d9/d15/c2c 0 2023-12-17T11:57:33.525 INFO:tasks.workunit.client.0.smithi002.stdout:6/74: mknod d0/d1/c18 0 2023-12-17T11:57:33.526 INFO:tasks.workunit.client.0.smithi002.stdout:6/75: creat d0/d1/dc/d10/f19 x:0 0 0 2023-12-17T11:57:33.526 INFO:tasks.workunit.client.0.smithi002.stdout:6/76: creat d0/f1a x:0 0 0 2023-12-17T11:57:33.527 INFO:tasks.workunit.client.1.smithi119.stdout:8/44: read f3 [2351211,105569] 0 2023-12-17T11:57:33.527 INFO:tasks.workunit.client.1.smithi119.stdout:9/103: dwrite d12/f19 [0,4194304] 0 2023-12-17T11:57:33.527 INFO:tasks.workunit.client.1.smithi119.stdout:5/84: dwrite d1/fc [0,4194304] 0 2023-12-17T11:57:33.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/85: dread - d1/f1a zero size 2023-12-17T11:57:33.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/86: readlink d1/l14 0 2023-12-17T11:57:33.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/87: dread - d1/f1a zero size 2023-12-17T11:57:33.529 INFO:tasks.workunit.client.0.smithi002.stdout:8/118: rmdir d3/d7 39 2023-12-17T11:57:33.530 INFO:tasks.workunit.client.1.smithi119.stdout:8/45: symlink d7/l9 0 2023-12-17T11:57:33.531 INFO:tasks.workunit.client.1.smithi119.stdout:5/88: symlink d1/l1b 0 2023-12-17T11:57:33.531 INFO:tasks.workunit.client.1.smithi119.stdout:3/60: dwrite d9/da/df/f15 [8388608,4194304] 0 2023-12-17T11:57:33.532 INFO:tasks.workunit.client.0.smithi002.stdout:6/77: mknod d0/d1/dc/d10/c1b 0 2023-12-17T11:57:33.533 INFO:tasks.workunit.client.0.smithi002.stdout:6/78: write d0/d1/f13 [112849,71992] 0 2023-12-17T11:57:33.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/69: getdents dc 0 2023-12-17T11:57:33.534 INFO:tasks.workunit.client.0.smithi002.stdout:8/119: creat d3/d8/da/dd/f2d x:0 0 0 2023-12-17T11:57:33.535 INFO:tasks.workunit.client.0.smithi002.stdout:8/120: write d3/d7/d1a/f1c [2943279,51602] 0 2023-12-17T11:57:33.535 INFO:tasks.workunit.client.1.smithi119.stdout:8/46: mkdir d7/da 0 2023-12-17T11:57:33.535 INFO:tasks.workunit.client.1.smithi119.stdout:3/61: read f6 [4056301,31229] 0 2023-12-17T11:57:33.536 INFO:tasks.workunit.client.1.smithi119.stdout:3/62: stat f3 0 2023-12-17T11:57:33.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/92: dread d3/d4/fe [0,4194304] 0 2023-12-17T11:57:33.539 INFO:tasks.workunit.client.0.smithi002.stdout:8/121: rename d3/d7/d18/l2c to d3/d8/l2e 0 2023-12-17T11:57:33.540 INFO:tasks.workunit.client.1.smithi119.stdout:8/47: creat d7/fb x:0 0 0 2023-12-17T11:57:33.540 INFO:tasks.workunit.client.1.smithi119.stdout:3/63: creat d9/f19 x:0 0 0 2023-12-17T11:57:33.540 INFO:tasks.workunit.client.1.smithi119.stdout:3/64: readlink d9/d11/l14 0 2023-12-17T11:57:33.540 INFO:tasks.workunit.client.1.smithi119.stdout:3/65: dread - f3 zero size 2023-12-17T11:57:33.540 INFO:tasks.workunit.client.0.smithi002.stdout:3/130: dread f7 [0,4194304] 0 2023-12-17T11:57:33.541 INFO:tasks.workunit.client.1.smithi119.stdout:3/66: mknod d9/da/df/c1a 0 2023-12-17T11:57:33.541 INFO:tasks.workunit.client.1.smithi119.stdout:3/67: creat d9/f1b x:0 0 0 2023-12-17T11:57:33.541 INFO:tasks.workunit.client.1.smithi119.stdout:2/58: sync 2023-12-17T11:57:33.542 INFO:tasks.workunit.client.1.smithi119.stdout:0/38: sync 2023-12-17T11:57:33.542 INFO:tasks.workunit.client.1.smithi119.stdout:2/59: fdatasync d6/f11 0 2023-12-17T11:57:33.542 INFO:tasks.workunit.client.1.smithi119.stdout:0/39: write d2/f4 [1060576,33579] 0 2023-12-17T11:57:33.543 INFO:tasks.workunit.client.0.smithi002.stdout:6/79: link d0/d1/l12 d0/d1/l1c 0 2023-12-17T11:57:33.543 INFO:tasks.workunit.client.0.smithi002.stdout:6/80: truncate d0/d1/dc/f8 6838188 0 2023-12-17T11:57:33.543 INFO:tasks.workunit.client.1.smithi119.stdout:1/18: sync 2023-12-17T11:57:33.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/68: mkdir d9/d1c 0 2023-12-17T11:57:33.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/69: truncate d9/da/fd 340020 0 2023-12-17T11:57:33.545 INFO:tasks.workunit.client.1.smithi119.stdout:2/60: creat d6/f14 x:0 0 0 2023-12-17T11:57:33.546 INFO:tasks.workunit.client.0.smithi002.stdout:3/131: rename d9/d15/l1f to d9/l2d 0 2023-12-17T11:57:33.547 INFO:tasks.workunit.client.0.smithi002.stdout:1/80: sync 2023-12-17T11:57:33.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/81: chown d3/l8 111 1 2023-12-17T11:57:33.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/82: write d3/ff [132275,76960] 0 2023-12-17T11:57:33.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/83: readlink d3/d6/ld 0 2023-12-17T11:57:33.548 INFO:tasks.workunit.client.1.smithi119.stdout:2/61: dread - d6/f11 zero size 2023-12-17T11:57:33.549 INFO:tasks.workunit.client.1.smithi119.stdout:0/40: link d2/l6 d2/d3/d5/lb 0 2023-12-17T11:57:33.549 INFO:tasks.workunit.client.0.smithi002.stdout:3/132: symlink d9/d24/l2e 0 2023-12-17T11:57:33.551 INFO:tasks.workunit.client.0.smithi002.stdout:3/133: truncate d9/f13 1887115 0 2023-12-17T11:57:33.553 INFO:tasks.workunit.client.1.smithi119.stdout:1/19: creat d3/f4 x:0 0 0 2023-12-17T11:57:33.554 INFO:tasks.workunit.client.1.smithi119.stdout:3/70: unlink d9/da/fd 0 2023-12-17T11:57:33.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/84: getdents d3/d6 0 2023-12-17T11:57:33.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/85: chown d3/d6/fa 1443315 1 2023-12-17T11:57:33.555 INFO:tasks.workunit.client.1.smithi119.stdout:1/20: mkdir d3/d5 0 2023-12-17T11:57:33.557 INFO:tasks.workunit.client.0.smithi002.stdout:1/86: mkdir d3/d6/d9/d12 0 2023-12-17T11:57:33.557 INFO:tasks.workunit.client.0.smithi002.stdout:1/87: stat d3/d6/ld 0 2023-12-17T11:57:33.560 INFO:tasks.workunit.client.1.smithi119.stdout:3/71: mknod d9/d11/c1d 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.1.smithi119.stdout:3/72: fdatasync f3 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.1.smithi119.stdout:3/73: readlink d9/da/l10 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.1.smithi119.stdout:8/48: dread f3 [0,4194304] 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.1.smithi119.stdout:1/21: creat d3/d5/f6 x:0 0 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.1.smithi119.stdout:1/22: stat f2 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.0.smithi002.stdout:1/88: creat d3/d6/d9/f13 x:0 0 0 2023-12-17T11:57:33.561 INFO:tasks.workunit.client.0.smithi002.stdout:1/89: dread - d3/d6/fa zero size 2023-12-17T11:57:33.564 INFO:tasks.workunit.client.0.smithi002.stdout:1/90: rename d3/d6/d9/c10 to d3/d6/d9/c14 0 2023-12-17T11:57:33.564 INFO:tasks.workunit.client.0.smithi002.stdout:1/91: read d3/ff [184084,82499] 0 2023-12-17T11:57:33.566 INFO:tasks.workunit.client.0.smithi002.stdout:1/92: symlink d3/l15 0 2023-12-17T11:57:33.574 INFO:tasks.workunit.client.1.smithi119.stdout:0/41: dread f1 [0,4194304] 0 2023-12-17T11:57:33.575 INFO:tasks.workunit.client.1.smithi119.stdout:5/89: dread d1/f17 [0,4194304] 0 2023-12-17T11:57:33.575 INFO:tasks.workunit.client.1.smithi119.stdout:5/90: fdatasync d1/f17 0 2023-12-17T11:57:33.578 INFO:tasks.workunit.client.1.smithi119.stdout:0/42: mkdir d2/d3/d5/dc 0 2023-12-17T11:57:33.579 INFO:tasks.workunit.client.0.smithi002.stdout:6/81: rmdir d0 39 2023-12-17T11:57:33.579 INFO:tasks.workunit.client.0.smithi002.stdout:6/82: chown d0/d1/dc/d10 484515 1 2023-12-17T11:57:33.579 INFO:tasks.workunit.client.0.smithi002.stdout:6/83: read - d0/d1/dc/f16 zero size 2023-12-17T11:57:33.579 INFO:tasks.workunit.client.0.smithi002.stdout:1/93: mkdir d3/d6/d16 0 2023-12-17T11:57:33.579 INFO:tasks.workunit.client.0.smithi002.stdout:1/94: write f1 [2224383,20120] 0 2023-12-17T11:57:33.580 INFO:tasks.workunit.client.0.smithi002.stdout:1/95: chown d3/d6/fe 268 1 2023-12-17T11:57:33.580 INFO:tasks.workunit.client.0.smithi002.stdout:6/84: write d0/d1/dc/f8 [3982599,96560] 0 2023-12-17T11:57:33.580 INFO:tasks.workunit.client.0.smithi002.stdout:6/85: write d0/d1/f13 [495726,77277] 0 2023-12-17T11:57:33.580 INFO:tasks.workunit.client.0.smithi002.stdout:6/86: dread - d0/d1/dc/f16 zero size 2023-12-17T11:57:33.580 INFO:tasks.workunit.client.0.smithi002.stdout:1/96: creat d3/f17 x:0 0 0 2023-12-17T11:57:33.581 INFO:tasks.workunit.client.1.smithi119.stdout:5/91: symlink d1/l1c 0 2023-12-17T11:57:33.581 INFO:tasks.workunit.client.1.smithi119.stdout:5/92: fsync d1/f17 0 2023-12-17T11:57:33.582 INFO:tasks.workunit.client.1.smithi119.stdout:5/93: stat d1/fa 0 2023-12-17T11:57:33.582 INFO:tasks.workunit.client.1.smithi119.stdout:0/43: write d2/f4 [65677,5442] 0 2023-12-17T11:57:33.584 INFO:tasks.workunit.client.0.smithi002.stdout:1/97: mknod d3/d6/d9/c18 0 2023-12-17T11:57:33.585 INFO:tasks.workunit.client.1.smithi119.stdout:5/94: symlink d1/l1d 0 2023-12-17T11:57:33.585 INFO:tasks.workunit.client.1.smithi119.stdout:0/44: symlink d2/d3/d5/ld 0 2023-12-17T11:57:33.585 INFO:tasks.workunit.client.1.smithi119.stdout:0/45: stat d2 0 2023-12-17T11:57:33.588 INFO:tasks.workunit.client.1.smithi119.stdout:0/46: creat d2/fe x:0 0 0 2023-12-17T11:57:33.588 INFO:tasks.workunit.client.1.smithi119.stdout:0/47: chown d2/d3/ca 994 1 2023-12-17T11:57:33.588 INFO:tasks.workunit.client.1.smithi119.stdout:9/104: dwrite d12/f1c [0,4194304] 0 2023-12-17T11:57:33.589 INFO:tasks.workunit.client.1.smithi119.stdout:5/95: creat d1/f1e x:0 0 0 2023-12-17T11:57:33.595 INFO:tasks.workunit.client.1.smithi119.stdout:8/49: getdents d7 0 2023-12-17T11:57:33.597 INFO:tasks.workunit.client.1.smithi119.stdout:8/50: mknod d7/cc 0 2023-12-17T11:57:33.600 INFO:tasks.workunit.client.0.smithi002.stdout:1/98: dread d3/ff [0,4194304] 0 2023-12-17T11:57:33.601 INFO:tasks.workunit.client.0.smithi002.stdout:2/93: dwrite d3/d4/d7/f1a [0,4194304] 0 2023-12-17T11:57:33.601 INFO:tasks.workunit.client.0.smithi002.stdout:2/94: readlink d3/d4/d7/l1c 0 2023-12-17T11:57:33.602 INFO:tasks.workunit.client.1.smithi119.stdout:8/51: symlink d7/ld 0 2023-12-17T11:57:33.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/99: symlink d3/d6/d9/d12/l19 0 2023-12-17T11:57:33.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/100: chown d3/d6/d9/c18 116415 1 2023-12-17T11:57:33.607 INFO:tasks.workunit.client.0.smithi002.stdout:1/101: chown f1 1 1 2023-12-17T11:57:33.607 INFO:tasks.workunit.client.1.smithi119.stdout:9/105: dread d12/f23 [0,4194304] 0 2023-12-17T11:57:33.610 INFO:tasks.workunit.client.0.smithi002.stdout:2/95: link d3/d4/d7/f11 d3/d4/d7/d14/d1b/f29 0 2023-12-17T11:57:33.612 INFO:tasks.workunit.client.0.smithi002.stdout:2/96: symlink d3/d4/d17/l2a 0 2023-12-17T11:57:33.612 INFO:tasks.workunit.client.0.smithi002.stdout:2/97: write d3/d4/f23 [843161,80887] 0 2023-12-17T11:57:33.612 INFO:tasks.workunit.client.0.smithi002.stdout:2/98: chown d3/c18 83496 1 2023-12-17T11:57:33.625 INFO:tasks.workunit.client.1.smithi119.stdout:3/74: dwrite d9/da/df/f17 [0,4194304] 0 2023-12-17T11:57:33.625 INFO:tasks.workunit.client.1.smithi119.stdout:3/75: write f4 [240898,106014] 0 2023-12-17T11:57:33.630 INFO:tasks.workunit.client.1.smithi119.stdout:5/96: dread d1/fd [0,4194304] 0 2023-12-17T11:57:33.630 INFO:tasks.workunit.client.1.smithi119.stdout:5/97: stat d1/c13 0 2023-12-17T11:57:33.647 INFO:tasks.workunit.client.0.smithi002.stdout:3/134: dwrite f5 [0,4194304] 0 2023-12-17T11:57:33.647 INFO:tasks.workunit.client.0.smithi002.stdout:3/135: dread - d9/f11 zero size 2023-12-17T11:57:33.648 INFO:tasks.workunit.client.1.smithi119.stdout:1/23: dwrite d3/d5/f6 [0,4194304] 0 2023-12-17T11:57:33.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/98: dread d1/fd [0,4194304] 0 2023-12-17T11:57:33.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/99: fdatasync d1/f12 0 2023-12-17T11:57:33.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/100: read - d1/f1e zero size 2023-12-17T11:57:33.649 INFO:tasks.workunit.client.1.smithi119.stdout:5/101: chown d1/l1d 509877 1 2023-12-17T11:57:33.649 INFO:tasks.workunit.client.1.smithi119.stdout:5/102: truncate d1/fe 883538 0 2023-12-17T11:57:33.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/136: link d9/ca d9/d1b/c2f 0 2023-12-17T11:57:33.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/137: chown d9/f29 852 1 2023-12-17T11:57:33.650 INFO:tasks.workunit.client.0.smithi002.stdout:3/138: creat d9/d1b/f30 x:0 0 0 2023-12-17T11:57:33.651 INFO:tasks.workunit.client.1.smithi119.stdout:0/48: dwrite f1 [0,4194304] 0 2023-12-17T11:57:33.653 INFO:tasks.workunit.client.0.smithi002.stdout:2/99: write d3/d4/d7/f1a [3617984,110898] 0 2023-12-17T11:57:33.654 INFO:tasks.workunit.client.1.smithi119.stdout:8/52: dwrite f3 [4194304,4194304] 0 2023-12-17T11:57:33.655 INFO:tasks.workunit.client.0.smithi002.stdout:3/139: mkdir d9/d15/d31 0 2023-12-17T11:57:33.655 INFO:tasks.workunit.client.0.smithi002.stdout:3/140: creat d9/d15/f32 x:0 0 0 2023-12-17T11:57:33.655 INFO:tasks.workunit.client.0.smithi002.stdout:3/141: fdatasync d9/f29 0 2023-12-17T11:57:33.656 INFO:tasks.workunit.client.1.smithi119.stdout:2/62: dwrite d6/ff [0,4194304] 0 2023-12-17T11:57:33.657 INFO:tasks.workunit.client.0.smithi002.stdout:8/122: dwrite d3/f25 [0,4194304] 0 2023-12-17T11:57:33.658 INFO:tasks.workunit.client.1.smithi119.stdout:8/53: rmdir d7 39 2023-12-17T11:57:33.658 INFO:tasks.workunit.client.0.smithi002.stdout:3/142: rmdir d9/d24 39 2023-12-17T11:57:33.659 INFO:tasks.workunit.client.1.smithi119.stdout:3/76: dread f4 [0,4194304] 0 2023-12-17T11:57:33.659 INFO:tasks.workunit.client.1.smithi119.stdout:3/77: fdatasync f6 0 2023-12-17T11:57:33.659 INFO:tasks.workunit.client.1.smithi119.stdout:9/106: dwrite d12/f17 [0,4194304] 0 2023-12-17T11:57:33.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/143: dread - d9/f11 zero size 2023-12-17T11:57:33.661 INFO:tasks.workunit.client.0.smithi002.stdout:3/144: fdatasync d9/d15/f19 0 2023-12-17T11:57:33.665 INFO:tasks.workunit.client.1.smithi119.stdout:5/103: write d1/fd [4117600,26605] 0 2023-12-17T11:57:33.666 INFO:tasks.workunit.client.1.smithi119.stdout:5/104: chown d1/cb 0 1 2023-12-17T11:57:33.670 INFO:tasks.workunit.client.1.smithi119.stdout:2/63: mkdir d6/d15 0 2023-12-17T11:57:33.671 INFO:tasks.workunit.client.1.smithi119.stdout:8/54: mknod d7/ce 0 2023-12-17T11:57:33.672 INFO:tasks.workunit.client.1.smithi119.stdout:1/24: write f2 [6201838,39550] 0 2023-12-17T11:57:33.677 INFO:tasks.workunit.client.1.smithi119.stdout:3/78: mkdir d9/d11/d1e 0 2023-12-17T11:57:33.677 INFO:tasks.workunit.client.1.smithi119.stdout:9/107: symlink d12/l25 0 2023-12-17T11:57:33.679 INFO:tasks.workunit.client.1.smithi119.stdout:5/105: rename d1/l1d to d1/l1f 0 2023-12-17T11:57:33.679 INFO:tasks.workunit.client.1.smithi119.stdout:5/106: creat d1/f20 x:0 0 0 2023-12-17T11:57:33.679 INFO:tasks.workunit.client.1.smithi119.stdout:5/107: fdatasync d1/fc 0 2023-12-17T11:57:33.680 INFO:tasks.workunit.client.1.smithi119.stdout:5/108: readlink d1/l1b 0 2023-12-17T11:57:33.680 INFO:tasks.workunit.client.1.smithi119.stdout:5/109: creat d1/f21 x:0 0 0 2023-12-17T11:57:33.680 INFO:tasks.workunit.client.1.smithi119.stdout:5/110: chown d1/l18 3936548 1 2023-12-17T11:57:33.680 INFO:tasks.workunit.client.1.smithi119.stdout:2/64: truncate d6/d9/fd 1005418 0 2023-12-17T11:57:33.683 INFO:tasks.workunit.client.1.smithi119.stdout:8/55: creat d7/ff x:0 0 0 2023-12-17T11:57:33.686 INFO:tasks.workunit.client.1.smithi119.stdout:3/79: creat d9/d11/d1e/f1f x:0 0 0 2023-12-17T11:57:33.688 INFO:tasks.workunit.client.1.smithi119.stdout:9/108: creat d12/d1d/d24/f26 x:0 0 0 2023-12-17T11:57:33.688 INFO:tasks.workunit.client.1.smithi119.stdout:9/109: chown d12/l15 51824 1 2023-12-17T11:57:33.697 INFO:tasks.workunit.client.1.smithi119.stdout:2/65: symlink d6/l16 0 2023-12-17T11:57:33.697 INFO:tasks.workunit.client.1.smithi119.stdout:2/66: dread - d6/f14 zero size 2023-12-17T11:57:33.697 INFO:tasks.workunit.client.1.smithi119.stdout:7/148: sync 2023-12-17T11:57:33.698 INFO:tasks.workunit.client.1.smithi119.stdout:4/51: sync 2023-12-17T11:57:33.698 INFO:tasks.workunit.client.1.smithi119.stdout:4/52: read f1 [4217875,58859] 0 2023-12-17T11:57:33.698 INFO:tasks.workunit.client.1.smithi119.stdout:4/53: chown f2 127370758 1 2023-12-17T11:57:33.698 INFO:tasks.workunit.client.1.smithi119.stdout:4/54: fdatasync f2 0 2023-12-17T11:57:33.698 INFO:tasks.workunit.client.1.smithi119.stdout:4/55: readlink dd/lf 0 2023-12-17T11:57:33.700 INFO:tasks.workunit.client.1.smithi119.stdout:6/95: sync 2023-12-17T11:57:33.701 INFO:tasks.workunit.client.1.smithi119.stdout:3/80: rmdir d9/d11 39 2023-12-17T11:57:33.701 INFO:tasks.workunit.client.1.smithi119.stdout:2/67: unlink d6/ff 0 2023-12-17T11:57:33.702 INFO:tasks.workunit.client.1.smithi119.stdout:1/25: dwrite d3/f4 [0,4194304] 0 2023-12-17T11:57:33.705 INFO:tasks.workunit.client.1.smithi119.stdout:4/56: symlink dd/d11/l13 0 2023-12-17T11:57:33.707 INFO:tasks.workunit.client.1.smithi119.stdout:6/96: rename d2/df/d17/c1e to d2/c20 0 2023-12-17T11:57:33.707 INFO:tasks.workunit.client.1.smithi119.stdout:6/97: chown d2/df/c16 3778 1 2023-12-17T11:57:33.707 INFO:tasks.workunit.client.1.smithi119.stdout:6/98: write d2/df/f1f [644301,124638] 0 2023-12-17T11:57:33.707 INFO:tasks.workunit.client.1.smithi119.stdout:6/99: chown d2/le 0 1 2023-12-17T11:57:33.715 INFO:tasks.workunit.client.1.smithi119.stdout:2/68: mknod d6/d9/c17 0 2023-12-17T11:57:33.715 INFO:tasks.workunit.client.1.smithi119.stdout:2/69: stat d6/d9/d13 0 2023-12-17T11:57:33.715 INFO:tasks.workunit.client.1.smithi119.stdout:5/111: rmdir d1 39 2023-12-17T11:57:33.715 INFO:tasks.workunit.client.1.smithi119.stdout:3/81: getdents d9 0 2023-12-17T11:57:33.715 INFO:tasks.workunit.client.1.smithi119.stdout:3/82: chown d9/da/df 377854 1 2023-12-17T11:57:33.717 INFO:tasks.workunit.client.1.smithi119.stdout:9/110: getdents d12/d1d/d24 0 2023-12-17T11:57:33.720 INFO:tasks.workunit.client.1.smithi119.stdout:2/70: truncate f5 3336620 0 2023-12-17T11:57:33.720 INFO:tasks.workunit.client.1.smithi119.stdout:2/71: chown d6/l16 52 1 2023-12-17T11:57:33.720 INFO:tasks.workunit.client.1.smithi119.stdout:2/72: stat f5 0 2023-12-17T11:57:33.721 INFO:tasks.workunit.client.1.smithi119.stdout:2/73: write d6/d9/fd [1249206,120631] 0 2023-12-17T11:57:33.721 INFO:tasks.workunit.client.1.smithi119.stdout:2/74: stat f5 0 2023-12-17T11:57:33.722 INFO:tasks.workunit.client.1.smithi119.stdout:3/83: rmdir d9 39 2023-12-17T11:57:33.722 INFO:tasks.workunit.client.1.smithi119.stdout:9/111: getdents d12/d1d 0 2023-12-17T11:57:33.722 INFO:tasks.workunit.client.1.smithi119.stdout:1/26: dread d3/f4 [0,4194304] 0 2023-12-17T11:57:33.723 INFO:tasks.workunit.client.0.smithi002.stdout:0/53: sync 2023-12-17T11:57:33.723 INFO:tasks.workunit.client.0.smithi002.stdout:0/54: dread - d0/d6/fb zero size 2023-12-17T11:57:33.724 INFO:tasks.workunit.client.0.smithi002.stdout:1/102: dwrite d3/d6/fe [0,4194304] 0 2023-12-17T11:57:33.724 INFO:tasks.workunit.client.0.smithi002.stdout:1/103: dread - d3/d6/fa zero size 2023-12-17T11:57:33.724 INFO:tasks.workunit.client.0.smithi002.stdout:1/104: readlink d3/d6/lb 0 2023-12-17T11:57:33.727 INFO:tasks.workunit.client.1.smithi119.stdout:2/75: mkdir d6/d9/d18 0 2023-12-17T11:57:33.727 INFO:tasks.workunit.client.0.smithi002.stdout:0/55: mkdir d0/d15 0 2023-12-17T11:57:33.730 INFO:tasks.workunit.client.1.smithi119.stdout:9/112: rename d12/f1e to d12/d1d/f27 0 2023-12-17T11:57:33.732 INFO:tasks.workunit.client.0.smithi002.stdout:1/105: creat d3/d6/d9/d12/f1a x:0 0 0 2023-12-17T11:57:33.733 INFO:tasks.workunit.client.1.smithi119.stdout:1/27: mkdir d3/d7 0 2023-12-17T11:57:33.733 INFO:tasks.workunit.client.1.smithi119.stdout:1/28: write d3/f4 [4212302,8631] 0 2023-12-17T11:57:33.736 INFO:tasks.workunit.client.0.smithi002.stdout:0/56: rename d0/d6/d8/c12 to d0/d6/c16 0 2023-12-17T11:57:33.738 INFO:tasks.workunit.client.1.smithi119.stdout:2/76: rename d6/l16 to d6/d9/d13/l19 0 2023-12-17T11:57:33.738 INFO:tasks.workunit.client.0.smithi002.stdout:1/106: unlink d3/d6/d9/l11 0 2023-12-17T11:57:33.740 INFO:tasks.workunit.client.0.smithi002.stdout:1/107: symlink d3/d6/l1b 0 2023-12-17T11:57:33.743 INFO:tasks.workunit.client.1.smithi119.stdout:9/113: rmdir d12 39 2023-12-17T11:57:33.744 INFO:tasks.workunit.client.0.smithi002.stdout:0/57: dread d0/d6/fe [4194304,4194304] 0 2023-12-17T11:57:33.745 INFO:tasks.workunit.client.1.smithi119.stdout:1/29: creat d3/d7/f8 x:0 0 0 2023-12-17T11:57:33.746 INFO:tasks.workunit.client.0.smithi002.stdout:8/123: dwrite d3/d8/da/d13/f24 [0,4194304] 0 2023-12-17T11:57:33.746 INFO:tasks.workunit.client.0.smithi002.stdout:8/124: getdents d3/d8/d28 0 2023-12-17T11:57:33.746 INFO:tasks.workunit.client.0.smithi002.stdout:0/58: write d0/d6/fe [4376669,86726] 0 2023-12-17T11:57:33.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/30: mknod d3/d5/c9 0 2023-12-17T11:57:33.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/31: readlink l1 0 2023-12-17T11:57:33.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/32: creat d3/fa x:0 0 0 2023-12-17T11:57:33.749 INFO:tasks.workunit.client.0.smithi002.stdout:1/108: dread d3/ff [0,4194304] 0 2023-12-17T11:57:33.750 INFO:tasks.workunit.client.1.smithi119.stdout:1/33: mkdir d3/db 0 2023-12-17T11:57:33.750 INFO:tasks.workunit.client.1.smithi119.stdout:1/34: fsync d3/d5/f6 0 2023-12-17T11:57:33.751 INFO:tasks.workunit.client.1.smithi119.stdout:1/35: write d3/fa [380612,57420] 0 2023-12-17T11:57:33.751 INFO:tasks.workunit.client.0.smithi002.stdout:0/59: truncate d0/ff 1499182 0 2023-12-17T11:57:33.751 INFO:tasks.workunit.client.0.smithi002.stdout:8/125: mknod d3/d8/c2f 0 2023-12-17T11:57:33.751 INFO:tasks.workunit.client.0.smithi002.stdout:8/126: chown d3/d8/da/d13 3337525 1 2023-12-17T11:57:33.752 INFO:tasks.workunit.client.1.smithi119.stdout:1/36: creat d3/db/fc x:0 0 0 2023-12-17T11:57:33.754 INFO:tasks.workunit.client.1.smithi119.stdout:9/114: dread d12/f23 [0,4194304] 0 2023-12-17T11:57:33.754 INFO:tasks.workunit.client.0.smithi002.stdout:3/145: dwrite d9/d1b/f28 [0,4194304] 0 2023-12-17T11:57:33.755 INFO:tasks.workunit.client.0.smithi002.stdout:3/146: write d9/d15/f2b [808652,27496] 0 2023-12-17T11:57:33.755 INFO:tasks.workunit.client.0.smithi002.stdout:1/109: mknod d3/d6/c1c 0 2023-12-17T11:57:33.756 INFO:tasks.workunit.client.1.smithi119.stdout:1/37: mknod d3/cd 0 2023-12-17T11:57:33.756 INFO:tasks.workunit.client.1.smithi119.stdout:9/115: truncate d12/f17 6565071 0 2023-12-17T11:57:33.756 INFO:tasks.workunit.client.1.smithi119.stdout:9/116: fsync fe 0 2023-12-17T11:57:33.761 INFO:tasks.workunit.client.1.smithi119.stdout:4/57: dwrite f1 [4194304,4194304] 0 2023-12-17T11:57:33.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/147: mknod d9/d24/c33 0 2023-12-17T11:57:33.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/148: read - d9/d1b/f30 zero size 2023-12-17T11:57:33.764 INFO:tasks.workunit.client.0.smithi002.stdout:1/110: symlink d3/d6/d9/d12/l1d 0 2023-12-17T11:57:33.764 INFO:tasks.workunit.client.0.smithi002.stdout:1/111: write d3/f17 [583707,12056] 0 2023-12-17T11:57:33.765 INFO:tasks.workunit.client.1.smithi119.stdout:4/58: creat dd/d11/f14 x:0 0 0 2023-12-17T11:57:33.769 INFO:tasks.workunit.client.1.smithi119.stdout:4/59: mkdir dd/d15 0 2023-12-17T11:57:33.771 INFO:tasks.workunit.client.1.smithi119.stdout:4/60: mkdir dd/d15/d16 0 2023-12-17T11:57:33.773 INFO:tasks.workunit.client.0.smithi002.stdout:8/127: read d3/d8/da/dd/f1d [3911281,85874] 0 2023-12-17T11:57:33.773 INFO:tasks.workunit.client.0.smithi002.stdout:3/149: write d9/d24/f25 [32565,47745] 0 2023-12-17T11:57:33.773 INFO:tasks.workunit.client.0.smithi002.stdout:3/150: chown d9/d1b/f28 7162756 1 2023-12-17T11:57:33.774 INFO:tasks.workunit.client.1.smithi119.stdout:7/149: dwrite d2/f19 [0,4194304] 0 2023-12-17T11:57:33.775 INFO:tasks.workunit.client.1.smithi119.stdout:7/150: fdatasync d2/d4/d11/f2d 0 2023-12-17T11:57:33.775 INFO:tasks.workunit.client.1.smithi119.stdout:7/151: fdatasync d2/d4/d1f/f2e 0 2023-12-17T11:57:33.775 INFO:tasks.workunit.client.1.smithi119.stdout:7/152: fdatasync d2/f26 0 2023-12-17T11:57:33.775 INFO:tasks.workunit.client.1.smithi119.stdout:5/112: dwrite d1/f17 [4194304,4194304] 0 2023-12-17T11:57:33.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/151: dread d9/f1e [0,4194304] 0 2023-12-17T11:57:33.780 INFO:tasks.workunit.client.0.smithi002.stdout:3/152: chown d9/d24/f25 17892 1 2023-12-17T11:57:33.783 INFO:tasks.workunit.client.1.smithi119.stdout:7/153: truncate d2/fe 2048336 0 2023-12-17T11:57:33.784 INFO:tasks.workunit.client.1.smithi119.stdout:7/154: readlink d2/d4/l5 0 2023-12-17T11:57:33.784 INFO:tasks.workunit.client.1.smithi119.stdout:7/155: fdatasync d2/d4/d11/f21 0 2023-12-17T11:57:33.785 INFO:tasks.workunit.client.0.smithi002.stdout:3/153: symlink d9/l34 0 2023-12-17T11:57:33.786 INFO:tasks.workunit.client.1.smithi119.stdout:2/77: dwrite d6/d9/fb [0,4194304] 0 2023-12-17T11:57:33.786 INFO:tasks.workunit.client.1.smithi119.stdout:2/78: write f4 [4108757,63017] 0 2023-12-17T11:57:33.786 INFO:tasks.workunit.client.1.smithi119.stdout:2/79: fsync f5 0 2023-12-17T11:57:33.786 INFO:tasks.workunit.client.1.smithi119.stdout:2/80: chown d6/f14 238 1 2023-12-17T11:57:33.786 INFO:tasks.workunit.client.1.smithi119.stdout:7/156: creat d2/f31 x:0 0 0 2023-12-17T11:57:33.786 INFO:tasks.workunit.client.1.smithi119.stdout:7/157: truncate d2/f3 2366462 0 2023-12-17T11:57:33.787 INFO:tasks.workunit.client.0.smithi002.stdout:3/154: mkdir d9/d1b/d35 0 2023-12-17T11:57:33.789 INFO:tasks.workunit.client.1.smithi119.stdout:9/117: dread f11 [4194304,4194304] 0 2023-12-17T11:57:33.789 INFO:tasks.workunit.client.1.smithi119.stdout:9/118: write ff [432888,5571] 0 2023-12-17T11:57:33.790 INFO:tasks.workunit.client.1.smithi119.stdout:9/119: chown d12/c13 2 1 2023-12-17T11:57:33.790 INFO:tasks.workunit.client.1.smithi119.stdout:2/81: rmdir d6/d15 0 2023-12-17T11:57:33.792 INFO:tasks.workunit.client.1.smithi119.stdout:2/82: symlink d6/d9/d18/l1a 0 2023-12-17T11:57:33.792 INFO:tasks.workunit.client.1.smithi119.stdout:2/83: readlink d6/d9/d18/l1a 0 2023-12-17T11:57:33.795 INFO:tasks.workunit.client.1.smithi119.stdout:2/84: creat d6/d9/f1b x:0 0 0 2023-12-17T11:57:33.802 INFO:tasks.workunit.client.1.smithi119.stdout:1/38: dwrite d3/db/fc [0,4194304] 0 2023-12-17T11:57:33.811 INFO:tasks.workunit.client.1.smithi119.stdout:7/158: rmdir d2 39 2023-12-17T11:57:33.812 INFO:tasks.workunit.client.1.smithi119.stdout:7/159: fsync d2/d4/d11/f21 0 2023-12-17T11:57:33.814 INFO:tasks.workunit.client.1.smithi119.stdout:2/85: dread d6/d9/fb [0,4194304] 0 2023-12-17T11:57:33.814 INFO:tasks.workunit.client.1.smithi119.stdout:2/86: creat d6/d9/f1c x:0 0 0 2023-12-17T11:57:33.816 INFO:tasks.workunit.client.1.smithi119.stdout:7/160: mknod d2/d4/d11/d2c/c32 0 2023-12-17T11:57:33.817 INFO:tasks.workunit.client.0.smithi002.stdout:3/155: dread f5 [0,4194304] 0 2023-12-17T11:57:33.822 INFO:tasks.workunit.client.0.smithi002.stdout:0/60: dread d0/d6/fe [0,4194304] 0 2023-12-17T11:57:33.827 INFO:tasks.workunit.client.0.smithi002.stdout:3/156: read d9/d15/f16 [840805,41599] 0 2023-12-17T11:57:33.827 INFO:tasks.workunit.client.0.smithi002.stdout:3/157: write f7 [5045090,130872] 0 2023-12-17T11:57:33.827 INFO:tasks.workunit.client.0.smithi002.stdout:8/128: dread d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:33.828 INFO:tasks.workunit.client.1.smithi119.stdout:2/87: rename d6/d9/d18 to d6/d9/d13/d1d 0 2023-12-17T11:57:33.828 INFO:tasks.workunit.client.0.smithi002.stdout:8/129: creat d3/d8/da/d13/f30 x:0 0 0 2023-12-17T11:57:33.829 INFO:tasks.workunit.client.1.smithi119.stdout:4/61: dwrite f8 [0,4194304] 0 2023-12-17T11:57:33.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/61: mkdir d0/d6/d17 0 2023-12-17T11:57:33.830 INFO:tasks.workunit.client.0.smithi002.stdout:8/130: rename d3/d7/d18/d2a to d3/d8/d28/d31 0 2023-12-17T11:57:33.831 INFO:tasks.workunit.client.0.smithi002.stdout:1/112: dwrite d3/ff [0,4194304] 0 2023-12-17T11:57:33.831 INFO:tasks.workunit.client.1.smithi119.stdout:2/88: rename d6/l8 to d6/d9/l1e 0 2023-12-17T11:57:33.834 INFO:tasks.workunit.client.1.smithi119.stdout:4/62: getdents dd/d15 0 2023-12-17T11:57:33.834 INFO:tasks.workunit.client.1.smithi119.stdout:4/63: chown dd/d11/l12 81017 1 2023-12-17T11:57:33.837 INFO:tasks.workunit.client.1.smithi119.stdout:4/64: stat la 0 2023-12-17T11:57:33.837 INFO:tasks.workunit.client.1.smithi119.stdout:2/89: truncate d6/d9/fd 127968 0 2023-12-17T11:57:33.837 INFO:tasks.workunit.client.1.smithi119.stdout:2/90: chown d6/d9/f1b 4443123 1 2023-12-17T11:57:33.837 INFO:tasks.workunit.client.1.smithi119.stdout:2/91: dread - d6/d9/f1b zero size 2023-12-17T11:57:33.837 INFO:tasks.workunit.client.1.smithi119.stdout:5/113: dwrite d1/f12 [0,4194304] 0 2023-12-17T11:57:33.839 INFO:tasks.workunit.client.0.smithi002.stdout:8/131: mknod d3/d8/da/dd/c32 0 2023-12-17T11:57:33.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/113: symlink d3/l1e 0 2023-12-17T11:57:33.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/114: truncate d3/f17 1299665 0 2023-12-17T11:57:33.845 INFO:tasks.workunit.client.0.smithi002.stdout:8/132: unlink d3/d8/da/dd/c16 0 2023-12-17T11:57:33.847 INFO:tasks.workunit.client.0.smithi002.stdout:1/115: symlink d3/d6/l1f 0 2023-12-17T11:57:33.849 INFO:tasks.workunit.client.0.smithi002.stdout:1/116: rename d3/d6/lb to d3/l20 0 2023-12-17T11:57:33.851 INFO:tasks.workunit.client.1.smithi119.stdout:9/120: dwrite ff [0,4194304] 0 2023-12-17T11:57:33.853 INFO:tasks.workunit.client.1.smithi119.stdout:1/39: dwrite f2 [8388608,4194304] 0 2023-12-17T11:57:33.854 INFO:tasks.workunit.client.0.smithi002.stdout:1/117: symlink d3/d6/d9/d12/l21 0 2023-12-17T11:57:33.854 INFO:tasks.workunit.client.0.smithi002.stdout:3/158: dread f5 [0,4194304] 0 2023-12-17T11:57:33.855 INFO:tasks.workunit.client.0.smithi002.stdout:0/62: truncate d0/f13 1536668 0 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:4/105: sync 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:4/106: stat d0/d10/l1f 0 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/96: sync 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/97: stat d6/d17/cd 0 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/98: fsync d6/d17/f1a 0 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/99: write d6/d17/dc/d13/f14 [1546972,98198] 0 2023-12-17T11:57:33.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/100: stat d6 0 2023-12-17T11:57:33.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/87: sync 2023-12-17T11:57:33.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/88: dread - d0/f1a zero size 2023-12-17T11:57:33.857 INFO:tasks.workunit.client.0.smithi002.stdout:2/100: sync 2023-12-17T11:57:33.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/133: dread d3/d7/d1a/f1c [0,4194304] 0 2023-12-17T11:57:33.861 INFO:tasks.workunit.client.1.smithi119.stdout:8/56: sync 2023-12-17T11:57:33.861 INFO:tasks.workunit.client.0.smithi002.stdout:4/107: symlink d0/d10/d21/l26 0 2023-12-17T11:57:33.863 INFO:tasks.workunit.client.0.smithi002.stdout:7/101: rmdir d6/d17/dc/d13/d21 39 2023-12-17T11:57:33.864 INFO:tasks.workunit.client.1.smithi119.stdout:5/114: dread d1/fc [0,4194304] 0 2023-12-17T11:57:33.865 INFO:tasks.workunit.client.0.smithi002.stdout:2/101: symlink d3/l2b 0 2023-12-17T11:57:33.866 INFO:tasks.workunit.client.1.smithi119.stdout:0/49: sync 2023-12-17T11:57:33.866 INFO:tasks.workunit.client.1.smithi119.stdout:0/50: dread - d2/fe zero size 2023-12-17T11:57:33.866 INFO:tasks.workunit.client.1.smithi119.stdout:0/51: chown d2/d3/d5 2 1 2023-12-17T11:57:33.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/120: sync 2023-12-17T11:57:33.871 INFO:tasks.workunit.client.0.smithi002.stdout:4/108: mkdir d0/d10/d14/d27 0 2023-12-17T11:57:33.871 INFO:tasks.workunit.client.1.smithi119.stdout:5/115: symlink d1/l22 0 2023-12-17T11:57:33.871 INFO:tasks.workunit.client.1.smithi119.stdout:1/40: getdents d3 0 2023-12-17T11:57:33.871 INFO:tasks.workunit.client.1.smithi119.stdout:9/121: rename d12/d1d/d24 to d12/d1d/d28 0 2023-12-17T11:57:33.872 INFO:tasks.workunit.client.0.smithi002.stdout:8/134: rename d3/d7/l21 to d3/d8/d28/l33 0 2023-12-17T11:57:33.872 INFO:tasks.workunit.client.0.smithi002.stdout:5/70: sync 2023-12-17T11:57:33.876 INFO:tasks.workunit.client.0.smithi002.stdout:4/109: symlink d0/d10/d14/d27/l28 0 2023-12-17T11:57:33.877 INFO:tasks.workunit.client.1.smithi119.stdout:2/92: dwrite d6/f11 [0,4194304] 0 2023-12-17T11:57:33.877 INFO:tasks.workunit.client.1.smithi119.stdout:2/93: creat d6/f1f x:0 0 0 2023-12-17T11:57:33.877 INFO:tasks.workunit.client.0.smithi002.stdout:8/135: rename d3/d7/f26 to d3/d8/d28/d31/f34 0 2023-12-17T11:57:33.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/110: symlink d0/d10/l29 0 2023-12-17T11:57:33.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/111: creat d0/d10/f2a x:0 0 0 2023-12-17T11:57:33.879 INFO:tasks.workunit.client.0.smithi002.stdout:8/136: unlink d3/c4 0 2023-12-17T11:57:33.882 INFO:tasks.workunit.client.1.smithi119.stdout:2/94: rename d6/d9/f1c to d6/d9/f20 0 2023-12-17T11:57:33.884 INFO:tasks.workunit.client.0.smithi002.stdout:4/112: rename d0/l5 to d0/d10/l2b 0 2023-12-17T11:57:33.884 INFO:tasks.workunit.client.0.smithi002.stdout:4/113: readlink d0/lc 0 2023-12-17T11:57:33.884 INFO:tasks.workunit.client.0.smithi002.stdout:8/137: unlink d3/d8/da/dd/c15 0 2023-12-17T11:57:33.885 INFO:tasks.workunit.client.0.smithi002.stdout:8/138: creat d3/d8/da/dd/f35 x:0 0 0 2023-12-17T11:57:33.885 INFO:tasks.workunit.client.0.smithi002.stdout:8/139: readlink d3/d8/d28/l33 0 2023-12-17T11:57:33.886 INFO:tasks.workunit.client.1.smithi119.stdout:9/122: rmdir d12/d1d/d28 39 2023-12-17T11:57:33.887 INFO:tasks.workunit.client.0.smithi002.stdout:8/140: rename d3/d8/c2f to d3/d8/da/d29/c36 0 2023-12-17T11:57:33.888 INFO:tasks.workunit.client.1.smithi119.stdout:2/95: link f5 d6/f21 0 2023-12-17T11:57:33.889 INFO:tasks.workunit.client.1.smithi119.stdout:5/116: dread d1/fd [0,4194304] 0 2023-12-17T11:57:33.889 INFO:tasks.workunit.client.1.smithi119.stdout:5/117: stat d1/c13 0 2023-12-17T11:57:33.889 INFO:tasks.workunit.client.1.smithi119.stdout:5/118: chown d1/f1a 0 1 2023-12-17T11:57:33.889 INFO:tasks.workunit.client.1.smithi119.stdout:5/119: truncate d1/fa 716524 0 2023-12-17T11:57:33.889 INFO:tasks.workunit.client.1.smithi119.stdout:5/120: fsync d1/f21 0 2023-12-17T11:57:33.890 INFO:tasks.workunit.client.1.smithi119.stdout:9/123: getdents d12/d1d 0 2023-12-17T11:57:33.893 INFO:tasks.workunit.client.1.smithi119.stdout:5/121: getdents d1 0 2023-12-17T11:57:33.899 INFO:tasks.workunit.client.1.smithi119.stdout:9/124: mknod d12/d1d/c29 0 2023-12-17T11:57:33.899 INFO:tasks.workunit.client.1.smithi119.stdout:9/125: fdatasync fe 0 2023-12-17T11:57:33.900 INFO:tasks.workunit.client.0.smithi002.stdout:3/159: dread d9/f1d [0,4194304] 0 2023-12-17T11:57:33.901 INFO:tasks.workunit.client.1.smithi119.stdout:5/122: rmdir d1 39 2023-12-17T11:57:33.901 INFO:tasks.workunit.client.1.smithi119.stdout:5/123: write d1/f12 [4251455,9766] 0 2023-12-17T11:57:33.906 INFO:tasks.workunit.client.1.smithi119.stdout:9/126: link d12/l16 d12/d1d/d28/l2a 0 2023-12-17T11:57:33.906 INFO:tasks.workunit.client.1.smithi119.stdout:9/127: chown d12/c13 263032 1 2023-12-17T11:57:33.910 INFO:tasks.workunit.client.1.smithi119.stdout:9/128: truncate d12/d1d/f27 4890258 0 2023-12-17T11:57:33.911 INFO:tasks.workunit.client.1.smithi119.stdout:9/129: rmdir d12/d1d/d28 39 2023-12-17T11:57:33.914 INFO:tasks.workunit.client.1.smithi119.stdout:9/130: symlink d12/d1d/d28/l2b 0 2023-12-17T11:57:33.916 INFO:tasks.workunit.client.1.smithi119.stdout:9/131: creat d12/f2c x:0 0 0 2023-12-17T11:57:33.917 INFO:tasks.workunit.client.1.smithi119.stdout:9/132: symlink d12/l2d 0 2023-12-17T11:57:33.921 INFO:tasks.workunit.client.0.smithi002.stdout:0/63: dread d0/d6/fe [0,4194304] 0 2023-12-17T11:57:33.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/121: write f9 [3834281,30563] 0 2023-12-17T11:57:33.926 INFO:tasks.workunit.client.0.smithi002.stdout:2/102: dwrite d3/d4/f16 [0,4194304] 0 2023-12-17T11:57:33.927 INFO:tasks.workunit.client.1.smithi119.stdout:0/52: dread f1 [0,4194304] 0 2023-12-17T11:57:33.928 INFO:tasks.workunit.client.0.smithi002.stdout:5/71: dread fa [0,4194304] 0 2023-12-17T11:57:33.928 INFO:tasks.workunit.client.1.smithi119.stdout:0/53: write d2/f4 [351533,41393] 0 2023-12-17T11:57:33.930 INFO:tasks.workunit.client.0.smithi002.stdout:3/160: dread d9/f29 [0,4194304] 0 2023-12-17T11:57:33.930 INFO:tasks.workunit.client.0.smithi002.stdout:2/103: rmdir d3/d4/d7/d14 39 2023-12-17T11:57:33.932 INFO:tasks.workunit.client.1.smithi119.stdout:5/124: dread d1/fe [0,4194304] 0 2023-12-17T11:57:33.933 INFO:tasks.workunit.client.0.smithi002.stdout:2/104: link d3/d4/d17/c25 d3/d4/d7/d14/c2c 0 2023-12-17T11:57:33.936 INFO:tasks.workunit.client.1.smithi119.stdout:8/57: dwrite f3 [4194304,4194304] 0 2023-12-17T11:57:33.938 INFO:tasks.workunit.client.0.smithi002.stdout:3/161: rmdir d9/d1b 39 2023-12-17T11:57:33.944 INFO:tasks.workunit.client.0.smithi002.stdout:3/162: rmdir d9/d24 39 2023-12-17T11:57:33.944 INFO:tasks.workunit.client.0.smithi002.stdout:3/163: dread - d9/f14 zero size 2023-12-17T11:57:33.945 INFO:tasks.workunit.client.1.smithi119.stdout:9/133: dread d12/f17 [0,4194304] 0 2023-12-17T11:57:33.945 INFO:tasks.workunit.client.1.smithi119.stdout:9/134: fdatasync d12/f1c 0 2023-12-17T11:57:33.948 INFO:tasks.workunit.client.1.smithi119.stdout:2/96: dwrite f5 [0,4194304] 0 2023-12-17T11:57:33.949 INFO:tasks.workunit.client.1.smithi119.stdout:8/58: unlink d7/ld 0 2023-12-17T11:57:33.949 INFO:tasks.workunit.client.1.smithi119.stdout:8/59: creat d7/f10 x:0 0 0 2023-12-17T11:57:33.949 INFO:tasks.workunit.client.1.smithi119.stdout:8/60: dread - d7/ff zero size 2023-12-17T11:57:33.950 INFO:tasks.workunit.client.0.smithi002.stdout:3/164: dread d9/d15/f16 [0,4194304] 0 2023-12-17T11:57:33.950 INFO:tasks.workunit.client.0.smithi002.stdout:3/165: stat l2 0 2023-12-17T11:57:33.952 INFO:tasks.workunit.client.1.smithi119.stdout:9/135: truncate d12/f19 255663 0 2023-12-17T11:57:33.952 INFO:tasks.workunit.client.1.smithi119.stdout:9/136: truncate d12/d1d/f27 5155817 0 2023-12-17T11:57:33.952 INFO:tasks.workunit.client.1.smithi119.stdout:2/97: mknod d6/d9/d13/c22 0 2023-12-17T11:57:33.956 INFO:tasks.workunit.client.0.smithi002.stdout:5/72: write f6 [1036031,61880] 0 2023-12-17T11:57:33.957 INFO:tasks.workunit.client.0.smithi002.stdout:5/73: creat dc/f12 x:0 0 0 2023-12-17T11:57:33.957 INFO:tasks.workunit.client.0.smithi002.stdout:5/74: truncate fb 328337 0 2023-12-17T11:57:33.959 INFO:tasks.workunit.client.0.smithi002.stdout:7/102: dwrite d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:33.959 INFO:tasks.workunit.client.1.smithi119.stdout:8/61: mkdir d7/da/d11 0 2023-12-17T11:57:33.960 INFO:tasks.workunit.client.0.smithi002.stdout:5/75: mknod dc/c13 0 2023-12-17T11:57:33.964 INFO:tasks.workunit.client.1.smithi119.stdout:9/137: mknod d12/d1d/d28/c2e 0 2023-12-17T11:57:33.964 INFO:tasks.workunit.client.0.smithi002.stdout:7/103: mknod d6/d17/d16/c23 0 2023-12-17T11:57:33.965 INFO:tasks.workunit.client.0.smithi002.stdout:7/104: chown d6/d17/dc/d13/f14 6274772 1 2023-12-17T11:57:33.965 INFO:tasks.workunit.client.0.smithi002.stdout:7/105: fsync d6/d17/f1a 0 2023-12-17T11:57:33.965 INFO:tasks.workunit.client.0.smithi002.stdout:1/118: dwrite d3/d6/d9/f13 [0,4194304] 0 2023-12-17T11:57:33.968 INFO:tasks.workunit.client.0.smithi002.stdout:1/119: rename d3/l1e to d3/d6/d16/l22 0 2023-12-17T11:57:33.969 INFO:tasks.workunit.client.0.smithi002.stdout:1/120: rmdir d3/d6 39 2023-12-17T11:57:33.970 INFO:tasks.workunit.client.0.smithi002.stdout:5/76: dread fb [0,4194304] 0 2023-12-17T11:57:33.970 INFO:tasks.workunit.client.0.smithi002.stdout:5/77: fdatasync fa 0 2023-12-17T11:57:33.972 INFO:tasks.workunit.client.1.smithi119.stdout:8/62: mkdir d7/d12 0 2023-12-17T11:57:33.973 INFO:tasks.workunit.client.1.smithi119.stdout:9/138: creat d12/d1d/f2f x:0 0 0 2023-12-17T11:57:33.975 INFO:tasks.workunit.client.0.smithi002.stdout:1/121: rmdir d3/d6/d9/d12 39 2023-12-17T11:57:33.978 INFO:tasks.workunit.client.1.smithi119.stdout:1/41: dwrite d3/d7/f8 [0,4194304] 0 2023-12-17T11:57:33.982 INFO:tasks.workunit.client.1.smithi119.stdout:9/139: mknod d12/d1d/d28/c30 0 2023-12-17T11:57:33.982 INFO:tasks.workunit.client.1.smithi119.stdout:9/140: dread - d12/d1d/d28/f26 zero size 2023-12-17T11:57:33.985 INFO:tasks.workunit.client.1.smithi119.stdout:6/100: sync 2023-12-17T11:57:33.985 INFO:tasks.workunit.client.1.smithi119.stdout:6/101: write d2/f11 [845609,89476] 0 2023-12-17T11:57:33.985 INFO:tasks.workunit.client.1.smithi119.stdout:6/102: rename d2 to d2/d21 22 2023-12-17T11:57:33.985 INFO:tasks.workunit.client.0.smithi002.stdout:7/106: read d6/d17/dc/d13/f14 [1566949,50606] 0 2023-12-17T11:57:33.985 INFO:tasks.workunit.client.0.smithi002.stdout:7/107: readlink l1 0 2023-12-17T11:57:33.995 INFO:tasks.workunit.client.1.smithi119.stdout:9/141: creat d12/d1d/f31 x:0 0 0 2023-12-17T11:57:34.000 INFO:tasks.workunit.client.1.smithi119.stdout:6/103: symlink d2/l22 0 2023-12-17T11:57:34.000 INFO:tasks.workunit.client.1.smithi119.stdout:2/98: rmdir d6/d9 39 2023-12-17T11:57:34.000 INFO:tasks.workunit.client.1.smithi119.stdout:2/99: chown d6/d9/c17 66989139 1 2023-12-17T11:57:34.003 INFO:tasks.workunit.client.0.smithi002.stdout:5/78: dread f7 [0,4194304] 0 2023-12-17T11:57:34.004 INFO:tasks.workunit.client.0.smithi002.stdout:7/108: mkdir d6/d17/d16/d1d/d24 0 2023-12-17T11:57:34.004 INFO:tasks.workunit.client.0.smithi002.stdout:7/109: fdatasync d6/d17/f1a 0 2023-12-17T11:57:34.005 INFO:tasks.workunit.client.0.smithi002.stdout:2/105: dwrite d3/d4/f5 [8388608,4194304] 0 2023-12-17T11:57:34.005 INFO:tasks.workunit.client.0.smithi002.stdout:2/106: chown d3 106 1 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.0.smithi002.stdout:2/107: chown d3/d4/d7/d14/c2c 3656614 1 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.0.smithi002.stdout:2/108: chown d3/d4/l12 552 1 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.0.smithi002.stdout:2/109: readlink d3/d4/d7/d14/l22 0 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.0.smithi002.stdout:1/122: write d3/fc [918033,104261] 0 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.1.smithi119.stdout:9/142: creat d12/d1d/f32 x:0 0 0 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.1.smithi119.stdout:9/143: write d12/d1d/f32 [501327,82826] 0 2023-12-17T11:57:34.006 INFO:tasks.workunit.client.1.smithi119.stdout:9/144: write d12/f1c [4482980,123707] 0 2023-12-17T11:57:34.008 INFO:tasks.workunit.client.0.smithi002.stdout:7/110: unlink d6/c7 0 2023-12-17T11:57:34.008 INFO:tasks.workunit.client.0.smithi002.stdout:7/111: readlink d6/d17/l10 0 2023-12-17T11:57:34.008 INFO:tasks.workunit.client.0.smithi002.stdout:7/112: chown d6/d17/c1e 1326801528 1 2023-12-17T11:57:34.008 INFO:tasks.workunit.client.0.smithi002.stdout:5/79: getdents dc 0 2023-12-17T11:57:34.013 INFO:tasks.workunit.client.1.smithi119.stdout:8/63: write f3 [4465493,4851] 0 2023-12-17T11:57:34.017 INFO:tasks.workunit.client.0.smithi002.stdout:2/110: mknod d3/d4/d7/d14/c2d 0 2023-12-17T11:57:34.017 INFO:tasks.workunit.client.0.smithi002.stdout:1/123: creat d3/d6/d9/d12/f23 x:0 0 0 2023-12-17T11:57:34.017 INFO:tasks.workunit.client.0.smithi002.stdout:1/124: chown d3/d6/d16/l22 113780 1 2023-12-17T11:57:34.020 INFO:tasks.workunit.client.1.smithi119.stdout:3/84: sync 2023-12-17T11:57:34.020 INFO:tasks.workunit.client.0.smithi002.stdout:6/89: dwrite d0/f3 [0,4194304] 0 2023-12-17T11:57:34.021 INFO:tasks.workunit.client.0.smithi002.stdout:1/125: read d3/f17 [672648,39052] 0 2023-12-17T11:57:34.021 INFO:tasks.workunit.client.1.smithi119.stdout:7/161: sync 2023-12-17T11:57:34.021 INFO:tasks.workunit.client.1.smithi119.stdout:7/162: read - d2/d4/f29 zero size 2023-12-17T11:57:34.026 INFO:tasks.workunit.client.1.smithi119.stdout:8/64: rename d7/f10 to d7/da/d11/f13 0 2023-12-17T11:57:34.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/65: sync 2023-12-17T11:57:34.029 INFO:tasks.workunit.client.0.smithi002.stdout:6/90: rename d0/l4 to d0/d1/dc/d10/l1d 0 2023-12-17T11:57:34.029 INFO:tasks.workunit.client.1.smithi119.stdout:2/100: dread f5 [0,4194304] 0 2023-12-17T11:57:34.029 INFO:tasks.workunit.client.1.smithi119.stdout:2/101: write f4 [2836202,38744] 0 2023-12-17T11:57:34.032 INFO:tasks.workunit.client.1.smithi119.stdout:2/102: creat d6/d9/d13/d1d/f23 x:0 0 0 2023-12-17T11:57:34.032 INFO:tasks.workunit.client.1.smithi119.stdout:2/103: readlink d6/d9/d13/l19 0 2023-12-17T11:57:34.032 INFO:tasks.workunit.client.1.smithi119.stdout:2/104: write d6/d9/f1b [353260,124548] 0 2023-12-17T11:57:34.032 INFO:tasks.workunit.client.1.smithi119.stdout:2/105: creat d6/d9/d13/d1d/f24 x:0 0 0 2023-12-17T11:57:34.032 INFO:tasks.workunit.client.1.smithi119.stdout:2/106: dread - d6/d9/d13/d1d/f24 zero size 2023-12-17T11:57:34.034 INFO:tasks.workunit.client.1.smithi119.stdout:9/145: write d12/d1d/f27 [574998,20162] 0 2023-12-17T11:57:34.036 INFO:tasks.workunit.client.0.smithi002.stdout:1/126: rename d3/l8 to d3/d6/d16/l24 0 2023-12-17T11:57:34.039 INFO:tasks.workunit.client.0.smithi002.stdout:2/111: dread d3/d4/fd [0,4194304] 0 2023-12-17T11:57:34.042 INFO:tasks.workunit.client.0.smithi002.stdout:3/166: dwrite d9/f13 [0,4194304] 0 2023-12-17T11:57:34.042 INFO:tasks.workunit.client.0.smithi002.stdout:3/167: chown d9/l10 1978500 1 2023-12-17T11:57:34.043 INFO:tasks.workunit.client.0.smithi002.stdout:9/122: dwrite f0 [4194304,4194304] 0 2023-12-17T11:57:34.047 INFO:tasks.workunit.client.0.smithi002.stdout:1/127: rename d3/l15 to d3/d6/l25 0 2023-12-17T11:57:34.052 INFO:tasks.workunit.client.0.smithi002.stdout:3/168: link d9/ca d9/d1b/c36 0 2023-12-17T11:57:34.052 INFO:tasks.workunit.client.0.smithi002.stdout:3/169: truncate d9/d1b/f30 456691 0 2023-12-17T11:57:34.052 INFO:tasks.workunit.client.0.smithi002.stdout:3/170: write d9/f14 [828081,11427] 0 2023-12-17T11:57:34.054 INFO:tasks.workunit.client.1.smithi119.stdout:5/125: dwrite d1/f12 [0,4194304] 0 2023-12-17T11:57:34.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/126: fdatasync d1/f20 0 2023-12-17T11:57:34.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/127: dread - d1/f21 zero size 2023-12-17T11:57:34.055 INFO:tasks.workunit.client.1.smithi119.stdout:5/128: dread - d1/f1e zero size 2023-12-17T11:57:34.056 INFO:tasks.workunit.client.0.smithi002.stdout:9/123: symlink dc/d1d/d23/l2f 0 2023-12-17T11:57:34.058 INFO:tasks.workunit.client.1.smithi119.stdout:1/42: dwrite d3/fa [0,4194304] 0 2023-12-17T11:57:34.058 INFO:tasks.workunit.client.1.smithi119.stdout:1/43: truncate d3/f4 4780692 0 2023-12-17T11:57:34.059 INFO:tasks.workunit.client.1.smithi119.stdout:3/85: dread d9/da/df/f17 [0,4194304] 0 2023-12-17T11:57:34.059 INFO:tasks.workunit.client.1.smithi119.stdout:5/129: creat d1/f23 x:0 0 0 2023-12-17T11:57:34.059 INFO:tasks.workunit.client.1.smithi119.stdout:3/86: write d9/da/df/f15 [3343739,98577] 0 2023-12-17T11:57:34.059 INFO:tasks.workunit.client.1.smithi119.stdout:3/87: read - d9/da/f18 zero size 2023-12-17T11:57:34.059 INFO:tasks.workunit.client.0.smithi002.stdout:6/91: read d0/d1/fd [2078991,50905] 0 2023-12-17T11:57:34.061 INFO:tasks.workunit.client.1.smithi119.stdout:9/146: write d12/f19 [4422,27817] 0 2023-12-17T11:57:34.062 INFO:tasks.workunit.client.1.smithi119.stdout:9/147: chown d12/f23 58332214 1 2023-12-17T11:57:34.066 INFO:tasks.workunit.client.0.smithi002.stdout:9/124: link dc/ff dc/d1d/d23/d24/f30 0 2023-12-17T11:57:34.071 INFO:tasks.workunit.client.1.smithi119.stdout:1/44: mknod d3/d7/ce 0 2023-12-17T11:57:34.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/125: truncate dc/f16 2207699 0 2023-12-17T11:57:34.074 INFO:tasks.workunit.client.1.smithi119.stdout:5/130: rename d1/l9 to d1/l24 0 2023-12-17T11:57:34.078 INFO:tasks.workunit.client.1.smithi119.stdout:3/88: mknod d9/d11/c20 0 2023-12-17T11:57:34.080 INFO:tasks.workunit.client.1.smithi119.stdout:1/45: unlink d3/cd 0 2023-12-17T11:57:34.081 INFO:tasks.workunit.client.1.smithi119.stdout:3/89: link d9/da/l10 d9/d11/l21 0 2023-12-17T11:57:34.084 INFO:tasks.workunit.client.0.smithi002.stdout:1/128: dread f1 [0,4194304] 0 2023-12-17T11:57:34.084 INFO:tasks.workunit.client.0.smithi002.stdout:1/129: write d3/d6/d9/d12/f23 [259291,59448] 0 2023-12-17T11:57:34.089 INFO:tasks.workunit.client.1.smithi119.stdout:6/104: dwrite d2/f11 [0,4194304] 0 2023-12-17T11:57:34.092 INFO:tasks.workunit.client.0.smithi002.stdout:6/92: dread d0/d1/dc/ff [0,4194304] 0 2023-12-17T11:57:34.093 INFO:tasks.workunit.client.0.smithi002.stdout:6/93: dread - d0/d1/dc/d10/f14 zero size 2023-12-17T11:57:34.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/130: creat d3/d6/d16/f26 x:0 0 0 2023-12-17T11:57:34.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/131: write f1 [833273,62211] 0 2023-12-17T11:57:34.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/132: dread - d3/d6/d16/f26 zero size 2023-12-17T11:57:34.099 INFO:tasks.workunit.client.0.smithi002.stdout:6/94: truncate d0/d1/fd 253508 0 2023-12-17T11:57:34.101 INFO:tasks.workunit.client.1.smithi119.stdout:7/163: dwrite d2/f3 [0,4194304] 0 2023-12-17T11:57:34.102 INFO:tasks.workunit.client.0.smithi002.stdout:6/95: getdents d0 0 2023-12-17T11:57:34.102 INFO:tasks.workunit.client.1.smithi119.stdout:5/131: write d1/fc [3461327,122019] 0 2023-12-17T11:57:34.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/133: getdents d3/d6 0 2023-12-17T11:57:34.109 INFO:tasks.workunit.client.0.smithi002.stdout:1/134: rename d3/d6/d16/l24 to d3/d6/d9/l27 0 2023-12-17T11:57:34.110 INFO:tasks.workunit.client.1.smithi119.stdout:7/164: rename d2/fe to d2/d4/d1f/d2a/f33 0 2023-12-17T11:57:34.110 INFO:tasks.workunit.client.1.smithi119.stdout:7/165: read - d2/f26 zero size 2023-12-17T11:57:34.111 INFO:tasks.workunit.client.0.smithi002.stdout:1/135: mkdir d3/d6/d16/d28 0 2023-12-17T11:57:34.112 INFO:tasks.workunit.client.1.smithi119.stdout:7/166: mknod d2/d4/c34 0 2023-12-17T11:57:34.115 INFO:tasks.workunit.client.1.smithi119.stdout:7/167: creat d2/f35 x:0 0 0 2023-12-17T11:57:34.115 INFO:tasks.workunit.client.1.smithi119.stdout:7/168: chown d2/f24 426481466 1 2023-12-17T11:57:34.117 INFO:tasks.workunit.client.1.smithi119.stdout:7/169: fdatasync d2/d4/d1f/f23 0 2023-12-17T11:57:34.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/107: dwrite d6/d9/fb [0,4194304] 0 2023-12-17T11:57:34.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/108: truncate d6/f14 46217 0 2023-12-17T11:57:34.120 INFO:tasks.workunit.client.1.smithi119.stdout:1/46: write d3/d7/f8 [1165445,90187] 0 2023-12-17T11:57:34.121 INFO:tasks.workunit.client.0.smithi002.stdout:3/171: dread d9/d15/f19 [0,4194304] 0 2023-12-17T11:57:34.123 INFO:tasks.workunit.client.1.smithi119.stdout:8/65: dwrite d7/da/d11/f13 [0,4194304] 0 2023-12-17T11:57:34.124 INFO:tasks.workunit.client.1.smithi119.stdout:8/66: write d7/ff [410226,45457] 0 2023-12-17T11:57:34.124 INFO:tasks.workunit.client.1.smithi119.stdout:8/67: readlink d7/l8 0 2023-12-17T11:57:34.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/172: unlink d9/d15/f20 0 2023-12-17T11:57:34.124 INFO:tasks.workunit.client.1.smithi119.stdout:8/68: write d7/ff [761289,85779] 0 2023-12-17T11:57:34.125 INFO:tasks.workunit.client.1.smithi119.stdout:7/170: rmdir d2/d4/d11/d2f 0 2023-12-17T11:57:34.128 INFO:tasks.workunit.client.1.smithi119.stdout:4/66: dwrite f2 [0,4194304] 0 2023-12-17T11:57:34.129 INFO:tasks.workunit.client.1.smithi119.stdout:2/109: unlink d6/le 0 2023-12-17T11:57:34.129 INFO:tasks.workunit.client.1.smithi119.stdout:2/110: stat d6/d9/d13/d1d 0 2023-12-17T11:57:34.130 INFO:tasks.workunit.client.1.smithi119.stdout:5/132: truncate d1/f12 2326477 0 2023-12-17T11:57:34.131 INFO:tasks.workunit.client.0.smithi002.stdout:3/173: mknod d9/d1b/c37 0 2023-12-17T11:57:34.133 INFO:tasks.workunit.client.0.smithi002.stdout:2/112: dwrite d3/d4/d7/d14/d1b/f26 [0,4194304] 0 2023-12-17T11:57:34.134 INFO:tasks.workunit.client.1.smithi119.stdout:8/69: mkdir d7/d12/d14 0 2023-12-17T11:57:34.137 INFO:tasks.workunit.client.1.smithi119.stdout:7/171: rename d2/d4/d11/c1a to d2/d4/d1f/d2a/c36 0 2023-12-17T11:57:34.138 INFO:tasks.workunit.client.1.smithi119.stdout:2/111: read d6/f14 [6668,1612] 0 2023-12-17T11:57:34.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/80: dwrite fb [0,4194304] 0 2023-12-17T11:57:34.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/81: chown dc/fd 0 1 2023-12-17T11:57:34.140 INFO:tasks.workunit.client.1.smithi119.stdout:9/148: dwrite d12/f19 [0,4194304] 0 2023-12-17T11:57:34.143 INFO:tasks.workunit.client.1.smithi119.stdout:4/67: mknod dd/d11/c17 0 2023-12-17T11:57:34.144 INFO:tasks.workunit.client.1.smithi119.stdout:3/90: dwrite f4 [0,4194304] 0 2023-12-17T11:57:34.145 INFO:tasks.workunit.client.0.smithi002.stdout:9/126: dwrite f0 [0,4194304] 0 2023-12-17T11:57:34.147 INFO:tasks.workunit.client.1.smithi119.stdout:8/70: mkdir d7/d12/d14/d15 0 2023-12-17T11:57:34.147 INFO:tasks.workunit.client.1.smithi119.stdout:5/133: mkdir d1/d25 0 2023-12-17T11:57:34.147 INFO:tasks.workunit.client.1.smithi119.stdout:5/134: readlink d1/l22 0 2023-12-17T11:57:34.147 INFO:tasks.workunit.client.1.smithi119.stdout:5/135: chown d1/f1e 0 1 2023-12-17T11:57:34.147 INFO:tasks.workunit.client.1.smithi119.stdout:8/71: write d7/ff [1528678,67305] 0 2023-12-17T11:57:34.147 INFO:tasks.workunit.client.1.smithi119.stdout:8/72: write d7/fb [53787,14148] 0 2023-12-17T11:57:34.148 INFO:tasks.workunit.client.1.smithi119.stdout:0/54: sync 2023-12-17T11:57:34.150 INFO:tasks.workunit.client.0.smithi002.stdout:2/113: rmdir d3/d4 39 2023-12-17T11:57:34.151 INFO:tasks.workunit.client.1.smithi119.stdout:2/112: rename d6/d9/c17 to d6/d9/d13/c25 0 2023-12-17T11:57:34.153 INFO:tasks.workunit.client.1.smithi119.stdout:1/47: dread d3/d5/f6 [0,4194304] 0 2023-12-17T11:57:34.161 INFO:tasks.workunit.client.1.smithi119.stdout:7/172: write d2/d4/d1f/f2e [3722253,84390] 0 2023-12-17T11:57:34.167 INFO:tasks.workunit.client.0.smithi002.stdout:0/64: sync 2023-12-17T11:57:34.167 INFO:tasks.workunit.client.0.smithi002.stdout:4/114: sync 2023-12-17T11:57:34.168 INFO:tasks.workunit.client.0.smithi002.stdout:8/141: sync 2023-12-17T11:57:34.170 INFO:tasks.workunit.client.1.smithi119.stdout:8/73: write d7/da/d11/f13 [2341120,77193] 0 2023-12-17T11:57:34.172 INFO:tasks.workunit.client.0.smithi002.stdout:1/136: dwrite d3/fc [0,4194304] 0 2023-12-17T11:57:34.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/142: creat d3/d7/f37 x:0 0 0 2023-12-17T11:57:34.172 INFO:tasks.workunit.client.0.smithi002.stdout:7/113: sync 2023-12-17T11:57:34.172 INFO:tasks.workunit.client.1.smithi119.stdout:5/136: mknod d1/d25/c26 0 2023-12-17T11:57:34.174 INFO:tasks.workunit.client.0.smithi002.stdout:8/143: creat d3/f38 x:0 0 0 2023-12-17T11:57:34.175 INFO:tasks.workunit.client.0.smithi002.stdout:8/144: readlink d3/d8/d28/l33 0 2023-12-17T11:57:34.175 INFO:tasks.workunit.client.1.smithi119.stdout:0/55: mknod d2/d3/cf 0 2023-12-17T11:57:34.176 INFO:tasks.workunit.client.0.smithi002.stdout:2/114: dread d3/d4/f23 [0,4194304] 0 2023-12-17T11:57:34.176 INFO:tasks.workunit.client.1.smithi119.stdout:6/105: truncate d2/f11 3575174 0 2023-12-17T11:57:34.176 INFO:tasks.workunit.client.1.smithi119.stdout:6/106: chown d2/df/d17/c1d 853600 1 2023-12-17T11:57:34.177 INFO:tasks.workunit.client.0.smithi002.stdout:2/115: write d3/d4/d17/f20 [1681039,115821] 0 2023-12-17T11:57:34.177 INFO:tasks.workunit.client.0.smithi002.stdout:2/116: chown d3/d4/d17/c25 1234 1 2023-12-17T11:57:34.177 INFO:tasks.workunit.client.0.smithi002.stdout:3/174: dwrite d9/f1d [0,4194304] 0 2023-12-17T11:57:34.179 INFO:tasks.workunit.client.0.smithi002.stdout:2/117: unlink d3/d4/f23 0 2023-12-17T11:57:34.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/175: symlink d9/l38 0 2023-12-17T11:57:34.184 INFO:tasks.workunit.client.0.smithi002.stdout:2/118: mkdir d3/d4/d7/d14/d2e 0 2023-12-17T11:57:34.184 INFO:tasks.workunit.client.1.smithi119.stdout:9/149: rmdir d12/d1d 39 2023-12-17T11:57:34.184 INFO:tasks.workunit.client.1.smithi119.stdout:9/150: chown d12/f19 19116344 1 2023-12-17T11:57:34.184 INFO:tasks.workunit.client.1.smithi119.stdout:9/151: write d12/f2c [776975,129614] 0 2023-12-17T11:57:34.184 INFO:tasks.workunit.client.1.smithi119.stdout:2/113: truncate d6/f21 3713953 0 2023-12-17T11:57:34.184 INFO:tasks.workunit.client.1.smithi119.stdout:1/48: mknod d3/cf 0 2023-12-17T11:57:34.185 INFO:tasks.workunit.client.0.smithi002.stdout:2/119: symlink d3/d4/d7/d14/d1b/l2f 0 2023-12-17T11:57:34.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/120: chown d3/d4/d7/f1a 637 1 2023-12-17T11:57:34.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/121: write d3/d4/d7/f11 [652819,57089] 0 2023-12-17T11:57:34.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/122: chown d3/d4/f5 261196 1 2023-12-17T11:57:34.187 INFO:tasks.workunit.client.1.smithi119.stdout:7/173: rmdir d2/d4/d1f/d2a 39 2023-12-17T11:57:34.192 INFO:tasks.workunit.client.1.smithi119.stdout:8/74: fdatasync d7/ff 0 2023-12-17T11:57:34.192 INFO:tasks.workunit.client.1.smithi119.stdout:8/75: creat d7/f16 x:0 0 0 2023-12-17T11:57:34.192 INFO:tasks.workunit.client.1.smithi119.stdout:8/76: creat d7/f17 x:0 0 0 2023-12-17T11:57:34.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/152: dread d12/f23 [0,4194304] 0 2023-12-17T11:57:34.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/153: truncate d12/d1d/f2f 955928 0 2023-12-17T11:57:34.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/154: dread - d12/d1d/f31 zero size 2023-12-17T11:57:34.197 INFO:tasks.workunit.client.1.smithi119.stdout:4/68: dwrite f8 [4194304,4194304] 0 2023-12-17T11:57:34.197 INFO:tasks.workunit.client.1.smithi119.stdout:3/91: dread d9/fc [0,4194304] 0 2023-12-17T11:57:34.197 INFO:tasks.workunit.client.1.smithi119.stdout:0/56: mkdir d2/d3/d10 0 2023-12-17T11:57:34.197 INFO:tasks.workunit.client.1.smithi119.stdout:2/114: symlink d6/l26 0 2023-12-17T11:57:34.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/65: write d0/fd [2450887,63510] 0 2023-12-17T11:57:34.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/66: chown d0/l10 11806 1 2023-12-17T11:57:34.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/67: write d0/f13 [762585,25839] 0 2023-12-17T11:57:34.202 INFO:tasks.workunit.client.0.smithi002.stdout:2/123: fsync d3/d4/d7/f1a 0 2023-12-17T11:57:34.202 INFO:tasks.workunit.client.0.smithi002.stdout:0/68: write d0/d6/fe [2472062,95678] 0 2023-12-17T11:57:34.204 INFO:tasks.workunit.client.1.smithi119.stdout:7/174: link d2/f25 d2/d4/d1f/d2a/f37 0 2023-12-17T11:57:34.207 INFO:tasks.workunit.client.1.smithi119.stdout:8/77: fsync f3 0 2023-12-17T11:57:34.211 INFO:tasks.workunit.client.1.smithi119.stdout:4/69: getdents dd 0 2023-12-17T11:57:34.214 INFO:tasks.workunit.client.0.smithi002.stdout:5/82: dwrite dc/f12 [0,4194304] 0 2023-12-17T11:57:34.214 INFO:tasks.workunit.client.1.smithi119.stdout:0/57: unlink d2/l6 0 2023-12-17T11:57:34.215 INFO:tasks.workunit.client.1.smithi119.stdout:0/58: write d2/fe [275957,100857] 0 2023-12-17T11:57:34.222 INFO:tasks.workunit.client.0.smithi002.stdout:5/83: unlink dc/f12 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/92: mknod d9/c22 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:8/78: rename d7/d12/d14 to d7/d18 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/93: fdatasync d9/da/f18 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:8/79: write d7/f17 [267731,10834] 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/94: write d9/fc [4944766,26628] 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/95: chown d9/da 486 1 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/96: fsync f4 0 2023-12-17T11:57:34.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/97: truncate d9/f19 210232 0 2023-12-17T11:57:34.235 INFO:tasks.workunit.client.1.smithi119.stdout:2/115: truncate f4 2618668 0 2023-12-17T11:57:34.235 INFO:tasks.workunit.client.0.smithi002.stdout:9/127: dwrite dc/f14 [0,4194304] 0 2023-12-17T11:57:34.240 INFO:tasks.workunit.client.0.smithi002.stdout:9/128: symlink dc/d1d/d23/d24/l31 0 2023-12-17T11:57:34.240 INFO:tasks.workunit.client.1.smithi119.stdout:8/80: link c4 d7/d18/c19 0 2023-12-17T11:57:34.241 INFO:tasks.workunit.client.1.smithi119.stdout:3/98: symlink d9/da/l23 0 2023-12-17T11:57:34.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/129: mkdir dc/d32 0 2023-12-17T11:57:34.243 INFO:tasks.workunit.client.1.smithi119.stdout:1/49: dread d3/d7/f8 [0,4194304] 0 2023-12-17T11:57:34.243 INFO:tasks.workunit.client.1.smithi119.stdout:2/116: symlink d6/d9/d13/d1d/l27 0 2023-12-17T11:57:34.244 INFO:tasks.workunit.client.1.smithi119.stdout:2/117: chown d6 6826 1 2023-12-17T11:57:34.245 INFO:tasks.workunit.client.1.smithi119.stdout:8/81: mkdir d7/da/d1a 0 2023-12-17T11:57:34.250 INFO:tasks.workunit.client.1.smithi119.stdout:3/99: creat d9/d1c/f24 x:0 0 0 2023-12-17T11:57:34.253 INFO:tasks.workunit.client.1.smithi119.stdout:1/50: symlink d3/d7/l10 0 2023-12-17T11:57:34.254 INFO:tasks.workunit.client.1.smithi119.stdout:1/51: readlink l1 0 2023-12-17T11:57:34.259 INFO:tasks.workunit.client.1.smithi119.stdout:6/107: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:34.262 INFO:tasks.workunit.client.1.smithi119.stdout:3/100: link d9/da/l23 d9/l25 0 2023-12-17T11:57:34.263 INFO:tasks.workunit.client.0.smithi002.stdout:2/124: truncate d3/d4/d7/d14/d1b/f27 3176534 0 2023-12-17T11:57:34.264 INFO:tasks.workunit.client.0.smithi002.stdout:7/114: dwrite d6/f1c [0,4194304] 0 2023-12-17T11:57:34.266 INFO:tasks.workunit.client.0.smithi002.stdout:2/125: link d3/d4/l12 d3/d4/d7/d14/d2e/l30 0 2023-12-17T11:57:34.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/115: rename d6/c18 to d6/d17/d16/c25 0 2023-12-17T11:57:34.270 INFO:tasks.workunit.client.0.smithi002.stdout:2/126: mkdir d3/d4/d7/d14/d1b/d31 0 2023-12-17T11:57:34.271 INFO:tasks.workunit.client.0.smithi002.stdout:2/127: fdatasync d3/d4/d7/d14/d1b/f26 0 2023-12-17T11:57:34.271 INFO:tasks.workunit.client.1.smithi119.stdout:1/52: unlink l1 0 2023-12-17T11:57:34.274 INFO:tasks.workunit.client.1.smithi119.stdout:6/108: creat d2/df/d17/f23 x:0 0 0 2023-12-17T11:57:34.274 INFO:tasks.workunit.client.1.smithi119.stdout:6/109: write d2/df/f1f [900271,10480] 0 2023-12-17T11:57:34.275 INFO:tasks.workunit.client.0.smithi002.stdout:7/116: truncate d6/d17/dc/d13/f14 2297625 0 2023-12-17T11:57:34.288 INFO:tasks.workunit.client.1.smithi119.stdout:0/59: getdents d2 0 2023-12-17T11:57:34.288 INFO:tasks.workunit.client.1.smithi119.stdout:0/60: truncate f1 6240165 0 2023-12-17T11:57:34.290 INFO:tasks.workunit.client.0.smithi002.stdout:8/145: dwrite d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:34.294 INFO:tasks.workunit.client.1.smithi119.stdout:5/137: dwrite d1/f8 [0,4194304] 0 2023-12-17T11:57:34.294 INFO:tasks.workunit.client.1.smithi119.stdout:5/138: stat d1/l1b 0 2023-12-17T11:57:34.300 INFO:tasks.workunit.client.0.smithi002.stdout:4/115: dwrite d0/d10/f25 [0,4194304] 0 2023-12-17T11:57:34.300 INFO:tasks.workunit.client.0.smithi002.stdout:4/116: fsync d0/d10/f25 0 2023-12-17T11:57:34.300 INFO:tasks.workunit.client.0.smithi002.stdout:4/117: fdatasync d0/d10/f2a 0 2023-12-17T11:57:34.300 INFO:tasks.workunit.client.0.smithi002.stdout:4/118: read d0/ff [3182805,75004] 0 2023-12-17T11:57:34.301 INFO:tasks.workunit.client.1.smithi119.stdout:2/118: read d6/f21 [1441198,51375] 0 2023-12-17T11:57:34.302 INFO:tasks.workunit.client.1.smithi119.stdout:9/155: dwrite d12/f2c [0,4194304] 0 2023-12-17T11:57:34.304 INFO:tasks.workunit.client.1.smithi119.stdout:7/175: dwrite d2/d4/d1f/f23 [0,4194304] 0 2023-12-17T11:57:34.307 INFO:tasks.workunit.client.0.smithi002.stdout:8/146: getdents d3 0 2023-12-17T11:57:34.311 INFO:tasks.workunit.client.0.smithi002.stdout:4/119: symlink d0/d10/d14/d27/l2c 0 2023-12-17T11:57:34.311 INFO:tasks.workunit.client.0.smithi002.stdout:4/120: fdatasync d0/d10/d14/f24 0 2023-12-17T11:57:34.311 INFO:tasks.workunit.client.0.smithi002.stdout:0/69: dread d0/d6/fe [0,4194304] 0 2023-12-17T11:57:34.314 INFO:tasks.workunit.client.0.smithi002.stdout:8/147: unlink d3/fc 0 2023-12-17T11:57:34.314 INFO:tasks.workunit.client.1.smithi119.stdout:9/156: link c1 d12/d1d/d28/c33 0 2023-12-17T11:57:34.314 INFO:tasks.workunit.client.1.smithi119.stdout:9/157: readlink d12/d1d/d28/l2b 0 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/148: chown d3/d7/l22 0 1 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/149: fdatasync d3/d8/d28/d31/f34 0 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/150: chown d3/d8/da/d13/f24 97634919 1 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/151: truncate d3/d8/da/dd/f1d 4309244 0 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/152: fsync d3/d8/da/dd/f35 0 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/153: dread - d3/d8/da/dd/f35 zero size 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/154: dread - d3/d8/da/d13/f30 zero size 2023-12-17T11:57:34.315 INFO:tasks.workunit.client.0.smithi002.stdout:3/176: dwrite f7 [0,4194304] 0 2023-12-17T11:57:34.316 INFO:tasks.workunit.client.0.smithi002.stdout:2/128: write d3/d4/f16 [2603614,60966] 0 2023-12-17T11:57:34.316 INFO:tasks.workunit.client.0.smithi002.stdout:2/129: chown d3 235682 1 2023-12-17T11:57:34.316 INFO:tasks.workunit.client.0.smithi002.stdout:2/130: stat d3/d4/d17/l28 0 2023-12-17T11:57:34.317 INFO:tasks.workunit.client.0.smithi002.stdout:4/121: rename d0/d10/f1d to d0/d10/f2d 0 2023-12-17T11:57:34.319 INFO:tasks.workunit.client.1.smithi119.stdout:1/53: write d3/d5/f6 [2804156,74818] 0 2023-12-17T11:57:34.319 INFO:tasks.workunit.client.1.smithi119.stdout:1/54: chown d3/d5/c9 8 1 2023-12-17T11:57:34.320 INFO:tasks.workunit.client.1.smithi119.stdout:1/55: fsync d3/f4 0 2023-12-17T11:57:34.320 INFO:tasks.workunit.client.1.smithi119.stdout:1/56: creat d3/d5/f11 x:0 0 0 2023-12-17T11:57:34.320 INFO:tasks.workunit.client.0.smithi002.stdout:3/177: truncate d9/f13 1039608 0 2023-12-17T11:57:34.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/130: dwrite dc/d1d/d23/f29 [0,4194304] 0 2023-12-17T11:57:34.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/131: dread - dc/f22 zero size 2023-12-17T11:57:34.327 INFO:tasks.workunit.client.1.smithi119.stdout:8/82: dread d7/da/d11/f13 [0,4194304] 0 2023-12-17T11:57:34.330 INFO:tasks.workunit.client.1.smithi119.stdout:4/70: dwrite f1 [0,4194304] 0 2023-12-17T11:57:34.332 INFO:tasks.workunit.client.0.smithi002.stdout:1/137: dwrite d3/f17 [0,4194304] 0 2023-12-17T11:57:34.333 INFO:tasks.workunit.client.1.smithi119.stdout:0/61: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:34.334 INFO:tasks.workunit.client.0.smithi002.stdout:7/117: dwrite d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:34.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/122: link d0/c9 d0/c2e 0 2023-12-17T11:57:34.337 INFO:tasks.workunit.client.0.smithi002.stdout:2/131: mkdir d3/d4/d7/d14/d1b/d31/d32 0 2023-12-17T11:57:34.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/123: fdatasync d0/fb 0 2023-12-17T11:57:34.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/124: truncate d0/d10/f2a 440248 0 2023-12-17T11:57:34.337 INFO:tasks.workunit.client.1.smithi119.stdout:7/176: truncate d2/f19 3425291 0 2023-12-17T11:57:34.343 INFO:tasks.workunit.client.1.smithi119.stdout:9/158: truncate ff 609636 0 2023-12-17T11:57:34.343 INFO:tasks.workunit.client.1.smithi119.stdout:3/101: dwrite f5 [0,4194304] 0 2023-12-17T11:57:34.344 INFO:tasks.workunit.client.0.smithi002.stdout:4/125: rename d0/d10/f2a to d0/d10/d21/f2f 0 2023-12-17T11:57:34.345 INFO:tasks.workunit.client.0.smithi002.stdout:4/126: creat d0/d10/f30 x:0 0 0 2023-12-17T11:57:34.347 INFO:tasks.workunit.client.0.smithi002.stdout:4/127: creat d0/d10/f31 x:0 0 0 2023-12-17T11:57:34.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/178: dread d9/f1d [0,4194304] 0 2023-12-17T11:57:34.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/179: fdatasync d9/f13 0 2023-12-17T11:57:34.355 INFO:tasks.workunit.client.0.smithi002.stdout:3/180: stat d9/d1b/f30 0 2023-12-17T11:57:34.356 INFO:tasks.workunit.client.1.smithi119.stdout:4/71: creat dd/f18 x:0 0 0 2023-12-17T11:57:34.357 INFO:tasks.workunit.client.0.smithi002.stdout:2/132: link d3/d4/c21 d3/d4/d7/d14/d1b/c33 0 2023-12-17T11:57:34.357 INFO:tasks.workunit.client.0.smithi002.stdout:2/133: write d3/d4/f5 [1231165,121209] 0 2023-12-17T11:57:34.359 INFO:tasks.workunit.client.0.smithi002.stdout:9/132: dread dc/d1d/d23/f29 [0,4194304] 0 2023-12-17T11:57:34.359 INFO:tasks.workunit.client.0.smithi002.stdout:9/133: write dc/f12 [9132,59030] 0 2023-12-17T11:57:34.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/138: dread d3/d6/d9/f13 [0,4194304] 0 2023-12-17T11:57:34.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/139: chown d3/d6/d9/d12/f23 1044305 1 2023-12-17T11:57:34.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/140: chown d3/d6/d9/l27 4918 1 2023-12-17T11:57:34.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/141: creat d3/d6/d9/f29 x:0 0 0 2023-12-17T11:57:34.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/142: fsync d3/d6/d9/f13 0 2023-12-17T11:57:34.372 INFO:tasks.workunit.client.1.smithi119.stdout:0/62: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.1.smithi119.stdout:7/177: creat d2/d4/f38 x:0 0 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.1.smithi119.stdout:7/178: rename d2/d4 to d2/d4/d1f/d2a/d39 22 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.1.smithi119.stdout:7/179: chown d2/d4/c1b 260708747 1 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:3/181: creat d9/d1b/f39 x:0 0 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/134: mkdir d3/d4/d7/d14/d34 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/135: fdatasync d3/d4/f6 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/136: write d3/d4/f16 [1574047,66089] 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:2/137: fsync d3/d4/f6 0 2023-12-17T11:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/134: truncate dc/d1d/d23/f2b 306945 0 2023-12-17T11:57:34.374 INFO:tasks.workunit.client.0.smithi002.stdout:9/135: truncate fb 1138057 0 2023-12-17T11:57:34.374 INFO:tasks.workunit.client.0.smithi002.stdout:9/136: readlink dc/le 0 2023-12-17T11:57:34.374 INFO:tasks.workunit.client.1.smithi119.stdout:1/57: dread d3/f4 [0,4194304] 0 2023-12-17T11:57:34.377 INFO:tasks.workunit.client.0.smithi002.stdout:1/143: mknod d3/d6/d16/c2a 0 2023-12-17T11:57:34.377 INFO:tasks.workunit.client.0.smithi002.stdout:1/144: chown d3/d6/d16/l22 120839973 1 2023-12-17T11:57:34.380 INFO:tasks.workunit.client.1.smithi119.stdout:1/58: fsync d3/d5/f6 0 2023-12-17T11:57:34.380 INFO:tasks.workunit.client.1.smithi119.stdout:1/59: write d3/d7/f8 [3421890,100538] 0 2023-12-17T11:57:34.380 INFO:tasks.workunit.client.0.smithi002.stdout:3/182: mknod d9/d15/d31/c3a 0 2023-12-17T11:57:34.381 INFO:tasks.workunit.client.0.smithi002.stdout:3/183: write d9/d15/f16 [944986,110080] 0 2023-12-17T11:57:34.383 INFO:tasks.workunit.client.0.smithi002.stdout:9/137: link dc/f1e dc/d1d/d23/d24/f33 0 2023-12-17T11:57:34.387 INFO:tasks.workunit.client.0.smithi002.stdout:6/96: sync 2023-12-17T11:57:34.387 INFO:tasks.workunit.client.0.smithi002.stdout:6/97: write d0/f15 [697969,47991] 0 2023-12-17T11:57:34.389 INFO:tasks.workunit.client.0.smithi002.stdout:6/98: unlink d0/f15 0 2023-12-17T11:57:34.389 INFO:tasks.workunit.client.0.smithi002.stdout:6/99: fdatasync d0/d1/dc/f16 0 2023-12-17T11:57:34.394 INFO:tasks.workunit.client.0.smithi002.stdout:3/184: dread d9/d1b/f30 [0,4194304] 0 2023-12-17T11:57:34.394 INFO:tasks.workunit.client.0.smithi002.stdout:3/185: readlink l2 0 2023-12-17T11:57:34.395 INFO:tasks.workunit.client.1.smithi119.stdout:0/63: write f1 [5209850,27003] 0 2023-12-17T11:57:34.395 INFO:tasks.workunit.client.1.smithi119.stdout:0/64: chown d2/l8 692 1 2023-12-17T11:57:34.397 INFO:tasks.workunit.client.1.smithi119.stdout:3/102: dread f4 [0,4194304] 0 2023-12-17T11:57:34.397 INFO:tasks.workunit.client.1.smithi119.stdout:6/110: dwrite d2/f9 [4194304,4194304] 0 2023-12-17T11:57:34.399 INFO:tasks.workunit.client.0.smithi002.stdout:3/186: rename d9/d1b/f39 to d9/d1b/d35/f3b 0 2023-12-17T11:57:34.401 INFO:tasks.workunit.client.1.smithi119.stdout:1/60: dread d3/f4 [0,4194304] 0 2023-12-17T11:57:34.401 INFO:tasks.workunit.client.1.smithi119.stdout:5/139: dwrite d1/f1e [0,4194304] 0 2023-12-17T11:57:34.402 INFO:tasks.workunit.client.1.smithi119.stdout:3/103: unlink d9/da/ce 0 2023-12-17T11:57:34.402 INFO:tasks.workunit.client.1.smithi119.stdout:3/104: readlink d9/da/l13 0 2023-12-17T11:57:34.407 INFO:tasks.workunit.client.1.smithi119.stdout:5/140: symlink d1/d25/l27 0 2023-12-17T11:57:34.407 INFO:tasks.workunit.client.1.smithi119.stdout:5/141: chown d1/fc 168 1 2023-12-17T11:57:34.407 INFO:tasks.workunit.client.1.smithi119.stdout:5/142: chown d1/l1c 377240355 1 2023-12-17T11:57:34.407 INFO:tasks.workunit.client.1.smithi119.stdout:5/143: creat d1/f28 x:0 0 0 2023-12-17T11:57:34.409 INFO:tasks.workunit.client.1.smithi119.stdout:5/144: truncate d1/fd 2727907 0 2023-12-17T11:57:34.410 INFO:tasks.workunit.client.0.smithi002.stdout:1/145: read d3/d6/fe [3568025,23823] 0 2023-12-17T11:57:34.410 INFO:tasks.workunit.client.0.smithi002.stdout:6/100: read d0/d1/f13 [355334,115167] 0 2023-12-17T11:57:34.411 INFO:tasks.workunit.client.0.smithi002.stdout:3/187: dread d9/f1e [0,4194304] 0 2023-12-17T11:57:34.411 INFO:tasks.workunit.client.0.smithi002.stdout:1/146: creat d3/d6/f2b x:0 0 0 2023-12-17T11:57:34.414 INFO:tasks.workunit.client.0.smithi002.stdout:3/188: link d9/d24/c33 d9/d15/c3c 0 2023-12-17T11:57:34.416 INFO:tasks.workunit.client.0.smithi002.stdout:1/147: rename f1 to d3/d6/d9/d12/f2c 0 2023-12-17T11:57:34.417 INFO:tasks.workunit.client.1.smithi119.stdout:7/180: dread d2/d4/ff [0,4194304] 0 2023-12-17T11:57:34.417 INFO:tasks.workunit.client.1.smithi119.stdout:2/119: dwrite d6/d9/fb [0,4194304] 0 2023-12-17T11:57:34.417 INFO:tasks.workunit.client.0.smithi002.stdout:7/118: dwrite d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:34.417 INFO:tasks.workunit.client.0.smithi002.stdout:7/119: readlink d6/d17/d16/l1b 0 2023-12-17T11:57:34.418 INFO:tasks.workunit.client.1.smithi119.stdout:8/83: dwrite f3 [4194304,4194304] 0 2023-12-17T11:57:34.418 INFO:tasks.workunit.client.0.smithi002.stdout:3/189: mknod d9/d15/c3d 0 2023-12-17T11:57:34.421 INFO:tasks.workunit.client.0.smithi002.stdout:4/128: getdents d0 0 2023-12-17T11:57:34.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/129: write d0/d10/f30 [113729,116926] 0 2023-12-17T11:57:34.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/130: chown d0/d10/c16 342 1 2023-12-17T11:57:34.423 INFO:tasks.workunit.client.1.smithi119.stdout:7/181: rename d2/f1d to d2/d4/d11/d2c/f3a 0 2023-12-17T11:57:34.423 INFO:tasks.workunit.client.1.smithi119.stdout:4/72: dwrite f1 [4194304,4194304] 0 2023-12-17T11:57:34.423 INFO:tasks.workunit.client.1.smithi119.stdout:2/120: link d6/l12 d6/d9/d13/d1d/l28 0 2023-12-17T11:57:34.423 INFO:tasks.workunit.client.1.smithi119.stdout:2/121: chown d6/d9/fb 450291677 1 2023-12-17T11:57:34.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/148: mkdir d3/d6/d2d 0 2023-12-17T11:57:34.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/149: chown d3/d6/d9/f13 2 1 2023-12-17T11:57:34.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/150: creat d3/d6/d9/f2e x:0 0 0 2023-12-17T11:57:34.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/151: dread - d3/d6/d9/f29 zero size 2023-12-17T11:57:34.425 INFO:tasks.workunit.client.0.smithi002.stdout:7/120: link d6/d17/cf d6/d17/c26 0 2023-12-17T11:57:34.428 INFO:tasks.workunit.client.0.smithi002.stdout:4/131: rename d0/d10/d14/c1b to d0/d10/c32 0 2023-12-17T11:57:34.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/70: dwrite d0/ff [0,4194304] 0 2023-12-17T11:57:34.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/71: readlink d0/l10 0 2023-12-17T11:57:34.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/72: dread - d0/d6/f11 zero size 2023-12-17T11:57:34.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/73: chown d0/ff 489535079 1 2023-12-17T11:57:34.431 INFO:tasks.workunit.client.0.smithi002.stdout:1/152: mkdir d3/d2f 0 2023-12-17T11:57:34.431 INFO:tasks.workunit.client.0.smithi002.stdout:1/153: truncate d3/d6/d9/f29 718455 0 2023-12-17T11:57:34.439 INFO:tasks.workunit.client.0.smithi002.stdout:7/121: mkdir d6/d17/d16/d1d/d27 0 2023-12-17T11:57:34.445 INFO:tasks.workunit.client.0.smithi002.stdout:4/132: write d0/fb [1647928,49999] 0 2023-12-17T11:57:34.448 INFO:tasks.workunit.client.0.smithi002.stdout:7/122: unlink l1 0 2023-12-17T11:57:34.449 INFO:tasks.workunit.client.1.smithi119.stdout:8/84: dread f3 [0,4194304] 0 2023-12-17T11:57:34.450 INFO:tasks.workunit.client.1.smithi119.stdout:8/85: creat d7/d18/d15/f1b x:0 0 0 2023-12-17T11:57:34.452 INFO:tasks.workunit.client.0.smithi002.stdout:9/138: getdents dc/d1d/d23/d24 0 2023-12-17T11:57:34.453 INFO:tasks.workunit.client.0.smithi002.stdout:9/139: chown f4 23 1 2023-12-17T11:57:34.453 INFO:tasks.workunit.client.0.smithi002.stdout:9/140: chown dc/d1d/d23/d24 13 1 2023-12-17T11:57:34.459 INFO:tasks.workunit.client.0.smithi002.stdout:3/190: dread d9/d15/f16 [0,4194304] 0 2023-12-17T11:57:34.459 INFO:tasks.workunit.client.0.smithi002.stdout:9/141: read fb [326793,50381] 0 2023-12-17T11:57:34.462 INFO:tasks.workunit.client.0.smithi002.stdout:4/133: mkdir d0/d10/d21/d33 0 2023-12-17T11:57:34.462 INFO:tasks.workunit.client.0.smithi002.stdout:7/123: stat d6/d17/d16/c1f 0 2023-12-17T11:57:34.464 INFO:tasks.workunit.client.0.smithi002.stdout:3/191: creat d9/d24/f3e x:0 0 0 2023-12-17T11:57:34.466 INFO:tasks.workunit.client.0.smithi002.stdout:9/142: truncate dc/f16 1278836 0 2023-12-17T11:57:34.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/134: symlink d0/d10/l34 0 2023-12-17T11:57:34.469 INFO:tasks.workunit.client.0.smithi002.stdout:9/143: creat dc/d32/f34 x:0 0 0 2023-12-17T11:57:34.471 INFO:tasks.workunit.client.1.smithi119.stdout:3/105: dwrite f6 [4194304,4194304] 0 2023-12-17T11:57:34.472 INFO:tasks.workunit.client.0.smithi002.stdout:9/144: rename f9 to dc/d32/f35 0 2023-12-17T11:57:34.473 INFO:tasks.workunit.client.0.smithi002.stdout:9/145: creat dc/d1d/d23/f36 x:0 0 0 2023-12-17T11:57:34.473 INFO:tasks.workunit.client.1.smithi119.stdout:3/106: getdents d9/d1c 0 2023-12-17T11:57:34.474 INFO:tasks.workunit.client.0.smithi002.stdout:9/146: truncate dc/f14 4092654 0 2023-12-17T11:57:34.475 INFO:tasks.workunit.client.1.smithi119.stdout:3/107: mknod d9/da/df/c26 0 2023-12-17T11:57:34.475 INFO:tasks.workunit.client.1.smithi119.stdout:3/108: truncate f7 173991 0 2023-12-17T11:57:34.475 INFO:tasks.workunit.client.1.smithi119.stdout:3/109: truncate d9/d11/d1e/f1f 43385 0 2023-12-17T11:57:34.476 INFO:tasks.workunit.client.0.smithi002.stdout:9/147: symlink dc/d1d/d25/l37 0 2023-12-17T11:57:34.476 INFO:tasks.workunit.client.0.smithi002.stdout:9/148: truncate dc/f1e 744417 0 2023-12-17T11:57:34.483 INFO:tasks.workunit.client.1.smithi119.stdout:0/65: dread f1 [0,4194304] 0 2023-12-17T11:57:34.484 INFO:tasks.workunit.client.1.smithi119.stdout:0/66: write f1 [5126458,18474] 0 2023-12-17T11:57:34.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/154: rename d3/d6/d9/d12 to d3/d6/d9/d30 0 2023-12-17T11:57:34.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/155: stat d3/d6/d9/d30/f2c 0 2023-12-17T11:57:34.486 INFO:tasks.workunit.client.0.smithi002.stdout:1/156: write d3/d6/f2b [413016,85539] 0 2023-12-17T11:57:34.487 INFO:tasks.workunit.client.1.smithi119.stdout:0/67: creat d2/d3/d10/f11 x:0 0 0 2023-12-17T11:57:34.487 INFO:tasks.workunit.client.1.smithi119.stdout:0/68: fsync d2/f4 0 2023-12-17T11:57:34.489 INFO:tasks.workunit.client.1.smithi119.stdout:0/69: mkdir d2/d3/d10/d12 0 2023-12-17T11:57:34.489 INFO:tasks.workunit.client.1.smithi119.stdout:0/70: write d2/f4 [373691,93286] 0 2023-12-17T11:57:34.489 INFO:tasks.workunit.client.1.smithi119.stdout:0/71: fdatasync d2/d3/d10/f11 0 2023-12-17T11:57:34.489 INFO:tasks.workunit.client.1.smithi119.stdout:0/72: chown f1 3626349 1 2023-12-17T11:57:34.490 INFO:tasks.workunit.client.0.smithi002.stdout:6/101: dwrite d0/f1a [0,4194304] 0 2023-12-17T11:57:34.490 INFO:tasks.workunit.client.0.smithi002.stdout:6/102: readlink d0/d1/l12 0 2023-12-17T11:57:34.490 INFO:tasks.workunit.client.1.smithi119.stdout:0/73: symlink d2/l13 0 2023-12-17T11:57:34.494 INFO:tasks.workunit.client.1.smithi119.stdout:1/61: dwrite d3/db/fc [0,4194304] 0 2023-12-17T11:57:34.495 INFO:tasks.workunit.client.1.smithi119.stdout:7/182: dwrite d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:34.495 INFO:tasks.workunit.client.1.smithi119.stdout:7/183: chown d2/c1c 5638 1 2023-12-17T11:57:34.497 INFO:tasks.workunit.client.1.smithi119.stdout:5/145: dwrite d1/f12 [0,4194304] 0 2023-12-17T11:57:34.497 INFO:tasks.workunit.client.1.smithi119.stdout:5/146: creat d1/f29 x:0 0 0 2023-12-17T11:57:34.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/103: creat d0/d1/dc/d17/f1e x:0 0 0 2023-12-17T11:57:34.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/104: creat d0/d1/dc/d17/f1f x:0 0 0 2023-12-17T11:57:34.499 INFO:tasks.workunit.client.1.smithi119.stdout:1/62: creat d3/f12 x:0 0 0 2023-12-17T11:57:34.500 INFO:tasks.workunit.client.0.smithi002.stdout:4/135: fsync d0/d10/f30 0 2023-12-17T11:57:34.500 INFO:tasks.workunit.client.0.smithi002.stdout:3/192: write d9/d1b/f28 [3374433,61947] 0 2023-12-17T11:57:34.501 INFO:tasks.workunit.client.1.smithi119.stdout:5/147: symlink d1/l2a 0 2023-12-17T11:57:34.501 INFO:tasks.workunit.client.1.smithi119.stdout:5/148: dread - d1/f21 zero size 2023-12-17T11:57:34.501 INFO:tasks.workunit.client.1.smithi119.stdout:5/149: fsync d1/fe 0 2023-12-17T11:57:34.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/74: truncate d0/ff 1138086 0 2023-12-17T11:57:34.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/75: chown d0/c5 1336087 1 2023-12-17T11:57:34.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/76: fdatasync d0/ff 0 2023-12-17T11:57:34.503 INFO:tasks.workunit.client.0.smithi002.stdout:0/77: fdatasync d0/ff 0 2023-12-17T11:57:34.503 INFO:tasks.workunit.client.1.smithi119.stdout:1/63: mknod d3/db/c13 0 2023-12-17T11:57:34.503 INFO:tasks.workunit.client.1.smithi119.stdout:1/64: creat d3/d7/f14 x:0 0 0 2023-12-17T11:57:34.503 INFO:tasks.workunit.client.1.smithi119.stdout:1/65: truncate d3/d7/f14 413724 0 2023-12-17T11:57:34.504 INFO:tasks.workunit.client.1.smithi119.stdout:1/66: chown d3/fa 628717 1 2023-12-17T11:57:34.504 INFO:tasks.workunit.client.1.smithi119.stdout:1/67: fsync d3/f4 0 2023-12-17T11:57:34.504 INFO:tasks.workunit.client.1.smithi119.stdout:2/122: dwrite d6/f21 [0,4194304] 0 2023-12-17T11:57:34.504 INFO:tasks.workunit.client.1.smithi119.stdout:3/110: read d9/da/df/f15 [11919143,55733] 0 2023-12-17T11:57:34.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/105: rename d0/f3 to d0/d1/dc/f20 0 2023-12-17T11:57:34.509 INFO:tasks.workunit.client.1.smithi119.stdout:5/150: mknod d1/d25/c2b 0 2023-12-17T11:57:34.509 INFO:tasks.workunit.client.1.smithi119.stdout:5/151: readlink d1/d25/l27 0 2023-12-17T11:57:34.509 INFO:tasks.workunit.client.1.smithi119.stdout:2/123: link d6/d9/d13/c25 d6/d9/c29 0 2023-12-17T11:57:34.511 INFO:tasks.workunit.client.1.smithi119.stdout:2/124: rmdir d6/d9/d13 39 2023-12-17T11:57:34.511 INFO:tasks.workunit.client.1.smithi119.stdout:5/152: creat d1/d25/f2c x:0 0 0 2023-12-17T11:57:34.512 INFO:tasks.workunit.client.1.smithi119.stdout:4/73: dwrite f2 [0,4194304] 0 2023-12-17T11:57:34.518 INFO:tasks.workunit.client.0.smithi002.stdout:9/149: dread dc/f13 [0,4194304] 0 2023-12-17T11:57:34.519 INFO:tasks.workunit.client.1.smithi119.stdout:7/184: read d2/d4/d11/f2d [3955650,92479] 0 2023-12-17T11:57:34.519 INFO:tasks.workunit.client.1.smithi119.stdout:7/185: stat d2/d4/d1f/d2a 0 2023-12-17T11:57:34.522 INFO:tasks.workunit.client.0.smithi002.stdout:4/136: rename d0/f1a to d0/d10/d21/d33/f35 0 2023-12-17T11:57:34.525 INFO:tasks.workunit.client.0.smithi002.stdout:7/124: dwrite d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:34.526 INFO:tasks.workunit.client.0.smithi002.stdout:1/157: getdents d3/d6/d9 0 2023-12-17T11:57:34.527 INFO:tasks.workunit.client.0.smithi002.stdout:1/158: readlink d3/d6/l1f 0 2023-12-17T11:57:34.531 INFO:tasks.workunit.client.1.smithi119.stdout:3/111: read f4 [587193,125912] 0 2023-12-17T11:57:34.531 INFO:tasks.workunit.client.1.smithi119.stdout:3/112: stat d9/fc 0 2023-12-17T11:57:34.531 INFO:tasks.workunit.client.1.smithi119.stdout:3/113: read - f3 zero size 2023-12-17T11:57:34.537 INFO:tasks.workunit.client.0.smithi002.stdout:3/193: rename d9/l10 to d9/d15/d31/l3f 0 2023-12-17T11:57:34.537 INFO:tasks.workunit.client.0.smithi002.stdout:1/159: rmdir d3/d6/d2d 0 2023-12-17T11:57:34.537 INFO:tasks.workunit.client.0.smithi002.stdout:7/125: mknod d6/d17/d16/d1d/d24/c28 0 2023-12-17T11:57:34.539 INFO:tasks.workunit.client.1.smithi119.stdout:1/68: dread f2 [8388608,4194304] 0 2023-12-17T11:57:34.540 INFO:tasks.workunit.client.1.smithi119.stdout:2/125: write f5 [2264841,65724] 0 2023-12-17T11:57:34.540 INFO:tasks.workunit.client.1.smithi119.stdout:1/69: stat d3 0 2023-12-17T11:57:34.542 INFO:tasks.workunit.client.1.smithi119.stdout:2/126: creat d6/d9/f2a x:0 0 0 2023-12-17T11:57:34.543 INFO:tasks.workunit.client.0.smithi002.stdout:0/78: rename d0/c7 to d0/d15/c18 0 2023-12-17T11:57:34.543 INFO:tasks.workunit.client.0.smithi002.stdout:6/106: rmdir d0 39 2023-12-17T11:57:34.545 INFO:tasks.workunit.client.1.smithi119.stdout:4/74: write f8 [2453914,124211] 0 2023-12-17T11:57:34.545 INFO:tasks.workunit.client.1.smithi119.stdout:1/70: unlink f2 0 2023-12-17T11:57:34.547 INFO:tasks.workunit.client.1.smithi119.stdout:7/186: dread d2/f24 [0,4194304] 0 2023-12-17T11:57:34.548 INFO:tasks.workunit.client.0.smithi002.stdout:3/194: mkdir d9/d40 0 2023-12-17T11:57:34.548 INFO:tasks.workunit.client.0.smithi002.stdout:3/195: fsync d9/d1b/f30 0 2023-12-17T11:57:34.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/160: unlink d3/d6/l1f 0 2023-12-17T11:57:34.548 INFO:tasks.workunit.client.0.smithi002.stdout:7/126: mknod d6/d17/d16/c29 0 2023-12-17T11:57:34.549 INFO:tasks.workunit.client.1.smithi119.stdout:2/127: mkdir d6/d2b 0 2023-12-17T11:57:34.549 INFO:tasks.workunit.client.1.smithi119.stdout:2/128: dread - d6/d9/f20 zero size 2023-12-17T11:57:34.550 INFO:tasks.workunit.client.1.smithi119.stdout:1/71: mknod d3/d5/c15 0 2023-12-17T11:57:34.551 INFO:tasks.workunit.client.1.smithi119.stdout:1/72: fsync d3/d7/f8 0 2023-12-17T11:57:34.551 INFO:tasks.workunit.client.0.smithi002.stdout:0/79: mkdir d0/d6/d8/d14/d19 0 2023-12-17T11:57:34.551 INFO:tasks.workunit.client.0.smithi002.stdout:0/80: fsync d0/fd 0 2023-12-17T11:57:34.551 INFO:tasks.workunit.client.0.smithi002.stdout:3/196: mkdir d9/d1b/d35/d41 0 2023-12-17T11:57:34.552 INFO:tasks.workunit.client.0.smithi002.stdout:3/197: chown d9/d15/f2b 6 1 2023-12-17T11:57:34.552 INFO:tasks.workunit.client.0.smithi002.stdout:5/84: sync 2023-12-17T11:57:34.552 INFO:tasks.workunit.client.0.smithi002.stdout:7/127: mknod d6/c2a 0 2023-12-17T11:57:34.555 INFO:tasks.workunit.client.0.smithi002.stdout:6/107: mkdir d0/d1/d21 0 2023-12-17T11:57:34.555 INFO:tasks.workunit.client.0.smithi002.stdout:6/108: fdatasync d0/d1/dc/d17/f1e 0 2023-12-17T11:57:34.558 INFO:tasks.workunit.client.1.smithi119.stdout:3/114: dread f5 [0,4194304] 0 2023-12-17T11:57:34.558 INFO:tasks.workunit.client.1.smithi119.stdout:3/115: creat d9/da/df/f27 x:0 0 0 2023-12-17T11:57:34.558 INFO:tasks.workunit.client.1.smithi119.stdout:3/116: dread - d9/da/f18 zero size 2023-12-17T11:57:34.558 INFO:tasks.workunit.client.1.smithi119.stdout:3/117: creat d9/da/f28 x:0 0 0 2023-12-17T11:57:34.559 INFO:tasks.workunit.client.0.smithi002.stdout:0/81: mknod d0/d6/d8/d14/c1a 0 2023-12-17T11:57:34.559 INFO:tasks.workunit.client.0.smithi002.stdout:3/198: rename d9/d1b/f30 to d9/d1b/d35/d41/f42 0 2023-12-17T11:57:34.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/85: symlink dc/l14 0 2023-12-17T11:57:34.561 INFO:tasks.workunit.client.0.smithi002.stdout:7/128: symlink d6/d17/d16/d1d/d27/l2b 0 2023-12-17T11:57:34.565 INFO:tasks.workunit.client.0.smithi002.stdout:0/82: mknod d0/d6/c1b 0 2023-12-17T11:57:34.565 INFO:tasks.workunit.client.0.smithi002.stdout:0/83: truncate d0/d6/f11 740744 0 2023-12-17T11:57:34.566 INFO:tasks.workunit.client.0.smithi002.stdout:7/129: mknod d6/d17/d16/c2c 0 2023-12-17T11:57:34.568 INFO:tasks.workunit.client.1.smithi119.stdout:4/75: fdatasync f8 0 2023-12-17T11:57:34.568 INFO:tasks.workunit.client.1.smithi119.stdout:4/76: truncate dd/d11/f14 434510 0 2023-12-17T11:57:34.568 INFO:tasks.workunit.client.1.smithi119.stdout:2/129: rmdir d6/d9 39 2023-12-17T11:57:34.569 INFO:tasks.workunit.client.0.smithi002.stdout:3/199: dread d9/d15/f19 [0,4194304] 0 2023-12-17T11:57:34.569 INFO:tasks.workunit.client.1.smithi119.stdout:5/153: dwrite d1/fd [0,4194304] 0 2023-12-17T11:57:34.574 INFO:tasks.workunit.client.0.smithi002.stdout:0/84: dread d0/d6/fe [0,4194304] 0 2023-12-17T11:57:34.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/130: truncate d6/f1c 1964348 0 2023-12-17T11:57:34.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/131: truncate d6/d17/dc/d13/f14 2851408 0 2023-12-17T11:57:34.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/132: write d6/f1c [2680912,91408] 0 2023-12-17T11:57:34.576 INFO:tasks.workunit.client.0.smithi002.stdout:5/86: read fa [3834190,64379] 0 2023-12-17T11:57:34.578 INFO:tasks.workunit.client.1.smithi119.stdout:0/74: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:57:34.578 INFO:tasks.workunit.client.1.smithi119.stdout:3/118: symlink d9/da/df/l29 0 2023-12-17T11:57:34.578 INFO:tasks.workunit.client.1.smithi119.stdout:3/119: chown d9/d11/c1d 5 1 2023-12-17T11:57:34.578 INFO:tasks.workunit.client.1.smithi119.stdout:3/120: getdents d9/d1c 0 2023-12-17T11:57:34.578 INFO:tasks.workunit.client.1.smithi119.stdout:3/121: chown d9/da/l23 7505 1 2023-12-17T11:57:34.578 INFO:tasks.workunit.client.1.smithi119.stdout:4/77: rename c5 to dd/d15/c19 0 2023-12-17T11:57:34.581 INFO:tasks.workunit.client.0.smithi002.stdout:7/133: creat d6/d17/dc/d13/f2d x:0 0 0 2023-12-17T11:57:34.582 INFO:tasks.workunit.client.0.smithi002.stdout:7/134: mkdir d6/d17/dc/d13/d21/d2e 0 2023-12-17T11:57:34.582 INFO:tasks.workunit.client.1.smithi119.stdout:2/130: mkdir d6/d9/d13/d1d/d2c 0 2023-12-17T11:57:34.582 INFO:tasks.workunit.client.1.smithi119.stdout:4/78: write dd/f18 [127679,11219] 0 2023-12-17T11:57:34.582 INFO:tasks.workunit.client.1.smithi119.stdout:5/154: link d1/d25/l27 d1/l2d 0 2023-12-17T11:57:34.582 INFO:tasks.workunit.client.1.smithi119.stdout:5/155: write d1/f1a [815184,55230] 0 2023-12-17T11:57:34.584 INFO:tasks.workunit.client.1.smithi119.stdout:0/75: creat d2/d3/f14 x:0 0 0 2023-12-17T11:57:34.585 INFO:tasks.workunit.client.1.smithi119.stdout:0/76: truncate d2/d3/f14 857302 0 2023-12-17T11:57:34.587 INFO:tasks.workunit.client.1.smithi119.stdout:0/77: symlink d2/d3/d5/dc/l15 0 2023-12-17T11:57:34.594 INFO:tasks.workunit.client.1.smithi119.stdout:3/122: getdents d9/da/df 0 2023-12-17T11:57:34.603 INFO:tasks.workunit.client.1.smithi119.stdout:3/123: getdents d9/da 0 2023-12-17T11:57:34.606 INFO:tasks.workunit.client.1.smithi119.stdout:3/124: mkdir d9/d1c/d2a 0 2023-12-17T11:57:34.610 INFO:tasks.workunit.client.1.smithi119.stdout:0/78: getdents d2/d3 0 2023-12-17T11:57:34.610 INFO:tasks.workunit.client.1.smithi119.stdout:6/111: sync 2023-12-17T11:57:34.610 INFO:tasks.workunit.client.1.smithi119.stdout:8/86: sync 2023-12-17T11:57:34.610 INFO:tasks.workunit.client.1.smithi119.stdout:9/159: sync 2023-12-17T11:57:34.611 INFO:tasks.workunit.client.0.smithi002.stdout:3/200: write f7 [3476354,81074] 0 2023-12-17T11:57:34.614 INFO:tasks.workunit.client.0.smithi002.stdout:3/201: mkdir d9/d1b/d35/d41/d43 0 2023-12-17T11:57:34.616 INFO:tasks.workunit.client.1.smithi119.stdout:0/79: getdents d2 0 2023-12-17T11:57:34.616 INFO:tasks.workunit.client.1.smithi119.stdout:8/87: rename f3 to d7/da/d1a/f1c 0 2023-12-17T11:57:34.618 INFO:tasks.workunit.client.1.smithi119.stdout:9/160: link d12/d1d/d28/l2a d12/d1d/l34 0 2023-12-17T11:57:34.634 INFO:tasks.workunit.client.1.smithi119.stdout:3/125: dread f6 [8388608,4194304] 0 2023-12-17T11:57:34.637 INFO:tasks.workunit.client.1.smithi119.stdout:0/80: dread d2/fe [0,4194304] 0 2023-12-17T11:57:34.637 INFO:tasks.workunit.client.1.smithi119.stdout:0/81: chown d2/d3/d10 482 1 2023-12-17T11:57:34.637 INFO:tasks.workunit.client.1.smithi119.stdout:3/126: rmdir d9 39 2023-12-17T11:57:34.638 INFO:tasks.workunit.client.1.smithi119.stdout:6/112: write d2/f11 [1692476,90281] 0 2023-12-17T11:57:34.638 INFO:tasks.workunit.client.1.smithi119.stdout:6/113: chown d2/le 14 1 2023-12-17T11:57:34.641 INFO:tasks.workunit.client.1.smithi119.stdout:6/114: truncate d2/f7 3673247 0 2023-12-17T11:57:34.641 INFO:tasks.workunit.client.1.smithi119.stdout:6/115: stat d2/f11 0 2023-12-17T11:57:34.643 INFO:tasks.workunit.client.1.smithi119.stdout:6/116: creat d2/df/f24 x:0 0 0 2023-12-17T11:57:34.643 INFO:tasks.workunit.client.1.smithi119.stdout:6/117: chown d2/f4 207756763 1 2023-12-17T11:57:34.643 INFO:tasks.workunit.client.1.smithi119.stdout:6/118: read d2/f11 [2996809,8076] 0 2023-12-17T11:57:34.643 INFO:tasks.workunit.client.1.smithi119.stdout:6/119: read d2/f11 [849283,63287] 0 2023-12-17T11:57:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:34 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:34 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:34 smithi119 ceph-mon[117414]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2023-12-17T11:57:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:34 smithi119 ceph-mon[117414]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2023-12-17T11:57:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:34 smithi119 ceph-mon[117414]: pgmap v20: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 741 op/s 2023-12-17T11:57:34.665 INFO:tasks.workunit.client.0.smithi002.stdout:0/85: dwrite d0/d6/f11 [0,4194304] 0 2023-12-17T11:57:34.667 INFO:tasks.workunit.client.0.smithi002.stdout:0/86: mknod d0/d6/d8/d14/d19/c1c 0 2023-12-17T11:57:34.668 INFO:tasks.workunit.client.0.smithi002.stdout:0/87: write d0/d6/fb [689179,73686] 0 2023-12-17T11:57:34.670 INFO:tasks.workunit.client.1.smithi119.stdout:0/82: write d2/f4 [2043457,119326] 0 2023-12-17T11:57:34.670 INFO:tasks.workunit.client.1.smithi119.stdout:6/120: dread d2/f5 [0,4194304] 0 2023-12-17T11:57:34.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/88: rename d0/d6/d8/d14/c1a to d0/d6/c1d 0 2023-12-17T11:57:34.675 INFO:tasks.workunit.client.1.smithi119.stdout:0/83: rename d2/d3/d10 to d2/d16 0 2023-12-17T11:57:34.676 INFO:tasks.workunit.client.0.smithi002.stdout:3/202: dwrite d9/f29 [0,4194304] 0 2023-12-17T11:57:34.676 INFO:tasks.workunit.client.0.smithi002.stdout:3/203: chown d9/d1b/d35/d41/d43 1111 1 2023-12-17T11:57:34.677 INFO:tasks.workunit.client.1.smithi119.stdout:0/84: creat d2/d16/f17 x:0 0 0 2023-12-17T11:57:34.684 INFO:tasks.workunit.client.1.smithi119.stdout:3/127: dwrite d9/f19 [0,4194304] 0 2023-12-17T11:57:34.687 INFO:tasks.workunit.client.1.smithi119.stdout:3/128: mknod d9/d1c/d2a/c2b 0 2023-12-17T11:57:34.690 INFO:tasks.workunit.client.1.smithi119.stdout:3/129: link d9/d11/c20 d9/d11/c2c 0 2023-12-17T11:57:34.699 INFO:tasks.workunit.client.1.smithi119.stdout:3/130: truncate d9/fc 2937281 0 2023-12-17T11:57:34.699 INFO:tasks.workunit.client.1.smithi119.stdout:3/131: stat d9/d11/c1d 0 2023-12-17T11:57:34.709 INFO:tasks.workunit.client.0.smithi002.stdout:6/109: dwrite d0/d1/dc/f16 [0,4194304] 0 2023-12-17T11:57:34.709 INFO:tasks.workunit.client.0.smithi002.stdout:6/110: chown d0/d1/l12 125 1 2023-12-17T11:57:34.710 INFO:tasks.workunit.client.1.smithi119.stdout:4/79: dwrite f8 [4194304,4194304] 0 2023-12-17T11:57:34.710 INFO:tasks.workunit.client.1.smithi119.stdout:4/80: truncate dd/f18 612107 0 2023-12-17T11:57:34.710 INFO:tasks.workunit.client.1.smithi119.stdout:4/81: chown dd 2575119 1 2023-12-17T11:57:34.712 INFO:tasks.workunit.client.1.smithi119.stdout:1/73: dwrite d3/fa [0,4194304] 0 2023-12-17T11:57:34.715 INFO:tasks.workunit.client.0.smithi002.stdout:9/150: dwrite dc/f21 [0,4194304] 0 2023-12-17T11:57:34.716 INFO:tasks.workunit.client.1.smithi119.stdout:7/187: dread d2/d4/f28 [0,4194304] 0 2023-12-17T11:57:34.716 INFO:tasks.workunit.client.1.smithi119.stdout:7/188: truncate d2/d4/d11/f2d 4772575 0 2023-12-17T11:57:34.718 INFO:tasks.workunit.client.0.smithi002.stdout:9/151: mkdir dc/d38 0 2023-12-17T11:57:34.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/152: read f1 [265916,87219] 0 2023-12-17T11:57:34.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:34 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:34.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:34 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:34.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:34 smithi002 ceph-mon[107131]: Reconfiguring alertmanager.smithi002 (dependencies changed)... 2023-12-17T11:57:34.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:34 smithi002 ceph-mon[107131]: Reconfiguring daemon alertmanager.smithi002 on smithi002 2023-12-17T11:57:34.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:34 smithi002 ceph-mon[107131]: pgmap v20: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 741 op/s 2023-12-17T11:57:34.728 INFO:tasks.workunit.client.1.smithi119.stdout:7/189: unlink d2/d4/d1f/f23 0 2023-12-17T11:57:34.733 INFO:tasks.workunit.client.1.smithi119.stdout:1/74: rmdir d3/d7 39 2023-12-17T11:57:34.733 INFO:tasks.workunit.client.1.smithi119.stdout:1/75: stat d3/f4 0 2023-12-17T11:57:34.733 INFO:tasks.workunit.client.1.smithi119.stdout:7/190: mknod d2/d4/d11/d2c/c3b 0 2023-12-17T11:57:34.733 INFO:tasks.workunit.client.1.smithi119.stdout:7/191: readlink d2/l6 0 2023-12-17T11:57:34.736 INFO:tasks.workunit.client.1.smithi119.stdout:7/192: mkdir d2/d4/d11/d3c 0 2023-12-17T11:57:34.736 INFO:tasks.workunit.client.1.smithi119.stdout:7/193: chown d2/c17 522081415 1 2023-12-17T11:57:34.736 INFO:tasks.workunit.client.1.smithi119.stdout:3/132: dread f5 [0,4194304] 0 2023-12-17T11:57:34.736 INFO:tasks.workunit.client.1.smithi119.stdout:3/133: write d9/da/df/f17 [4757150,126439] 0 2023-12-17T11:57:34.739 INFO:tasks.workunit.client.0.smithi002.stdout:9/153: mknod dc/d38/c39 0 2023-12-17T11:57:34.740 INFO:tasks.workunit.client.1.smithi119.stdout:1/76: mkdir d3/d5/d16 0 2023-12-17T11:57:34.740 INFO:tasks.workunit.client.1.smithi119.stdout:7/194: rmdir d2/d4/d1f/d2a 39 2023-12-17T11:57:34.740 INFO:tasks.workunit.client.1.smithi119.stdout:7/195: fsync d2/d4/d11/f21 0 2023-12-17T11:57:34.742 INFO:tasks.workunit.client.1.smithi119.stdout:3/134: creat d9/da/f2d x:0 0 0 2023-12-17T11:57:34.743 INFO:tasks.workunit.client.0.smithi002.stdout:5/87: dwrite f4 [0,4194304] 0 2023-12-17T11:57:34.745 INFO:tasks.workunit.client.1.smithi119.stdout:8/88: dwrite d7/ff [0,4194304] 0 2023-12-17T11:57:34.745 INFO:tasks.workunit.client.0.smithi002.stdout:7/135: dwrite d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:34.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/77: mkdir d3/db/d17 0 2023-12-17T11:57:34.747 INFO:tasks.workunit.client.1.smithi119.stdout:7/196: creat d2/d4/d11/f3d x:0 0 0 2023-12-17T11:57:34.748 INFO:tasks.workunit.client.1.smithi119.stdout:3/135: mknod d9/da/c2e 0 2023-12-17T11:57:34.750 INFO:tasks.workunit.client.0.smithi002.stdout:5/88: mknod dc/c15 0 2023-12-17T11:57:34.750 INFO:tasks.workunit.client.0.smithi002.stdout:7/136: symlink d6/d17/d16/l2f 0 2023-12-17T11:57:34.750 INFO:tasks.workunit.client.0.smithi002.stdout:7/137: readlink d6/d17/d16/d1d/d27/l2b 0 2023-12-17T11:57:34.750 INFO:tasks.workunit.client.1.smithi119.stdout:0/85: dwrite f1 [0,4194304] 0 2023-12-17T11:57:34.750 INFO:tasks.workunit.client.1.smithi119.stdout:0/86: truncate d2/fe 1227712 0 2023-12-17T11:57:34.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/138: creat d6/d17/dc/d13/f30 x:0 0 0 2023-12-17T11:57:34.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/139: chown d6/d17/dc/d13/d21 2003 1 2023-12-17T11:57:34.751 INFO:tasks.workunit.client.1.smithi119.stdout:5/156: dwrite d1/fd [4194304,4194304] 0 2023-12-17T11:57:34.752 INFO:tasks.workunit.client.1.smithi119.stdout:5/157: creat d1/f2e x:0 0 0 2023-12-17T11:57:34.752 INFO:tasks.workunit.client.1.smithi119.stdout:5/158: stat d1/f28 0 2023-12-17T11:57:34.752 INFO:tasks.workunit.client.0.smithi002.stdout:7/140: stat d6/d17/c26 0 2023-12-17T11:57:34.754 INFO:tasks.workunit.client.0.smithi002.stdout:7/141: creat d6/d17/d16/d1d/d24/f31 x:0 0 0 2023-12-17T11:57:34.755 INFO:tasks.workunit.client.1.smithi119.stdout:8/89: creat d7/da/d11/f1d x:0 0 0 2023-12-17T11:57:34.755 INFO:tasks.workunit.client.1.smithi119.stdout:1/78: symlink d3/d7/l18 0 2023-12-17T11:57:34.756 INFO:tasks.workunit.client.1.smithi119.stdout:1/79: dread - d3/f12 zero size 2023-12-17T11:57:34.759 INFO:tasks.workunit.client.1.smithi119.stdout:2/131: dwrite d6/f1f [0,4194304] 0 2023-12-17T11:57:34.763 INFO:tasks.workunit.client.1.smithi119.stdout:7/197: mkdir d2/d4/d3e 0 2023-12-17T11:57:34.763 INFO:tasks.workunit.client.1.smithi119.stdout:0/87: mkdir d2/d16/d12/d18 0 2023-12-17T11:57:34.765 INFO:tasks.workunit.client.1.smithi119.stdout:5/159: mknod d1/c2f 0 2023-12-17T11:57:34.765 INFO:tasks.workunit.client.1.smithi119.stdout:5/160: creat d1/f30 x:0 0 0 2023-12-17T11:57:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:9/154: write f0 [1750199,13933] 0 2023-12-17T11:57:34.766 INFO:tasks.workunit.client.0.smithi002.stdout:5/89: dread f6 [0,4194304] 0 2023-12-17T11:57:34.767 INFO:tasks.workunit.client.0.smithi002.stdout:5/90: unlink dc/fd 0 2023-12-17T11:57:34.768 INFO:tasks.workunit.client.1.smithi119.stdout:8/90: link l6 d7/da/l1e 0 2023-12-17T11:57:34.769 INFO:tasks.workunit.client.0.smithi002.stdout:9/155: unlink dc/d1d/d23/d24/c2a 0 2023-12-17T11:57:34.772 INFO:tasks.workunit.client.1.smithi119.stdout:4/82: dwrite f1 [0,4194304] 0 2023-12-17T11:57:34.777 INFO:tasks.workunit.client.1.smithi119.stdout:2/132: dread d6/f21 [0,4194304] 0 2023-12-17T11:57:34.777 INFO:tasks.workunit.client.1.smithi119.stdout:2/133: truncate d6/d9/f20 64005 0 2023-12-17T11:57:34.777 INFO:tasks.workunit.client.1.smithi119.stdout:7/198: rename d2/d4/d1f/d2a to d2/d4/d11/d3f 0 2023-12-17T11:57:34.781 INFO:tasks.workunit.client.0.smithi002.stdout:5/91: dread fa [0,4194304] 0 2023-12-17T11:57:34.784 INFO:tasks.workunit.client.1.smithi119.stdout:6/121: dwrite d2/df/f24 [0,4194304] 0 2023-12-17T11:57:34.784 INFO:tasks.workunit.client.1.smithi119.stdout:6/122: truncate d2/df/d17/f23 503436 0 2023-12-17T11:57:34.784 INFO:tasks.workunit.client.0.smithi002.stdout:5/92: mknod dc/c16 0 2023-12-17T11:57:34.785 INFO:tasks.workunit.client.1.smithi119.stdout:5/161: link d1/f12 d1/d25/f31 0 2023-12-17T11:57:34.786 INFO:tasks.workunit.client.0.smithi002.stdout:5/93: mkdir dc/d17 0 2023-12-17T11:57:34.787 INFO:tasks.workunit.client.0.smithi002.stdout:5/94: truncate f7 2546732 0 2023-12-17T11:57:34.787 INFO:tasks.workunit.client.1.smithi119.stdout:8/91: mkdir d7/d12/d1f 0 2023-12-17T11:57:34.788 INFO:tasks.workunit.client.1.smithi119.stdout:7/199: mkdir d2/d40 0 2023-12-17T11:57:34.790 INFO:tasks.workunit.client.0.smithi002.stdout:9/156: dread dc/ff [0,4194304] 0 2023-12-17T11:57:34.792 INFO:tasks.workunit.client.0.smithi002.stdout:3/204: dwrite d9/d24/f3e [0,4194304] 0 2023-12-17T11:57:34.793 INFO:tasks.workunit.client.0.smithi002.stdout:8/155: sync 2023-12-17T11:57:34.793 INFO:tasks.workunit.client.0.smithi002.stdout:8/156: write d3/d8/da/dd/f1d [1974746,121407] 0 2023-12-17T11:57:34.794 INFO:tasks.workunit.client.1.smithi119.stdout:5/162: mknod d1/c32 0 2023-12-17T11:57:34.794 INFO:tasks.workunit.client.1.smithi119.stdout:5/163: dread - d1/f23 zero size 2023-12-17T11:57:34.794 INFO:tasks.workunit.client.0.smithi002.stdout:6/111: dwrite d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:34.795 INFO:tasks.workunit.client.1.smithi119.stdout:8/92: mknod d7/da/d1a/c20 0 2023-12-17T11:57:34.795 INFO:tasks.workunit.client.0.smithi002.stdout:6/112: chown d0/d1/d21 3100846 1 2023-12-17T11:57:34.795 INFO:tasks.workunit.client.0.smithi002.stdout:6/113: fdatasync d0/f1a 0 2023-12-17T11:57:34.795 INFO:tasks.workunit.client.0.smithi002.stdout:3/205: creat d9/f44 x:0 0 0 2023-12-17T11:57:34.797 INFO:tasks.workunit.client.1.smithi119.stdout:0/88: rename f1 to d2/d3/d5/f19 0 2023-12-17T11:57:34.798 INFO:tasks.workunit.client.0.smithi002.stdout:3/206: write d9/f1e [328794,39805] 0 2023-12-17T11:57:34.798 INFO:tasks.workunit.client.0.smithi002.stdout:3/207: creat d9/f45 x:0 0 0 2023-12-17T11:57:34.798 INFO:tasks.workunit.client.0.smithi002.stdout:7/142: dwrite d6/d17/d16/d1d/d24/f31 [0,4194304] 0 2023-12-17T11:57:34.798 INFO:tasks.workunit.client.0.smithi002.stdout:7/143: chown d6/d17 0 1 2023-12-17T11:57:34.799 INFO:tasks.workunit.client.0.smithi002.stdout:0/89: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:34.800 INFO:tasks.workunit.client.1.smithi119.stdout:5/164: unlink d1/f12 0 2023-12-17T11:57:34.800 INFO:tasks.workunit.client.1.smithi119.stdout:5/165: write d1/f2e [812690,91213] 0 2023-12-17T11:57:34.801 INFO:tasks.workunit.client.1.smithi119.stdout:5/166: creat d1/f33 x:0 0 0 2023-12-17T11:57:34.806 INFO:tasks.workunit.client.1.smithi119.stdout:5/167: truncate d1/d25/f31 3779507 0 2023-12-17T11:57:34.808 INFO:tasks.workunit.client.1.smithi119.stdout:5/168: mknod d1/c34 0 2023-12-17T11:57:34.809 INFO:tasks.workunit.client.1.smithi119.stdout:5/169: creat d1/f35 x:0 0 0 2023-12-17T11:57:34.813 INFO:tasks.workunit.client.1.smithi119.stdout:3/136: dwrite d9/f19 [0,4194304] 0 2023-12-17T11:57:34.823 INFO:tasks.workunit.client.1.smithi119.stdout:3/137: creat d9/d11/f2f x:0 0 0 2023-12-17T11:57:34.823 INFO:tasks.workunit.client.1.smithi119.stdout:3/138: stat d9/d11/d1e 0 2023-12-17T11:57:34.823 INFO:tasks.workunit.client.1.smithi119.stdout:3/139: chown d9/d1c 651 1 2023-12-17T11:57:34.824 INFO:tasks.workunit.client.0.smithi002.stdout:3/208: creat d9/d1b/d35/d41/d43/f46 x:0 0 0 2023-12-17T11:57:34.824 INFO:tasks.workunit.client.0.smithi002.stdout:0/90: truncate d0/ff 100922 0 2023-12-17T11:57:34.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/91: symlink d0/l1e 0 2023-12-17T11:57:34.830 INFO:tasks.workunit.client.0.smithi002.stdout:0/92: symlink d0/d6/d8/l1f 0 2023-12-17T11:57:34.830 INFO:tasks.workunit.client.0.smithi002.stdout:0/93: read d0/d6/fe [294211,113865] 0 2023-12-17T11:57:34.832 INFO:tasks.workunit.client.0.smithi002.stdout:0/94: rmdir d0/d6/d8/d14/d19 39 2023-12-17T11:57:34.833 INFO:tasks.workunit.client.0.smithi002.stdout:0/95: creat d0/d6/d8/f20 x:0 0 0 2023-12-17T11:57:34.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/209: write d9/f13 [146722,85312] 0 2023-12-17T11:57:34.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/210: dread - d9/f44 zero size 2023-12-17T11:57:34.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/211: write d9/d15/f2b [1308660,58066] 0 2023-12-17T11:57:34.842 INFO:tasks.workunit.client.0.smithi002.stdout:0/96: creat d0/d6/d8/d14/d19/f21 x:0 0 0 2023-12-17T11:57:34.846 INFO:tasks.workunit.client.1.smithi119.stdout:3/140: link f7 d9/da/f30 0 2023-12-17T11:57:34.846 INFO:tasks.workunit.client.1.smithi119.stdout:5/170: getdents d1 0 2023-12-17T11:57:34.847 INFO:tasks.workunit.client.0.smithi002.stdout:2/138: sync 2023-12-17T11:57:34.847 INFO:tasks.workunit.client.1.smithi119.stdout:0/89: write d2/d3/d5/f19 [119222,101262] 0 2023-12-17T11:57:34.848 INFO:tasks.workunit.client.1.smithi119.stdout:2/134: dwrite d6/d9/fb [4194304,4194304] 0 2023-12-17T11:57:34.848 INFO:tasks.workunit.client.1.smithi119.stdout:2/135: dread - d6/d9/f2a zero size 2023-12-17T11:57:34.849 INFO:tasks.workunit.client.0.smithi002.stdout:2/139: symlink d3/l35 0 2023-12-17T11:57:34.849 INFO:tasks.workunit.client.0.smithi002.stdout:2/140: truncate d3/d4/d7/d14/d1b/f26 4210363 0 2023-12-17T11:57:34.849 INFO:tasks.workunit.client.0.smithi002.stdout:2/141: stat d3/d4/d17/d19/f24 0 2023-12-17T11:57:34.851 INFO:tasks.workunit.client.0.smithi002.stdout:2/142: creat d3/d4/d7/f36 x:0 0 0 2023-12-17T11:57:34.861 INFO:tasks.workunit.client.0.smithi002.stdout:5/95: dread f7 [0,4194304] 0 2023-12-17T11:57:34.866 INFO:tasks.workunit.client.1.smithi119.stdout:6/123: dwrite d2/f11 [0,4194304] 0 2023-12-17T11:57:34.869 INFO:tasks.workunit.client.0.smithi002.stdout:5/96: write f7 [1687044,14470] 0 2023-12-17T11:57:34.870 INFO:tasks.workunit.client.0.smithi002.stdout:2/143: rmdir d3/d4/d7 39 2023-12-17T11:57:34.871 INFO:tasks.workunit.client.1.smithi119.stdout:2/136: dread d6/d9/fb [0,4194304] 0 2023-12-17T11:57:34.872 INFO:tasks.workunit.client.0.smithi002.stdout:7/144: dwrite d6/f1c [0,4194304] 0 2023-12-17T11:57:34.872 INFO:tasks.workunit.client.0.smithi002.stdout:7/145: write d6/d17/dc/d13/f30 [738713,115856] 0 2023-12-17T11:57:34.874 INFO:tasks.workunit.client.1.smithi119.stdout:6/124: dread d2/df/d17/f23 [0,4194304] 0 2023-12-17T11:57:34.874 INFO:tasks.workunit.client.1.smithi119.stdout:6/125: fsync d2/f9 0 2023-12-17T11:57:34.878 INFO:tasks.workunit.client.0.smithi002.stdout:7/146: rmdir d6/d17 39 2023-12-17T11:57:34.886 INFO:tasks.workunit.client.0.smithi002.stdout:0/97: dread d0/fd [0,4194304] 0 2023-12-17T11:57:34.887 INFO:tasks.workunit.client.1.smithi119.stdout:7/200: dwrite d2/d4/d11/d3f/f2b [0,4194304] 0 2023-12-17T11:57:34.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/114: dwrite d0/d1/dc/d17/f1f [0,4194304] 0 2023-12-17T11:57:34.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/115: dread - d0/d1/dc/d10/f14 zero size 2023-12-17T11:57:34.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/116: chown d0/d1/dc 11216744 1 2023-12-17T11:57:34.897 INFO:tasks.workunit.client.0.smithi002.stdout:9/157: dwrite dc/f16 [0,4194304] 0 2023-12-17T11:57:34.898 INFO:tasks.workunit.client.0.smithi002.stdout:9/158: dread - dc/f15 zero size 2023-12-17T11:57:34.900 INFO:tasks.workunit.client.1.smithi119.stdout:6/126: write d2/df/f24 [2031277,82777] 0 2023-12-17T11:57:34.901 INFO:tasks.workunit.client.0.smithi002.stdout:9/159: creat dc/d1d/d23/d24/f3a x:0 0 0 2023-12-17T11:57:34.901 INFO:tasks.workunit.client.0.smithi002.stdout:9/160: truncate dc/d1d/d23/d24/f33 865215 0 2023-12-17T11:57:34.902 INFO:tasks.workunit.client.1.smithi119.stdout:3/141: dwrite d9/da/df/f15 [0,4194304] 0 2023-12-17T11:57:34.904 INFO:tasks.workunit.client.0.smithi002.stdout:0/98: dread d0/d6/f11 [0,4194304] 0 2023-12-17T11:57:34.904 INFO:tasks.workunit.client.0.smithi002.stdout:9/161: unlink dc/f16 0 2023-12-17T11:57:34.905 INFO:tasks.workunit.client.0.smithi002.stdout:0/99: write d0/d6/d8/d14/d19/f21 [241059,118048] 0 2023-12-17T11:57:34.905 INFO:tasks.workunit.client.0.smithi002.stdout:8/157: dwrite d3/d8/da/d13/f24 [0,4194304] 0 2023-12-17T11:57:34.906 INFO:tasks.workunit.client.0.smithi002.stdout:8/158: write d3/d7/d1a/f1c [3572853,116969] 0 2023-12-17T11:57:34.906 INFO:tasks.workunit.client.0.smithi002.stdout:8/159: truncate d3/d8/da/d13/f30 125258 0 2023-12-17T11:57:34.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/162: rename dc/d1d/d23/f36 to dc/d1d/f3b 0 2023-12-17T11:57:34.912 INFO:tasks.workunit.client.0.smithi002.stdout:0/100: creat d0/f22 x:0 0 0 2023-12-17T11:57:34.912 INFO:tasks.workunit.client.0.smithi002.stdout:0/101: truncate d0/d6/fb 1589706 0 2023-12-17T11:57:34.919 INFO:tasks.workunit.client.1.smithi119.stdout:6/127: write d2/f4 [2071101,21796] 0 2023-12-17T11:57:34.920 INFO:tasks.workunit.client.1.smithi119.stdout:6/128: truncate d2/f1b 735380 0 2023-12-17T11:57:34.921 INFO:tasks.workunit.client.0.smithi002.stdout:8/160: getdents d3/d8/d28 0 2023-12-17T11:57:34.921 INFO:tasks.workunit.client.0.smithi002.stdout:2/144: write d3/d4/d7/d14/d1b/f26 [1852053,25830] 0 2023-12-17T11:57:34.921 INFO:tasks.workunit.client.0.smithi002.stdout:2/145: readlink d3/d4/d7/d14/l22 0 2023-12-17T11:57:34.921 INFO:tasks.workunit.client.0.smithi002.stdout:2/146: truncate d3/d4/d7/d14/d1b/f29 4641306 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:5/97: dwrite f4 [0,4194304] 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:5/98: readlink dc/l14 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:5/99: write f6 [4321652,17590] 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:9/163: symlink dc/d1d/l3c 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:9/164: truncate dc/f12 482786 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:9/165: creat dc/d1d/d23/f3d x:0 0 0 2023-12-17T11:57:34.922 INFO:tasks.workunit.client.0.smithi002.stdout:6/117: write d0/d1/dc/f16 [660238,113661] 0 2023-12-17T11:57:34.923 INFO:tasks.workunit.client.0.smithi002.stdout:6/118: chown d0/d1/c18 171897 1 2023-12-17T11:57:34.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/102: dread d0/f13 [0,4194304] 0 2023-12-17T11:57:34.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/103: stat d0/fd 0 2023-12-17T11:57:34.927 INFO:tasks.workunit.client.0.smithi002.stdout:5/100: rmdir dc 39 2023-12-17T11:57:34.927 INFO:tasks.workunit.client.0.smithi002.stdout:6/119: rename d0/d1/dc/d10/c11 to d0/d1/dc/d10/c22 0 2023-12-17T11:57:34.933 INFO:tasks.workunit.client.1.smithi119.stdout:5/171: mkdir d1/d36 0 2023-12-17T11:57:34.940 INFO:tasks.workunit.client.0.smithi002.stdout:6/120: truncate d0/d1/dc/f8 5633257 0 2023-12-17T11:57:34.940 INFO:tasks.workunit.client.0.smithi002.stdout:6/121: truncate d0/d1/dc/d17/f1f 4841753 0 2023-12-17T11:57:34.944 INFO:tasks.workunit.client.1.smithi119.stdout:0/90: readlink d2/d3/d5/ld 0 2023-12-17T11:57:34.947 INFO:tasks.workunit.client.1.smithi119.stdout:2/137: creat d6/d9/d13/d1d/f2d x:0 0 0 2023-12-17T11:57:34.947 INFO:tasks.workunit.client.1.smithi119.stdout:2/138: truncate d6/d9/f2a 48585 0 2023-12-17T11:57:34.948 INFO:tasks.workunit.client.0.smithi002.stdout:2/147: dread d3/d4/d7/f1a [0,4194304] 0 2023-12-17T11:57:34.960 INFO:tasks.workunit.client.1.smithi119.stdout:3/142: rename d9/da/l13 to d9/d11/d1e/l31 0 2023-12-17T11:57:34.960 INFO:tasks.workunit.client.1.smithi119.stdout:3/143: chown f3 1 1 2023-12-17T11:57:34.961 INFO:tasks.workunit.client.0.smithi002.stdout:9/166: write dc/d1d/d23/f2e [1856065,115107] 0 2023-12-17T11:57:34.961 INFO:tasks.workunit.client.0.smithi002.stdout:4/137: sync 2023-12-17T11:57:34.961 INFO:tasks.workunit.client.0.smithi002.stdout:1/161: sync 2023-12-17T11:57:34.961 INFO:tasks.workunit.client.0.smithi002.stdout:1/162: fsync d3/d6/d9/d30/f2c 0 2023-12-17T11:57:34.961 INFO:tasks.workunit.client.0.smithi002.stdout:1/163: creat d3/d6/d16/f31 x:0 0 0 2023-12-17T11:57:34.963 INFO:tasks.workunit.client.0.smithi002.stdout:6/122: creat d0/d1/f23 x:0 0 0 2023-12-17T11:57:34.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/148: truncate d3/d4/fe 3910865 0 2023-12-17T11:57:34.966 INFO:tasks.workunit.client.0.smithi002.stdout:4/138: creat d0/d10/d21/f36 x:0 0 0 2023-12-17T11:57:34.967 INFO:tasks.workunit.client.0.smithi002.stdout:6/123: mknod d0/d1/dc/d10/c24 0 2023-12-17T11:57:34.967 INFO:tasks.workunit.client.1.smithi119.stdout:5/172: rmdir d1/d25 39 2023-12-17T11:57:34.968 INFO:tasks.workunit.client.0.smithi002.stdout:4/139: unlink d0/d10/d14/d27/l28 0 2023-12-17T11:57:34.968 INFO:tasks.workunit.client.0.smithi002.stdout:4/140: fsync d0/d10/d14/f24 0 2023-12-17T11:57:34.969 INFO:tasks.workunit.client.0.smithi002.stdout:6/124: mknod d0/d1/dc/c25 0 2023-12-17T11:57:34.970 INFO:tasks.workunit.client.1.smithi119.stdout:2/139: unlink d6/la 0 2023-12-17T11:57:34.971 INFO:tasks.workunit.client.0.smithi002.stdout:4/141: creat d0/d10/d21/d33/f37 x:0 0 0 2023-12-17T11:57:34.971 INFO:tasks.workunit.client.0.smithi002.stdout:4/142: fsync d0/d10/f30 0 2023-12-17T11:57:34.971 INFO:tasks.workunit.client.0.smithi002.stdout:4/143: dread - d0/d10/f31 zero size 2023-12-17T11:57:34.972 INFO:tasks.workunit.client.0.smithi002.stdout:4/144: dread - d0/d10/d21/d33/f35 zero size 2023-12-17T11:57:34.972 INFO:tasks.workunit.client.0.smithi002.stdout:4/145: chown d0/d10/d14/d27 146 1 2023-12-17T11:57:34.972 INFO:tasks.workunit.client.0.smithi002.stdout:7/147: dwrite d6/f1c [0,4194304] 0 2023-12-17T11:57:34.972 INFO:tasks.workunit.client.0.smithi002.stdout:7/148: chown d6/d17/d16/d1d/d24/f31 58101 1 2023-12-17T11:57:34.978 INFO:tasks.workunit.client.1.smithi119.stdout:6/129: rename d2/df/d17/c1d to d2/c25 0 2023-12-17T11:57:34.978 INFO:tasks.workunit.client.1.smithi119.stdout:6/130: chown d2/df/c12 0 1 2023-12-17T11:57:34.978 INFO:tasks.workunit.client.1.smithi119.stdout:6/131: stat d2/df/f1f 0 2023-12-17T11:57:34.978 INFO:tasks.workunit.client.1.smithi119.stdout:6/132: fsync d2/df/f24 0 2023-12-17T11:57:34.978 INFO:tasks.workunit.client.1.smithi119.stdout:3/144: creat d9/da/df/f32 x:0 0 0 2023-12-17T11:57:34.981 INFO:tasks.workunit.client.1.smithi119.stdout:2/140: mknod d6/d9/d13/d1d/c2e 0 2023-12-17T11:57:34.981 INFO:tasks.workunit.client.0.smithi002.stdout:6/125: link d0/f1a d0/d1/dc/d17/f26 0 2023-12-17T11:57:34.981 INFO:tasks.workunit.client.0.smithi002.stdout:4/146: symlink d0/d10/d21/l38 0 2023-12-17T11:57:34.981 INFO:tasks.workunit.client.0.smithi002.stdout:6/126: getdents d0/d1/d21 0 2023-12-17T11:57:34.981 INFO:tasks.workunit.client.0.smithi002.stdout:6/127: chown d0/la 3 1 2023-12-17T11:57:34.982 INFO:tasks.workunit.client.0.smithi002.stdout:7/149: rename d6/d17/c1e to d6/d17/dc/c32 0 2023-12-17T11:57:34.982 INFO:tasks.workunit.client.0.smithi002.stdout:6/128: chown d0/d1/dc/f16 156 1 2023-12-17T11:57:34.982 INFO:tasks.workunit.client.0.smithi002.stdout:6/129: chown d0/d1/dc/d10/f14 0 1 2023-12-17T11:57:34.983 INFO:tasks.workunit.client.0.smithi002.stdout:7/150: write d6/d17/dc/d13/f30 [716272,11810] 0 2023-12-17T11:57:34.983 INFO:tasks.workunit.client.0.smithi002.stdout:7/151: chown d6/d17/d16/d1d/d24/f31 7397503 1 2023-12-17T11:57:34.983 INFO:tasks.workunit.client.0.smithi002.stdout:7/152: fdatasync d6/d17/f1a 0 2023-12-17T11:57:34.983 INFO:tasks.workunit.client.0.smithi002.stdout:7/153: chown d6 169 1 2023-12-17T11:57:34.990 INFO:tasks.workunit.client.1.smithi119.stdout:2/141: mknod d6/c2f 0 2023-12-17T11:57:34.990 INFO:tasks.workunit.client.1.smithi119.stdout:2/142: write d6/d9/d13/d1d/f2d [17204,84160] 0 2023-12-17T11:57:34.992 INFO:tasks.workunit.client.1.smithi119.stdout:2/143: symlink d6/d9/l30 0 2023-12-17T11:57:34.999 INFO:tasks.workunit.client.0.smithi002.stdout:1/164: dread d3/d6/d9/f13 [0,4194304] 0 2023-12-17T11:57:35.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/130: mknod d0/d1/dc/d10/c27 0 2023-12-17T11:57:35.000 INFO:tasks.workunit.client.0.smithi002.stdout:6/131: chown d0/d1/c18 24 1 2023-12-17T11:57:35.004 INFO:tasks.workunit.client.0.smithi002.stdout:1/165: symlink d3/d6/d16/d28/l32 0 2023-12-17T11:57:35.004 INFO:tasks.workunit.client.0.smithi002.stdout:1/166: read d3/d6/d9/d30/f2c [1444634,61147] 0 2023-12-17T11:57:35.005 INFO:tasks.workunit.client.0.smithi002.stdout:1/167: link d3/d6/fa d3/d6/f33 0 2023-12-17T11:57:35.006 INFO:tasks.workunit.client.1.smithi119.stdout:3/145: dread d9/fc [0,4194304] 0 2023-12-17T11:57:35.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/147: dread d0/ff [0,4194304] 0 2023-12-17T11:57:35.007 INFO:tasks.workunit.client.1.smithi119.stdout:5/173: mknod d1/d25/c37 0 2023-12-17T11:57:35.007 INFO:tasks.workunit.client.0.smithi002.stdout:4/148: write d0/f8 [15860,9387] 0 2023-12-17T11:57:35.011 INFO:tasks.workunit.client.0.smithi002.stdout:4/149: truncate d0/ff 3224851 0 2023-12-17T11:57:35.012 INFO:tasks.workunit.client.0.smithi002.stdout:4/150: creat d0/d10/f39 x:0 0 0 2023-12-17T11:57:35.027 INFO:tasks.workunit.client.0.smithi002.stdout:9/167: dwrite dc/d1d/d23/d24/f30 [0,4194304] 0 2023-12-17T11:57:35.029 INFO:tasks.workunit.client.0.smithi002.stdout:9/168: getdents dc/d1d/d23 0 2023-12-17T11:57:35.039 INFO:tasks.workunit.client.0.smithi002.stdout:1/168: getdents d3/d6/d16/d28 0 2023-12-17T11:57:35.044 INFO:tasks.workunit.client.0.smithi002.stdout:1/169: rename d3/d6/d9/l27 to d3/d6/d16/l34 0 2023-12-17T11:57:35.044 INFO:tasks.workunit.client.0.smithi002.stdout:1/170: chown d3/d6/d16 11753 1 2023-12-17T11:57:35.048 INFO:tasks.workunit.client.1.smithi119.stdout:2/144: write d6/f11 [2624173,127942] 0 2023-12-17T11:57:35.050 INFO:tasks.workunit.client.0.smithi002.stdout:1/171: creat d3/d6/d9/f35 x:0 0 0 2023-12-17T11:57:35.050 INFO:tasks.workunit.client.0.smithi002.stdout:1/172: readlink d3/d6/d16/l22 0 2023-12-17T11:57:35.051 INFO:tasks.workunit.client.0.smithi002.stdout:1/173: stat d3/d6/c1c 0 2023-12-17T11:57:35.066 INFO:tasks.workunit.client.0.smithi002.stdout:8/161: dwrite d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:35.066 INFO:tasks.workunit.client.1.smithi119.stdout:3/146: dwrite d9/d1c/f24 [0,4194304] 0 2023-12-17T11:57:35.066 INFO:tasks.workunit.client.1.smithi119.stdout:3/147: fsync d9/f19 0 2023-12-17T11:57:35.067 INFO:tasks.workunit.client.1.smithi119.stdout:3/148: write d9/f1b [989363,112156] 0 2023-12-17T11:57:35.071 INFO:tasks.workunit.client.0.smithi002.stdout:0/104: dwrite d0/d6/fe [0,4194304] 0 2023-12-17T11:57:35.072 INFO:tasks.workunit.client.1.smithi119.stdout:9/161: sync 2023-12-17T11:57:35.072 INFO:tasks.workunit.client.1.smithi119.stdout:9/162: write d12/f19 [5039998,126427] 0 2023-12-17T11:57:35.073 INFO:tasks.workunit.client.1.smithi119.stdout:9/163: write d12/d1d/f2f [15361,54500] 0 2023-12-17T11:57:35.073 INFO:tasks.workunit.client.1.smithi119.stdout:9/164: fdatasync ff 0 2023-12-17T11:57:35.074 INFO:tasks.workunit.client.0.smithi002.stdout:1/174: write d3/fc [2492790,69826] 0 2023-12-17T11:57:35.074 INFO:tasks.workunit.client.0.smithi002.stdout:1/175: creat d3/d6/d9/f36 x:0 0 0 2023-12-17T11:57:35.075 INFO:tasks.workunit.client.0.smithi002.stdout:5/101: dread fa [0,4194304] 0 2023-12-17T11:57:35.075 INFO:tasks.workunit.client.0.smithi002.stdout:5/102: write fa [4741192,7005] 0 2023-12-17T11:57:35.075 INFO:tasks.workunit.client.0.smithi002.stdout:1/176: mkdir d3/d6/d9/d37 0 2023-12-17T11:57:35.084 INFO:tasks.workunit.client.0.smithi002.stdout:2/149: dwrite d3/d4/fd [0,4194304] 0 2023-12-17T11:57:35.091 INFO:tasks.workunit.client.1.smithi119.stdout:6/133: dwrite d2/df/f24 [0,4194304] 0 2023-12-17T11:57:35.091 INFO:tasks.workunit.client.1.smithi119.stdout:6/134: fsync d2/f4 0 2023-12-17T11:57:35.092 INFO:tasks.workunit.client.0.smithi002.stdout:5/103: fsync fa 0 2023-12-17T11:57:35.094 INFO:tasks.workunit.client.0.smithi002.stdout:2/150: mkdir d3/d4/d7/d14/d2e/d37 0 2023-12-17T11:57:35.094 INFO:tasks.workunit.client.0.smithi002.stdout:2/151: write d3/d4/d17/f20 [3228247,69171] 0 2023-12-17T11:57:35.101 INFO:tasks.workunit.client.1.smithi119.stdout:6/135: dread d2/df/f1f [0,4194304] 0 2023-12-17T11:57:35.104 INFO:tasks.workunit.client.0.smithi002.stdout:9/169: dwrite dc/d1d/f3b [0,4194304] 0 2023-12-17T11:57:35.110 INFO:tasks.workunit.client.1.smithi119.stdout:5/174: creat d1/d25/f38 x:0 0 0 2023-12-17T11:57:35.114 INFO:tasks.workunit.client.0.smithi002.stdout:6/132: dwrite d0/d1/f13 [0,4194304] 0 2023-12-17T11:57:35.128 INFO:tasks.workunit.client.0.smithi002.stdout:9/170: dread f0 [4194304,4194304] 0 2023-12-17T11:57:35.129 INFO:tasks.workunit.client.0.smithi002.stdout:9/171: mknod dc/d1d/d23/c3e 0 2023-12-17T11:57:35.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/172: mknod dc/d1d/c3f 0 2023-12-17T11:57:35.134 INFO:tasks.workunit.client.0.smithi002.stdout:9/173: link l7 dc/d1d/d25/l40 0 2023-12-17T11:57:35.134 INFO:tasks.workunit.client.0.smithi002.stdout:4/151: dwrite d0/ff [0,4194304] 0 2023-12-17T11:57:35.134 INFO:tasks.workunit.client.0.smithi002.stdout:7/154: dwrite d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:57:35.136 INFO:tasks.workunit.client.0.smithi002.stdout:4/152: creat d0/d10/d14/d27/f3a x:0 0 0 2023-12-17T11:57:35.136 INFO:tasks.workunit.client.0.smithi002.stdout:4/153: write d0/d10/f30 [840055,4622] 0 2023-12-17T11:57:35.138 INFO:tasks.workunit.client.0.smithi002.stdout:4/154: symlink d0/d10/d14/l3b 0 2023-12-17T11:57:35.139 INFO:tasks.workunit.client.0.smithi002.stdout:4/155: symlink d0/d10/d14/d27/l3c 0 2023-12-17T11:57:35.151 INFO:tasks.workunit.client.0.smithi002.stdout:4/156: getdents d0/d10 0 2023-12-17T11:57:35.152 INFO:tasks.workunit.client.0.smithi002.stdout:4/157: symlink d0/l3d 0 2023-12-17T11:57:35.152 INFO:tasks.workunit.client.0.smithi002.stdout:4/158: dread - d0/d10/d21/f36 zero size 2023-12-17T11:57:35.152 INFO:tasks.workunit.client.0.smithi002.stdout:4/159: mkdir d0/d3e 0 2023-12-17T11:57:35.152 INFO:tasks.workunit.client.0.smithi002.stdout:4/160: write d0/d10/d21/d33/f35 [416371,78325] 0 2023-12-17T11:57:35.152 INFO:tasks.workunit.client.0.smithi002.stdout:4/161: write d0/d10/d14/f24 [351981,54772] 0 2023-12-17T11:57:35.161 INFO:tasks.workunit.client.0.smithi002.stdout:0/105: dwrite d0/d6/f11 [0,4194304] 0 2023-12-17T11:57:35.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/152: dwrite d3/d4/d7/d14/d1b/f29 [0,4194304] 0 2023-12-17T11:57:35.175 INFO:tasks.workunit.client.0.smithi002.stdout:6/133: dwrite d0/d1/fd [0,4194304] 0 2023-12-17T11:57:35.175 INFO:tasks.workunit.client.0.smithi002.stdout:6/134: chown d0/d1/dc/ce 9 1 2023-12-17T11:57:35.175 INFO:tasks.workunit.client.0.smithi002.stdout:6/135: dread - d0/d1/dc/d10/f14 zero size 2023-12-17T11:57:35.175 INFO:tasks.workunit.client.0.smithi002.stdout:6/136: stat d0/d1/dc/d17/f26 0 2023-12-17T11:57:35.181 INFO:tasks.workunit.client.0.smithi002.stdout:1/177: dwrite d3/d6/d9/d30/f1a [0,4194304] 0 2023-12-17T11:57:35.181 INFO:tasks.workunit.client.0.smithi002.stdout:1/178: dread - d3/d6/d9/f35 zero size 2023-12-17T11:57:35.183 INFO:tasks.workunit.client.0.smithi002.stdout:0/106: link d0/d6/f11 d0/d15/f23 0 2023-12-17T11:57:35.183 INFO:tasks.workunit.client.0.smithi002.stdout:0/107: creat d0/d6/d8/f24 x:0 0 0 2023-12-17T11:57:35.190 INFO:tasks.workunit.client.0.smithi002.stdout:2/153: write d3/d4/f6 [7988007,120911] 0 2023-12-17T11:57:35.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/174: dwrite f1 [0,4194304] 0 2023-12-17T11:57:35.206 INFO:tasks.workunit.client.0.smithi002.stdout:5/104: write fb [3548824,123368] 0 2023-12-17T11:57:35.206 INFO:tasks.workunit.client.0.smithi002.stdout:5/105: write fa [2848177,65435] 0 2023-12-17T11:57:35.207 INFO:tasks.workunit.client.0.smithi002.stdout:8/162: dwrite d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:35.207 INFO:tasks.workunit.client.0.smithi002.stdout:8/163: chown d3/d7/d1a/l1b 1844 1 2023-12-17T11:57:35.208 INFO:tasks.workunit.client.0.smithi002.stdout:9/175: truncate dc/f21 2250287 0 2023-12-17T11:57:35.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/176: write fb [1937446,117395] 0 2023-12-17T11:57:35.212 INFO:tasks.workunit.client.0.smithi002.stdout:9/177: dread - dc/d1d/d23/d24/f3a zero size 2023-12-17T11:57:35.234 INFO:tasks.workunit.client.0.smithi002.stdout:4/162: dwrite d0/d10/f11 [0,4194304] 0 2023-12-17T11:57:35.236 INFO:tasks.workunit.client.0.smithi002.stdout:5/106: rename f9 to dc/f18 0 2023-12-17T11:57:35.237 INFO:tasks.workunit.client.0.smithi002.stdout:8/164: creat d3/d8/d28/f39 x:0 0 0 2023-12-17T11:57:35.237 INFO:tasks.workunit.client.0.smithi002.stdout:4/163: mknod d0/d10/d21/d33/c3f 0 2023-12-17T11:57:35.241 INFO:tasks.workunit.client.0.smithi002.stdout:8/165: creat d3/d8/da/d29/f3a x:0 0 0 2023-12-17T11:57:35.243 INFO:tasks.workunit.client.0.smithi002.stdout:8/166: link d3/d8/da/d13/f30 d3/d8/da/d13/f3b 0 2023-12-17T11:57:35.244 INFO:tasks.workunit.client.0.smithi002.stdout:5/107: dread dc/f18 [0,4194304] 0 2023-12-17T11:57:35.254 INFO:tasks.workunit.client.0.smithi002.stdout:8/167: mknod d3/d8/da/dd/c3c 0 2023-12-17T11:57:35.255 INFO:tasks.workunit.client.0.smithi002.stdout:8/168: creat d3/d8/f3d x:0 0 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:8/169: chown d3/l12 103733800 1 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:8/170: dread - d3/d8/da/d29/f3a zero size 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:5/108: creat dc/d17/f19 x:0 0 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/179: write d3/ff [3425528,106348] 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/180: truncate d3/d6/d16/f26 763273 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:5/109: mkdir dc/d1a 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/181: write d3/d6/fe [4017777,120884] 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/182: write d3/d6/d9/f36 [707379,14758] 0 2023-12-17T11:57:35.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/183: creat d3/d6/d9/f38 x:0 0 0 2023-12-17T11:57:35.263 INFO:tasks.workunit.client.0.smithi002.stdout:2/154: dwrite d3/d4/d7/f1a [0,4194304] 0 2023-12-17T11:57:35.263 INFO:tasks.workunit.client.0.smithi002.stdout:2/155: write d3/d4/f16 [3777240,82033] 0 2023-12-17T11:57:35.266 INFO:tasks.workunit.client.0.smithi002.stdout:3/212: sync 2023-12-17T11:57:35.267 INFO:tasks.workunit.client.0.smithi002.stdout:9/178: dread dc/d1d/f3b [0,4194304] 0 2023-12-17T11:57:35.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/108: dwrite d0/f13 [0,4194304] 0 2023-12-17T11:57:35.268 INFO:tasks.workunit.client.0.smithi002.stdout:0/109: stat d0/d6/d8/l1f 0 2023-12-17T11:57:35.268 INFO:tasks.workunit.client.0.smithi002.stdout:9/179: write dc/d32/f35 [815072,24644] 0 2023-12-17T11:57:35.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/213: mknod d9/d24/c47 0 2023-12-17T11:57:35.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/214: dread - d9/d1b/d35/f3b zero size 2023-12-17T11:57:35.268 INFO:tasks.workunit.client.0.smithi002.stdout:3/215: chown d9/d1b/c21 262118976 1 2023-12-17T11:57:35.270 INFO:tasks.workunit.client.0.smithi002.stdout:0/110: mkdir d0/d6/d8/d25 0 2023-12-17T11:57:35.272 INFO:tasks.workunit.client.0.smithi002.stdout:9/180: mknod dc/d1d/c41 0 2023-12-17T11:57:35.272 INFO:tasks.workunit.client.0.smithi002.stdout:9/181: chown dc/d1d/f3b 108166159 1 2023-12-17T11:57:35.275 INFO:tasks.workunit.client.0.smithi002.stdout:9/182: mkdir dc/d42 0 2023-12-17T11:57:35.275 INFO:tasks.workunit.client.0.smithi002.stdout:9/183: write dc/f15 [601477,89691] 0 2023-12-17T11:57:35.275 INFO:tasks.workunit.client.0.smithi002.stdout:9/184: chown dc 20311610 1 2023-12-17T11:57:35.278 INFO:tasks.workunit.client.0.smithi002.stdout:8/171: dread d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:35.281 INFO:tasks.workunit.client.0.smithi002.stdout:2/156: dread d3/d4/d7/f11 [0,4194304] 0 2023-12-17T11:57:35.284 INFO:tasks.workunit.client.0.smithi002.stdout:1/184: rmdir d3/d6/d9 39 2023-12-17T11:57:35.284 INFO:tasks.workunit.client.0.smithi002.stdout:5/110: dread fb [0,4194304] 0 2023-12-17T11:57:35.284 INFO:tasks.workunit.client.0.smithi002.stdout:5/111: stat dc/l10 0 2023-12-17T11:57:35.286 INFO:tasks.workunit.client.0.smithi002.stdout:9/185: creat dc/d1d/d25/f43 x:0 0 0 2023-12-17T11:57:35.293 INFO:tasks.workunit.client.0.smithi002.stdout:1/185: mkdir d3/d6/d9/d37/d39 0 2023-12-17T11:57:35.293 INFO:tasks.workunit.client.0.smithi002.stdout:1/186: stat d3/d6/d9/d30/l1d 0 2023-12-17T11:57:35.295 INFO:tasks.workunit.client.0.smithi002.stdout:8/172: unlink d3/d8/d28/f39 0 2023-12-17T11:57:35.295 INFO:tasks.workunit.client.0.smithi002.stdout:8/173: write d3/f25 [5065647,16234] 0 2023-12-17T11:57:35.295 INFO:tasks.workunit.client.0.smithi002.stdout:8/174: dread - d3/d8/da/d29/f3a zero size 2023-12-17T11:57:35.295 INFO:tasks.workunit.client.0.smithi002.stdout:9/186: rename dc/le to dc/l44 0 2023-12-17T11:57:35.298 INFO:tasks.workunit.client.0.smithi002.stdout:0/111: rename d0/d6/d8 to d0/d6/d26 0 2023-12-17T11:57:35.299 INFO:tasks.workunit.client.0.smithi002.stdout:0/112: stat d0/d15 0 2023-12-17T11:57:35.299 INFO:tasks.workunit.client.0.smithi002.stdout:0/113: fdatasync d0/d6/d26/f24 0 2023-12-17T11:57:35.299 INFO:tasks.workunit.client.0.smithi002.stdout:0/114: write d0/d6/d26/f20 [782804,55736] 0 2023-12-17T11:57:35.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/115: creat d0/d15/f27 x:0 0 0 2023-12-17T11:57:35.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/116: creat d0/d15/f28 x:0 0 0 2023-12-17T11:57:35.306 INFO:tasks.workunit.client.0.smithi002.stdout:0/117: getdents d0/d6/d17 0 2023-12-17T11:57:35.312 INFO:tasks.workunit.client.1.smithi119.stdout:5/175: getdents d1/d25 0 2023-12-17T11:57:35.316 INFO:tasks.workunit.client.1.smithi119.stdout:5/176: rmdir d1 39 2023-12-17T11:57:35.316 INFO:tasks.workunit.client.1.smithi119.stdout:5/177: dread - d1/d25/f38 zero size 2023-12-17T11:57:35.322 INFO:tasks.workunit.client.1.smithi119.stdout:6/136: creat d2/f26 x:0 0 0 2023-12-17T11:57:35.322 INFO:tasks.workunit.client.1.smithi119.stdout:6/137: readlink d2/df/l18 0 2023-12-17T11:57:35.323 INFO:tasks.workunit.client.1.smithi119.stdout:5/178: mkdir d1/d25/d39 0 2023-12-17T11:57:35.323 INFO:tasks.workunit.client.1.smithi119.stdout:9/165: creat d12/f35 x:0 0 0 2023-12-17T11:57:35.323 INFO:tasks.workunit.client.1.smithi119.stdout:9/166: write d12/f23 [950820,47096] 0 2023-12-17T11:57:35.324 INFO:tasks.workunit.client.1.smithi119.stdout:9/167: truncate d12/d1d/f32 1345906 0 2023-12-17T11:57:35.324 INFO:tasks.workunit.client.1.smithi119.stdout:5/179: write d1/d25/f2c [121668,71639] 0 2023-12-17T11:57:35.324 INFO:tasks.workunit.client.1.smithi119.stdout:5/180: readlink d1/l2a 0 2023-12-17T11:57:35.326 INFO:tasks.workunit.client.1.smithi119.stdout:9/168: creat d12/d1d/f36 x:0 0 0 2023-12-17T11:57:35.326 INFO:tasks.workunit.client.1.smithi119.stdout:5/181: write d1/fe [843259,131001] 0 2023-12-17T11:57:35.327 INFO:tasks.workunit.client.0.smithi002.stdout:4/164: dwrite d0/d10/d14/f24 [0,4194304] 0 2023-12-17T11:57:35.327 INFO:tasks.workunit.client.0.smithi002.stdout:4/165: chown d0/d10/c1c 111 1 2023-12-17T11:57:35.330 INFO:tasks.workunit.client.0.smithi002.stdout:2/157: truncate d3/d4/f16 4083944 0 2023-12-17T11:57:35.333 INFO:tasks.workunit.client.1.smithi119.stdout:5/182: unlink d1/fe 0 2023-12-17T11:57:35.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/166: creat d0/d10/f40 x:0 0 0 2023-12-17T11:57:35.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/167: getdents d0/d3e 0 2023-12-17T11:57:35.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/168: chown d0/f19 26521176 1 2023-12-17T11:57:35.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/169: chown d0/d10/f2d 530 1 2023-12-17T11:57:35.337 INFO:tasks.workunit.client.0.smithi002.stdout:4/170: fsync d0/d10/d21/f36 0 2023-12-17T11:57:35.342 INFO:tasks.workunit.client.1.smithi119.stdout:2/145: symlink d6/d2b/l31 0 2023-12-17T11:57:35.342 INFO:tasks.workunit.client.1.smithi119.stdout:2/146: chown d6/f14 1150180 1 2023-12-17T11:57:35.346 INFO:tasks.workunit.client.1.smithi119.stdout:2/147: rename d6/d9/d13/d1d/f23 to d6/d9/d13/f32 0 2023-12-17T11:57:35.354 INFO:tasks.workunit.client.0.smithi002.stdout:1/187: dread d3/d6/fe [0,4194304] 0 2023-12-17T11:57:35.354 INFO:tasks.workunit.client.0.smithi002.stdout:1/188: write d3/d6/fa [986026,40777] 0 2023-12-17T11:57:35.354 INFO:tasks.workunit.client.0.smithi002.stdout:0/118: fsync d0/d6/d26/f20 0 2023-12-17T11:57:35.354 INFO:tasks.workunit.client.0.smithi002.stdout:0/119: getdents d0/d6/d26/d25 0 2023-12-17T11:57:35.369 INFO:tasks.workunit.client.0.smithi002.stdout:3/216: dwrite d9/d1b/d35/d41/d43/f46 [0,4194304] 0 2023-12-17T11:57:35.370 INFO:tasks.workunit.client.1.smithi119.stdout:3/149: mkdir d9/d1c/d2a/d33 0 2023-12-17T11:57:35.372 INFO:tasks.workunit.client.0.smithi002.stdout:8/175: dwrite d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:35.373 INFO:tasks.workunit.client.1.smithi119.stdout:4/83: sync 2023-12-17T11:57:35.373 INFO:tasks.workunit.client.1.smithi119.stdout:0/91: sync 2023-12-17T11:57:35.373 INFO:tasks.workunit.client.1.smithi119.stdout:8/93: sync 2023-12-17T11:57:35.374 INFO:tasks.workunit.client.1.smithi119.stdout:1/80: sync 2023-12-17T11:57:35.374 INFO:tasks.workunit.client.0.smithi002.stdout:9/187: dwrite dc/f12 [0,4194304] 0 2023-12-17T11:57:35.374 INFO:tasks.workunit.client.0.smithi002.stdout:9/188: chown dc/f1e 62244358 1 2023-12-17T11:57:35.376 INFO:tasks.workunit.client.1.smithi119.stdout:7/201: sync 2023-12-17T11:57:35.377 INFO:tasks.workunit.client.0.smithi002.stdout:4/171: write d0/ff [3709687,116965] 0 2023-12-17T11:57:35.377 INFO:tasks.workunit.client.1.smithi119.stdout:0/92: creat d2/d16/d12/f1a x:0 0 0 2023-12-17T11:57:35.380 INFO:tasks.workunit.client.1.smithi119.stdout:4/84: creat dd/d15/d16/f1a x:0 0 0 2023-12-17T11:57:35.381 INFO:tasks.workunit.client.1.smithi119.stdout:6/138: dread d2/f11 [0,4194304] 0 2023-12-17T11:57:35.381 INFO:tasks.workunit.client.0.smithi002.stdout:1/189: dread d3/d6/d9/f36 [0,4194304] 0 2023-12-17T11:57:35.382 INFO:tasks.workunit.client.0.smithi002.stdout:1/190: creat d3/d6/f3a x:0 0 0 2023-12-17T11:57:35.383 INFO:tasks.workunit.client.1.smithi119.stdout:9/169: dwrite f11 [4194304,4194304] 0 2023-12-17T11:57:35.385 INFO:tasks.workunit.client.1.smithi119.stdout:1/81: mkdir d3/d5/d19 0 2023-12-17T11:57:35.388 INFO:tasks.workunit.client.1.smithi119.stdout:2/148: dwrite d6/d9/f2a [0,4194304] 0 2023-12-17T11:57:35.388 INFO:tasks.workunit.client.0.smithi002.stdout:0/120: dread d0/d15/f23 [0,4194304] 0 2023-12-17T11:57:35.388 INFO:tasks.workunit.client.0.smithi002.stdout:5/112: dwrite f8 [4194304,4194304] 0 2023-12-17T11:57:35.394 INFO:tasks.workunit.client.1.smithi119.stdout:4/85: creat dd/f1b x:0 0 0 2023-12-17T11:57:35.395 INFO:tasks.workunit.client.1.smithi119.stdout:9/170: write d12/f17 [6306857,8276] 0 2023-12-17T11:57:35.402 INFO:tasks.workunit.client.0.smithi002.stdout:3/217: symlink d9/d15/d31/l48 0 2023-12-17T11:57:35.402 INFO:tasks.workunit.client.0.smithi002.stdout:3/218: readlink d9/d15/l23 0 2023-12-17T11:57:35.403 INFO:tasks.workunit.client.1.smithi119.stdout:5/183: dwrite d1/f35 [0,4194304] 0 2023-12-17T11:57:35.407 INFO:tasks.workunit.client.0.smithi002.stdout:8/176: creat d3/d8/d28/d31/f3e x:0 0 0 2023-12-17T11:57:35.413 INFO:tasks.workunit.client.1.smithi119.stdout:1/82: creat d3/d7/f1a x:0 0 0 2023-12-17T11:57:35.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/137: sync 2023-12-17T11:57:35.421 INFO:tasks.workunit.client.0.smithi002.stdout:7/155: sync 2023-12-17T11:57:35.423 INFO:tasks.workunit.client.1.smithi119.stdout:0/93: symlink d2/d3/d5/l1b 0 2023-12-17T11:57:35.430 INFO:tasks.workunit.client.1.smithi119.stdout:6/139: unlink d2/f1b 0 2023-12-17T11:57:35.432 INFO:tasks.workunit.client.0.smithi002.stdout:4/172: unlink d0/d10/l1e 0 2023-12-17T11:57:35.432 INFO:tasks.workunit.client.0.smithi002.stdout:4/173: write d0/fb [2639771,49644] 0 2023-12-17T11:57:35.433 INFO:tasks.workunit.client.1.smithi119.stdout:4/86: mkdir dd/d15/d1c 0 2023-12-17T11:57:35.433 INFO:tasks.workunit.client.1.smithi119.stdout:4/87: creat dd/f1d x:0 0 0 2023-12-17T11:57:35.437 INFO:tasks.workunit.client.0.smithi002.stdout:1/191: mknod d3/d6/d9/d37/c3b 0 2023-12-17T11:57:35.438 INFO:tasks.workunit.client.1.smithi119.stdout:2/149: dwrite d6/d9/f1b [0,4194304] 0 2023-12-17T11:57:35.438 INFO:tasks.workunit.client.0.smithi002.stdout:7/156: dread d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:35.441 INFO:tasks.workunit.client.1.smithi119.stdout:9/171: rename d12/f1c to d12/f37 0 2023-12-17T11:57:35.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/121: symlink d0/l29 0 2023-12-17T11:57:35.447 INFO:tasks.workunit.client.0.smithi002.stdout:5/113: mkdir dc/d1b 0 2023-12-17T11:57:35.450 INFO:tasks.workunit.client.1.smithi119.stdout:3/150: dwrite d9/da/f2d [0,4194304] 0 2023-12-17T11:57:35.451 INFO:tasks.workunit.client.1.smithi119.stdout:1/83: unlink d3/d5/c15 0 2023-12-17T11:57:35.456 INFO:tasks.workunit.client.1.smithi119.stdout:6/140: mknod d2/df/c27 0 2023-12-17T11:57:35.461 INFO:tasks.workunit.client.1.smithi119.stdout:8/94: dwrite d7/f16 [0,4194304] 0 2023-12-17T11:57:35.463 INFO:tasks.workunit.client.0.smithi002.stdout:3/219: unlink d9/d24/c47 0 2023-12-17T11:57:35.465 INFO:tasks.workunit.client.1.smithi119.stdout:4/88: rmdir dd/d15/d1c 0 2023-12-17T11:57:35.465 INFO:tasks.workunit.client.1.smithi119.stdout:4/89: fsync dd/d15/d16/f1a 0 2023-12-17T11:57:35.471 INFO:tasks.workunit.client.1.smithi119.stdout:7/202: dwrite d2/d4/d1f/f2e [0,4194304] 0 2023-12-17T11:57:35.471 INFO:tasks.workunit.client.1.smithi119.stdout:7/203: fsync d2/d4/f16 0 2023-12-17T11:57:35.471 INFO:tasks.workunit.client.1.smithi119.stdout:6/141: write d2/f11 [550084,38843] 0 2023-12-17T11:57:35.472 INFO:tasks.workunit.client.0.smithi002.stdout:9/189: rmdir dc/d32 39 2023-12-17T11:57:35.472 INFO:tasks.workunit.client.0.smithi002.stdout:9/190: readlink dc/d1d/d25/l37 0 2023-12-17T11:57:35.473 INFO:tasks.workunit.client.1.smithi119.stdout:2/150: creat d6/f33 x:0 0 0 2023-12-17T11:57:35.479 INFO:tasks.workunit.client.0.smithi002.stdout:1/192: rename d3/d6/d9/d30/f2c to d3/d6/d9/f3c 0 2023-12-17T11:57:35.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/157: read d6/d17/d16/d1d/d24/f31 [1629135,115198] 0 2023-12-17T11:57:35.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/158: fdatasync d6/f1c 0 2023-12-17T11:57:35.482 INFO:tasks.workunit.client.0.smithi002.stdout:5/114: mkdir dc/d17/d1c 0 2023-12-17T11:57:35.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/115: dread - dc/d17/f19 zero size 2023-12-17T11:57:35.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/116: chown dc/d1a 25838139 1 2023-12-17T11:57:35.485 INFO:tasks.workunit.client.0.smithi002.stdout:3/220: unlink d9/d1b/c2f 0 2023-12-17T11:57:35.487 INFO:tasks.workunit.client.1.smithi119.stdout:3/151: creat d9/da/df/f34 x:0 0 0 2023-12-17T11:57:35.487 INFO:tasks.workunit.client.1.smithi119.stdout:3/152: read d9/da/f30 [67472,40289] 0 2023-12-17T11:57:35.488 INFO:tasks.workunit.client.0.smithi002.stdout:8/177: mkdir d3/d7/d18/d3f 0 2023-12-17T11:57:35.489 INFO:tasks.workunit.client.0.smithi002.stdout:8/178: fdatasync d3/d8/da/d13/f3b 0 2023-12-17T11:57:35.489 INFO:tasks.workunit.client.1.smithi119.stdout:1/84: getdents d3 0 2023-12-17T11:57:35.490 INFO:tasks.workunit.client.0.smithi002.stdout:6/138: mkdir d0/d1/d28 0 2023-12-17T11:57:35.491 INFO:tasks.workunit.client.0.smithi002.stdout:9/191: mknod dc/d38/c45 0 2023-12-17T11:57:35.491 INFO:tasks.workunit.client.0.smithi002.stdout:3/221: dread d9/d15/f19 [0,4194304] 0 2023-12-17T11:57:35.492 INFO:tasks.workunit.client.0.smithi002.stdout:0/122: rename d0/ff to d0/d6/d26/d14/f2a 0 2023-12-17T11:57:35.493 INFO:tasks.workunit.client.1.smithi119.stdout:8/95: creat d7/d18/d15/f21 x:0 0 0 2023-12-17T11:57:35.495 INFO:tasks.workunit.client.1.smithi119.stdout:4/90: creat dd/d15/d16/f1e x:0 0 0 2023-12-17T11:57:35.495 INFO:tasks.workunit.client.1.smithi119.stdout:4/91: chown dd/l10 1 1 2023-12-17T11:57:35.496 INFO:tasks.workunit.client.0.smithi002.stdout:4/174: dwrite d0/d10/d21/d33/f35 [0,4194304] 0 2023-12-17T11:57:35.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/175: truncate d0/d10/d21/d33/f37 550085 0 2023-12-17T11:57:35.498 INFO:tasks.workunit.client.0.smithi002.stdout:5/117: symlink dc/l1d 0 2023-12-17T11:57:35.498 INFO:tasks.workunit.client.0.smithi002.stdout:3/222: mkdir d9/d1b/d35/d41/d49 0 2023-12-17T11:57:35.498 INFO:tasks.workunit.client.1.smithi119.stdout:7/204: truncate d2/d4/f28 3527280 0 2023-12-17T11:57:35.499 INFO:tasks.workunit.client.0.smithi002.stdout:7/159: rename d6/c11 to d6/d17/c33 0 2023-12-17T11:57:35.499 INFO:tasks.workunit.client.1.smithi119.stdout:6/142: symlink d2/l28 0 2023-12-17T11:57:35.501 INFO:tasks.workunit.client.1.smithi119.stdout:2/151: mkdir d6/d9/d13/d34 0 2023-12-17T11:57:35.503 INFO:tasks.workunit.client.1.smithi119.stdout:9/172: getdents d12/d1d 0 2023-12-17T11:57:35.507 INFO:tasks.workunit.client.1.smithi119.stdout:3/153: mkdir d9/d35 0 2023-12-17T11:57:35.507 INFO:tasks.workunit.client.1.smithi119.stdout:3/154: chown f5 233375 1 2023-12-17T11:57:35.507 INFO:tasks.workunit.client.0.smithi002.stdout:5/118: symlink dc/l1e 0 2023-12-17T11:57:35.509 INFO:tasks.workunit.client.0.smithi002.stdout:3/223: link d9/d15/c3c d9/d1b/d35/d41/c4a 0 2023-12-17T11:57:35.510 INFO:tasks.workunit.client.1.smithi119.stdout:1/85: creat d3/db/d17/f1b x:0 0 0 2023-12-17T11:57:35.511 INFO:tasks.workunit.client.1.smithi119.stdout:1/86: write d3/d7/f8 [4723471,48811] 0 2023-12-17T11:57:35.511 INFO:tasks.workunit.client.1.smithi119.stdout:8/96: creat d7/da/f22 x:0 0 0 2023-12-17T11:57:35.512 INFO:tasks.workunit.client.0.smithi002.stdout:7/160: symlink d6/d17/dc/d13/l34 0 2023-12-17T11:57:35.513 INFO:tasks.workunit.client.1.smithi119.stdout:4/92: truncate f2 1325687 0 2023-12-17T11:57:35.515 INFO:tasks.workunit.client.1.smithi119.stdout:6/143: link d2/c20 d2/df/c29 0 2023-12-17T11:57:35.515 INFO:tasks.workunit.client.1.smithi119.stdout:6/144: readlink d2/df/l18 0 2023-12-17T11:57:35.516 INFO:tasks.workunit.client.1.smithi119.stdout:6/145: chown d2/f7 815 1 2023-12-17T11:57:35.516 INFO:tasks.workunit.client.1.smithi119.stdout:3/155: mknod d9/d11/c36 0 2023-12-17T11:57:35.518 INFO:tasks.workunit.client.0.smithi002.stdout:6/139: dread d0/f1a [0,4194304] 0 2023-12-17T11:57:35.518 INFO:tasks.workunit.client.0.smithi002.stdout:6/140: dread - d0/d1/dc/d10/f19 zero size 2023-12-17T11:57:35.518 INFO:tasks.workunit.client.1.smithi119.stdout:1/87: mknod d3/c1c 0 2023-12-17T11:57:35.519 INFO:tasks.workunit.client.1.smithi119.stdout:8/97: mkdir d7/d12/d23 0 2023-12-17T11:57:35.519 INFO:tasks.workunit.client.1.smithi119.stdout:8/98: chown c4 38 1 2023-12-17T11:57:35.520 INFO:tasks.workunit.client.0.smithi002.stdout:7/161: truncate d6/f1c 1664643 0 2023-12-17T11:57:35.520 INFO:tasks.workunit.client.0.smithi002.stdout:7/162: chown d6/d17/dc/d13/d21/d2e 1810757 1 2023-12-17T11:57:35.521 INFO:tasks.workunit.client.0.smithi002.stdout:7/163: write d6/d17/dc/d13/f2d [867976,102547] 0 2023-12-17T11:57:35.522 INFO:tasks.workunit.client.0.smithi002.stdout:5/119: dread f7 [0,4194304] 0 2023-12-17T11:57:35.522 INFO:tasks.workunit.client.0.smithi002.stdout:5/120: chown f8 45637 1 2023-12-17T11:57:35.522 INFO:tasks.workunit.client.0.smithi002.stdout:5/121: stat dc/d1a 0 2023-12-17T11:57:35.525 INFO:tasks.workunit.client.1.smithi119.stdout:4/93: symlink dd/d15/l1f 0 2023-12-17T11:57:35.525 INFO:tasks.workunit.client.1.smithi119.stdout:5/184: dwrite d1/f33 [0,4194304] 0 2023-12-17T11:57:35.525 INFO:tasks.workunit.client.1.smithi119.stdout:3/156: creat d9/d11/d1e/f37 x:0 0 0 2023-12-17T11:57:35.525 INFO:tasks.workunit.client.1.smithi119.stdout:3/157: write d9/d11/d1e/f37 [365854,111185] 0 2023-12-17T11:57:35.532 INFO:tasks.workunit.client.1.smithi119.stdout:1/88: rename d3/d7/f8 to d3/d5/f1d 0 2023-12-17T11:57:35.532 INFO:tasks.workunit.client.1.smithi119.stdout:4/94: dread dd/f18 [0,4194304] 0 2023-12-17T11:57:35.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/95: write dd/d15/d16/f1e [369530,80752] 0 2023-12-17T11:57:35.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/96: chown lc 1 1 2023-12-17T11:57:35.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/97: stat f4 0 2023-12-17T11:57:35.537 INFO:tasks.workunit.client.1.smithi119.stdout:8/99: creat d7/d12/d1f/f24 x:0 0 0 2023-12-17T11:57:35.537 INFO:tasks.workunit.client.0.smithi002.stdout:7/164: unlink d6/d17/l10 0 2023-12-17T11:57:35.542 INFO:tasks.workunit.client.0.smithi002.stdout:5/122: symlink dc/d17/l1f 0 2023-12-17T11:57:35.546 INFO:tasks.workunit.client.0.smithi002.stdout:6/141: symlink d0/d1/l29 0 2023-12-17T11:57:35.546 INFO:tasks.workunit.client.0.smithi002.stdout:6/142: read - d0/d1/dc/d10/f14 zero size 2023-12-17T11:57:35.546 INFO:tasks.workunit.client.0.smithi002.stdout:6/143: chown d0/d1/dc/d10/l1d 7360 1 2023-12-17T11:57:35.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/185: mkdir d1/d36/d3a 0 2023-12-17T11:57:35.547 INFO:tasks.workunit.client.0.smithi002.stdout:7/165: unlink d6/d17/c26 0 2023-12-17T11:57:35.547 INFO:tasks.workunit.client.0.smithi002.stdout:8/179: dwrite d3/d8/da/dd/f35 [0,4194304] 0 2023-12-17T11:57:35.548 INFO:tasks.workunit.client.1.smithi119.stdout:1/89: creat d3/d5/d19/f1e x:0 0 0 2023-12-17T11:57:35.550 INFO:tasks.workunit.client.1.smithi119.stdout:4/98: truncate f1 2974381 0 2023-12-17T11:57:35.556 INFO:tasks.workunit.client.1.smithi119.stdout:5/186: rename d1/f28 to d1/d25/d39/f3b 0 2023-12-17T11:57:35.556 INFO:tasks.workunit.client.1.smithi119.stdout:1/90: truncate d3/d7/f14 285100 0 2023-12-17T11:57:35.556 INFO:tasks.workunit.client.1.smithi119.stdout:5/187: write d1/d25/f38 [986853,54809] 0 2023-12-17T11:57:35.561 INFO:tasks.workunit.client.1.smithi119.stdout:4/99: mkdir dd/d15/d16/d20 0 2023-12-17T11:57:35.565 INFO:tasks.workunit.client.1.smithi119.stdout:5/188: creat d1/d25/d39/f3c x:0 0 0 2023-12-17T11:57:35.565 INFO:tasks.workunit.client.0.smithi002.stdout:8/180: creat d3/f40 x:0 0 0 2023-12-17T11:57:35.565 INFO:tasks.workunit.client.0.smithi002.stdout:6/144: mknod d0/d1/c2a 0 2023-12-17T11:57:35.565 INFO:tasks.workunit.client.0.smithi002.stdout:7/166: getdents d6/d17/dc/d13/d21 0 2023-12-17T11:57:35.566 INFO:tasks.workunit.client.0.smithi002.stdout:6/145: truncate d0/d1/f23 623224 0 2023-12-17T11:57:35.570 INFO:tasks.workunit.client.1.smithi119.stdout:5/189: rename d1/f23 to d1/d36/f3d 0 2023-12-17T11:57:35.571 INFO:tasks.workunit.client.1.smithi119.stdout:2/152: dwrite d6/d9/fd [0,4194304] 0 2023-12-17T11:57:35.575 INFO:tasks.workunit.client.1.smithi119.stdout:2/153: getdents d6/d2b 0 2023-12-17T11:57:35.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/100: dread dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:35.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/101: creat dd/f21 x:0 0 0 2023-12-17T11:57:35.589 INFO:tasks.workunit.client.1.smithi119.stdout:0/94: dwrite d2/d16/f11 [0,4194304] 0 2023-12-17T11:57:35.589 INFO:tasks.workunit.client.1.smithi119.stdout:0/95: fsync d2/d3/d5/f19 0 2023-12-17T11:57:35.591 INFO:tasks.workunit.client.1.smithi119.stdout:7/205: unlink d2/l6 0 2023-12-17T11:57:35.596 INFO:tasks.workunit.client.1.smithi119.stdout:0/96: rmdir d2/d16/d12/d18 0 2023-12-17T11:57:35.596 INFO:tasks.workunit.client.1.smithi119.stdout:0/97: chown d2/d3/d5/ld 220 1 2023-12-17T11:57:35.597 INFO:tasks.workunit.client.0.smithi002.stdout:9/192: dwrite dc/d1d/d23/d24/f3a [0,4194304] 0 2023-12-17T11:57:35.601 INFO:tasks.workunit.client.1.smithi119.stdout:7/206: creat d2/d4/d3e/f41 x:0 0 0 2023-12-17T11:57:35.601 INFO:tasks.workunit.client.1.smithi119.stdout:0/98: dread d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:35.611 INFO:tasks.workunit.client.0.smithi002.stdout:8/181: dread d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:35.612 INFO:tasks.workunit.client.0.smithi002.stdout:3/224: dwrite d9/d1b/f1c [4194304,4194304] 0 2023-12-17T11:57:35.612 INFO:tasks.workunit.client.0.smithi002.stdout:5/123: dwrite f8 [8388608,4194304] 0 2023-12-17T11:57:35.616 INFO:tasks.workunit.client.1.smithi119.stdout:0/99: link d2/d3/f14 d2/d16/d12/f1c 0 2023-12-17T11:57:35.616 INFO:tasks.workunit.client.1.smithi119.stdout:9/173: dwrite f11 [0,4194304] 0 2023-12-17T11:57:35.617 INFO:tasks.workunit.client.1.smithi119.stdout:6/146: dwrite d2/df/f24 [0,4194304] 0 2023-12-17T11:57:35.617 INFO:tasks.workunit.client.1.smithi119.stdout:6/147: stat d2/l28 0 2023-12-17T11:57:35.617 INFO:tasks.workunit.client.1.smithi119.stdout:6/148: chown d2/c10 0 1 2023-12-17T11:57:35.618 INFO:tasks.workunit.client.0.smithi002.stdout:5/124: truncate fa 964811 0 2023-12-17T11:57:35.618 INFO:tasks.workunit.client.0.smithi002.stdout:5/125: write f8 [732113,48128] 0 2023-12-17T11:57:35.619 INFO:tasks.workunit.client.0.smithi002.stdout:0/123: dwrite d0/f22 [0,4194304] 0 2023-12-17T11:57:35.622 INFO:tasks.workunit.client.1.smithi119.stdout:0/100: mknod d2/d3/d5/dc/c1d 0 2023-12-17T11:57:35.626 INFO:tasks.workunit.client.1.smithi119.stdout:8/100: dwrite d7/da/d1a/f1c [8388608,4194304] 0 2023-12-17T11:57:35.629 INFO:tasks.workunit.client.0.smithi002.stdout:7/167: dwrite d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:35.632 INFO:tasks.workunit.client.1.smithi119.stdout:2/154: write d6/d9/f1b [3716213,14267] 0 2023-12-17T11:57:35.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/126: rename dc/d17/f19 to dc/d17/d1c/f20 0 2023-12-17T11:57:35.637 INFO:tasks.workunit.client.1.smithi119.stdout:9/174: getdents d12/d1d/d28 0 2023-12-17T11:57:35.637 INFO:tasks.workunit.client.0.smithi002.stdout:4/176: dwrite d0/fb [0,4194304] 0 2023-12-17T11:57:35.645 INFO:tasks.workunit.client.1.smithi119.stdout:8/101: read d7/f16 [3670792,95110] 0 2023-12-17T11:57:35.645 INFO:tasks.workunit.client.1.smithi119.stdout:8/102: chown d7/da/d11/f13 124 1 2023-12-17T11:57:35.646 INFO:tasks.workunit.client.1.smithi119.stdout:6/149: truncate d2/f5 2513288 0 2023-12-17T11:57:35.650 INFO:tasks.workunit.client.1.smithi119.stdout:1/91: rmdir d3/d7 39 2023-12-17T11:57:35.653 INFO:tasks.workunit.client.0.smithi002.stdout:4/177: write d0/f8 [825491,128936] 0 2023-12-17T11:57:35.653 INFO:tasks.workunit.client.0.smithi002.stdout:3/225: dread d9/d15/f2b [0,4194304] 0 2023-12-17T11:57:35.655 INFO:tasks.workunit.client.1.smithi119.stdout:8/103: creat d7/d12/f25 x:0 0 0 2023-12-17T11:57:35.655 INFO:tasks.workunit.client.1.smithi119.stdout:0/101: symlink d2/d3/d5/l1e 0 2023-12-17T11:57:35.658 INFO:tasks.workunit.client.0.smithi002.stdout:9/193: dwrite f2 [0,4194304] 0 2023-12-17T11:57:35.658 INFO:tasks.workunit.client.0.smithi002.stdout:9/194: write dc/d1d/d23/f2e [3483367,74011] 0 2023-12-17T11:57:35.658 INFO:tasks.workunit.client.1.smithi119.stdout:7/207: dwrite d2/f25 [4194304,4194304] 0 2023-12-17T11:57:35.661 INFO:tasks.workunit.client.0.smithi002.stdout:7/168: truncate d6/d17/dc/d13/f2d 671192 0 2023-12-17T11:57:35.661 INFO:tasks.workunit.client.1.smithi119.stdout:4/102: dwrite f4 [0,4194304] 0 2023-12-17T11:57:35.662 INFO:tasks.workunit.client.1.smithi119.stdout:5/190: dwrite d1/f21 [0,4194304] 0 2023-12-17T11:57:35.662 INFO:tasks.workunit.client.1.smithi119.stdout:5/191: write d1/d25/f2c [1089441,12420] 0 2023-12-17T11:57:35.662 INFO:tasks.workunit.client.1.smithi119.stdout:5/192: dread - d1/f20 zero size 2023-12-17T11:57:35.663 INFO:tasks.workunit.client.0.smithi002.stdout:8/182: dwrite d3/f25 [4194304,4194304] 0 2023-12-17T11:57:35.663 INFO:tasks.workunit.client.0.smithi002.stdout:3/226: mkdir d9/d1b/d35/d41/d43/d4b 0 2023-12-17T11:57:35.664 INFO:tasks.workunit.client.0.smithi002.stdout:3/227: write f7 [5445233,42886] 0 2023-12-17T11:57:35.664 INFO:tasks.workunit.client.0.smithi002.stdout:3/228: write d9/d24/f25 [811066,127103] 0 2023-12-17T11:57:35.664 INFO:tasks.workunit.client.0.smithi002.stdout:3/229: chown d9/l27 0 1 2023-12-17T11:57:35.664 INFO:tasks.workunit.client.1.smithi119.stdout:1/92: rmdir d3/db 39 2023-12-17T11:57:35.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/102: unlink d2/d16/f11 0 2023-12-17T11:57:35.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/103: fsync d2/d3/d5/f19 0 2023-12-17T11:57:35.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/104: chown d2/d16 102370 1 2023-12-17T11:57:35.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/105: truncate d2/fe 1912182 0 2023-12-17T11:57:35.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/106: stat d2/d16/f17 0 2023-12-17T11:57:35.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/107: readlink d2/d3/d5/l1e 0 2023-12-17T11:57:35.672 INFO:tasks.workunit.client.1.smithi119.stdout:7/208: link d2/d4/d11/f3d d2/d4/d11/d2c/f42 0 2023-12-17T11:57:35.677 INFO:tasks.workunit.client.0.smithi002.stdout:9/195: creat dc/d1d/d23/f46 x:0 0 0 2023-12-17T11:57:35.679 INFO:tasks.workunit.client.0.smithi002.stdout:5/127: write fa [332163,98148] 0 2023-12-17T11:57:35.679 INFO:tasks.workunit.client.0.smithi002.stdout:5/128: chown dc/d17/l1f 425 1 2023-12-17T11:57:35.683 INFO:tasks.workunit.client.0.smithi002.stdout:7/169: creat d6/d17/d16/d1d/f35 x:0 0 0 2023-12-17T11:57:35.688 INFO:tasks.workunit.client.1.smithi119.stdout:1/93: dread d3/d5/f1d [0,4194304] 0 2023-12-17T11:57:35.694 INFO:tasks.workunit.client.0.smithi002.stdout:8/183: mknod d3/d8/da/d13/c41 0 2023-12-17T11:57:35.694 INFO:tasks.workunit.client.0.smithi002.stdout:8/184: creat d3/d8/f42 x:0 0 0 2023-12-17T11:57:35.695 INFO:tasks.workunit.client.0.smithi002.stdout:8/185: stat d3/d7/f27 0 2023-12-17T11:57:35.696 INFO:tasks.workunit.client.1.smithi119.stdout:7/209: dread d2/d4/f16 [4194304,4194304] 0 2023-12-17T11:57:35.696 INFO:tasks.workunit.client.1.smithi119.stdout:7/210: read - d2/f35 zero size 2023-12-17T11:57:35.702 INFO:tasks.workunit.client.1.smithi119.stdout:5/193: chown d1/d25/l27 35858 1 2023-12-17T11:57:35.704 INFO:tasks.workunit.client.0.smithi002.stdout:3/230: rename l4 to d9/d24/l4c 0 2023-12-17T11:57:35.704 INFO:tasks.workunit.client.0.smithi002.stdout:9/196: mkdir dc/d1d/d23/d24/d47 0 2023-12-17T11:57:35.704 INFO:tasks.workunit.client.0.smithi002.stdout:9/197: chown dc/d1d/d23 373467 1 2023-12-17T11:57:35.705 INFO:tasks.workunit.client.1.smithi119.stdout:1/94: rmdir d3/d7 39 2023-12-17T11:57:35.705 INFO:tasks.workunit.client.1.smithi119.stdout:1/95: readlink d3/d7/l18 0 2023-12-17T11:57:35.708 INFO:tasks.workunit.client.0.smithi002.stdout:4/178: dwrite d0/d10/d21/f36 [0,4194304] 0 2023-12-17T11:57:35.708 INFO:tasks.workunit.client.0.smithi002.stdout:4/179: dread - d0/f19 zero size 2023-12-17T11:57:35.711 INFO:tasks.workunit.client.0.smithi002.stdout:4/180: write d0/d10/f40 [780829,38951] 0 2023-12-17T11:57:35.711 INFO:tasks.workunit.client.0.smithi002.stdout:7/170: mknod d6/d17/dc/d13/d21/c36 0 2023-12-17T11:57:35.711 INFO:tasks.workunit.client.0.smithi002.stdout:7/171: chown d6/d17/d16/c2c 504557 1 2023-12-17T11:57:35.711 INFO:tasks.workunit.client.1.smithi119.stdout:7/211: rename d2/d4/d3e/f41 to d2/d4/d11/f43 0 2023-12-17T11:57:35.713 INFO:tasks.workunit.client.1.smithi119.stdout:4/103: getdents dd 0 2023-12-17T11:57:35.713 INFO:tasks.workunit.client.1.smithi119.stdout:4/104: chown dd/f1d 84872232 1 2023-12-17T11:57:35.714 INFO:tasks.workunit.client.0.smithi002.stdout:8/186: symlink d3/d8/da/l43 0 2023-12-17T11:57:35.714 INFO:tasks.workunit.client.0.smithi002.stdout:4/181: dread d0/d10/d21/f2f [0,4194304] 0 2023-12-17T11:57:35.715 INFO:tasks.workunit.client.0.smithi002.stdout:3/231: dread d9/d15/f16 [0,4194304] 0 2023-12-17T11:57:35.715 INFO:tasks.workunit.client.1.smithi119.stdout:1/96: creat d3/db/f1f x:0 0 0 2023-12-17T11:57:35.715 INFO:tasks.workunit.client.1.smithi119.stdout:1/97: truncate d3/d7/f1a 881674 0 2023-12-17T11:57:35.728 INFO:tasks.workunit.client.1.smithi119.stdout:7/212: mknod d2/d4/c44 0 2023-12-17T11:57:35.728 INFO:tasks.workunit.client.1.smithi119.stdout:7/213: dread - d2/d4/d11/f43 zero size 2023-12-17T11:57:35.728 INFO:tasks.workunit.client.1.smithi119.stdout:2/155: dwrite d6/f33 [0,4194304] 0 2023-12-17T11:57:35.728 INFO:tasks.workunit.client.1.smithi119.stdout:9/175: dwrite fe [0,4194304] 0 2023-12-17T11:57:35.728 INFO:tasks.workunit.client.1.smithi119.stdout:8/104: dwrite d7/ff [0,4194304] 0 2023-12-17T11:57:35.728 INFO:tasks.workunit.client.1.smithi119.stdout:8/105: fsync d7/d12/f25 0 2023-12-17T11:57:35.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/198: getdents dc/d32 0 2023-12-17T11:57:35.732 INFO:tasks.workunit.client.0.smithi002.stdout:9/199: write dc/f11 [738277,75116] 0 2023-12-17T11:57:35.732 INFO:tasks.workunit.client.1.smithi119.stdout:1/98: mkdir d3/d7/d20 0 2023-12-17T11:57:35.732 INFO:tasks.workunit.client.1.smithi119.stdout:1/99: read - d3/db/d17/f1b zero size 2023-12-17T11:57:35.732 INFO:tasks.workunit.client.1.smithi119.stdout:1/100: chown d3/c1c 75135 1 2023-12-17T11:57:35.733 INFO:tasks.workunit.client.1.smithi119.stdout:1/101: chown d3/fa 6 1 2023-12-17T11:57:35.733 INFO:tasks.workunit.client.0.smithi002.stdout:2/158: sync 2023-12-17T11:57:35.733 INFO:tasks.workunit.client.0.smithi002.stdout:2/159: rename d3/d4/d7/d14/d2e/d37 to d3/d4/d7/d14/d2e/d37/d38 22 2023-12-17T11:57:35.737 INFO:tasks.workunit.client.0.smithi002.stdout:7/172: dread d6/d17/dc/d13/f2d [0,4194304] 0 2023-12-17T11:57:35.737 INFO:tasks.workunit.client.0.smithi002.stdout:7/173: fdatasync d6/d17/dc/d13/f30 0 2023-12-17T11:57:35.739 INFO:tasks.workunit.client.1.smithi119.stdout:9/176: dread d12/f17 [4194304,4194304] 0 2023-12-17T11:57:35.739 INFO:tasks.workunit.client.1.smithi119.stdout:9/177: chown d12/f37 62 1 2023-12-17T11:57:35.739 INFO:tasks.workunit.client.1.smithi119.stdout:9/178: fdatasync ff 0 2023-12-17T11:57:35.741 INFO:tasks.workunit.client.1.smithi119.stdout:2/156: mknod d6/d9/d13/d1d/d2c/c35 0 2023-12-17T11:57:35.741 INFO:tasks.workunit.client.1.smithi119.stdout:1/102: truncate d3/fa 1010410 0 2023-12-17T11:57:35.746 INFO:tasks.workunit.client.0.smithi002.stdout:4/182: mkdir d0/d3e/d41 0 2023-12-17T11:57:35.747 INFO:tasks.workunit.client.0.smithi002.stdout:3/232: symlink d9/d1b/d35/d41/d43/l4d 0 2023-12-17T11:57:35.747 INFO:tasks.workunit.client.0.smithi002.stdout:2/160: link d3/d4/d7/d14/d1b/l1d d3/d4/d7/d14/l39 0 2023-12-17T11:57:35.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/200: unlink f2 0 2023-12-17T11:57:35.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/201: write dc/f15 [838890,95736] 0 2023-12-17T11:57:35.751 INFO:tasks.workunit.client.1.smithi119.stdout:6/150: dwrite d2/f26 [0,4194304] 0 2023-12-17T11:57:35.751 INFO:tasks.workunit.client.1.smithi119.stdout:6/151: chown d2/df/f1f 67833 1 2023-12-17T11:57:35.752 INFO:tasks.workunit.client.0.smithi002.stdout:3/233: mknod d9/d1b/c4e 0 2023-12-17T11:57:35.756 INFO:tasks.workunit.client.0.smithi002.stdout:2/161: creat d3/d4/f3a x:0 0 0 2023-12-17T11:57:35.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/174: rmdir d6 39 2023-12-17T11:57:35.761 INFO:tasks.workunit.client.0.smithi002.stdout:7/175: chown d6/d17/l19 15017 1 2023-12-17T11:57:35.762 INFO:tasks.workunit.client.1.smithi119.stdout:9/179: write fe [2597820,39552] 0 2023-12-17T11:57:35.762 INFO:tasks.workunit.client.1.smithi119.stdout:0/108: dwrite d2/d3/d5/f19 [4194304,4194304] 0 2023-12-17T11:57:35.765 INFO:tasks.workunit.client.0.smithi002.stdout:8/187: rename d3/d8/da/d13 to d3/d8/da/d44 0 2023-12-17T11:57:35.767 INFO:tasks.workunit.client.0.smithi002.stdout:9/202: creat dc/d1d/d23/d24/d47/f48 x:0 0 0 2023-12-17T11:57:35.767 INFO:tasks.workunit.client.0.smithi002.stdout:9/203: fdatasync dc/d1d/d23/f46 0 2023-12-17T11:57:35.768 INFO:tasks.workunit.client.0.smithi002.stdout:3/234: mkdir d9/d1b/d4f 0 2023-12-17T11:57:35.769 INFO:tasks.workunit.client.0.smithi002.stdout:3/235: write d9/f11 [424780,2058] 0 2023-12-17T11:57:35.771 INFO:tasks.workunit.client.0.smithi002.stdout:1/193: sync 2023-12-17T11:57:35.777 INFO:tasks.workunit.client.1.smithi119.stdout:2/157: dread d6/d9/fd [0,4194304] 0 2023-12-17T11:57:35.780 INFO:tasks.workunit.client.0.smithi002.stdout:2/162: mknod d3/d4/d7/d14/c3b 0 2023-12-17T11:57:35.782 INFO:tasks.workunit.client.0.smithi002.stdout:4/183: getdents d0/d3e 0 2023-12-17T11:57:35.782 INFO:tasks.workunit.client.0.smithi002.stdout:4/184: truncate d0/f8 1497957 0 2023-12-17T11:57:35.783 INFO:tasks.workunit.client.0.smithi002.stdout:7/176: mkdir d6/d17/dc/d13/d37 0 2023-12-17T11:57:35.790 INFO:tasks.workunit.client.0.smithi002.stdout:8/188: symlink d3/d8/d28/l45 0 2023-12-17T11:57:35.790 INFO:tasks.workunit.client.0.smithi002.stdout:8/189: write d3/d8/f42 [966685,54787] 0 2023-12-17T11:57:35.791 INFO:tasks.workunit.client.1.smithi119.stdout:5/194: dwrite d1/f1e [0,4194304] 0 2023-12-17T11:57:35.792 INFO:tasks.workunit.client.0.smithi002.stdout:1/194: creat d3/d6/d9/d30/f3d x:0 0 0 2023-12-17T11:57:35.793 INFO:tasks.workunit.client.0.smithi002.stdout:1/195: creat d3/d6/f3e x:0 0 0 2023-12-17T11:57:35.793 INFO:tasks.workunit.client.0.smithi002.stdout:1/196: write d3/ff [2368814,48954] 0 2023-12-17T11:57:35.795 INFO:tasks.workunit.client.0.smithi002.stdout:2/163: rename d3/d4/l12 to d3/d4/d7/d14/l3c 0 2023-12-17T11:57:35.795 INFO:tasks.workunit.client.0.smithi002.stdout:2/164: chown d3/d4/d17/d19/f24 1055 1 2023-12-17T11:57:35.798 INFO:tasks.workunit.client.0.smithi002.stdout:9/204: dread dc/f11 [0,4194304] 0 2023-12-17T11:57:35.800 INFO:tasks.workunit.client.1.smithi119.stdout:8/106: dwrite d7/fb [0,4194304] 0 2023-12-17T11:57:35.803 INFO:tasks.workunit.client.0.smithi002.stdout:4/185: link d0/d10/f40 d0/d10/d21/f42 0 2023-12-17T11:57:35.807 INFO:tasks.workunit.client.1.smithi119.stdout:6/152: write d2/df/f24 [342369,82051] 0 2023-12-17T11:57:35.807 INFO:tasks.workunit.client.1.smithi119.stdout:9/180: creat d12/d1d/d28/f38 x:0 0 0 2023-12-17T11:57:35.809 INFO:tasks.workunit.client.0.smithi002.stdout:7/177: dread d6/d17/d16/d1d/d24/f31 [0,4194304] 0 2023-12-17T11:57:35.812 INFO:tasks.workunit.client.1.smithi119.stdout:2/158: mknod d6/c36 0 2023-12-17T11:57:35.812 INFO:tasks.workunit.client.1.smithi119.stdout:5/195: symlink d1/d36/d3a/l3e 0 2023-12-17T11:57:35.813 INFO:tasks.workunit.client.0.smithi002.stdout:1/197: mknod d3/d6/d9/d37/d39/c3f 0 2023-12-17T11:57:35.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/165: symlink d3/d4/d7/d14/d2e/l3d 0 2023-12-17T11:57:35.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/166: chown d3/d4/d7/d14 152788513 1 2023-12-17T11:57:35.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/167: rename d3 to d3/d4/d7/d14/d3e 22 2023-12-17T11:57:35.816 INFO:tasks.workunit.client.1.smithi119.stdout:8/107: mkdir d7/da/d11/d26 0 2023-12-17T11:57:35.817 INFO:tasks.workunit.client.0.smithi002.stdout:9/205: mkdir dc/d1d/d23/d24/d49 0 2023-12-17T11:57:35.819 INFO:tasks.workunit.client.1.smithi119.stdout:5/196: symlink d1/d36/l3f 0 2023-12-17T11:57:35.819 INFO:tasks.workunit.client.1.smithi119.stdout:5/197: write d1/d36/f3d [893865,45287] 0 2023-12-17T11:57:35.821 INFO:tasks.workunit.client.1.smithi119.stdout:7/214: dwrite d2/f19 [0,4194304] 0 2023-12-17T11:57:35.822 INFO:tasks.workunit.client.1.smithi119.stdout:8/108: creat d7/f27 x:0 0 0 2023-12-17T11:57:35.822 INFO:tasks.workunit.client.1.smithi119.stdout:8/109: dread - d7/d18/d15/f21 zero size 2023-12-17T11:57:35.823 INFO:tasks.workunit.client.0.smithi002.stdout:7/178: unlink l5 0 2023-12-17T11:57:35.824 INFO:tasks.workunit.client.0.smithi002.stdout:1/198: symlink d3/d6/d9/d30/l40 0 2023-12-17T11:57:35.824 INFO:tasks.workunit.client.0.smithi002.stdout:1/199: creat d3/d6/d9/d30/f41 x:0 0 0 2023-12-17T11:57:35.825 INFO:tasks.workunit.client.0.smithi002.stdout:3/236: dwrite f5 [0,4194304] 0 2023-12-17T11:57:35.825 INFO:tasks.workunit.client.0.smithi002.stdout:3/237: chown d9/f29 1368879147 1 2023-12-17T11:57:35.825 INFO:tasks.workunit.client.0.smithi002.stdout:3/238: chown d9/d1b/d4f 172496265 1 2023-12-17T11:57:35.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/168: rename d3/d4/d7/d14/d1b/d31 to d3/d4/d7/d14/d2e/d37/d3f 0 2023-12-17T11:57:35.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/169: getdents d3/d4/d7/d14/d34 0 2023-12-17T11:57:35.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/170: chown d3/l35 91978 1 2023-12-17T11:57:35.829 INFO:tasks.workunit.client.1.smithi119.stdout:0/109: dwrite d2/d16/d12/f1a [0,4194304] 0 2023-12-17T11:57:35.831 INFO:tasks.workunit.client.1.smithi119.stdout:4/105: dwrite dd/f21 [0,4194304] 0 2023-12-17T11:57:35.832 INFO:tasks.workunit.client.0.smithi002.stdout:2/171: fdatasync d3/d4/f5 0 2023-12-17T11:57:35.832 INFO:tasks.workunit.client.1.smithi119.stdout:7/215: getdents d2/d4/d3e 0 2023-12-17T11:57:35.832 INFO:tasks.workunit.client.1.smithi119.stdout:7/216: read - d2/d4/d11/f21 zero size 2023-12-17T11:57:35.832 INFO:tasks.workunit.client.1.smithi119.stdout:7/217: write d2/f35 [599823,58490] 0 2023-12-17T11:57:35.832 INFO:tasks.workunit.client.0.smithi002.stdout:7/179: symlink d6/d17/dc/d13/l38 0 2023-12-17T11:57:35.834 INFO:tasks.workunit.client.1.smithi119.stdout:8/110: rmdir d7/d12/d1f 39 2023-12-17T11:57:35.834 INFO:tasks.workunit.client.1.smithi119.stdout:8/111: truncate d7/da/d11/f1d 879826 0 2023-12-17T11:57:35.839 INFO:tasks.workunit.client.1.smithi119.stdout:6/153: read d2/f19 [5110003,86289] 0 2023-12-17T11:57:35.844 INFO:tasks.workunit.client.1.smithi119.stdout:5/198: symlink d1/d25/l40 0 2023-12-17T11:57:35.849 INFO:tasks.workunit.client.1.smithi119.stdout:4/106: mknod dd/d15/d16/c22 0 2023-12-17T11:57:35.850 INFO:tasks.workunit.client.1.smithi119.stdout:8/112: creat d7/da/d11/d26/f28 x:0 0 0 2023-12-17T11:57:35.853 INFO:tasks.workunit.client.1.smithi119.stdout:6/154: creat d2/df/d17/f2a x:0 0 0 2023-12-17T11:57:35.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/172: write d3/d4/fe [1963026,106208] 0 2023-12-17T11:57:35.858 INFO:tasks.workunit.client.1.smithi119.stdout:5/199: truncate d1/f21 195999 0 2023-12-17T11:57:35.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/190: dwrite d3/d8/da/dd/f2d [0,4194304] 0 2023-12-17T11:57:35.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/191: truncate d3/d8/da/d29/f3a 926804 0 2023-12-17T11:57:35.859 INFO:tasks.workunit.client.1.smithi119.stdout:7/218: dread d2/f10 [0,4194304] 0 2023-12-17T11:57:35.862 INFO:tasks.workunit.client.1.smithi119.stdout:4/107: rename l7 to dd/d15/d16/l23 0 2023-12-17T11:57:35.863 INFO:tasks.workunit.client.1.smithi119.stdout:6/155: dread d2/df/f1f [0,4194304] 0 2023-12-17T11:57:35.864 INFO:tasks.workunit.client.1.smithi119.stdout:5/200: write d1/f1a [29595,4572] 0 2023-12-17T11:57:35.865 INFO:tasks.workunit.client.1.smithi119.stdout:9/181: rmdir d12/d1d/d28 39 2023-12-17T11:57:35.870 INFO:tasks.workunit.client.1.smithi119.stdout:7/219: rename d2/d4/d1f/f2e to d2/d4/d3e/f45 0 2023-12-17T11:57:35.870 INFO:tasks.workunit.client.1.smithi119.stdout:7/220: dread - d2/d4/f38 zero size 2023-12-17T11:57:35.872 INFO:tasks.workunit.client.1.smithi119.stdout:4/108: link dd/d11/c17 dd/d15/c24 0 2023-12-17T11:57:35.877 INFO:tasks.workunit.client.1.smithi119.stdout:6/156: truncate d2/f9 1298736 0 2023-12-17T11:57:35.880 INFO:tasks.workunit.client.1.smithi119.stdout:5/201: truncate d1/fc 148651 0 2023-12-17T11:57:35.883 INFO:tasks.workunit.client.0.smithi002.stdout:2/173: creat d3/d4/d7/d14/d1b/f40 x:0 0 0 2023-12-17T11:57:35.883 INFO:tasks.workunit.client.0.smithi002.stdout:2/174: write d3/d4/f6 [6958698,78648] 0 2023-12-17T11:57:35.883 INFO:tasks.workunit.client.0.smithi002.stdout:2/175: stat d3/d4/d7/d14/c2d 0 2023-12-17T11:57:35.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/206: rmdir dc 39 2023-12-17T11:57:35.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/207: stat dc/d38 0 2023-12-17T11:57:35.887 INFO:tasks.workunit.client.1.smithi119.stdout:6/157: mkdir d2/d2b 0 2023-12-17T11:57:35.897 INFO:tasks.workunit.client.0.smithi002.stdout:6/146: sync 2023-12-17T11:57:35.897 INFO:tasks.workunit.client.1.smithi119.stdout:6/158: truncate d2/f5 696617 0 2023-12-17T11:57:35.897 INFO:tasks.workunit.client.1.smithi119.stdout:6/159: chown d2/df/d17 927140922 1 2023-12-17T11:57:35.898 INFO:tasks.workunit.client.0.smithi002.stdout:2/176: stat d3/d4/d7/d14/l22 0 2023-12-17T11:57:35.901 INFO:tasks.workunit.client.0.smithi002.stdout:3/239: dwrite d9/d1b/f28 [0,4194304] 0 2023-12-17T11:57:35.901 INFO:tasks.workunit.client.0.smithi002.stdout:3/240: truncate d9/f14 1052570 0 2023-12-17T11:57:35.902 INFO:tasks.workunit.client.0.smithi002.stdout:3/241: creat d9/d1b/d35/d41/d43/f50 x:0 0 0 2023-12-17T11:57:35.902 INFO:tasks.workunit.client.0.smithi002.stdout:3/242: fsync d9/d15/f19 0 2023-12-17T11:57:35.903 INFO:tasks.workunit.client.1.smithi119.stdout:6/160: link d2/df/c27 d2/df/d17/c2c 0 2023-12-17T11:57:35.903 INFO:tasks.workunit.client.0.smithi002.stdout:9/208: rename dc/f22 to dc/d42/f4a 0 2023-12-17T11:57:35.906 INFO:tasks.workunit.client.1.smithi119.stdout:0/110: dwrite d2/d16/f17 [0,4194304] 0 2023-12-17T11:57:35.906 INFO:tasks.workunit.client.0.smithi002.stdout:7/180: dwrite d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:35.909 INFO:tasks.workunit.client.1.smithi119.stdout:5/202: dread d1/f2e [0,4194304] 0 2023-12-17T11:57:35.909 INFO:tasks.workunit.client.0.smithi002.stdout:2/177: mkdir d3/d4/d7/d14/d41 0 2023-12-17T11:57:35.912 INFO:tasks.workunit.client.1.smithi119.stdout:6/161: creat d2/d2b/f2d x:0 0 0 2023-12-17T11:57:35.912 INFO:tasks.workunit.client.1.smithi119.stdout:6/162: creat d2/f2e x:0 0 0 2023-12-17T11:57:35.916 INFO:tasks.workunit.client.1.smithi119.stdout:0/111: mkdir d2/d16/d12/d1f 0 2023-12-17T11:57:35.917 INFO:tasks.workunit.client.0.smithi002.stdout:6/147: dread d0/d1/dc/f16 [0,4194304] 0 2023-12-17T11:57:35.917 INFO:tasks.workunit.client.0.smithi002.stdout:6/148: write d0/f1a [4403770,103220] 0 2023-12-17T11:57:35.920 INFO:tasks.workunit.client.0.smithi002.stdout:7/181: dread d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:35.920 INFO:tasks.workunit.client.0.smithi002.stdout:7/182: truncate d6/f1c 2178519 0 2023-12-17T11:57:35.922 INFO:tasks.workunit.client.0.smithi002.stdout:9/209: mkdir dc/d1d/d23/d24/d47/d4b 0 2023-12-17T11:57:35.923 INFO:tasks.workunit.client.0.smithi002.stdout:8/192: dwrite d3/d8/da/d44/f24 [4194304,4194304] 0 2023-12-17T11:57:35.924 INFO:tasks.workunit.client.0.smithi002.stdout:1/200: dwrite d3/d6/d9/f29 [0,4194304] 0 2023-12-17T11:57:35.924 INFO:tasks.workunit.client.0.smithi002.stdout:1/201: write d3/d6/d9/d30/f41 [531508,102903] 0 2023-12-17T11:57:35.924 INFO:tasks.workunit.client.0.smithi002.stdout:1/202: creat d3/d6/f42 x:0 0 0 2023-12-17T11:57:35.924 INFO:tasks.workunit.client.1.smithi119.stdout:7/221: dwrite d2/d4/f16 [4194304,4194304] 0 2023-12-17T11:57:35.926 INFO:tasks.workunit.client.0.smithi002.stdout:3/243: rename d9/f11 to d9/d24/f51 0 2023-12-17T11:57:35.926 INFO:tasks.workunit.client.1.smithi119.stdout:8/113: getdents d7/da/d11/d26 0 2023-12-17T11:57:35.928 INFO:tasks.workunit.client.0.smithi002.stdout:3/244: write d9/d15/f2b [512561,34782] 0 2023-12-17T11:57:35.930 INFO:tasks.workunit.client.1.smithi119.stdout:0/112: creat d2/d16/d12/d1f/f20 x:0 0 0 2023-12-17T11:57:35.931 INFO:tasks.workunit.client.0.smithi002.stdout:0/124: sync 2023-12-17T11:57:35.937 INFO:tasks.workunit.client.1.smithi119.stdout:4/109: dwrite dd/f1d [0,4194304] 0 2023-12-17T11:57:35.937 INFO:tasks.workunit.client.1.smithi119.stdout:9/182: dwrite f11 [4194304,4194304] 0 2023-12-17T11:57:35.939 INFO:tasks.workunit.client.0.smithi002.stdout:6/149: rename d0/d1/dc/d10/c24 to d0/d1/dc/d10/c2b 0 2023-12-17T11:57:35.940 INFO:tasks.workunit.client.0.smithi002.stdout:5/129: sync 2023-12-17T11:57:35.948 INFO:tasks.workunit.client.0.smithi002.stdout:9/210: unlink dc/d1d/d23/f3d 0 2023-12-17T11:57:35.949 INFO:tasks.workunit.client.1.smithi119.stdout:5/203: dread d1/d25/f31 [0,4194304] 0 2023-12-17T11:57:35.949 INFO:tasks.workunit.client.1.smithi119.stdout:7/222: mknod d2/c46 0 2023-12-17T11:57:35.949 INFO:tasks.workunit.client.1.smithi119.stdout:5/204: creat d1/d25/d39/f41 x:0 0 0 2023-12-17T11:57:35.958 INFO:tasks.workunit.client.0.smithi002.stdout:8/193: creat d3/d8/da/f46 x:0 0 0 2023-12-17T11:57:35.962 INFO:tasks.workunit.client.1.smithi119.stdout:5/205: write d1/d25/f31 [2725131,7096] 0 2023-12-17T11:57:35.962 INFO:tasks.workunit.client.1.smithi119.stdout:5/206: fdatasync d1/fd 0 2023-12-17T11:57:35.963 INFO:tasks.workunit.client.1.smithi119.stdout:8/114: truncate d7/ff 2451281 0 2023-12-17T11:57:35.965 INFO:tasks.workunit.client.0.smithi002.stdout:1/203: mkdir d3/d6/d9/d37/d39/d43 0 2023-12-17T11:57:35.966 INFO:tasks.workunit.client.1.smithi119.stdout:7/223: read d2/f24 [529755,106030] 0 2023-12-17T11:57:35.966 INFO:tasks.workunit.client.1.smithi119.stdout:7/224: write d2/d4/d11/f2d [1248585,87280] 0 2023-12-17T11:57:35.970 INFO:tasks.workunit.client.0.smithi002.stdout:1/204: read d3/d6/d9/f36 [545890,42540] 0 2023-12-17T11:57:35.972 INFO:tasks.workunit.client.0.smithi002.stdout:2/178: rename d3/d4/d7/d14/d2e/d37/d3f/d32 to d3/d4/d7/d14/d42 0 2023-12-17T11:57:35.972 INFO:tasks.workunit.client.0.smithi002.stdout:2/179: chown d3/d4/fd 383937056 1 2023-12-17T11:57:35.974 INFO:tasks.workunit.client.0.smithi002.stdout:3/245: mkdir d9/d15/d52 0 2023-12-17T11:57:35.981 INFO:tasks.workunit.client.0.smithi002.stdout:6/150: mknod d0/d1/dc/c2c 0 2023-12-17T11:57:35.982 INFO:tasks.workunit.client.0.smithi002.stdout:9/211: mknod dc/d1d/d23/d24/c4c 0 2023-12-17T11:57:35.985 INFO:tasks.workunit.client.1.smithi119.stdout:4/110: dwrite dd/f18 [0,4194304] 0 2023-12-17T11:57:35.986 INFO:tasks.workunit.client.0.smithi002.stdout:8/194: rename d3/d8/da/d44/c41 to d3/d8/da/d44/c47 0 2023-12-17T11:57:35.986 INFO:tasks.workunit.client.0.smithi002.stdout:8/195: fdatasync d3/d8/d28/d31/f34 0 2023-12-17T11:57:35.986 INFO:tasks.workunit.client.0.smithi002.stdout:8/196: truncate d3/d7/f27 259422 0 2023-12-17T11:57:35.990 INFO:tasks.workunit.client.1.smithi119.stdout:8/115: rename d7/cc to d7/da/d1a/c29 0 2023-12-17T11:57:35.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/130: dwrite fa [0,4194304] 0 2023-12-17T11:57:35.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/131: chown dc/d1a 2037570861 1 2023-12-17T11:57:35.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/132: creat dc/d17/f21 x:0 0 0 2023-12-17T11:57:35.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/133: chown dc/d1b 777 1 2023-12-17T11:57:35.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/134: chown dc/l14 166 1 2023-12-17T11:57:35.995 INFO:tasks.workunit.client.1.smithi119.stdout:7/225: creat d2/d4/f47 x:0 0 0 2023-12-17T11:57:35.995 INFO:tasks.workunit.client.1.smithi119.stdout:7/226: write d2/f35 [1217571,9284] 0 2023-12-17T11:57:35.998 INFO:tasks.workunit.client.1.smithi119.stdout:0/113: truncate d2/d16/f17 2482697 0 2023-12-17T11:57:35.999 INFO:tasks.workunit.client.1.smithi119.stdout:0/114: fsync d2/d3/f14 0 2023-12-17T11:57:36.000 INFO:tasks.workunit.client.0.smithi002.stdout:1/205: unlink d3/d6/l1b 0 2023-12-17T11:57:36.001 INFO:tasks.workunit.client.0.smithi002.stdout:6/151: getdents d0/d1/dc/d10 0 2023-12-17T11:57:36.001 INFO:tasks.workunit.client.0.smithi002.stdout:6/152: chown d0/d1/dc/f20 22 1 2023-12-17T11:57:36.001 INFO:tasks.workunit.client.0.smithi002.stdout:0/125: rename d0/d6/d17 to d0/d6/d26/d14/d19/d2b 0 2023-12-17T11:57:36.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/183: dwrite d6/d17/d16/d1d/d24/f31 [0,4194304] 0 2023-12-17T11:57:36.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/184: chown d6/d17/dc/d13/d37 76298577 1 2023-12-17T11:57:36.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/185: truncate d6/d17/d16/d1d/f35 785507 0 2023-12-17T11:57:36.005 INFO:tasks.workunit.client.1.smithi119.stdout:9/183: dwrite d12/d1d/f27 [0,4194304] 0 2023-12-17T11:57:36.006 INFO:tasks.workunit.client.0.smithi002.stdout:2/180: mkdir d3/d4/d43 0 2023-12-17T11:57:36.008 INFO:tasks.workunit.client.0.smithi002.stdout:1/206: mknod d3/d6/d9/d30/c44 0 2023-12-17T11:57:36.008 INFO:tasks.workunit.client.0.smithi002.stdout:1/207: truncate d3/d6/d9/f13 4607463 0 2023-12-17T11:57:36.008 INFO:tasks.workunit.client.0.smithi002.stdout:1/208: chown d3/d6/d9/d37/c3b 307382 1 2023-12-17T11:57:36.009 INFO:tasks.workunit.client.1.smithi119.stdout:8/116: mkdir d7/d12/d1f/d2a 0 2023-12-17T11:57:36.009 INFO:tasks.workunit.client.1.smithi119.stdout:8/117: chown d7/f17 0 1 2023-12-17T11:57:36.010 INFO:tasks.workunit.client.0.smithi002.stdout:7/186: dread d6/d17/dc/d13/f2d [0,4194304] 0 2023-12-17T11:57:36.014 INFO:tasks.workunit.client.0.smithi002.stdout:3/246: dwrite d9/f13 [0,4194304] 0 2023-12-17T11:57:36.015 INFO:tasks.workunit.client.0.smithi002.stdout:6/153: creat d0/d1/d21/f2d x:0 0 0 2023-12-17T11:57:36.015 INFO:tasks.workunit.client.0.smithi002.stdout:6/154: chown d0/d1/dc/d10/c2b 162 1 2023-12-17T11:57:36.016 INFO:tasks.workunit.client.1.smithi119.stdout:0/115: mkdir d2/d16/d12/d21 0 2023-12-17T11:57:36.016 INFO:tasks.workunit.client.1.smithi119.stdout:0/116: creat d2/d16/d12/d1f/f22 x:0 0 0 2023-12-17T11:57:36.017 INFO:tasks.workunit.client.1.smithi119.stdout:5/207: mknod d1/d25/c42 0 2023-12-17T11:57:36.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/197: rename d3/d8/d28/l33 to d3/d7/d1a/l48 0 2023-12-17T11:57:36.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/198: fdatasync d3/d8/da/d29/f3a 0 2023-12-17T11:57:36.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/199: truncate d3/d8/f3d 65710 0 2023-12-17T11:57:36.020 INFO:tasks.workunit.client.0.smithi002.stdout:8/200: stat d3/d8/d28/d31/f3e 0 2023-12-17T11:57:36.022 INFO:tasks.workunit.client.1.smithi119.stdout:8/118: dread d7/ff [0,4194304] 0 2023-12-17T11:57:36.023 INFO:tasks.workunit.client.1.smithi119.stdout:8/119: write d7/f17 [683909,10240] 0 2023-12-17T11:57:36.023 INFO:tasks.workunit.client.1.smithi119.stdout:8/120: write d7/d18/d15/f21 [125325,68119] 0 2023-12-17T11:57:36.024 INFO:tasks.workunit.client.0.smithi002.stdout:0/126: symlink d0/d6/d26/d25/l2c 0 2023-12-17T11:57:36.029 INFO:tasks.workunit.client.1.smithi119.stdout:4/111: unlink f1 0 2023-12-17T11:57:36.031 INFO:tasks.workunit.client.0.smithi002.stdout:9/212: dwrite dc/d32/f34 [0,4194304] 0 2023-12-17T11:57:36.035 INFO:tasks.workunit.client.0.smithi002.stdout:2/181: mknod d3/d4/d7/d14/d1b/c44 0 2023-12-17T11:57:36.039 INFO:tasks.workunit.client.1.smithi119.stdout:9/184: mknod d12/d1d/c39 0 2023-12-17T11:57:36.042 INFO:tasks.workunit.client.0.smithi002.stdout:1/209: unlink d3/d6/d9/d30/l21 0 2023-12-17T11:57:36.043 INFO:tasks.workunit.client.0.smithi002.stdout:1/210: readlink d3/d6/d9/d30/l40 0 2023-12-17T11:57:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:7/187: symlink d6/d17/dc/d13/d21/d2e/l39 0 2023-12-17T11:57:36.046 INFO:tasks.workunit.client.0.smithi002.stdout:7/188: write d6/d17/dc/d13/f2d [1600221,29389] 0 2023-12-17T11:57:36.048 INFO:tasks.workunit.client.1.smithi119.stdout:3/158: sync 2023-12-17T11:57:36.048 INFO:tasks.workunit.client.1.smithi119.stdout:3/159: fdatasync f3 0 2023-12-17T11:57:36.051 INFO:tasks.workunit.client.0.smithi002.stdout:6/155: creat d0/d1/dc/d17/f2e x:0 0 0 2023-12-17T11:57:36.052 INFO:tasks.workunit.client.1.smithi119.stdout:5/208: symlink d1/d36/d3a/l43 0 2023-12-17T11:57:36.056 INFO:tasks.workunit.client.0.smithi002.stdout:3/247: rename d9/f44 to d9/d1b/d4f/f53 0 2023-12-17T11:57:36.058 INFO:tasks.workunit.client.1.smithi119.stdout:9/185: link d12/f2c d12/d1d/d28/f3a 0 2023-12-17T11:57:36.061 INFO:tasks.workunit.client.1.smithi119.stdout:3/160: symlink d9/d1c/d2a/d33/l38 0 2023-12-17T11:57:36.061 INFO:tasks.workunit.client.1.smithi119.stdout:3/161: fsync d9/d1c/f24 0 2023-12-17T11:57:36.063 INFO:tasks.workunit.client.1.smithi119.stdout:5/209: mkdir d1/d44 0 2023-12-17T11:57:36.064 INFO:tasks.workunit.client.1.smithi119.stdout:0/117: dwrite d2/d16/d12/f1c [0,4194304] 0 2023-12-17T11:57:36.064 INFO:tasks.workunit.client.1.smithi119.stdout:0/118: fsync d2/d3/f14 0 2023-12-17T11:57:36.068 INFO:tasks.workunit.client.1.smithi119.stdout:9/186: creat d12/d1d/d28/f3b x:0 0 0 2023-12-17T11:57:36.072 INFO:tasks.workunit.client.1.smithi119.stdout:3/162: symlink d9/d11/d1e/l39 0 2023-12-17T11:57:36.075 INFO:tasks.workunit.client.1.smithi119.stdout:5/210: rename d1/l1b to d1/d25/d39/l45 0 2023-12-17T11:57:36.076 INFO:tasks.workunit.client.1.smithi119.stdout:0/119: symlink d2/d16/l23 0 2023-12-17T11:57:36.078 INFO:tasks.workunit.client.1.smithi119.stdout:8/121: dwrite d7/da/d11/f13 [4194304,4194304] 0 2023-12-17T11:57:36.083 INFO:tasks.workunit.client.1.smithi119.stdout:9/187: dread d12/f37 [0,4194304] 0 2023-12-17T11:57:36.083 INFO:tasks.workunit.client.1.smithi119.stdout:9/188: readlink d12/l15 0 2023-12-17T11:57:36.086 INFO:tasks.workunit.client.1.smithi119.stdout:0/120: mkdir d2/d16/d12/d1f/d24 0 2023-12-17T11:57:36.086 INFO:tasks.workunit.client.1.smithi119.stdout:4/112: dwrite dd/f18 [0,4194304] 0 2023-12-17T11:57:36.086 INFO:tasks.workunit.client.1.smithi119.stdout:4/113: chown dd/f21 27 1 2023-12-17T11:57:36.087 INFO:tasks.workunit.client.0.smithi002.stdout:8/201: dwrite d3/d8/d28/d31/f3e [0,4194304] 0 2023-12-17T11:57:36.087 INFO:tasks.workunit.client.1.smithi119.stdout:0/121: creat d2/d16/d12/f25 x:0 0 0 2023-12-17T11:57:36.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/182: symlink d3/d4/d43/l45 0 2023-12-17T11:57:36.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/183: fsync d3/d4/ff 0 2023-12-17T11:57:36.089 INFO:tasks.workunit.client.0.smithi002.stdout:2/184: truncate d3/d4/ff 151806 0 2023-12-17T11:57:36.091 INFO:tasks.workunit.client.0.smithi002.stdout:9/213: unlink l8 0 2023-12-17T11:57:36.092 INFO:tasks.workunit.client.1.smithi119.stdout:3/163: dread d9/da/df/f17 [0,4194304] 0 2023-12-17T11:57:36.093 INFO:tasks.workunit.client.0.smithi002.stdout:6/156: truncate d0/d1/dc/f20 3692715 0 2023-12-17T11:57:36.093 INFO:tasks.workunit.client.0.smithi002.stdout:6/157: fdatasync d0/d1/dc/d10/f14 0 2023-12-17T11:57:36.095 INFO:tasks.workunit.client.1.smithi119.stdout:9/189: creat d12/d1d/f3c x:0 0 0 2023-12-17T11:57:36.096 INFO:tasks.workunit.client.0.smithi002.stdout:1/211: rename d3/fc to d3/d6/d9/d37/f45 0 2023-12-17T11:57:36.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/212: creat d3/d6/d16/f46 x:0 0 0 2023-12-17T11:57:36.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/213: dread - d3/d6/f3e zero size 2023-12-17T11:57:36.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/214: truncate d3/d6/d9/f38 73187 0 2023-12-17T11:57:36.097 INFO:tasks.workunit.client.0.smithi002.stdout:1/215: truncate d3/d6/fa 1545474 0 2023-12-17T11:57:36.097 INFO:tasks.workunit.client.0.smithi002.stdout:3/248: symlink d9/l54 0 2023-12-17T11:57:36.099 INFO:tasks.workunit.client.1.smithi119.stdout:5/211: creat d1/d25/f46 x:0 0 0 2023-12-17T11:57:36.105 INFO:tasks.workunit.client.0.smithi002.stdout:8/202: mkdir d3/d7/d18/d3f/d49 0 2023-12-17T11:57:36.108 INFO:tasks.workunit.client.0.smithi002.stdout:9/214: link dc/d1d/d23/d24/c28 dc/d1d/d23/d24/d49/c4d 0 2023-12-17T11:57:36.109 INFO:tasks.workunit.client.1.smithi119.stdout:4/114: symlink dd/d15/l25 0 2023-12-17T11:57:36.111 INFO:tasks.workunit.client.0.smithi002.stdout:6/158: symlink d0/d1/dc/l2f 0 2023-12-17T11:57:36.112 INFO:tasks.workunit.client.1.smithi119.stdout:0/122: creat d2/d16/d12/d21/f26 x:0 0 0 2023-12-17T11:57:36.116 INFO:tasks.workunit.client.1.smithi119.stdout:3/164: unlink d9/da/df/f34 0 2023-12-17T11:57:36.116 INFO:tasks.workunit.client.1.smithi119.stdout:3/165: stat d9/d11/d1e/f37 0 2023-12-17T11:57:36.116 INFO:tasks.workunit.client.0.smithi002.stdout:8/203: dread d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:36.118 INFO:tasks.workunit.client.0.smithi002.stdout:1/216: truncate d3/d6/d9/f29 944643 0 2023-12-17T11:57:36.125 INFO:tasks.workunit.client.1.smithi119.stdout:4/115: write dd/f21 [44966,36009] 0 2023-12-17T11:57:36.133 INFO:tasks.workunit.client.0.smithi002.stdout:1/217: dread d3/d6/d9/d30/f41 [0,4194304] 0 2023-12-17T11:57:36.134 INFO:tasks.workunit.client.1.smithi119.stdout:9/190: rmdir d12/d1d/d28 39 2023-12-17T11:57:36.137 INFO:tasks.workunit.client.0.smithi002.stdout:6/159: rename d0/d1/dc/c25 to d0/d1/dc/c30 0 2023-12-17T11:57:36.138 INFO:tasks.workunit.client.0.smithi002.stdout:6/160: chown d0/d1/dc/d10/f14 305505232 1 2023-12-17T11:57:36.140 INFO:tasks.workunit.client.1.smithi119.stdout:3/166: dread d9/f19 [0,4194304] 0 2023-12-17T11:57:36.143 INFO:tasks.workunit.client.1.smithi119.stdout:9/191: rename f11 to d12/d1d/d28/f3d 0 2023-12-17T11:57:36.144 INFO:tasks.workunit.client.1.smithi119.stdout:8/122: truncate d7/da/d11/f13 7382889 0 2023-12-17T11:57:36.144 INFO:tasks.workunit.client.1.smithi119.stdout:8/123: fsync d7/da/f22 0 2023-12-17T11:57:36.146 INFO:tasks.workunit.client.0.smithi002.stdout:1/218: rename d3/d6/d9/f36 to d3/d6/d16/f47 0 2023-12-17T11:57:36.146 INFO:tasks.workunit.client.0.smithi002.stdout:1/219: dread - d3/d6/f3e zero size 2023-12-17T11:57:36.146 INFO:tasks.workunit.client.0.smithi002.stdout:1/220: chown d3/d6/d9/d37/d39/c3f 29 1 2023-12-17T11:57:36.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/221: fdatasync d3/d6/d9/f3c 0 2023-12-17T11:57:36.156 INFO:tasks.workunit.client.1.smithi119.stdout:8/124: rmdir d7/d18/d15 39 2023-12-17T11:57:36.156 INFO:tasks.workunit.client.1.smithi119.stdout:8/125: creat d7/d12/f2b x:0 0 0 2023-12-17T11:57:36.156 INFO:tasks.workunit.client.1.smithi119.stdout:8/126: chown d7/f27 647505 1 2023-12-17T11:57:36.157 INFO:tasks.workunit.client.1.smithi119.stdout:0/123: dwrite d2/d3/f14 [4194304,4194304] 0 2023-12-17T11:57:36.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/161: dread d0/f1a [0,4194304] 0 2023-12-17T11:57:36.160 INFO:tasks.workunit.client.0.smithi002.stdout:2/185: dwrite d3/d4/d7/f11 [0,4194304] 0 2023-12-17T11:57:36.161 INFO:tasks.workunit.client.1.smithi119.stdout:5/212: dwrite d1/f21 [0,4194304] 0 2023-12-17T11:57:36.165 INFO:tasks.workunit.client.1.smithi119.stdout:0/124: creat d2/d16/f27 x:0 0 0 2023-12-17T11:57:36.166 INFO:tasks.workunit.client.1.smithi119.stdout:5/213: creat d1/d36/f47 x:0 0 0 2023-12-17T11:57:36.172 INFO:tasks.workunit.client.0.smithi002.stdout:9/215: dwrite dc/f21 [0,4194304] 0 2023-12-17T11:57:36.172 INFO:tasks.workunit.client.0.smithi002.stdout:2/186: rmdir d3/d4/d7/d14/d41 0 2023-12-17T11:57:36.174 INFO:tasks.workunit.client.1.smithi119.stdout:5/214: creat d1/d36/f48 x:0 0 0 2023-12-17T11:57:36.175 INFO:tasks.workunit.client.0.smithi002.stdout:6/162: rename d0/d1/dc/d10/f19 to d0/d1/d21/f31 0 2023-12-17T11:57:36.175 INFO:tasks.workunit.client.0.smithi002.stdout:2/187: creat d3/d4/d7/d14/d34/f46 x:0 0 0 2023-12-17T11:57:36.178 INFO:tasks.workunit.client.0.smithi002.stdout:9/216: creat dc/d1d/d23/d24/f4e x:0 0 0 2023-12-17T11:57:36.182 INFO:tasks.workunit.client.1.smithi119.stdout:8/127: dread d7/fb [0,4194304] 0 2023-12-17T11:57:36.187 INFO:tasks.workunit.client.1.smithi119.stdout:5/215: link d1/d36/d3a/l43 d1/d25/d39/l49 0 2023-12-17T11:57:36.189 INFO:tasks.workunit.client.0.smithi002.stdout:2/188: link d3/d4/d17/d19/f24 d3/d4/d7/d14/d42/f47 0 2023-12-17T11:57:36.191 INFO:tasks.workunit.client.0.smithi002.stdout:4/186: sync 2023-12-17T11:57:36.191 INFO:tasks.workunit.client.0.smithi002.stdout:4/187: readlink d0/d10/l29 0 2023-12-17T11:57:36.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/217: mkdir dc/d42/d4f 0 2023-12-17T11:57:36.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/218: fsync dc/d1d/f3b 0 2023-12-17T11:57:36.192 INFO:tasks.workunit.client.1.smithi119.stdout:8/128: mkdir d7/da/d11/d26/d2c 0 2023-12-17T11:57:36.192 INFO:tasks.workunit.client.1.smithi119.stdout:9/192: write d12/f19 [248143,91574] 0 2023-12-17T11:57:36.193 INFO:tasks.workunit.client.1.smithi119.stdout:3/167: dwrite d9/f19 [0,4194304] 0 2023-12-17T11:57:36.193 INFO:tasks.workunit.client.1.smithi119.stdout:3/168: write d9/da/df/f17 [5010690,68169] 0 2023-12-17T11:57:36.193 INFO:tasks.workunit.client.1.smithi119.stdout:2/159: sync 2023-12-17T11:57:36.195 INFO:tasks.workunit.client.1.smithi119.stdout:1/103: sync 2023-12-17T11:57:36.195 INFO:tasks.workunit.client.1.smithi119.stdout:1/104: write d3/d5/f11 [248236,14431] 0 2023-12-17T11:57:36.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/163: sync 2023-12-17T11:57:36.197 INFO:tasks.workunit.client.1.smithi119.stdout:7/227: sync 2023-12-17T11:57:36.199 INFO:tasks.workunit.client.1.smithi119.stdout:8/129: symlink d7/d12/l2d 0 2023-12-17T11:57:36.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/219: creat dc/d1d/d23/d24/d47/d4b/f50 x:0 0 0 2023-12-17T11:57:36.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/220: truncate dc/f1b 1306780 0 2023-12-17T11:57:36.200 INFO:tasks.workunit.client.1.smithi119.stdout:9/193: rename d12/d1d/d28/f26 to d12/d1d/f3e 0 2023-12-17T11:57:36.201 INFO:tasks.workunit.client.1.smithi119.stdout:9/194: readlink d12/l1f 0 2023-12-17T11:57:36.205 INFO:tasks.workunit.client.1.smithi119.stdout:3/169: dread d9/f1b [0,4194304] 0 2023-12-17T11:57:36.206 INFO:tasks.workunit.client.1.smithi119.stdout:3/170: fsync d9/f1b 0 2023-12-17T11:57:36.208 INFO:tasks.workunit.client.1.smithi119.stdout:2/160: truncate d6/d9/fb 6432323 0 2023-12-17T11:57:36.210 INFO:tasks.workunit.client.0.smithi002.stdout:8/204: dwrite d3/d8/da/dd/f35 [0,4194304] 0 2023-12-17T11:57:36.213 INFO:tasks.workunit.client.1.smithi119.stdout:8/130: symlink d7/da/d11/l2e 0 2023-12-17T11:57:36.213 INFO:tasks.workunit.client.1.smithi119.stdout:4/116: dwrite dd/f21 [0,4194304] 0 2023-12-17T11:57:36.213 INFO:tasks.workunit.client.1.smithi119.stdout:4/117: chown f2 1337328 1 2023-12-17T11:57:36.213 INFO:tasks.workunit.client.1.smithi119.stdout:4/118: getdents dd/d15/d16/d20 0 2023-12-17T11:57:36.213 INFO:tasks.workunit.client.1.smithi119.stdout:8/131: creat d7/da/f2f x:0 0 0 2023-12-17T11:57:36.213 INFO:tasks.workunit.client.1.smithi119.stdout:8/132: chown d7/da/d11/d26/f28 198 1 2023-12-17T11:57:36.214 INFO:tasks.workunit.client.1.smithi119.stdout:8/133: write d7/d18/d15/f1b [207708,16425] 0 2023-12-17T11:57:36.214 INFO:tasks.workunit.client.1.smithi119.stdout:9/195: symlink d12/d1d/l3f 0 2023-12-17T11:57:36.215 INFO:tasks.workunit.client.0.smithi002.stdout:8/205: dread d3/d8/f3d [0,4194304] 0 2023-12-17T11:57:36.221 INFO:tasks.workunit.client.0.smithi002.stdout:8/206: mkdir d3/d8/da/d4a 0 2023-12-17T11:57:36.221 INFO:tasks.workunit.client.0.smithi002.stdout:8/207: chown d3/d8/da/d44/c47 6127613 1 2023-12-17T11:57:36.221 INFO:tasks.workunit.client.0.smithi002.stdout:8/208: read - d3/f38 zero size 2023-12-17T11:57:36.224 INFO:tasks.workunit.client.0.smithi002.stdout:4/188: read d0/d10/d21/d33/f35 [1552136,87728] 0 2023-12-17T11:57:36.226 INFO:tasks.workunit.client.1.smithi119.stdout:3/171: mkdir d9/d1c/d2a/d33/d3a 0 2023-12-17T11:57:36.227 INFO:tasks.workunit.client.1.smithi119.stdout:2/161: creat d6/d9/d13/d1d/f37 x:0 0 0 2023-12-17T11:57:36.227 INFO:tasks.workunit.client.1.smithi119.stdout:2/162: fdatasync d6/d9/d13/f32 0 2023-12-17T11:57:36.227 INFO:tasks.workunit.client.1.smithi119.stdout:2/163: chown f5 1320356 1 2023-12-17T11:57:36.227 INFO:tasks.workunit.client.1.smithi119.stdout:6/164: rmdir d2/df 39 2023-12-17T11:57:36.227 INFO:tasks.workunit.client.1.smithi119.stdout:0/125: dwrite d2/d16/d12/f1c [4194304,4194304] 0 2023-12-17T11:57:36.227 INFO:tasks.workunit.client.1.smithi119.stdout:4/119: mkdir dd/d11/d26 0 2023-12-17T11:57:36.228 INFO:tasks.workunit.client.1.smithi119.stdout:4/120: readlink dd/d15/l25 0 2023-12-17T11:57:36.228 INFO:tasks.workunit.client.1.smithi119.stdout:4/121: truncate dd/f1b 622057 0 2023-12-17T11:57:36.228 INFO:tasks.workunit.client.0.smithi002.stdout:1/222: dwrite d3/d6/f3a [0,4194304] 0 2023-12-17T11:57:36.228 INFO:tasks.workunit.client.0.smithi002.stdout:1/223: write d3/d6/d9/f3c [4463616,66967] 0 2023-12-17T11:57:36.228 INFO:tasks.workunit.client.0.smithi002.stdout:1/224: getdents d3/d6/d16/d28 0 2023-12-17T11:57:36.229 INFO:tasks.workunit.client.0.smithi002.stdout:1/225: chown d3/d6/d16/d28/l32 18547446 1 2023-12-17T11:57:36.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/209: creat d3/d7/d18/d3f/d49/f4b x:0 0 0 2023-12-17T11:57:36.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/210: chown d3/d7/d1a 6206378 1 2023-12-17T11:57:36.229 INFO:tasks.workunit.client.0.smithi002.stdout:9/221: dread dc/d1d/d23/d24/f30 [0,4194304] 0 2023-12-17T11:57:36.232 INFO:tasks.workunit.client.0.smithi002.stdout:2/189: rmdir d3 39 2023-12-17T11:57:36.232 INFO:tasks.workunit.client.0.smithi002.stdout:2/190: chown d3/d4/d7/d14 1053300673 1 2023-12-17T11:57:36.233 INFO:tasks.workunit.client.1.smithi119.stdout:8/134: symlink d7/d12/l30 0 2023-12-17T11:57:36.233 INFO:tasks.workunit.client.1.smithi119.stdout:8/135: truncate d7/da/d11/f1d 1171473 0 2023-12-17T11:57:36.240 INFO:tasks.workunit.client.1.smithi119.stdout:9/196: mkdir d12/d1d/d40 0 2023-12-17T11:57:36.240 INFO:tasks.workunit.client.1.smithi119.stdout:9/197: fsync ff 0 2023-12-17T11:57:36.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/226: link d3/d6/d9/f13 d3/d2f/f48 0 2023-12-17T11:57:36.249 INFO:tasks.workunit.client.0.smithi002.stdout:8/211: symlink d3/d8/da/d4a/l4c 0 2023-12-17T11:57:36.249 INFO:tasks.workunit.client.1.smithi119.stdout:4/122: unlink dd/lf 0 2023-12-17T11:57:36.249 INFO:tasks.workunit.client.1.smithi119.stdout:3/172: dread f5 [0,4194304] 0 2023-12-17T11:57:36.249 INFO:tasks.workunit.client.1.smithi119.stdout:3/173: fdatasync f6 0 2023-12-17T11:57:36.250 INFO:tasks.workunit.client.1.smithi119.stdout:3/174: fsync d9/da/df/f15 0 2023-12-17T11:57:36.250 INFO:tasks.workunit.client.1.smithi119.stdout:8/136: link d7/d18/c19 d7/d12/d23/c31 0 2023-12-17T11:57:36.250 INFO:tasks.workunit.client.1.smithi119.stdout:8/137: stat d7/d12 0 2023-12-17T11:57:36.251 INFO:tasks.workunit.client.0.smithi002.stdout:2/191: rmdir d3/d4/d7/d14/d34 39 2023-12-17T11:57:36.251 INFO:tasks.workunit.client.0.smithi002.stdout:2/192: write d3/d4/f3a [840434,65612] 0 2023-12-17T11:57:36.255 INFO:tasks.workunit.client.1.smithi119.stdout:0/126: unlink d2/fe 0 2023-12-17T11:57:36.255 INFO:tasks.workunit.client.1.smithi119.stdout:0/127: fdatasync d2/d3/f14 0 2023-12-17T11:57:36.255 INFO:tasks.workunit.client.1.smithi119.stdout:0/128: write d2/d16/d12/d1f/f20 [190715,3524] 0 2023-12-17T11:57:36.255 INFO:tasks.workunit.client.1.smithi119.stdout:0/129: dread - d2/d16/d12/f25 zero size 2023-12-17T11:57:36.256 INFO:tasks.workunit.client.1.smithi119.stdout:9/198: truncate d12/f37 4354053 0 2023-12-17T11:57:36.256 INFO:tasks.workunit.client.0.smithi002.stdout:6/163: dwrite d0/d1/fd [0,4194304] 0 2023-12-17T11:57:36.258 INFO:tasks.workunit.client.1.smithi119.stdout:2/164: getdents d6 0 2023-12-17T11:57:36.259 INFO:tasks.workunit.client.1.smithi119.stdout:5/216: dwrite d1/f20 [0,4194304] 0 2023-12-17T11:57:36.259 INFO:tasks.workunit.client.1.smithi119.stdout:5/217: write d1/d25/d39/f41 [146995,43445] 0 2023-12-17T11:57:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:4/189: rmdir d0/d10/d14 39 2023-12-17T11:57:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:4/190: fsync d0/d10/f40 0 2023-12-17T11:57:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:4/191: stat d0/d10/d14/d27 0 2023-12-17T11:57:36.261 INFO:tasks.workunit.client.1.smithi119.stdout:1/105: dwrite d3/db/fc [0,4194304] 0 2023-12-17T11:57:36.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/175: link d9/d11/l12 d9/da/df/l3b 0 2023-12-17T11:57:36.269 INFO:tasks.workunit.client.1.smithi119.stdout:0/130: unlink d2/d3/cf 0 2023-12-17T11:57:36.273 INFO:tasks.workunit.client.0.smithi002.stdout:8/212: symlink d3/d8/l4d 0 2023-12-17T11:57:36.273 INFO:tasks.workunit.client.0.smithi002.stdout:2/193: creat d3/d4/d7/d14/f48 x:0 0 0 2023-12-17T11:57:36.273 INFO:tasks.workunit.client.0.smithi002.stdout:2/194: readlink d3/d4/d7/d14/l39 0 2023-12-17T11:57:36.278 INFO:tasks.workunit.client.1.smithi119.stdout:9/199: rename d12/d1d/d28/f3b to d12/d1d/f41 0 2023-12-17T11:57:36.281 INFO:tasks.workunit.client.1.smithi119.stdout:2/165: truncate d6/f33 3796571 0 2023-12-17T11:57:36.283 INFO:tasks.workunit.client.1.smithi119.stdout:7/228: dwrite d2/f25 [0,4194304] 0 2023-12-17T11:57:36.283 INFO:tasks.workunit.client.1.smithi119.stdout:7/229: fdatasync d2/d4/f16 0 2023-12-17T11:57:36.291 INFO:tasks.workunit.client.1.smithi119.stdout:1/106: creat d3/d5/f21 x:0 0 0 2023-12-17T11:57:36.291 INFO:tasks.workunit.client.1.smithi119.stdout:1/107: truncate d3/d5/f21 1034805 0 2023-12-17T11:57:36.291 INFO:tasks.workunit.client.1.smithi119.stdout:3/176: mknod d9/d1c/d2a/c3c 0 2023-12-17T11:57:36.293 INFO:tasks.workunit.client.1.smithi119.stdout:0/131: rename d2/d3/d5/f19 to d2/f28 0 2023-12-17T11:57:36.295 INFO:tasks.workunit.client.0.smithi002.stdout:4/192: creat d0/f43 x:0 0 0 2023-12-17T11:57:36.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/227: getdents d3/d6 0 2023-12-17T11:57:36.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/228: creat d3/f49 x:0 0 0 2023-12-17T11:57:36.298 INFO:tasks.workunit.client.1.smithi119.stdout:2/166: mkdir d6/d38 0 2023-12-17T11:57:36.298 INFO:tasks.workunit.client.1.smithi119.stdout:2/167: readlink d6/d9/d13/l19 0 2023-12-17T11:57:36.301 INFO:tasks.workunit.client.0.smithi002.stdout:2/195: symlink d3/d4/d7/d14/d34/l49 0 2023-12-17T11:57:36.302 INFO:tasks.workunit.client.1.smithi119.stdout:7/230: mknod d2/d4/d3e/c48 0 2023-12-17T11:57:36.302 INFO:tasks.workunit.client.1.smithi119.stdout:7/231: stat d2/f35 0 2023-12-17T11:57:36.303 INFO:tasks.workunit.client.1.smithi119.stdout:7/232: write d2/f3 [5026603,11414] 0 2023-12-17T11:57:36.303 INFO:tasks.workunit.client.0.smithi002.stdout:4/193: mknod d0/d3e/d41/c44 0 2023-12-17T11:57:36.304 INFO:tasks.workunit.client.1.smithi119.stdout:3/177: creat d9/d1c/d2a/d33/d3a/f3d x:0 0 0 2023-12-17T11:57:36.305 INFO:tasks.workunit.client.1.smithi119.stdout:3/178: creat d9/d11/d1e/f3e x:0 0 0 2023-12-17T11:57:36.310 INFO:tasks.workunit.client.0.smithi002.stdout:8/213: getdents d3/d7/d18/d3f/d49 0 2023-12-17T11:57:36.314 INFO:tasks.workunit.client.0.smithi002.stdout:2/196: symlink d3/d4/d7/d14/d2e/l4a 0 2023-12-17T11:57:36.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/194: truncate d0/fd 3836340 0 2023-12-17T11:57:36.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/195: creat d0/d10/d21/d33/f45 x:0 0 0 2023-12-17T11:57:36.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/196: write d0/d10/d21/d33/f35 [296823,7731] 0 2023-12-17T11:57:36.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/197: creat d3/d4/d7/d14/d34/f4b x:0 0 0 2023-12-17T11:57:36.318 INFO:tasks.workunit.client.1.smithi119.stdout:8/138: dwrite d7/d18/d15/f21 [0,4194304] 0 2023-12-17T11:57:36.318 INFO:tasks.workunit.client.1.smithi119.stdout:0/132: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:36.318 INFO:tasks.workunit.client.1.smithi119.stdout:0/133: chown d2 1 1 2023-12-17T11:57:36.318 INFO:tasks.workunit.client.1.smithi119.stdout:8/139: getdents d7/da/d11/d26/d2c 0 2023-12-17T11:57:36.320 INFO:tasks.workunit.client.0.smithi002.stdout:2/198: chown d3/d4/d7/d14/c2d 88 1 2023-12-17T11:57:36.321 INFO:tasks.workunit.client.0.smithi002.stdout:4/197: mknod d0/d10/d21/c46 0 2023-12-17T11:57:36.322 INFO:tasks.workunit.client.1.smithi119.stdout:3/179: creat d9/d11/f3f x:0 0 0 2023-12-17T11:57:36.322 INFO:tasks.workunit.client.1.smithi119.stdout:3/180: write d9/d1c/d2a/d33/d3a/f3d [689073,21135] 0 2023-12-17T11:57:36.323 INFO:tasks.workunit.client.1.smithi119.stdout:3/181: chown d9/d11/d1e/l31 140087805 1 2023-12-17T11:57:36.324 INFO:tasks.workunit.client.0.smithi002.stdout:4/198: fsync d0/d10/f40 0 2023-12-17T11:57:36.324 INFO:tasks.workunit.client.0.smithi002.stdout:4/199: chown d0/d10/d21 895 1 2023-12-17T11:57:36.325 INFO:tasks.workunit.client.0.smithi002.stdout:2/199: dread d3/d4/ff [0,4194304] 0 2023-12-17T11:57:36.327 INFO:tasks.workunit.client.1.smithi119.stdout:0/134: getdents d2/d3/d5/dc 0 2023-12-17T11:57:36.329 INFO:tasks.workunit.client.1.smithi119.stdout:8/140: creat d7/da/d11/d26/f32 x:0 0 0 2023-12-17T11:57:36.329 INFO:tasks.workunit.client.1.smithi119.stdout:3/182: stat d9/da/l10 0 2023-12-17T11:57:36.330 INFO:tasks.workunit.client.1.smithi119.stdout:7/233: dread d2/d4/f28 [0,4194304] 0 2023-12-17T11:57:36.334 INFO:tasks.workunit.client.1.smithi119.stdout:4/123: dwrite dd/f1b [0,4194304] 0 2023-12-17T11:57:36.334 INFO:tasks.workunit.client.1.smithi119.stdout:5/218: dwrite d1/d25/d39/f3b [0,4194304] 0 2023-12-17T11:57:36.334 INFO:tasks.workunit.client.1.smithi119.stdout:2/168: dread d6/d9/f2a [0,4194304] 0 2023-12-17T11:57:36.334 INFO:tasks.workunit.client.1.smithi119.stdout:2/169: stat f5 0 2023-12-17T11:57:36.334 INFO:tasks.workunit.client.1.smithi119.stdout:3/183: rename f7 to d9/d1c/d2a/d33/d3a/f40 0 2023-12-17T11:57:36.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/214: dread d3/d8/da/dd/f35 [0,4194304] 0 2023-12-17T11:57:36.336 INFO:tasks.workunit.client.0.smithi002.stdout:8/215: readlink d3/d7/d1a/l1b 0 2023-12-17T11:57:36.336 INFO:tasks.workunit.client.0.smithi002.stdout:6/164: dwrite d0/d1/dc/d17/f26 [4194304,4194304] 0 2023-12-17T11:57:36.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/234: mkdir d2/d49 0 2023-12-17T11:57:36.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/235: write d2/d4/d11/f43 [379449,68707] 0 2023-12-17T11:57:36.339 INFO:tasks.workunit.client.0.smithi002.stdout:4/200: dread d0/ff [0,4194304] 0 2023-12-17T11:57:36.340 INFO:tasks.workunit.client.0.smithi002.stdout:4/201: fsync d0/d10/f39 0 2023-12-17T11:57:36.344 INFO:tasks.workunit.client.1.smithi119.stdout:2/170: mknod d6/d9/d13/d1d/c39 0 2023-12-17T11:57:36.344 INFO:tasks.workunit.client.1.smithi119.stdout:2/171: read - d6/d9/d13/d1d/f24 zero size 2023-12-17T11:57:36.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/216: truncate d3/d8/da/dd/f1d 1849207 0 2023-12-17T11:57:36.348 INFO:tasks.workunit.client.1.smithi119.stdout:0/135: rmdir d2/d16/d12/d21 39 2023-12-17T11:57:36.349 INFO:tasks.workunit.client.1.smithi119.stdout:3/184: stat d9/da/l23 0 2023-12-17T11:57:36.349 INFO:tasks.workunit.client.1.smithi119.stdout:3/185: write d9/d1c/d2a/d33/d3a/f3d [945789,53390] 0 2023-12-17T11:57:36.349 INFO:tasks.workunit.client.1.smithi119.stdout:3/186: write d9/d11/d1e/f3e [3170,99814] 0 2023-12-17T11:57:36.351 INFO:tasks.workunit.client.1.smithi119.stdout:7/236: creat d2/d4/d11/d3f/f4a x:0 0 0 2023-12-17T11:57:36.351 INFO:tasks.workunit.client.1.smithi119.stdout:7/237: chown d2/ca 1315 1 2023-12-17T11:57:36.351 INFO:tasks.workunit.client.1.smithi119.stdout:7/238: stat d2/d4/l5 0 2023-12-17T11:57:36.354 INFO:tasks.workunit.client.1.smithi119.stdout:0/136: symlink d2/d16/d12/l29 0 2023-12-17T11:57:36.355 INFO:tasks.workunit.client.1.smithi119.stdout:4/124: read dd/f1d [1716354,82909] 0 2023-12-17T11:57:36.360 INFO:tasks.workunit.client.0.smithi002.stdout:0/127: sync 2023-12-17T11:57:36.360 INFO:tasks.workunit.client.0.smithi002.stdout:0/128: dread - d0/d6/d26/f24 zero size 2023-12-17T11:57:36.361 INFO:tasks.workunit.client.0.smithi002.stdout:5/135: sync 2023-12-17T11:57:36.361 INFO:tasks.workunit.client.0.smithi002.stdout:7/189: sync 2023-12-17T11:57:36.363 INFO:tasks.workunit.client.0.smithi002.stdout:6/165: rmdir d0/d1 39 2023-12-17T11:57:36.364 INFO:tasks.workunit.client.0.smithi002.stdout:3/249: sync 2023-12-17T11:57:36.368 INFO:tasks.workunit.client.1.smithi119.stdout:2/172: dread d6/d9/f2a [0,4194304] 0 2023-12-17T11:57:36.368 INFO:tasks.workunit.client.1.smithi119.stdout:7/239: mkdir d2/d4b 0 2023-12-17T11:57:36.369 INFO:tasks.workunit.client.0.smithi002.stdout:0/129: rename d0/d6/d26/d14/f2a to d0/d6/d26/f2d 0 2023-12-17T11:57:36.372 INFO:tasks.workunit.client.0.smithi002.stdout:5/136: creat dc/d1a/f22 x:0 0 0 2023-12-17T11:57:36.373 INFO:tasks.workunit.client.0.smithi002.stdout:5/137: fdatasync f6 0 2023-12-17T11:57:36.373 INFO:tasks.workunit.client.1.smithi119.stdout:5/219: rmdir d1/d25 39 2023-12-17T11:57:36.375 INFO:tasks.workunit.client.0.smithi002.stdout:3/250: link d9/l38 d9/d24/l55 0 2023-12-17T11:57:36.375 INFO:tasks.workunit.client.0.smithi002.stdout:3/251: fdatasync d9/f45 0 2023-12-17T11:57:36.375 INFO:tasks.workunit.client.0.smithi002.stdout:3/252: truncate d9/d1b/d35/f3b 657396 0 2023-12-17T11:57:36.378 INFO:tasks.workunit.client.1.smithi119.stdout:7/240: creat d2/d4/d1f/f4c x:0 0 0 2023-12-17T11:57:36.378 INFO:tasks.workunit.client.1.smithi119.stdout:7/241: readlink d2/lc 0 2023-12-17T11:57:36.381 INFO:tasks.workunit.client.1.smithi119.stdout:4/125: getdents dd 0 2023-12-17T11:57:36.382 INFO:tasks.workunit.client.0.smithi002.stdout:1/229: dwrite d3/f49 [0,4194304] 0 2023-12-17T11:57:36.382 INFO:tasks.workunit.client.0.smithi002.stdout:2/200: dwrite d3/d4/fd [0,4194304] 0 2023-12-17T11:57:36.390 INFO:tasks.workunit.client.1.smithi119.stdout:4/126: dread dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:36.390 INFO:tasks.workunit.client.1.smithi119.stdout:7/242: creat d2/d4/d11/d3c/f4d x:0 0 0 2023-12-17T11:57:36.393 INFO:tasks.workunit.client.1.smithi119.stdout:8/141: dwrite d7/da/f22 [0,4194304] 0 2023-12-17T11:57:36.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/130: unlink d0/d6/d26/d25/l2c 0 2023-12-17T11:57:36.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/131: creat d0/f2e x:0 0 0 2023-12-17T11:57:36.396 INFO:tasks.workunit.client.0.smithi002.stdout:5/138: dread fa [0,4194304] 0 2023-12-17T11:57:36.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/132: write d0/d6/d26/d14/d19/f21 [748174,95581] 0 2023-12-17T11:57:36.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/201: mknod d3/d4/d7/d14/d2e/d37/d3f/c4c 0 2023-12-17T11:57:36.400 INFO:tasks.workunit.client.0.smithi002.stdout:1/230: truncate d3/ff 272131 0 2023-12-17T11:57:36.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/231: fsync d3/d6/d9/f38 0 2023-12-17T11:57:36.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/232: stat d3/d6/d9/d30 0 2023-12-17T11:57:36.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/233: fsync d3/d6/d9/d30/f41 0 2023-12-17T11:57:36.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/234: chown d3/d6/d9/d30/l19 841277993 1 2023-12-17T11:57:36.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/235: fsync d3/d6/d16/f31 0 2023-12-17T11:57:36.401 INFO:tasks.workunit.client.0.smithi002.stdout:1/236: chown d3/f49 0 1 2023-12-17T11:57:36.402 INFO:tasks.workunit.client.0.smithi002.stdout:3/253: rmdir d9/d1b/d35/d41/d43 39 2023-12-17T11:57:36.406 INFO:tasks.workunit.client.0.smithi002.stdout:4/202: dwrite d0/f43 [0,4194304] 0 2023-12-17T11:57:36.408 INFO:tasks.workunit.client.1.smithi119.stdout:3/187: rename d9/d1c/d2a to d9/da/df/d41 0 2023-12-17T11:57:36.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/139: rmdir dc 39 2023-12-17T11:57:36.411 INFO:tasks.workunit.client.1.smithi119.stdout:8/142: truncate d7/ff 1667093 0 2023-12-17T11:57:36.413 INFO:tasks.workunit.client.0.smithi002.stdout:0/133: dread d0/d6/fb [0,4194304] 0 2023-12-17T11:57:36.415 INFO:tasks.workunit.client.1.smithi119.stdout:5/220: read d1/f35 [3851813,50103] 0 2023-12-17T11:57:36.416 INFO:tasks.workunit.client.0.smithi002.stdout:8/217: dwrite d3/f40 [0,4194304] 0 2023-12-17T11:57:36.416 INFO:tasks.workunit.client.1.smithi119.stdout:0/137: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:57:36.420 INFO:tasks.workunit.client.1.smithi119.stdout:3/188: symlink d9/d35/l42 0 2023-12-17T11:57:36.420 INFO:tasks.workunit.client.1.smithi119.stdout:4/127: write f8 [6111635,35709] 0 2023-12-17T11:57:36.420 INFO:tasks.workunit.client.1.smithi119.stdout:4/128: dread - dd/d15/d16/f1a zero size 2023-12-17T11:57:36.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/166: dread d0/d1/dc/f16 [0,4194304] 0 2023-12-17T11:57:36.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/167: readlink d0/d1/dc/lb 0 2023-12-17T11:57:36.421 INFO:tasks.workunit.client.0.smithi002.stdout:6/168: truncate d0/d1/d21/f2d 677145 0 2023-12-17T11:57:36.424 INFO:tasks.workunit.client.1.smithi119.stdout:3/189: creat d9/da/f43 x:0 0 0 2023-12-17T11:57:36.426 INFO:tasks.workunit.client.0.smithi002.stdout:7/190: dwrite d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:57:36.426 INFO:tasks.workunit.client.0.smithi002.stdout:7/191: write d6/d17/dc/d13/f14 [135480,53239] 0 2023-12-17T11:57:36.426 INFO:tasks.workunit.client.1.smithi119.stdout:2/173: rename d6/d9/d13/d1d/d2c to d6/d9/d3a 0 2023-12-17T11:57:36.429 INFO:tasks.workunit.client.0.smithi002.stdout:2/202: mkdir d3/d4/d17/d19/d4d 0 2023-12-17T11:57:36.432 INFO:tasks.workunit.client.0.smithi002.stdout:1/237: mkdir d3/d6/d9/d37/d39/d43/d4a 0 2023-12-17T11:57:36.432 INFO:tasks.workunit.client.0.smithi002.stdout:1/238: fdatasync d3/d6/f2b 0 2023-12-17T11:57:36.436 INFO:tasks.workunit.client.0.smithi002.stdout:3/254: unlink d9/f29 0 2023-12-17T11:57:36.439 INFO:tasks.workunit.client.0.smithi002.stdout:7/192: dread d6/f1c [0,4194304] 0 2023-12-17T11:57:36.439 INFO:tasks.workunit.client.1.smithi119.stdout:0/138: dread d2/d16/f17 [0,4194304] 0 2023-12-17T11:57:36.439 INFO:tasks.workunit.client.1.smithi119.stdout:0/139: chown d2/d3/d5/dc/l15 18 1 2023-12-17T11:57:36.439 INFO:tasks.workunit.client.1.smithi119.stdout:3/190: dread d9/da/df/d41/d33/d3a/f40 [0,4194304] 0 2023-12-17T11:57:36.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/203: mkdir d0/d3e/d47 0 2023-12-17T11:57:36.443 INFO:tasks.workunit.client.0.smithi002.stdout:5/140: symlink dc/l23 0 2023-12-17T11:57:36.444 INFO:tasks.workunit.client.0.smithi002.stdout:5/141: write f7 [1680889,42436] 0 2023-12-17T11:57:36.445 INFO:tasks.workunit.client.0.smithi002.stdout:5/142: chown dc/l10 102 1 2023-12-17T11:57:36.447 INFO:tasks.workunit.client.1.smithi119.stdout:0/140: mknod d2/d16/d12/d1f/d24/c2a 0 2023-12-17T11:57:36.448 INFO:tasks.workunit.client.1.smithi119.stdout:2/174: dread d6/d9/fd [0,4194304] 0 2023-12-17T11:57:36.450 INFO:tasks.workunit.client.0.smithi002.stdout:4/204: dread d0/f8 [0,4194304] 0 2023-12-17T11:57:36.463 INFO:tasks.workunit.client.1.smithi119.stdout:2/175: symlink d6/d9/d13/d1d/l3b 0 2023-12-17T11:57:36.464 INFO:tasks.workunit.client.1.smithi119.stdout:2/176: write d6/f14 [1067389,83013] 0 2023-12-17T11:57:36.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/218: creat d3/d7/d18/d3f/d49/f4e x:0 0 0 2023-12-17T11:57:36.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/193: dread d6/d17/f1a [0,4194304] 0 2023-12-17T11:57:36.470 INFO:tasks.workunit.client.0.smithi002.stdout:7/194: write d6/d17/dc/d13/f14 [989783,102441] 0 2023-12-17T11:57:36.471 INFO:tasks.workunit.client.0.smithi002.stdout:7/195: fdatasync d6/d17/dc/d13/f2d 0 2023-12-17T11:57:36.471 INFO:tasks.workunit.client.0.smithi002.stdout:7/196: stat d6 0 2023-12-17T11:57:36.471 INFO:tasks.workunit.client.0.smithi002.stdout:7/197: chown d6/f1c 3363253 1 2023-12-17T11:57:36.471 INFO:tasks.workunit.client.1.smithi119.stdout:4/129: dread dd/f1d [0,4194304] 0 2023-12-17T11:57:36.474 INFO:tasks.workunit.client.0.smithi002.stdout:2/203: symlink d3/d4/d7/d14/d2e/d37/d3f/l4e 0 2023-12-17T11:57:36.474 INFO:tasks.workunit.client.0.smithi002.stdout:2/204: fdatasync d3/d4/d7/f1a 0 2023-12-17T11:57:36.474 INFO:tasks.workunit.client.0.smithi002.stdout:3/255: symlink d9/d40/l56 0 2023-12-17T11:57:36.477 INFO:tasks.workunit.client.1.smithi119.stdout:6/165: sync 2023-12-17T11:57:36.478 INFO:tasks.workunit.client.1.smithi119.stdout:6/166: fsync d2/f7 0 2023-12-17T11:57:36.484 INFO:tasks.workunit.client.0.smithi002.stdout:2/205: creat d3/d4/d43/f4f x:0 0 0 2023-12-17T11:57:36.487 INFO:tasks.workunit.client.1.smithi119.stdout:8/143: dwrite d7/d12/d1f/f24 [0,4194304] 0 2023-12-17T11:57:36.490 INFO:tasks.workunit.client.1.smithi119.stdout:8/144: stat d7/da/d1a/c29 0 2023-12-17T11:57:36.490 INFO:tasks.workunit.client.0.smithi002.stdout:6/169: dwrite d0/d1/fd [0,4194304] 0 2023-12-17T11:57:36.491 INFO:tasks.workunit.client.1.smithi119.stdout:8/145: creat d7/d12/f33 x:0 0 0 2023-12-17T11:57:36.491 INFO:tasks.workunit.client.1.smithi119.stdout:8/146: read - d7/d12/f33 zero size 2023-12-17T11:57:36.491 INFO:tasks.workunit.client.1.smithi119.stdout:5/221: dwrite d1/f30 [0,4194304] 0 2023-12-17T11:57:36.495 INFO:tasks.workunit.client.1.smithi119.stdout:8/147: rename d7/ff to d7/da/d1a/f34 0 2023-12-17T11:57:36.495 INFO:tasks.workunit.client.1.smithi119.stdout:8/148: readlink d7/l8 0 2023-12-17T11:57:36.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/198: write d6/d17/dc/d13/f30 [1972963,62005] 0 2023-12-17T11:57:36.496 INFO:tasks.workunit.client.0.smithi002.stdout:2/206: dread d3/d4/ff [0,4194304] 0 2023-12-17T11:57:36.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/170: rename d0/d1/d21/f31 to d0/d1/d28/f32 0 2023-12-17T11:57:36.501 INFO:tasks.workunit.client.0.smithi002.stdout:9/222: sync 2023-12-17T11:57:36.503 INFO:tasks.workunit.client.1.smithi119.stdout:5/222: symlink d1/d44/l4a 0 2023-12-17T11:57:36.503 INFO:tasks.workunit.client.1.smithi119.stdout:5/223: dread - d1/d25/d39/f3c zero size 2023-12-17T11:57:36.503 INFO:tasks.workunit.client.0.smithi002.stdout:2/207: mkdir d3/d50 0 2023-12-17T11:57:36.503 INFO:tasks.workunit.client.0.smithi002.stdout:4/205: rmdir d0 39 2023-12-17T11:57:36.503 INFO:tasks.workunit.client.0.smithi002.stdout:4/206: chown d0/l17 4046241 1 2023-12-17T11:57:36.504 INFO:tasks.workunit.client.0.smithi002.stdout:2/208: chown d3/d4/fe 125 1 2023-12-17T11:57:36.504 INFO:tasks.workunit.client.0.smithi002.stdout:3/256: dread d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:36.504 INFO:tasks.workunit.client.0.smithi002.stdout:3/257: chown d9/l38 0 1 2023-12-17T11:57:36.504 INFO:tasks.workunit.client.0.smithi002.stdout:3/258: chown d9/d15/c3c 334247 1 2023-12-17T11:57:36.504 INFO:tasks.workunit.client.0.smithi002.stdout:3/259: dread - d9/d15/f22 zero size 2023-12-17T11:57:36.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/171: rmdir d0/d1/d21 39 2023-12-17T11:57:36.508 INFO:tasks.workunit.client.0.smithi002.stdout:0/134: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:36.508 INFO:tasks.workunit.client.0.smithi002.stdout:1/239: dwrite d3/d6/d16/f47 [0,4194304] 0 2023-12-17T11:57:36.508 INFO:tasks.workunit.client.1.smithi119.stdout:8/149: link d7/fb d7/f35 0 2023-12-17T11:57:36.516 INFO:tasks.workunit.client.0.smithi002.stdout:3/260: creat d9/d1b/d35/d41/d43/d4b/f57 x:0 0 0 2023-12-17T11:57:36.516 INFO:tasks.workunit.client.0.smithi002.stdout:7/199: creat d6/f3a x:0 0 0 2023-12-17T11:57:36.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/207: link d0/d10/d21/d33/f37 d0/d10/d21/f48 0 2023-12-17T11:57:36.517 INFO:tasks.workunit.client.0.smithi002.stdout:6/172: rename d0/d1/l12 to d0/d1/dc/d10/l33 0 2023-12-17T11:57:36.517 INFO:tasks.workunit.client.0.smithi002.stdout:6/173: chown d0/la 6174767 1 2023-12-17T11:57:36.517 INFO:tasks.workunit.client.0.smithi002.stdout:2/209: write d3/d4/d7/d14/d1b/f29 [3504563,105333] 0 2023-12-17T11:57:36.518 INFO:tasks.workunit.client.0.smithi002.stdout:2/210: chown d3/d4/d7/d14/l39 1 1 2023-12-17T11:57:36.521 INFO:tasks.workunit.client.0.smithi002.stdout:0/135: mkdir d0/d6/d26/d14/d19/d2f 0 2023-12-17T11:57:36.523 INFO:tasks.workunit.client.0.smithi002.stdout:7/200: truncate d6/d17/d16/d1d/f35 495726 0 2023-12-17T11:57:36.523 INFO:tasks.workunit.client.0.smithi002.stdout:7/201: write d6/d17/dc/d13/f2d [2104284,47850] 0 2023-12-17T11:57:36.523 INFO:tasks.workunit.client.0.smithi002.stdout:7/202: creat d6/f3b x:0 0 0 2023-12-17T11:57:36.526 INFO:tasks.workunit.client.0.smithi002.stdout:1/240: unlink d3/d6/d9/d37/f45 0 2023-12-17T11:57:36.528 INFO:tasks.workunit.client.0.smithi002.stdout:6/174: rename d0/d1/dc/f16 to d0/d1/dc/f34 0 2023-12-17T11:57:36.530 INFO:tasks.workunit.client.0.smithi002.stdout:3/261: rename d9/l38 to d9/d15/l58 0 2023-12-17T11:57:36.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/203: unlink d6/f3a 0 2023-12-17T11:57:36.532 INFO:tasks.workunit.client.0.smithi002.stdout:6/175: truncate d0/d1/dc/ff 2350445 0 2023-12-17T11:57:36.533 INFO:tasks.workunit.client.0.smithi002.stdout:0/136: dread d0/d6/d26/f20 [0,4194304] 0 2023-12-17T11:57:36.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/130: write dd/f18 [2147264,16145] 0 2023-12-17T11:57:36.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/141: dwrite d2/d16/d12/f1c [4194304,4194304] 0 2023-12-17T11:57:36.535 INFO:tasks.workunit.client.1.smithi119.stdout:0/142: symlink d2/d3/d5/l2b 0 2023-12-17T11:57:36.535 INFO:tasks.workunit.client.0.smithi002.stdout:7/204: truncate d6/d17/d16/d1d/d24/f31 797756 0 2023-12-17T11:57:36.536 INFO:tasks.workunit.client.1.smithi119.stdout:3/191: dwrite d9/da/df/f17 [4194304,4194304] 0 2023-12-17T11:57:36.536 INFO:tasks.workunit.client.1.smithi119.stdout:3/192: dread - d9/da/f43 zero size 2023-12-17T11:57:36.536 INFO:tasks.workunit.client.1.smithi119.stdout:2/177: dwrite d6/f21 [0,4194304] 0 2023-12-17T11:57:36.538 INFO:tasks.workunit.client.1.smithi119.stdout:3/193: mkdir d9/d44 0 2023-12-17T11:57:36.540 INFO:tasks.workunit.client.1.smithi119.stdout:2/178: creat d6/d2b/f3c x:0 0 0 2023-12-17T11:57:36.542 INFO:tasks.workunit.client.1.smithi119.stdout:2/179: symlink d6/d9/d13/d34/l3d 0 2023-12-17T11:57:36.542 INFO:tasks.workunit.client.1.smithi119.stdout:2/180: write d6/f1f [4543754,9246] 0 2023-12-17T11:57:36.542 INFO:tasks.workunit.client.1.smithi119.stdout:2/181: fsync d6/d9/f2a 0 2023-12-17T11:57:36.548 INFO:tasks.workunit.client.1.smithi119.stdout:0/143: dread d2/d16/f17 [0,4194304] 0 2023-12-17T11:57:36.550 INFO:tasks.workunit.client.1.smithi119.stdout:6/167: dwrite d2/df/f1f [0,4194304] 0 2023-12-17T11:57:36.551 INFO:tasks.workunit.client.0.smithi002.stdout:2/211: dread d3/d4/f5 [0,4194304] 0 2023-12-17T11:57:36.552 INFO:tasks.workunit.client.0.smithi002.stdout:5/143: dwrite dc/d1a/f22 [0,4194304] 0 2023-12-17T11:57:36.552 INFO:tasks.workunit.client.0.smithi002.stdout:8/219: dread d3/f40 [0,4194304] 0 2023-12-17T11:57:36.552 INFO:tasks.workunit.client.0.smithi002.stdout:8/220: chown d3/d8/d28 87766 1 2023-12-17T11:57:36.553 INFO:tasks.workunit.client.0.smithi002.stdout:0/137: rename d0/d6/f11 to d0/d6/d26/d14/d19/d2b/f30 0 2023-12-17T11:57:36.558 INFO:tasks.workunit.client.1.smithi119.stdout:0/144: mknod d2/d16/d12/d21/c2c 0 2023-12-17T11:57:36.558 INFO:tasks.workunit.client.1.smithi119.stdout:0/145: fdatasync d2/f28 0 2023-12-17T11:57:36.559 INFO:tasks.workunit.client.1.smithi119.stdout:3/194: write d9/da/df/f17 [3476238,77817] 0 2023-12-17T11:57:36.562 INFO:tasks.workunit.client.0.smithi002.stdout:9/223: dread dc/d1d/d23/f29 [0,4194304] 0 2023-12-17T11:57:36.566 INFO:tasks.workunit.client.0.smithi002.stdout:8/221: mknod d3/d8/da/dd/c4f 0 2023-12-17T11:57:36.567 INFO:tasks.workunit.client.0.smithi002.stdout:4/208: dread d0/d10/d21/f36 [0,4194304] 0 2023-12-17T11:57:36.572 INFO:tasks.workunit.client.1.smithi119.stdout:6/168: rmdir d2/df 39 2023-12-17T11:57:36.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/212: rename d3/d4/d17/l28 to d3/d4/d7/d14/d42/l51 0 2023-12-17T11:57:36.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/213: truncate d3/d4/d7/d14/d34/f4b 367512 0 2023-12-17T11:57:36.573 INFO:tasks.workunit.client.1.smithi119.stdout:6/169: read - d2/d2b/f2d zero size 2023-12-17T11:57:36.573 INFO:tasks.workunit.client.1.smithi119.stdout:6/170: chown d2/df 4135 1 2023-12-17T11:57:36.574 INFO:tasks.workunit.client.1.smithi119.stdout:6/171: truncate d2/df/d17/f23 935401 0 2023-12-17T11:57:36.574 INFO:tasks.workunit.client.1.smithi119.stdout:6/172: creat d2/df/d17/f2f x:0 0 0 2023-12-17T11:57:36.574 INFO:tasks.workunit.client.1.smithi119.stdout:6/173: truncate d2/df/f24 4605518 0 2023-12-17T11:57:36.574 INFO:tasks.workunit.client.1.smithi119.stdout:6/174: write d2/f19 [419390,36057] 0 2023-12-17T11:57:36.576 INFO:tasks.workunit.client.1.smithi119.stdout:8/150: write d7/d12/d1f/f24 [1811899,64076] 0 2023-12-17T11:57:36.576 INFO:tasks.workunit.client.1.smithi119.stdout:8/151: readlink d7/l8 0 2023-12-17T11:57:36.580 INFO:tasks.workunit.client.0.smithi002.stdout:9/224: link dc/d1d/f3b dc/d32/f51 0 2023-12-17T11:57:36.581 INFO:tasks.workunit.client.1.smithi119.stdout:5/224: dwrite d1/fa [0,4194304] 0 2023-12-17T11:57:36.581 INFO:tasks.workunit.client.1.smithi119.stdout:4/131: dread f8 [4194304,4194304] 0 2023-12-17T11:57:36.581 INFO:tasks.workunit.client.1.smithi119.stdout:4/132: fdatasync f2 0 2023-12-17T11:57:36.582 INFO:tasks.workunit.client.1.smithi119.stdout:3/195: symlink d9/d11/d1e/l45 0 2023-12-17T11:57:36.585 INFO:tasks.workunit.client.0.smithi002.stdout:2/214: creat d3/d4/f52 x:0 0 0 2023-12-17T11:57:36.585 INFO:tasks.workunit.client.0.smithi002.stdout:2/215: chown d3/d4/d7/d14/d2e/d37/d3f/l4e 29602988 1 2023-12-17T11:57:36.585 INFO:tasks.workunit.client.0.smithi002.stdout:2/216: readlink d3/d4/d7/d14/d2e/l3d 0 2023-12-17T11:57:36.593 INFO:tasks.workunit.client.1.smithi119.stdout:6/175: creat d2/df/f30 x:0 0 0 2023-12-17T11:57:36.593 INFO:tasks.workunit.client.0.smithi002.stdout:9/225: mkdir dc/d1d/d23/d52 0 2023-12-17T11:57:36.594 INFO:tasks.workunit.client.1.smithi119.stdout:6/176: creat d2/df/f31 x:0 0 0 2023-12-17T11:57:36.594 INFO:tasks.workunit.client.1.smithi119.stdout:6/177: dread - d2/d2b/f2d zero size 2023-12-17T11:57:36.595 INFO:tasks.workunit.client.0.smithi002.stdout:7/205: dread d6/d17/dc/d13/f2d [0,4194304] 0 2023-12-17T11:57:36.603 INFO:tasks.workunit.client.1.smithi119.stdout:8/152: dread d7/d12/d1f/f24 [0,4194304] 0 2023-12-17T11:57:36.603 INFO:tasks.workunit.client.0.smithi002.stdout:1/241: dwrite d3/d6/f2b [0,4194304] 0 2023-12-17T11:57:36.603 INFO:tasks.workunit.client.0.smithi002.stdout:1/242: fdatasync d3/d6/d9/f2e 0 2023-12-17T11:57:36.604 INFO:tasks.workunit.client.0.smithi002.stdout:1/243: read - d3/d6/d9/f35 zero size 2023-12-17T11:57:36.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/206: creat d6/d17/dc/d13/d37/f3c x:0 0 0 2023-12-17T11:57:36.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/207: readlink d6/d17/dc/d13/l34 0 2023-12-17T11:57:36.610 INFO:tasks.workunit.client.0.smithi002.stdout:3/262: dread d9/d24/f3e [0,4194304] 0 2023-12-17T11:57:36.611 INFO:tasks.workunit.client.1.smithi119.stdout:0/146: dwrite d2/d16/d12/d21/f26 [0,4194304] 0 2023-12-17T11:57:36.611 INFO:tasks.workunit.client.1.smithi119.stdout:0/147: chown d2/d3 30827068 1 2023-12-17T11:57:36.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/263: read d9/f14 [208714,74845] 0 2023-12-17T11:57:36.616 INFO:tasks.workunit.client.0.smithi002.stdout:3/264: readlink d9/l27 0 2023-12-17T11:57:36.616 INFO:tasks.workunit.client.1.smithi119.stdout:4/133: mknod dd/d15/d16/c27 0 2023-12-17T11:57:36.617 INFO:tasks.workunit.client.1.smithi119.stdout:4/134: truncate dd/d15/d16/f1a 951479 0 2023-12-17T11:57:36.617 INFO:tasks.workunit.client.1.smithi119.stdout:4/135: fsync dd/d15/d16/f1a 0 2023-12-17T11:57:36.617 INFO:tasks.workunit.client.1.smithi119.stdout:4/136: chown dd/d15/l25 30163905 1 2023-12-17T11:57:36.626 INFO:tasks.workunit.client.1.smithi119.stdout:8/153: truncate d7/da/d1a/f1c 11863673 0 2023-12-17T11:57:36.626 INFO:tasks.workunit.client.1.smithi119.stdout:8/154: truncate d7/da/d11/f1d 1742877 0 2023-12-17T11:57:36.626 INFO:tasks.workunit.client.1.smithi119.stdout:8/155: fdatasync d7/da/d11/d26/f28 0 2023-12-17T11:57:36.626 INFO:tasks.workunit.client.1.smithi119.stdout:8/156: chown d7/da/d1a/f34 33457382 1 2023-12-17T11:57:36.628 INFO:tasks.workunit.client.0.smithi002.stdout:1/244: mknod d3/d6/d9/d37/d39/c4b 0 2023-12-17T11:57:36.629 INFO:tasks.workunit.client.0.smithi002.stdout:1/245: creat d3/d6/d9/d30/f4c x:0 0 0 2023-12-17T11:57:36.631 INFO:tasks.workunit.client.0.smithi002.stdout:7/208: rmdir d6/d17/d16/d1d/d24 39 2023-12-17T11:57:36.632 INFO:tasks.workunit.client.1.smithi119.stdout:3/196: dwrite d9/d11/d1e/f1f [0,4194304] 0 2023-12-17T11:57:36.632 INFO:tasks.workunit.client.1.smithi119.stdout:3/197: chown d9/d11/d1e/l45 33185978 1 2023-12-17T11:57:36.632 INFO:tasks.workunit.client.1.smithi119.stdout:3/198: stat d9/d11/c1d 0 2023-12-17T11:57:36.633 INFO:tasks.workunit.client.0.smithi002.stdout:3/265: read d9/d24/f25 [1484712,48763] 0 2023-12-17T11:57:36.634 INFO:tasks.workunit.client.1.smithi119.stdout:2/182: dwrite d6/d9/fd [0,4194304] 0 2023-12-17T11:57:36.636 INFO:tasks.workunit.client.1.smithi119.stdout:0/148: mkdir d2/d3/d2d 0 2023-12-17T11:57:36.636 INFO:tasks.workunit.client.1.smithi119.stdout:0/149: truncate d2/d16/f27 409260 0 2023-12-17T11:57:36.636 INFO:tasks.workunit.client.1.smithi119.stdout:0/150: truncate d2/d16/d12/f1a 4237101 0 2023-12-17T11:57:36.640 INFO:tasks.workunit.client.0.smithi002.stdout:0/138: dwrite d0/d6/d26/f20 [0,4194304] 0 2023-12-17T11:57:36.641 INFO:tasks.workunit.client.0.smithi002.stdout:0/139: chown d0/d6/fb 15 1 2023-12-17T11:57:36.641 INFO:tasks.workunit.client.1.smithi119.stdout:1/108: sync 2023-12-17T11:57:36.641 INFO:tasks.workunit.client.1.smithi119.stdout:9/200: sync 2023-12-17T11:57:36.641 INFO:tasks.workunit.client.1.smithi119.stdout:5/225: rename d1/fd to d1/d36/d3a/f4b 0 2023-12-17T11:57:36.643 INFO:tasks.workunit.client.1.smithi119.stdout:4/137: rename dd/f21 to dd/f28 0 2023-12-17T11:57:36.648 INFO:tasks.workunit.client.0.smithi002.stdout:7/209: mknod d6/d17/d16/c3d 0 2023-12-17T11:57:36.651 INFO:tasks.workunit.client.0.smithi002.stdout:1/246: unlink d3/d6/c1c 0 2023-12-17T11:57:36.651 INFO:tasks.workunit.client.1.smithi119.stdout:7/243: sync 2023-12-17T11:57:36.652 INFO:tasks.workunit.client.1.smithi119.stdout:3/199: symlink d9/da/df/d41/l46 0 2023-12-17T11:57:36.654 INFO:tasks.workunit.client.0.smithi002.stdout:3/266: mkdir d9/d1b/d35/d41/d59 0 2023-12-17T11:57:36.657 INFO:tasks.workunit.client.1.smithi119.stdout:2/183: unlink d6/d9/f1b 0 2023-12-17T11:57:36.657 INFO:tasks.workunit.client.1.smithi119.stdout:2/184: fsync d6/d9/d13/f32 0 2023-12-17T11:57:36.660 INFO:tasks.workunit.client.1.smithi119.stdout:0/151: getdents d2/d3/d5 0 2023-12-17T11:57:36.668 INFO:tasks.workunit.client.0.smithi002.stdout:8/222: write d3/d8/d28/d31/f3e [97722,1001] 0 2023-12-17T11:57:36.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/176: dwrite d0/d1/dc/f34 [4194304,4194304] 0 2023-12-17T11:57:36.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/177: write d0/d1/dc/d17/f2e [997492,20656] 0 2023-12-17T11:57:36.669 INFO:tasks.workunit.client.1.smithi119.stdout:5/226: truncate d1/d25/f31 186736 0 2023-12-17T11:57:36.674 INFO:tasks.workunit.client.0.smithi002.stdout:0/140: creat d0/d6/d26/d25/f31 x:0 0 0 2023-12-17T11:57:36.675 INFO:tasks.workunit.client.0.smithi002.stdout:1/247: mkdir d3/d2f/d4d 0 2023-12-17T11:57:36.681 INFO:tasks.workunit.client.1.smithi119.stdout:4/138: link c6 dd/d15/c29 0 2023-12-17T11:57:36.684 INFO:tasks.workunit.client.0.smithi002.stdout:3/267: symlink d9/d1b/d35/d41/d59/l5a 0 2023-12-17T11:57:36.684 INFO:tasks.workunit.client.0.smithi002.stdout:3/268: stat d9/d1b/f28 0 2023-12-17T11:57:36.684 INFO:tasks.workunit.client.0.smithi002.stdout:3/269: truncate d9/d1b/d4f/f53 1047085 0 2023-12-17T11:57:36.685 INFO:tasks.workunit.client.1.smithi119.stdout:8/157: dwrite d7/d12/f2b [0,4194304] 0 2023-12-17T11:57:36.687 INFO:tasks.workunit.client.1.smithi119.stdout:3/200: truncate d9/d1c/f24 4136857 0 2023-12-17T11:57:36.688 INFO:tasks.workunit.client.1.smithi119.stdout:3/201: readlink d9/da/df/d41/d33/l38 0 2023-12-17T11:57:36.688 INFO:tasks.workunit.client.1.smithi119.stdout:3/202: stat d9/d11/c36 0 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:2/185: creat d6/d9/d13/f3e x:0 0 0 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:5/227: dread d1/d36/f3d [0,4194304] 0 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:5/228: dread - d1/d36/f47 zero size 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:9/201: dwrite d12/f23 [0,4194304] 0 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:9/202: truncate d12/d1d/f36 752542 0 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:9/203: creat d12/f42 x:0 0 0 2023-12-17T11:57:36.701 INFO:tasks.workunit.client.1.smithi119.stdout:9/204: truncate d12/d1d/f32 2059976 0 2023-12-17T11:57:36.703 INFO:tasks.workunit.client.0.smithi002.stdout:4/209: dwrite d0/d10/f30 [0,4194304] 0 2023-12-17T11:57:36.711 INFO:tasks.workunit.client.0.smithi002.stdout:7/210: dwrite d6/d17/dc/d13/d37/f3c [0,4194304] 0 2023-12-17T11:57:36.711 INFO:tasks.workunit.client.0.smithi002.stdout:7/211: readlink d6/d17/dc/d13/l38 0 2023-12-17T11:57:36.712 INFO:tasks.workunit.client.0.smithi002.stdout:8/223: rename d3/d8/da/d44/c47 to d3/d8/d28/c50 0 2023-12-17T11:57:36.712 INFO:tasks.workunit.client.1.smithi119.stdout:8/158: symlink d7/d12/d23/l36 0 2023-12-17T11:57:36.717 INFO:tasks.workunit.client.0.smithi002.stdout:6/178: mknod d0/c35 0 2023-12-17T11:57:36.717 INFO:tasks.workunit.client.0.smithi002.stdout:6/179: stat d0/d1/dc/d17/f26 0 2023-12-17T11:57:36.717 INFO:tasks.workunit.client.0.smithi002.stdout:6/180: fsync d0/f1a 0 2023-12-17T11:57:36.717 INFO:tasks.workunit.client.0.smithi002.stdout:6/181: write d0/d1/dc/d10/f14 [563395,10185] 0 2023-12-17T11:57:36.717 INFO:tasks.workunit.client.0.smithi002.stdout:5/144: dread f7 [0,4194304] 0 2023-12-17T11:57:36.718 INFO:tasks.workunit.client.1.smithi119.stdout:6/178: rename d2/c25 to d2/df/d17/c32 0 2023-12-17T11:57:36.718 INFO:tasks.workunit.client.1.smithi119.stdout:6/179: fdatasync d2/df/d17/f2a 0 2023-12-17T11:57:36.719 INFO:tasks.workunit.client.1.smithi119.stdout:0/152: dwrite d2/d3/f14 [4194304,4194304] 0 2023-12-17T11:57:36.721 INFO:tasks.workunit.client.0.smithi002.stdout:9/226: dwrite dc/d42/f4a [0,4194304] 0 2023-12-17T11:57:36.721 INFO:tasks.workunit.client.0.smithi002.stdout:9/227: fsync dc/d1d/d23/d24/f4e 0 2023-12-17T11:57:36.723 INFO:tasks.workunit.client.0.smithi002.stdout:0/141: rmdir d0/d6 39 2023-12-17T11:57:36.724 INFO:tasks.workunit.client.0.smithi002.stdout:0/142: truncate d0/d6/d26/f20 5131156 0 2023-12-17T11:57:36.724 INFO:tasks.workunit.client.0.smithi002.stdout:0/143: readlink d0/d6/la 0 2023-12-17T11:57:36.724 INFO:tasks.workunit.client.1.smithi119.stdout:3/203: dread f5 [0,4194304] 0 2023-12-17T11:57:36.724 INFO:tasks.workunit.client.1.smithi119.stdout:3/204: chown d9/d11/f2f 0 1 2023-12-17T11:57:36.729 INFO:tasks.workunit.client.1.smithi119.stdout:5/229: dread d1/f35 [0,4194304] 0 2023-12-17T11:57:36.734 INFO:tasks.workunit.client.1.smithi119.stdout:9/205: truncate d12/d1d/d28/f3d 7783105 0 2023-12-17T11:57:36.738 INFO:tasks.workunit.client.1.smithi119.stdout:8/159: stat l5 0 2023-12-17T11:57:36.738 INFO:tasks.workunit.client.1.smithi119.stdout:8/160: read d7/f16 [1431672,39339] 0 2023-12-17T11:57:36.744 INFO:tasks.workunit.client.1.smithi119.stdout:3/205: symlink d9/da/df/d41/l47 0 2023-12-17T11:57:36.747 INFO:tasks.workunit.client.1.smithi119.stdout:0/153: write d2/d16/d12/d21/f26 [3118900,10316] 0 2023-12-17T11:57:36.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/109: dwrite d3/d5/f11 [0,4194304] 0 2023-12-17T11:57:36.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/110: chown d3/d5/f6 86817 1 2023-12-17T11:57:36.750 INFO:tasks.workunit.client.0.smithi002.stdout:9/228: dread dc/f11 [0,4194304] 0 2023-12-17T11:57:36.750 INFO:tasks.workunit.client.1.smithi119.stdout:9/206: dread ff [0,4194304] 0 2023-12-17T11:57:36.750 INFO:tasks.workunit.client.1.smithi119.stdout:3/206: dread d9/f1b [0,4194304] 0 2023-12-17T11:57:36.755 INFO:tasks.workunit.client.1.smithi119.stdout:3/207: write d9/f1b [811636,121661] 0 2023-12-17T11:57:36.759 INFO:tasks.workunit.client.1.smithi119.stdout:4/139: dwrite f2 [0,4194304] 0 2023-12-17T11:57:36.763 INFO:tasks.workunit.client.1.smithi119.stdout:8/161: getdents d7/da/d1a 0 2023-12-17T11:57:36.764 INFO:tasks.workunit.client.0.smithi002.stdout:3/270: rename d9/d15/d31/c3a to d9/d15/d31/c5b 0 2023-12-17T11:57:36.764 INFO:tasks.workunit.client.0.smithi002.stdout:3/271: readlink d9/d40/l56 0 2023-12-17T11:57:36.766 INFO:tasks.workunit.client.0.smithi002.stdout:1/248: dwrite d3/d6/d9/d30/f3d [0,4194304] 0 2023-12-17T11:57:36.769 INFO:tasks.workunit.client.1.smithi119.stdout:5/230: getdents d1/d36/d3a 0 2023-12-17T11:57:36.771 INFO:tasks.workunit.client.0.smithi002.stdout:3/272: dread d9/d15/f2b [0,4194304] 0 2023-12-17T11:57:36.776 INFO:tasks.workunit.client.0.smithi002.stdout:4/210: link d0/d10/f40 d0/d10/d21/f49 0 2023-12-17T11:57:36.776 INFO:tasks.workunit.client.0.smithi002.stdout:9/229: write dc/f14 [3413418,70417] 0 2023-12-17T11:57:36.777 INFO:tasks.workunit.client.1.smithi119.stdout:4/140: mkdir dd/d2a 0 2023-12-17T11:57:36.783 INFO:tasks.workunit.client.1.smithi119.stdout:2/186: dwrite d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:36.784 INFO:tasks.workunit.client.1.smithi119.stdout:0/154: dread d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:36.790 INFO:tasks.workunit.client.1.smithi119.stdout:8/162: mknod d7/da/d11/d26/d2c/c37 0 2023-12-17T11:57:36.791 INFO:tasks.workunit.client.1.smithi119.stdout:8/163: chown c4 2629797 1 2023-12-17T11:57:36.793 INFO:tasks.workunit.client.0.smithi002.stdout:7/212: mkdir d6/d17/dc/d13/d3e 0 2023-12-17T11:57:36.794 INFO:tasks.workunit.client.0.smithi002.stdout:7/213: write d6/d17/d16/d1d/f35 [263413,83069] 0 2023-12-17T11:57:36.795 INFO:tasks.workunit.client.0.smithi002.stdout:8/224: symlink d3/d8/d28/l51 0 2023-12-17T11:57:36.797 INFO:tasks.workunit.client.0.smithi002.stdout:6/182: truncate d0/d1/dc/d17/f1f 3222408 0 2023-12-17T11:57:36.799 INFO:tasks.workunit.client.0.smithi002.stdout:5/145: symlink dc/d1a/l24 0 2023-12-17T11:57:36.799 INFO:tasks.workunit.client.0.smithi002.stdout:5/146: dread - dc/d17/f21 zero size 2023-12-17T11:57:36.801 INFO:tasks.workunit.client.1.smithi119.stdout:7/244: rename d2/d4/d11/d3f to d2/d4e 0 2023-12-17T11:57:36.801 INFO:tasks.workunit.client.1.smithi119.stdout:7/245: write d2/d4/d11/f21 [591888,73210] 0 2023-12-17T11:57:36.802 INFO:tasks.workunit.client.1.smithi119.stdout:2/187: truncate f5 1831264 0 2023-12-17T11:57:36.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/230: dread dc/d42/f4a [0,4194304] 0 2023-12-17T11:57:36.803 INFO:tasks.workunit.client.0.smithi002.stdout:1/249: write d3/d6/f3a [925019,62886] 0 2023-12-17T11:57:36.803 INFO:tasks.workunit.client.0.smithi002.stdout:1/250: read - d3/d6/d16/f46 zero size 2023-12-17T11:57:36.805 INFO:tasks.workunit.client.1.smithi119.stdout:0/155: mkdir d2/d16/d12/d2e 0 2023-12-17T11:57:36.805 INFO:tasks.workunit.client.0.smithi002.stdout:1/251: write d3/d6/d16/f46 [658249,16202] 0 2023-12-17T11:57:36.805 INFO:tasks.workunit.client.0.smithi002.stdout:1/252: write d3/d6/fe [2022910,67934] 0 2023-12-17T11:57:36.807 INFO:tasks.workunit.client.1.smithi119.stdout:7/246: mknod d2/d4/c4f 0 2023-12-17T11:57:36.807 INFO:tasks.workunit.client.1.smithi119.stdout:7/247: fsync d2/d4/d1f/f4c 0 2023-12-17T11:57:36.809 INFO:tasks.workunit.client.0.smithi002.stdout:4/211: symlink d0/d10/d14/l4a 0 2023-12-17T11:57:36.812 INFO:tasks.workunit.client.0.smithi002.stdout:7/214: creat d6/d17/dc/d13/d21/f3f x:0 0 0 2023-12-17T11:57:36.814 INFO:tasks.workunit.client.1.smithi119.stdout:4/141: dread dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:36.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/212: creat d0/d10/f4b x:0 0 0 2023-12-17T11:57:36.829 INFO:tasks.workunit.client.0.smithi002.stdout:1/253: write d3/f49 [841886,36760] 0 2023-12-17T11:57:36.830 INFO:tasks.workunit.client.1.smithi119.stdout:7/248: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:36.830 INFO:tasks.workunit.client.1.smithi119.stdout:7/249: write d2/f35 [1511717,30847] 0 2023-12-17T11:57:36.830 INFO:tasks.workunit.client.1.smithi119.stdout:7/250: chown d2/d4/d3e/f45 131 1 2023-12-17T11:57:36.830 INFO:tasks.workunit.client.1.smithi119.stdout:7/251: chown d2/f24 539058340 1 2023-12-17T11:57:36.831 INFO:tasks.workunit.client.1.smithi119.stdout:7/252: truncate d2/d4/f16 3324185 0 2023-12-17T11:57:36.831 INFO:tasks.workunit.client.1.smithi119.stdout:7/253: getdents d2/d49 0 2023-12-17T11:57:36.842 INFO:tasks.workunit.client.0.smithi002.stdout:3/273: dwrite d9/d1b/f28 [4194304,4194304] 0 2023-12-17T11:57:36.844 INFO:tasks.workunit.client.0.smithi002.stdout:3/274: chown d9/d15/f19 7230 1 2023-12-17T11:57:36.844 INFO:tasks.workunit.client.0.smithi002.stdout:3/275: stat d9/le 0 2023-12-17T11:57:36.844 INFO:tasks.workunit.client.0.smithi002.stdout:3/276: truncate f7 6515878 0 2023-12-17T11:57:36.844 INFO:tasks.workunit.client.0.smithi002.stdout:3/277: write d9/f1e [517253,29781] 0 2023-12-17T11:57:36.877 INFO:tasks.workunit.client.1.smithi119.stdout:3/208: dwrite d9/d1c/f24 [0,4194304] 0 2023-12-17T11:57:36.877 INFO:tasks.workunit.client.1.smithi119.stdout:3/209: chown d9/d11/l14 2 1 2023-12-17T11:57:36.892 INFO:tasks.workunit.client.1.smithi119.stdout:3/210: creat d9/d35/f48 x:0 0 0 2023-12-17T11:57:36.893 INFO:tasks.workunit.client.0.smithi002.stdout:3/278: dread f7 [0,4194304] 0 2023-12-17T11:57:36.896 INFO:tasks.workunit.client.0.smithi002.stdout:3/279: read d9/d15/f2b [861108,65986] 0 2023-12-17T11:57:36.904 INFO:tasks.workunit.client.1.smithi119.stdout:5/231: dwrite d1/d36/f47 [0,4194304] 0 2023-12-17T11:57:36.905 INFO:tasks.workunit.client.1.smithi119.stdout:6/180: dwrite d2/f2e [0,4194304] 0 2023-12-17T11:57:36.905 INFO:tasks.workunit.client.1.smithi119.stdout:6/181: write d2/f4 [1359117,47215] 0 2023-12-17T11:57:36.911 INFO:tasks.workunit.client.0.smithi002.stdout:1/254: dwrite d3/d6/f33 [0,4194304] 0 2023-12-17T11:57:36.911 INFO:tasks.workunit.client.0.smithi002.stdout:1/255: fsync d3/d6/d9/d30/f41 0 2023-12-17T11:57:36.912 INFO:tasks.workunit.client.0.smithi002.stdout:1/256: write d3/d6/d9/f35 [700893,130437] 0 2023-12-17T11:57:36.914 INFO:tasks.workunit.client.0.smithi002.stdout:5/147: dread f6 [8388608,4194304] 0 2023-12-17T11:57:36.920 INFO:tasks.workunit.client.1.smithi119.stdout:4/142: dwrite dd/f1b [0,4194304] 0 2023-12-17T11:57:36.923 INFO:tasks.workunit.client.0.smithi002.stdout:6/183: dwrite d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:36.923 INFO:tasks.workunit.client.0.smithi002.stdout:7/215: dread d6/f1c [0,4194304] 0 2023-12-17T11:57:36.924 INFO:tasks.workunit.client.1.smithi119.stdout:6/182: rename d2/f7 to d2/d2b/f33 0 2023-12-17T11:57:36.924 INFO:tasks.workunit.client.1.smithi119.stdout:6/183: creat d2/df/d17/f34 x:0 0 0 2023-12-17T11:57:36.924 INFO:tasks.workunit.client.1.smithi119.stdout:6/184: dread - d2/df/f30 zero size 2023-12-17T11:57:36.926 INFO:tasks.workunit.client.0.smithi002.stdout:1/257: link d3/d6/d9/c18 d3/d6/d9/d30/c4e 0 2023-12-17T11:57:36.928 INFO:tasks.workunit.client.1.smithi119.stdout:6/185: rename d2/df/c29 to d2/d2b/c35 0 2023-12-17T11:57:36.932 INFO:tasks.workunit.client.0.smithi002.stdout:5/148: getdents dc 0 2023-12-17T11:57:36.932 INFO:tasks.workunit.client.0.smithi002.stdout:5/149: read f8 [678974,125405] 0 2023-12-17T11:57:36.933 INFO:tasks.workunit.client.0.smithi002.stdout:5/150: chown dc/d17 591022275 1 2023-12-17T11:57:36.934 INFO:tasks.workunit.client.1.smithi119.stdout:8/164: dwrite d7/fb [0,4194304] 0 2023-12-17T11:57:36.935 INFO:tasks.workunit.client.0.smithi002.stdout:1/258: mknod d3/d6/d9/c4f 0 2023-12-17T11:57:36.935 INFO:tasks.workunit.client.1.smithi119.stdout:8/165: creat d7/d12/d23/f38 x:0 0 0 2023-12-17T11:57:36.935 INFO:tasks.workunit.client.1.smithi119.stdout:8/166: chown d7/l8 1388668 1 2023-12-17T11:57:36.935 INFO:tasks.workunit.client.1.smithi119.stdout:8/167: write d7/f27 [743137,102042] 0 2023-12-17T11:57:36.936 INFO:tasks.workunit.client.0.smithi002.stdout:1/259: creat d3/d6/d9/d37/d39/d43/f50 x:0 0 0 2023-12-17T11:57:36.943 INFO:tasks.workunit.client.0.smithi002.stdout:7/216: dread d6/d17/d16/d1d/d24/f31 [0,4194304] 0 2023-12-17T11:57:36.948 INFO:tasks.workunit.client.0.smithi002.stdout:8/225: dwrite d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:36.948 INFO:tasks.workunit.client.0.smithi002.stdout:4/213: dwrite d0/d10/f39 [0,4194304] 0 2023-12-17T11:57:36.948 INFO:tasks.workunit.client.0.smithi002.stdout:8/226: creat d3/d7/d18/d3f/d49/f52 x:0 0 0 2023-12-17T11:57:36.955 INFO:tasks.workunit.client.0.smithi002.stdout:8/227: symlink d3/d8/d28/d31/l53 0 2023-12-17T11:57:36.955 INFO:tasks.workunit.client.0.smithi002.stdout:8/228: readlink d3/d7/d1a/l48 0 2023-12-17T11:57:36.955 INFO:tasks.workunit.client.0.smithi002.stdout:8/229: creat d3/d8/da/d29/f54 x:0 0 0 2023-12-17T11:57:36.955 INFO:tasks.workunit.client.0.smithi002.stdout:8/230: stat d3/d8/f3d 0 2023-12-17T11:57:36.955 INFO:tasks.workunit.client.1.smithi119.stdout:0/156: dwrite d2/d16/d12/d21/f26 [4194304,4194304] 0 2023-12-17T11:57:36.958 INFO:tasks.workunit.client.1.smithi119.stdout:9/207: dwrite d12/f37 [0,4194304] 0 2023-12-17T11:57:36.966 INFO:tasks.workunit.client.0.smithi002.stdout:9/231: dwrite dc/f13 [0,4194304] 0 2023-12-17T11:57:36.973 INFO:tasks.workunit.client.1.smithi119.stdout:0/157: truncate d2/f28 7967325 0 2023-12-17T11:57:36.976 INFO:tasks.workunit.client.1.smithi119.stdout:5/232: dwrite d1/fa [0,4194304] 0 2023-12-17T11:57:36.977 INFO:tasks.workunit.client.1.smithi119.stdout:2/188: write f5 [2448384,44607] 0 2023-12-17T11:57:36.979 INFO:tasks.workunit.client.1.smithi119.stdout:4/143: dwrite dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:36.979 INFO:tasks.workunit.client.1.smithi119.stdout:4/144: chown f8 0 1 2023-12-17T11:57:36.979 INFO:tasks.workunit.client.1.smithi119.stdout:4/145: write f8 [5875739,53602] 0 2023-12-17T11:57:36.985 INFO:tasks.workunit.client.1.smithi119.stdout:0/158: rmdir d2/d3/d2d 0 2023-12-17T11:57:36.985 INFO:tasks.workunit.client.1.smithi119.stdout:0/159: chown d2/d3/d5/l2b 82462 1 2023-12-17T11:57:36.986 INFO:tasks.workunit.client.1.smithi119.stdout:5/233: link d1/f2e d1/d44/f4c 0 2023-12-17T11:57:36.989 INFO:tasks.workunit.client.0.smithi002.stdout:2/217: sync 2023-12-17T11:57:36.991 INFO:tasks.workunit.client.1.smithi119.stdout:4/146: rename cb to dd/d15/d16/d20/c2b 0 2023-12-17T11:57:36.993 INFO:tasks.workunit.client.1.smithi119.stdout:9/208: read d12/d1d/d28/f3d [833425,29544] 0 2023-12-17T11:57:36.994 INFO:tasks.workunit.client.1.smithi119.stdout:9/209: write d12/d1d/d28/f3d [1424901,84166] 0 2023-12-17T11:57:37.006 INFO:tasks.workunit.client.0.smithi002.stdout:9/232: dread dc/d42/f4a [0,4194304] 0 2023-12-17T11:57:37.006 INFO:tasks.workunit.client.0.smithi002.stdout:6/184: dwrite d0/d1/dc/d17/f2e [0,4194304] 0 2023-12-17T11:57:37.007 INFO:tasks.workunit.client.1.smithi119.stdout:9/210: creat d12/d1d/d28/f43 x:0 0 0 2023-12-17T11:57:37.007 INFO:tasks.workunit.client.1.smithi119.stdout:9/211: creat d12/d1d/f44 x:0 0 0 2023-12-17T11:57:37.011 INFO:tasks.workunit.client.1.smithi119.stdout:0/160: dread d2/d16/d12/f1c [0,4194304] 0 2023-12-17T11:57:37.011 INFO:tasks.workunit.client.1.smithi119.stdout:0/161: chown d2/d16/d12/d1f/d24 4957285 1 2023-12-17T11:57:37.022 INFO:tasks.workunit.client.1.smithi119.stdout:9/212: rename d12/d1d/l34 to d12/d1d/l45 0 2023-12-17T11:57:37.022 INFO:tasks.workunit.client.1.smithi119.stdout:9/213: dread - d12/f42 zero size 2023-12-17T11:57:37.026 INFO:tasks.workunit.client.0.smithi002.stdout:2/218: write d3/d4/fd [11039166,40784] 0 2023-12-17T11:57:37.027 INFO:tasks.workunit.client.1.smithi119.stdout:0/162: dread d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:37.028 INFO:tasks.workunit.client.1.smithi119.stdout:0/163: dread - d2/d16/d12/d1f/f22 zero size 2023-12-17T11:57:37.028 INFO:tasks.workunit.client.0.smithi002.stdout:9/233: creat dc/d32/f53 x:0 0 0 2023-12-17T11:57:37.031 INFO:tasks.workunit.client.1.smithi119.stdout:9/214: mkdir d12/d1d/d28/d46 0 2023-12-17T11:57:37.031 INFO:tasks.workunit.client.1.smithi119.stdout:9/215: fdatasync fe 0 2023-12-17T11:57:37.031 INFO:tasks.workunit.client.1.smithi119.stdout:9/216: write d12/f35 [719590,93872] 0 2023-12-17T11:57:37.032 INFO:tasks.workunit.client.1.smithi119.stdout:2/189: dwrite d6/f11 [0,4194304] 0 2023-12-17T11:57:37.032 INFO:tasks.workunit.client.0.smithi002.stdout:2/219: link d3/d4/fd d3/d50/f53 0 2023-12-17T11:57:37.033 INFO:tasks.workunit.client.0.smithi002.stdout:8/231: dwrite d3/d8/f3d [0,4194304] 0 2023-12-17T11:57:37.034 INFO:tasks.workunit.client.0.smithi002.stdout:9/234: rmdir dc/d42 39 2023-12-17T11:57:37.034 INFO:tasks.workunit.client.0.smithi002.stdout:6/185: write d0/d1/dc/d17/f2e [2030882,83143] 0 2023-12-17T11:57:37.036 INFO:tasks.workunit.client.1.smithi119.stdout:9/217: unlink d12/d1d/f3e 0 2023-12-17T11:57:37.036 INFO:tasks.workunit.client.1.smithi119.stdout:9/218: stat d12/d1d/d40 0 2023-12-17T11:57:37.038 INFO:tasks.workunit.client.1.smithi119.stdout:2/190: mkdir d6/d2b/d3f 0 2023-12-17T11:57:37.038 INFO:tasks.workunit.client.1.smithi119.stdout:2/191: truncate d6/d9/d13/f32 820273 0 2023-12-17T11:57:37.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/232: dread d3/d8/da/d29/f3a [0,4194304] 0 2023-12-17T11:57:37.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/233: truncate d3/d8/da/dd/f35 5004918 0 2023-12-17T11:57:37.039 INFO:tasks.workunit.client.1.smithi119.stdout:5/234: dwrite d1/f35 [0,4194304] 0 2023-12-17T11:57:37.047 INFO:tasks.workunit.client.0.smithi002.stdout:9/235: mknod dc/d42/c54 0 2023-12-17T11:57:37.048 INFO:tasks.workunit.client.1.smithi119.stdout:9/219: unlink d12/d1d/f32 0 2023-12-17T11:57:37.053 INFO:tasks.workunit.client.0.smithi002.stdout:8/234: unlink d3/d8/c20 0 2023-12-17T11:57:37.055 INFO:tasks.workunit.client.0.smithi002.stdout:9/236: creat dc/d42/f55 x:0 0 0 2023-12-17T11:57:37.059 INFO:tasks.workunit.client.1.smithi119.stdout:5/235: link d1/d25/c37 d1/d44/c4d 0 2023-12-17T11:57:37.059 INFO:tasks.workunit.client.1.smithi119.stdout:2/192: dread d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:37.059 INFO:tasks.workunit.client.0.smithi002.stdout:6/186: link d0/d1/dc/d10/l1d d0/d1/l36 0 2023-12-17T11:57:37.063 INFO:tasks.workunit.client.0.smithi002.stdout:9/237: mknod dc/c56 0 2023-12-17T11:57:37.063 INFO:tasks.workunit.client.0.smithi002.stdout:9/238: creat dc/d42/f57 x:0 0 0 2023-12-17T11:57:37.066 INFO:tasks.workunit.client.1.smithi119.stdout:2/193: link f4 d6/f40 0 2023-12-17T11:57:37.066 INFO:tasks.workunit.client.1.smithi119.stdout:2/194: write d6/d9/f20 [953846,47905] 0 2023-12-17T11:57:37.076 INFO:tasks.workunit.client.0.smithi002.stdout:6/187: dread d0/f1a [0,4194304] 0 2023-12-17T11:57:37.078 INFO:tasks.workunit.client.0.smithi002.stdout:9/239: dread dc/f1f [0,4194304] 0 2023-12-17T11:57:37.078 INFO:tasks.workunit.client.0.smithi002.stdout:9/240: fsync dc/d1d/d23/f2b 0 2023-12-17T11:57:37.083 INFO:tasks.workunit.client.1.smithi119.stdout:5/236: write d1/f35 [1233179,72305] 0 2023-12-17T11:57:37.084 INFO:tasks.workunit.client.0.smithi002.stdout:6/188: link d0/d1/fd d0/d1/dc/d10/f37 0 2023-12-17T11:57:37.086 INFO:tasks.workunit.client.0.smithi002.stdout:9/241: unlink dc/d1d/d23/d24/f3a 0 2023-12-17T11:57:37.089 INFO:tasks.workunit.client.0.smithi002.stdout:9/242: getdents dc/d1d/d23/d24/d47/d4b 0 2023-12-17T11:57:37.089 INFO:tasks.workunit.client.0.smithi002.stdout:9/243: read dc/d1d/d23/f2e [2360896,127406] 0 2023-12-17T11:57:37.090 INFO:tasks.workunit.client.0.smithi002.stdout:6/189: dread d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:37.095 INFO:tasks.workunit.client.1.smithi119.stdout:9/220: dwrite d12/d1d/d28/f43 [0,4194304] 0 2023-12-17T11:57:37.096 INFO:tasks.workunit.client.0.smithi002.stdout:6/190: dread d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:37.097 INFO:tasks.workunit.client.0.smithi002.stdout:6/191: readlink d0/d1/dc/d10/l1d 0 2023-12-17T11:57:37.100 INFO:tasks.workunit.client.0.smithi002.stdout:6/192: truncate d0/d1/fd 3245587 0 2023-12-17T11:57:37.101 INFO:tasks.workunit.client.0.smithi002.stdout:6/193: read - d0/d1/d28/f32 zero size 2023-12-17T11:57:37.102 INFO:tasks.workunit.client.1.smithi119.stdout:9/221: mknod d12/d1d/c47 0 2023-12-17T11:57:37.105 INFO:tasks.workunit.client.0.smithi002.stdout:6/194: link d0/d1/dc/f20 d0/d1/d21/f38 0 2023-12-17T11:57:37.105 INFO:tasks.workunit.client.0.smithi002.stdout:6/195: fdatasync d0/d1/dc/ff 0 2023-12-17T11:57:37.105 INFO:tasks.workunit.client.0.smithi002.stdout:9/244: write dc/f21 [3147107,99495] 0 2023-12-17T11:57:37.106 INFO:tasks.workunit.client.1.smithi119.stdout:9/222: truncate d12/d1d/d28/f3a 1220841 0 2023-12-17T11:57:37.106 INFO:tasks.workunit.client.1.smithi119.stdout:5/237: write d1/f33 [4022806,124492] 0 2023-12-17T11:57:37.110 INFO:tasks.workunit.client.1.smithi119.stdout:6/186: getdents d2 0 2023-12-17T11:57:37.116 INFO:tasks.workunit.client.0.smithi002.stdout:2/220: dwrite d3/d4/f6 [0,4194304] 0 2023-12-17T11:57:37.122 INFO:tasks.workunit.client.0.smithi002.stdout:2/221: mknod d3/d50/c54 0 2023-12-17T11:57:37.123 INFO:tasks.workunit.client.0.smithi002.stdout:2/222: symlink d3/d4/d17/l55 0 2023-12-17T11:57:37.124 INFO:tasks.workunit.client.0.smithi002.stdout:2/223: write d3/d4/d7/d14/d34/f46 [1033005,60763] 0 2023-12-17T11:57:37.125 INFO:tasks.workunit.client.0.smithi002.stdout:6/196: dread d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:37.125 INFO:tasks.workunit.client.0.smithi002.stdout:6/197: fsync d0/d1/dc/d17/f1f 0 2023-12-17T11:57:37.127 INFO:tasks.workunit.client.0.smithi002.stdout:6/198: truncate d0/f1a 2197506 0 2023-12-17T11:57:37.129 INFO:tasks.workunit.client.0.smithi002.stdout:6/199: creat d0/d1/dc/f39 x:0 0 0 2023-12-17T11:57:37.129 INFO:tasks.workunit.client.0.smithi002.stdout:6/200: write d0/d1/d28/f32 [921254,57696] 0 2023-12-17T11:57:37.130 INFO:tasks.workunit.client.1.smithi119.stdout:6/187: dread d2/f26 [0,4194304] 0 2023-12-17T11:57:37.132 INFO:tasks.workunit.client.1.smithi119.stdout:2/195: dwrite d6/d9/d13/d1d/f24 [0,4194304] 0 2023-12-17T11:57:37.139 INFO:tasks.workunit.client.1.smithi119.stdout:2/196: creat d6/d9/d3a/f41 x:0 0 0 2023-12-17T11:57:37.146 INFO:tasks.workunit.client.1.smithi119.stdout:4/147: truncate f8 2513314 0 2023-12-17T11:57:37.148 INFO:tasks.workunit.client.1.smithi119.stdout:4/148: symlink dd/d15/d16/d20/l2c 0 2023-12-17T11:57:37.149 INFO:tasks.workunit.client.1.smithi119.stdout:4/149: truncate dd/d15/d16/f1e 1039719 0 2023-12-17T11:57:37.151 INFO:tasks.workunit.client.1.smithi119.stdout:4/150: mkdir dd/d11/d2d 0 2023-12-17T11:57:37.152 INFO:tasks.workunit.client.1.smithi119.stdout:4/151: rmdir dd/d15 39 2023-12-17T11:57:37.161 INFO:tasks.workunit.client.1.smithi119.stdout:9/223: dwrite d12/f17 [0,4194304] 0 2023-12-17T11:57:37.162 INFO:tasks.workunit.client.1.smithi119.stdout:9/224: write d12/d1d/f3c [474582,75088] 0 2023-12-17T11:57:37.166 INFO:tasks.workunit.client.0.smithi002.stdout:9/245: dwrite dc/d1d/d23/d24/d47/d4b/f50 [0,4194304] 0 2023-12-17T11:57:37.173 INFO:tasks.workunit.client.1.smithi119.stdout:6/188: dwrite d2/df/d17/f2f [0,4194304] 0 2023-12-17T11:57:37.173 INFO:tasks.workunit.client.1.smithi119.stdout:6/189: creat d2/df/f36 x:0 0 0 2023-12-17T11:57:37.175 INFO:tasks.workunit.client.0.smithi002.stdout:9/246: rmdir dc/d32 39 2023-12-17T11:57:37.175 INFO:tasks.workunit.client.1.smithi119.stdout:6/190: write d2/df/d17/f23 [432682,108626] 0 2023-12-17T11:57:37.177 INFO:tasks.workunit.client.0.smithi002.stdout:9/247: write fb [1512741,116587] 0 2023-12-17T11:57:37.181 INFO:tasks.workunit.client.0.smithi002.stdout:3/280: rename f5 to d9/d1b/d35/d41/d59/f5c 0 2023-12-17T11:57:37.181 INFO:tasks.workunit.client.0.smithi002.stdout:3/281: truncate d9/d1b/d35/d41/f42 963310 0 2023-12-17T11:57:37.182 INFO:tasks.workunit.client.0.smithi002.stdout:3/282: readlink d9/l2d 0 2023-12-17T11:57:37.184 INFO:tasks.workunit.client.0.smithi002.stdout:1/260: rename d3/d6/f33 to d3/d6/d9/d37/f51 0 2023-12-17T11:57:37.184 INFO:tasks.workunit.client.0.smithi002.stdout:1/261: creat d3/d6/d16/f52 x:0 0 0 2023-12-17T11:57:37.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/217: rename d6/d17/d16/c29 to d6/d17/d16/d1d/c40 0 2023-12-17T11:57:37.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/218: write d6/d17/dc/d13/d37/f3c [5190174,1906] 0 2023-12-17T11:57:37.187 INFO:tasks.workunit.client.1.smithi119.stdout:2/197: dwrite d6/d9/f20 [0,4194304] 0 2023-12-17T11:57:37.189 INFO:tasks.workunit.client.0.smithi002.stdout:2/224: dwrite d3/d4/fd [8388608,4194304] 0 2023-12-17T11:57:37.189 INFO:tasks.workunit.client.1.smithi119.stdout:9/225: rmdir d12/d1d 39 2023-12-17T11:57:37.189 INFO:tasks.workunit.client.1.smithi119.stdout:9/226: readlink d12/d1d/d28/l2b 0 2023-12-17T11:57:37.192 INFO:tasks.workunit.client.0.smithi002.stdout:1/262: creat d3/d6/d9/d37/f53 x:0 0 0 2023-12-17T11:57:37.193 INFO:tasks.workunit.client.0.smithi002.stdout:3/283: dread d9/d1b/d35/d41/f42 [0,4194304] 0 2023-12-17T11:57:37.195 INFO:tasks.workunit.client.1.smithi119.stdout:2/198: unlink l3 0 2023-12-17T11:57:37.198 INFO:tasks.workunit.client.0.smithi002.stdout:4/214: rename d0/fb to d0/d10/d14/f4c 0 2023-12-17T11:57:37.200 INFO:tasks.workunit.client.1.smithi119.stdout:2/199: mkdir d6/d38/d42 0 2023-12-17T11:57:37.201 INFO:tasks.workunit.client.0.smithi002.stdout:7/219: symlink d6/d17/dc/d13/d21/d2e/l41 0 2023-12-17T11:57:37.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/201: truncate d0/d1/dc/d10/f37 3526269 0 2023-12-17T11:57:37.204 INFO:tasks.workunit.client.0.smithi002.stdout:2/225: mkdir d3/d56 0 2023-12-17T11:57:37.206 INFO:tasks.workunit.client.0.smithi002.stdout:4/215: symlink d0/d3e/d41/l4d 0 2023-12-17T11:57:37.207 INFO:tasks.workunit.client.0.smithi002.stdout:4/216: stat d0/d10/d21/l38 0 2023-12-17T11:57:37.211 INFO:tasks.workunit.client.0.smithi002.stdout:7/220: rmdir d6/d17/d16/d1d/d27 39 2023-12-17T11:57:37.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/202: creat d0/f3a x:0 0 0 2023-12-17T11:57:37.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/217: mkdir d0/d10/d14/d4e 0 2023-12-17T11:57:37.216 INFO:tasks.workunit.client.1.smithi119.stdout:2/200: dread d6/f40 [0,4194304] 0 2023-12-17T11:57:37.222 INFO:tasks.workunit.client.0.smithi002.stdout:6/203: symlink d0/d1/d21/l3b 0 2023-12-17T11:57:37.224 INFO:tasks.workunit.client.0.smithi002.stdout:8/235: rename d3/d8/da/d29 to d3/d8/d55 0 2023-12-17T11:57:37.224 INFO:tasks.workunit.client.0.smithi002.stdout:8/236: write d3/d7/d18/d3f/d49/f4e [337371,51016] 0 2023-12-17T11:57:37.224 INFO:tasks.workunit.client.0.smithi002.stdout:8/237: dread - d3/d7/d18/d3f/d49/f52 zero size 2023-12-17T11:57:37.225 INFO:tasks.workunit.client.1.smithi119.stdout:4/152: write f8 [1902856,120707] 0 2023-12-17T11:57:37.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:36 smithi002 ceph-mon[107131]: pgmap v21: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 741 op/s 2023-12-17T11:57:37.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/238: mknod d3/d7/d1a/c56 0 2023-12-17T11:57:37.235 INFO:tasks.workunit.client.0.smithi002.stdout:0/144: sync 2023-12-17T11:57:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:5/151: sync 2023-12-17T11:57:37.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/145: creat d0/d15/f32 x:0 0 0 2023-12-17T11:57:37.243 INFO:tasks.workunit.client.1.smithi119.stdout:6/191: dwrite d2/df/d17/f34 [0,4194304] 0 2023-12-17T11:57:37.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/146: mkdir d0/d33 0 2023-12-17T11:57:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:0/147: write d0/f2e [721498,112370] 0 2023-12-17T11:57:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:0/148: chown d0/f22 4 1 2023-12-17T11:57:37.244 INFO:tasks.workunit.client.1.smithi119.stdout:2/201: dread d6/f33 [0,4194304] 0 2023-12-17T11:57:37.244 INFO:tasks.workunit.client.1.smithi119.stdout:2/202: fsync d6/d9/fb 0 2023-12-17T11:57:37.244 INFO:tasks.workunit.client.0.smithi002.stdout:5/152: rmdir dc/d1a 39 2023-12-17T11:57:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:9/248: dwrite dc/d42/f4a [0,4194304] 0 2023-12-17T11:57:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:5/153: rename dc/l14 to dc/d17/l25 0 2023-12-17T11:57:37.249 INFO:tasks.workunit.client.0.smithi002.stdout:5/154: chown dc/d17/l25 36954 1 2023-12-17T11:57:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:5/155: creat dc/d17/f26 x:0 0 0 2023-12-17T11:57:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/221: write d6/d17/dc/d13/d37/f3c [2761784,24920] 0 2023-12-17T11:57:37.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/222: truncate d6/f3b 442861 0 2023-12-17T11:57:37.252 INFO:tasks.workunit.client.1.smithi119.stdout:6/192: unlink d2/f5 0 2023-12-17T11:57:37.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/239: write d3/d8/f3d [4033062,66067] 0 2023-12-17T11:57:37.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/240: write d3/d7/f37 [471744,107409] 0 2023-12-17T11:57:37.252 INFO:tasks.workunit.client.0.smithi002.stdout:8/241: readlink d3/d8/l4d 0 2023-12-17T11:57:37.262 INFO:tasks.workunit.client.1.smithi119.stdout:2/203: creat d6/d9/d13/d34/f43 x:0 0 0 2023-12-17T11:57:37.262 INFO:tasks.workunit.client.1.smithi119.stdout:2/204: dread - d6/d2b/f3c zero size 2023-12-17T11:57:37.263 INFO:tasks.workunit.client.1.smithi119.stdout:2/205: mknod d6/d9/d13/d34/c44 0 2023-12-17T11:57:37.263 INFO:tasks.workunit.client.1.smithi119.stdout:2/206: truncate f5 2535421 0 2023-12-17T11:57:37.263 INFO:tasks.workunit.client.0.smithi002.stdout:9/249: creat dc/d1d/d23/d24/d49/f58 x:0 0 0 2023-12-17T11:57:37.266 INFO:tasks.workunit.client.1.smithi119.stdout:9/227: dwrite ff [0,4194304] 0 2023-12-17T11:57:37.266 INFO:tasks.workunit.client.1.smithi119.stdout:9/228: write d12/f19 [4077716,75104] 0 2023-12-17T11:57:37.267 INFO:tasks.workunit.client.0.smithi002.stdout:5/156: symlink dc/l27 0 2023-12-17T11:57:37.267 INFO:tasks.workunit.client.0.smithi002.stdout:5/157: write dc/d17/f26 [373200,9290] 0 2023-12-17T11:57:37.267 INFO:tasks.workunit.client.0.smithi002.stdout:5/158: truncate fb 4855998 0 2023-12-17T11:57:37.268 INFO:tasks.workunit.client.1.smithi119.stdout:2/207: rename d6/f14 to d6/f45 0 2023-12-17T11:57:37.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/223: write d6/d17/f1a [2906808,119978] 0 2023-12-17T11:57:37.270 INFO:tasks.workunit.client.0.smithi002.stdout:7/224: write d6/d17/f1a [4806650,93554] 0 2023-12-17T11:57:37.270 INFO:tasks.workunit.client.0.smithi002.stdout:7/225: chown d6/d17/cd 309021 1 2023-12-17T11:57:37.270 INFO:tasks.workunit.client.0.smithi002.stdout:2/226: dwrite d3/d4/d7/d14/d34/f4b [0,4194304] 0 2023-12-17T11:57:37.273 INFO:tasks.workunit.client.1.smithi119.stdout:4/153: truncate dd/d15/d16/f1e 299075 0 2023-12-17T11:57:37.274 INFO:tasks.workunit.client.0.smithi002.stdout:9/250: getdents dc/d1d/d25 0 2023-12-17T11:57:37.277 INFO:tasks.workunit.client.0.smithi002.stdout:5/159: unlink dc/d17/f21 0 2023-12-17T11:57:37.287 INFO:tasks.workunit.client.1.smithi119.stdout:9/229: read d12/d1d/f27 [4029291,59017] 0 2023-12-17T11:57:37.288 INFO:tasks.workunit.client.1.smithi119.stdout:2/208: dread d6/d9/d13/f32 [0,4194304] 0 2023-12-17T11:57:37.288 INFO:tasks.workunit.client.0.smithi002.stdout:3/284: dwrite d9/d15/f2b [0,4194304] 0 2023-12-17T11:57:37.288 INFO:tasks.workunit.client.0.smithi002.stdout:9/251: unlink dc/d1d/d23/d24/d47/d4b/f50 0 2023-12-17T11:57:37.290 INFO:tasks.workunit.client.0.smithi002.stdout:4/218: dread d0/ff [0,4194304] 0 2023-12-17T11:57:37.291 INFO:tasks.workunit.client.0.smithi002.stdout:1/263: dwrite d3/d6/f2b [0,4194304] 0 2023-12-17T11:57:37.291 INFO:tasks.workunit.client.0.smithi002.stdout:1/264: readlink d3/d6/d16/d28/l32 0 2023-12-17T11:57:37.291 INFO:tasks.workunit.client.0.smithi002.stdout:1/265: chown d3 1468377 1 2023-12-17T11:57:37.292 INFO:tasks.workunit.client.1.smithi119.stdout:4/154: creat dd/d15/f2e x:0 0 0 2023-12-17T11:57:37.292 INFO:tasks.workunit.client.1.smithi119.stdout:4/155: chown dd/d15/c19 0 1 2023-12-17T11:57:37.292 INFO:tasks.workunit.client.1.smithi119.stdout:4/156: chown dd/d15/d16/c22 389 1 2023-12-17T11:57:37.293 INFO:tasks.workunit.client.0.smithi002.stdout:5/160: truncate f4 3001684 0 2023-12-17T11:57:37.295 INFO:tasks.workunit.client.1.smithi119.stdout:9/230: link d12/d1d/d28/f3d d12/f48 0 2023-12-17T11:57:37.295 INFO:tasks.workunit.client.1.smithi119.stdout:9/231: write d12/f35 [1680716,119297] 0 2023-12-17T11:57:37.296 INFO:tasks.workunit.client.1.smithi119.stdout:6/193: dwrite d2/df/f24 [4194304,4194304] 0 2023-12-17T11:57:37.296 INFO:tasks.workunit.client.1.smithi119.stdout:6/194: creat d2/df/d17/f37 x:0 0 0 2023-12-17T11:57:37.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/209: mknod d6/d2b/c46 0 2023-12-17T11:57:37.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/210: write d6/d9/d3a/f41 [637881,72554] 0 2023-12-17T11:57:37.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/211: fsync d6/d9/d13/d1d/f24 0 2023-12-17T11:57:37.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/212: readlink d6/l26 0 2023-12-17T11:57:37.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/213: dread - d6/d2b/f3c zero size 2023-12-17T11:57:37.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/214: read - d6/d9/d13/f3e zero size 2023-12-17T11:57:37.302 INFO:tasks.workunit.client.1.smithi119.stdout:4/157: creat dd/d15/d16/d20/f2f x:0 0 0 2023-12-17T11:57:37.304 INFO:tasks.workunit.client.0.smithi002.stdout:2/227: dread d3/d4/f6 [4194304,4194304] 0 2023-12-17T11:57:37.307 INFO:tasks.workunit.client.0.smithi002.stdout:4/219: truncate d0/d10/f39 4041375 0 2023-12-17T11:57:37.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/204: dwrite d0/d1/dc/d17/f26 [0,4194304] 0 2023-12-17T11:57:37.309 INFO:tasks.workunit.client.0.smithi002.stdout:6/205: stat d0/d1/dc/d17/f26 0 2023-12-17T11:57:37.309 INFO:tasks.workunit.client.1.smithi119.stdout:9/232: mkdir d12/d1d/d49 0 2023-12-17T11:57:37.312 INFO:tasks.workunit.client.0.smithi002.stdout:1/266: dread d3/d6/fe [0,4194304] 0 2023-12-17T11:57:37.313 INFO:tasks.workunit.client.0.smithi002.stdout:5/161: unlink f7 0 2023-12-17T11:57:37.313 INFO:tasks.workunit.client.0.smithi002.stdout:5/162: chown dc/c16 864 1 2023-12-17T11:57:37.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/267: write d3/d6/d9/f13 [4445040,125274] 0 2023-12-17T11:57:37.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/268: creat d3/d6/d9/d30/f54 x:0 0 0 2023-12-17T11:57:37.315 INFO:tasks.workunit.client.0.smithi002.stdout:1/269: write d3/d6/d9/d37/d39/d43/f50 [120429,44093] 0 2023-12-17T11:57:37.315 INFO:tasks.workunit.client.0.smithi002.stdout:1/270: chown d3/d6/l25 12 1 2023-12-17T11:57:37.315 INFO:tasks.workunit.client.1.smithi119.stdout:3/211: sync 2023-12-17T11:57:37.316 INFO:tasks.workunit.client.1.smithi119.stdout:8/168: sync 2023-12-17T11:57:37.316 INFO:tasks.workunit.client.1.smithi119.stdout:7/254: sync 2023-12-17T11:57:37.316 INFO:tasks.workunit.client.1.smithi119.stdout:7/255: chown d2/f10 23909 1 2023-12-17T11:57:37.317 INFO:tasks.workunit.client.1.smithi119.stdout:1/111: sync 2023-12-17T11:57:37.317 INFO:tasks.workunit.client.1.smithi119.stdout:1/112: creat d3/db/f22 x:0 0 0 2023-12-17T11:57:37.324 INFO:tasks.workunit.client.0.smithi002.stdout:0/149: dwrite d0/d6/d26/d14/d19/f21 [0,4194304] 0 2023-12-17T11:57:37.331 INFO:tasks.workunit.client.1.smithi119.stdout:2/215: mknod d6/d2b/c47 0 2023-12-17T11:57:37.338 INFO:tasks.workunit.client.1.smithi119.stdout:4/158: creat dd/d2a/f30 x:0 0 0 2023-12-17T11:57:37.338 INFO:tasks.workunit.client.1.smithi119.stdout:4/159: write dd/f18 [4119585,75496] 0 2023-12-17T11:57:37.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/228: creat d3/d4/d7/d14/d2e/f57 x:0 0 0 2023-12-17T11:57:37.343 INFO:tasks.workunit.client.1.smithi119.stdout:9/233: mkdir d12/d4a 0 2023-12-17T11:57:37.343 INFO:tasks.workunit.client.1.smithi119.stdout:9/234: truncate d12/d1d/f31 840699 0 2023-12-17T11:57:37.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/242: dwrite d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:37.349 INFO:tasks.workunit.client.1.smithi119.stdout:6/195: dwrite d2/f19 [0,4194304] 0 2023-12-17T11:57:37.350 INFO:tasks.workunit.client.0.smithi002.stdout:4/220: truncate d0/d10/f30 2638933 0 2023-12-17T11:57:37.356 INFO:tasks.workunit.client.1.smithi119.stdout:5/238: sync 2023-12-17T11:57:37.356 INFO:tasks.workunit.client.1.smithi119.stdout:5/239: chown d1/cb 12757 1 2023-12-17T11:57:37.356 INFO:tasks.workunit.client.1.smithi119.stdout:0/164: sync 2023-12-17T11:57:37.358 INFO:tasks.workunit.client.1.smithi119.stdout:7/256: mknod d2/d49/c50 0 2023-12-17T11:57:37.358 INFO:tasks.workunit.client.1.smithi119.stdout:3/212: rename f5 to d9/d1c/f49 0 2023-12-17T11:57:37.361 INFO:tasks.workunit.client.0.smithi002.stdout:5/163: symlink dc/d17/d1c/l28 0 2023-12-17T11:57:37.362 INFO:tasks.workunit.client.1.smithi119.stdout:1/113: mknod d3/d5/c23 0 2023-12-17T11:57:37.365 INFO:tasks.workunit.client.0.smithi002.stdout:1/271: mknod d3/d6/d9/c55 0 2023-12-17T11:57:37.366 INFO:tasks.workunit.client.0.smithi002.stdout:1/272: dread - d3/d6/f42 zero size 2023-12-17T11:57:37.366 INFO:tasks.workunit.client.0.smithi002.stdout:1/273: truncate d3/d6/d9/f2e 196663 0 2023-12-17T11:57:37.366 INFO:tasks.workunit.client.0.smithi002.stdout:1/274: creat d3/d6/d9/d30/f56 x:0 0 0 2023-12-17T11:57:37.366 INFO:tasks.workunit.client.0.smithi002.stdout:1/275: stat d3/f17 0 2023-12-17T11:57:37.369 INFO:tasks.workunit.client.1.smithi119.stdout:0/165: symlink d2/d16/d12/d1f/d24/l2f 0 2023-12-17T11:57:37.370 INFO:tasks.workunit.client.1.smithi119.stdout:5/240: dread d1/fa [0,4194304] 0 2023-12-17T11:57:37.371 INFO:tasks.workunit.client.0.smithi002.stdout:7/226: dwrite d6/d17/dc/d13/d21/f3f [0,4194304] 0 2023-12-17T11:57:37.371 INFO:tasks.workunit.client.1.smithi119.stdout:5/241: write d1/f2e [1069994,108148] 0 2023-12-17T11:57:37.374 INFO:tasks.workunit.client.1.smithi119.stdout:4/160: rename dd/d15/d16/d20/f2f to dd/d15/f31 0 2023-12-17T11:57:37.374 INFO:tasks.workunit.client.1.smithi119.stdout:4/161: read - dd/d15/f2e zero size 2023-12-17T11:57:37.375 INFO:tasks.workunit.client.0.smithi002.stdout:0/150: mknod d0/d6/d26/d14/c34 0 2023-12-17T11:57:37.375 INFO:tasks.workunit.client.0.smithi002.stdout:0/151: write d0/d15/f27 [400876,54358] 0 2023-12-17T11:57:37.375 INFO:tasks.workunit.client.1.smithi119.stdout:7/257: getdents d2/d4/d11 0 2023-12-17T11:57:37.381 INFO:tasks.workunit.client.1.smithi119.stdout:2/216: rmdir d6/d9/d13/d34 39 2023-12-17T11:57:37.382 INFO:tasks.workunit.client.1.smithi119.stdout:1/114: dread d3/d5/f6 [0,4194304] 0 2023-12-17T11:57:37.383 INFO:tasks.workunit.client.1.smithi119.stdout:8/169: dwrite d7/d12/f2b [0,4194304] 0 2023-12-17T11:57:37.386 INFO:tasks.workunit.client.1.smithi119.stdout:0/166: mknod d2/d16/d12/d1f/d24/c30 0 2023-12-17T11:57:37.386 INFO:tasks.workunit.client.1.smithi119.stdout:0/167: chown d2/d16/d12/d21/c2c 496213667 1 2023-12-17T11:57:37.391 INFO:tasks.workunit.client.1.smithi119.stdout:6/196: rename d2/df/d17/f2a to d2/f38 0 2023-12-17T11:57:37.391 INFO:tasks.workunit.client.1.smithi119.stdout:6/197: chown d2/f2e 1605 1 2023-12-17T11:57:37.392 INFO:tasks.workunit.client.0.smithi002.stdout:9/252: rename dc/d1d/d23/d24 to dc/d42/d4f/d59 0 2023-12-17T11:57:37.393 INFO:tasks.workunit.client.0.smithi002.stdout:9/253: readlink dc/d42/d4f/d59/l31 0 2023-12-17T11:57:37.394 INFO:tasks.workunit.client.0.smithi002.stdout:9/254: write dc/d42/d4f/d59/f4e [946423,55928] 0 2023-12-17T11:57:37.394 INFO:tasks.workunit.client.0.smithi002.stdout:2/229: mknod d3/d50/c58 0 2023-12-17T11:57:37.400 INFO:tasks.workunit.client.1.smithi119.stdout:3/213: rmdir d9/da 39 2023-12-17T11:57:37.400 INFO:tasks.workunit.client.1.smithi119.stdout:3/214: write d9/da/f30 [995109,11048] 0 2023-12-17T11:57:37.402 INFO:tasks.workunit.client.0.smithi002.stdout:8/243: link d3/d8/d55/f3a d3/d7/d18/d3f/f57 0 2023-12-17T11:57:37.402 INFO:tasks.workunit.client.1.smithi119.stdout:9/235: dwrite d12/d1d/f31 [0,4194304] 0 2023-12-17T11:57:37.402 INFO:tasks.workunit.client.1.smithi119.stdout:9/236: chown c1 164794 1 2023-12-17T11:57:37.402 INFO:tasks.workunit.client.1.smithi119.stdout:9/237: chown d12 231907922 1 2023-12-17T11:57:37.405 INFO:tasks.workunit.client.1.smithi119.stdout:2/217: mknod d6/d9/d13/d1d/c48 0 2023-12-17T11:57:37.405 INFO:tasks.workunit.client.1.smithi119.stdout:4/162: write f2 [1913585,63402] 0 2023-12-17T11:57:37.406 INFO:tasks.workunit.client.1.smithi119.stdout:1/115: truncate d3/db/fc 707531 0 2023-12-17T11:57:37.406 INFO:tasks.workunit.client.1.smithi119.stdout:1/116: readlink d3/d7/l18 0 2023-12-17T11:57:37.407 INFO:tasks.workunit.client.0.smithi002.stdout:8/244: dread d3/d7/d18/d3f/f57 [0,4194304] 0 2023-12-17T11:57:37.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:36 smithi119 ceph-mon[117414]: pgmap v21: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 741 op/s 2023-12-17T11:57:37.409 INFO:tasks.workunit.client.1.smithi119.stdout:5/242: read d1/d36/d3a/f4b [969056,27583] 0 2023-12-17T11:57:37.415 INFO:tasks.workunit.client.1.smithi119.stdout:8/170: truncate d7/d12/d1f/f24 3127510 0 2023-12-17T11:57:37.415 INFO:tasks.workunit.client.1.smithi119.stdout:6/198: rename d2/df/l1a to d2/df/l39 0 2023-12-17T11:57:37.415 INFO:tasks.workunit.client.1.smithi119.stdout:6/199: read - d2/df/f31 zero size 2023-12-17T11:57:37.415 INFO:tasks.workunit.client.1.smithi119.stdout:6/200: creat d2/d2b/f3a x:0 0 0 2023-12-17T11:57:37.415 INFO:tasks.workunit.client.1.smithi119.stdout:6/201: creat d2/df/f3b x:0 0 0 2023-12-17T11:57:37.416 INFO:tasks.workunit.client.1.smithi119.stdout:0/168: rename d2/l8 to d2/d16/d12/d1f/l31 0 2023-12-17T11:57:37.416 INFO:tasks.workunit.client.1.smithi119.stdout:0/169: chown d2/d16/d12/d1f/l31 17848605 1 2023-12-17T11:57:37.416 INFO:tasks.workunit.client.1.smithi119.stdout:0/170: creat d2/d16/d12/f32 x:0 0 0 2023-12-17T11:57:37.416 INFO:tasks.workunit.client.1.smithi119.stdout:0/171: dread - d2/d16/d12/f32 zero size 2023-12-17T11:57:37.418 INFO:tasks.workunit.client.0.smithi002.stdout:5/164: unlink dc/d17/l1f 0 2023-12-17T11:57:37.420 INFO:tasks.workunit.client.0.smithi002.stdout:8/245: dread d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:37.424 INFO:tasks.workunit.client.0.smithi002.stdout:0/152: rmdir d0/d6 39 2023-12-17T11:57:37.424 INFO:tasks.workunit.client.0.smithi002.stdout:0/153: fsync d0/d6/d26/d14/d19/d2b/f30 0 2023-12-17T11:57:37.425 INFO:tasks.workunit.client.0.smithi002.stdout:2/230: write d3/d4/d17/f20 [3235485,79210] 0 2023-12-17T11:57:37.428 INFO:tasks.workunit.client.1.smithi119.stdout:2/218: dread d6/d9/d3a/f41 [0,4194304] 0 2023-12-17T11:57:37.436 INFO:tasks.workunit.client.1.smithi119.stdout:9/238: symlink d12/d1d/d40/l4b 0 2023-12-17T11:57:37.436 INFO:tasks.workunit.client.1.smithi119.stdout:3/215: rename d9/c22 to d9/da/df/d41/c4a 0 2023-12-17T11:57:37.436 INFO:tasks.workunit.client.1.smithi119.stdout:4/163: creat dd/f32 x:0 0 0 2023-12-17T11:57:37.437 INFO:tasks.workunit.client.0.smithi002.stdout:7/227: dwrite d6/d17/d16/d1d/d24/f31 [0,4194304] 0 2023-12-17T11:57:37.445 INFO:tasks.workunit.client.1.smithi119.stdout:9/239: dread d12/f2c [0,4194304] 0 2023-12-17T11:57:37.446 INFO:tasks.workunit.client.1.smithi119.stdout:8/171: dread d7/f27 [0,4194304] 0 2023-12-17T11:57:37.446 INFO:tasks.workunit.client.1.smithi119.stdout:2/219: mknod d6/d9/d13/c49 0 2023-12-17T11:57:37.454 INFO:tasks.workunit.client.1.smithi119.stdout:1/117: rename d3/d7 to d3/db/d17/d24 0 2023-12-17T11:57:37.454 INFO:tasks.workunit.client.1.smithi119.stdout:1/118: dread - d3/db/f22 zero size 2023-12-17T11:57:37.454 INFO:tasks.workunit.client.1.smithi119.stdout:1/119: fsync d3/db/f1f 0 2023-12-17T11:57:37.454 INFO:tasks.workunit.client.1.smithi119.stdout:5/243: dwrite d1/d36/f47 [0,4194304] 0 2023-12-17T11:57:37.454 INFO:tasks.workunit.client.1.smithi119.stdout:5/244: chown d1/d25/d39/f3b 4923489 1 2023-12-17T11:57:37.454 INFO:tasks.workunit.client.1.smithi119.stdout:5/245: dread - d1/d25/d39/f3c zero size 2023-12-17T11:57:37.455 INFO:tasks.workunit.client.1.smithi119.stdout:5/246: write d1/d25/d39/f41 [544792,13365] 0 2023-12-17T11:57:37.455 INFO:tasks.workunit.client.1.smithi119.stdout:5/247: dread - d1/d36/f48 zero size 2023-12-17T11:57:37.455 INFO:tasks.workunit.client.1.smithi119.stdout:5/248: read d1/d25/f31 [15900,2274] 0 2023-12-17T11:57:37.458 INFO:tasks.workunit.client.1.smithi119.stdout:4/164: link dd/d15/d16/c27 dd/d15/d16/c33 0 2023-12-17T11:57:37.458 INFO:tasks.workunit.client.1.smithi119.stdout:4/165: chown dd/d15/d16 118268 1 2023-12-17T11:57:37.458 INFO:tasks.workunit.client.1.smithi119.stdout:8/172: creat d7/d18/d15/f39 x:0 0 0 2023-12-17T11:57:37.458 INFO:tasks.workunit.client.1.smithi119.stdout:8/173: chown d7/f35 17007 1 2023-12-17T11:57:37.459 INFO:tasks.workunit.client.1.smithi119.stdout:1/120: dread d3/db/d17/d24/f14 [0,4194304] 0 2023-12-17T11:57:37.459 INFO:tasks.workunit.client.1.smithi119.stdout:1/121: chown d3/db/d17/f1b 28618388 1 2023-12-17T11:57:37.465 INFO:tasks.workunit.client.1.smithi119.stdout:2/220: mknod d6/d9/d13/d34/c4a 0 2023-12-17T11:57:37.465 INFO:tasks.workunit.client.0.smithi002.stdout:1/276: fsync d3/d6/d9/d30/f56 0 2023-12-17T11:57:37.465 INFO:tasks.workunit.client.0.smithi002.stdout:4/221: truncate d0/d10/f30 495024 0 2023-12-17T11:57:37.468 INFO:tasks.workunit.client.1.smithi119.stdout:3/216: dwrite d9/da/f30 [0,4194304] 0 2023-12-17T11:57:37.468 INFO:tasks.workunit.client.1.smithi119.stdout:3/217: dread - d9/da/df/f32 zero size 2023-12-17T11:57:37.469 INFO:tasks.workunit.client.1.smithi119.stdout:9/240: rename d12/d1d/d28/c33 to d12/d1d/c4c 0 2023-12-17T11:57:37.471 INFO:tasks.workunit.client.0.smithi002.stdout:5/165: link dc/l27 dc/d1b/l29 0 2023-12-17T11:57:37.475 INFO:tasks.workunit.client.0.smithi002.stdout:9/255: dwrite dc/d42/d4f/d59/d49/f58 [0,4194304] 0 2023-12-17T11:57:37.478 INFO:tasks.workunit.client.0.smithi002.stdout:0/154: creat d0/d6/d26/f35 x:0 0 0 2023-12-17T11:57:37.478 INFO:tasks.workunit.client.0.smithi002.stdout:0/155: write d0/d6/d26/f24 [993797,85862] 0 2023-12-17T11:57:37.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/249: creat d1/d36/f4e x:0 0 0 2023-12-17T11:57:37.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/250: write d1/f2e [46629,67383] 0 2023-12-17T11:57:37.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/251: chown d1/cb 132923 1 2023-12-17T11:57:37.479 INFO:tasks.workunit.client.1.smithi119.stdout:4/166: mknod dd/d11/c34 0 2023-12-17T11:57:37.482 INFO:tasks.workunit.client.1.smithi119.stdout:8/174: mknod d7/da/d11/d26/c3a 0 2023-12-17T11:57:37.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/122: creat d3/f25 x:0 0 0 2023-12-17T11:57:37.485 INFO:tasks.workunit.client.0.smithi002.stdout:7/228: symlink d6/d17/d16/d1d/l42 0 2023-12-17T11:57:37.486 INFO:tasks.workunit.client.0.smithi002.stdout:8/246: dwrite d3/d7/d1a/f1c [0,4194304] 0 2023-12-17T11:57:37.489 INFO:tasks.workunit.client.1.smithi119.stdout:0/172: dwrite d2/d16/d12/d1f/f22 [0,4194304] 0 2023-12-17T11:57:37.493 INFO:tasks.workunit.client.0.smithi002.stdout:1/277: creat d3/d6/d9/f57 x:0 0 0 2023-12-17T11:57:37.493 INFO:tasks.workunit.client.0.smithi002.stdout:1/278: chown d3/d6/f2b 11859 1 2023-12-17T11:57:37.494 INFO:tasks.workunit.client.1.smithi119.stdout:8/175: dread d7/f27 [0,4194304] 0 2023-12-17T11:57:37.494 INFO:tasks.workunit.client.1.smithi119.stdout:8/176: dread - d7/da/d11/d26/f32 zero size 2023-12-17T11:57:37.495 INFO:tasks.workunit.client.0.smithi002.stdout:4/222: symlink d0/d10/d21/d33/l4f 0 2023-12-17T11:57:37.495 INFO:tasks.workunit.client.0.smithi002.stdout:0/156: write d0/d15/f23 [1712020,34131] 0 2023-12-17T11:57:37.495 INFO:tasks.workunit.client.0.smithi002.stdout:0/157: chown d0/d15/f27 12630 1 2023-12-17T11:57:37.498 INFO:tasks.workunit.client.1.smithi119.stdout:3/218: symlink d9/l4b 0 2023-12-17T11:57:37.500 INFO:tasks.workunit.client.1.smithi119.stdout:4/167: mknod dd/d15/d16/c35 0 2023-12-17T11:57:37.502 INFO:tasks.workunit.client.1.smithi119.stdout:5/252: dread d1/d44/f4c [0,4194304] 0 2023-12-17T11:57:37.510 INFO:tasks.workunit.client.0.smithi002.stdout:9/256: symlink dc/d42/l5a 0 2023-12-17T11:57:37.520 INFO:tasks.workunit.client.1.smithi119.stdout:5/253: write d1/fa [2159493,9010] 0 2023-12-17T11:57:37.521 INFO:tasks.workunit.client.1.smithi119.stdout:0/173: symlink d2/d16/l33 0 2023-12-17T11:57:37.522 INFO:tasks.workunit.client.1.smithi119.stdout:2/221: dwrite d6/d9/d13/f3e [0,4194304] 0 2023-12-17T11:57:37.523 INFO:tasks.workunit.client.1.smithi119.stdout:3/219: mknod d9/da/c4c 0 2023-12-17T11:57:37.528 INFO:tasks.workunit.client.0.smithi002.stdout:2/231: truncate d3/d50/f53 6867635 0 2023-12-17T11:57:37.529 INFO:tasks.workunit.client.0.smithi002.stdout:2/232: chown d3/d4/d7/f11 8645 1 2023-12-17T11:57:37.529 INFO:tasks.workunit.client.0.smithi002.stdout:8/247: rename d3/d8/da/d44/f30 to d3/d7/f58 0 2023-12-17T11:57:37.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/279: creat d3/d6/d16/d28/f58 x:0 0 0 2023-12-17T11:57:37.547 INFO:tasks.workunit.client.0.smithi002.stdout:0/158: dread d0/f22 [0,4194304] 0 2023-12-17T11:57:37.549 INFO:tasks.workunit.client.0.smithi002.stdout:9/257: unlink dc/d1d/d25/l37 0 2023-12-17T11:57:37.550 INFO:tasks.workunit.client.0.smithi002.stdout:2/233: dread d3/d4/d7/f11 [0,4194304] 0 2023-12-17T11:57:37.552 INFO:tasks.workunit.client.0.smithi002.stdout:1/280: mkdir d3/d6/d59 0 2023-12-17T11:57:37.553 INFO:tasks.workunit.client.1.smithi119.stdout:2/222: mkdir d6/d2b/d4b 0 2023-12-17T11:57:37.554 INFO:tasks.workunit.client.1.smithi119.stdout:2/223: creat d6/d9/d3a/f4c x:0 0 0 2023-12-17T11:57:37.554 INFO:tasks.workunit.client.1.smithi119.stdout:2/224: chown d6 3562 1 2023-12-17T11:57:37.555 INFO:tasks.workunit.client.1.smithi119.stdout:2/225: creat d6/d9/d13/f4d x:0 0 0 2023-12-17T11:57:37.555 INFO:tasks.workunit.client.1.smithi119.stdout:2/226: creat d6/d9/d3a/f4e x:0 0 0 2023-12-17T11:57:37.555 INFO:tasks.workunit.client.1.smithi119.stdout:2/227: dread - d6/d9/d13/d1d/f37 zero size 2023-12-17T11:57:37.555 INFO:tasks.workunit.client.0.smithi002.stdout:1/281: write d3/d6/d9/d30/f23 [141,37047] 0 2023-12-17T11:57:37.556 INFO:tasks.workunit.client.0.smithi002.stdout:0/159: creat d0/d6/d26/d14/d19/d2f/f36 x:0 0 0 2023-12-17T11:57:37.557 INFO:tasks.workunit.client.0.smithi002.stdout:0/160: write d0/d6/d26/f2d [584493,90909] 0 2023-12-17T11:57:37.559 INFO:tasks.workunit.client.1.smithi119.stdout:3/220: creat d9/d1c/f4d x:0 0 0 2023-12-17T11:57:37.560 INFO:tasks.workunit.client.1.smithi119.stdout:3/221: write d9/da/df/d41/d33/d3a/f3d [908178,128232] 0 2023-12-17T11:57:37.562 INFO:tasks.workunit.client.1.smithi119.stdout:8/177: dwrite d7/d12/d23/f38 [0,4194304] 0 2023-12-17T11:57:37.562 INFO:tasks.workunit.client.1.smithi119.stdout:8/178: truncate d7/d18/d15/f1b 420980 0 2023-12-17T11:57:37.562 INFO:tasks.workunit.client.1.smithi119.stdout:8/179: stat d7/da/d1a 0 2023-12-17T11:57:37.563 INFO:tasks.workunit.client.1.smithi119.stdout:8/180: dread - d7/da/d11/d26/f32 zero size 2023-12-17T11:57:37.563 INFO:tasks.workunit.client.1.smithi119.stdout:4/168: dwrite dd/f1d [0,4194304] 0 2023-12-17T11:57:37.565 INFO:tasks.workunit.client.0.smithi002.stdout:7/229: dwrite d6/d17/dc/d13/d21/f3f [0,4194304] 0 2023-12-17T11:57:37.565 INFO:tasks.workunit.client.0.smithi002.stdout:4/223: dwrite d0/d10/f2d [0,4194304] 0 2023-12-17T11:57:37.565 INFO:tasks.workunit.client.0.smithi002.stdout:4/224: fdatasync d0/f8 0 2023-12-17T11:57:37.566 INFO:tasks.workunit.client.0.smithi002.stdout:4/225: fdatasync d0/f8 0 2023-12-17T11:57:37.566 INFO:tasks.workunit.client.0.smithi002.stdout:4/226: write d0/d10/f31 [311191,45033] 0 2023-12-17T11:57:37.566 INFO:tasks.workunit.client.1.smithi119.stdout:5/254: dwrite d1/f20 [0,4194304] 0 2023-12-17T11:57:37.567 INFO:tasks.workunit.client.1.smithi119.stdout:5/255: stat d1/c16 0 2023-12-17T11:57:37.567 INFO:tasks.workunit.client.1.smithi119.stdout:5/256: readlink d1/d25/l40 0 2023-12-17T11:57:37.571 INFO:tasks.workunit.client.1.smithi119.stdout:2/228: getdents d6/d9/d13/d34 0 2023-12-17T11:57:37.571 INFO:tasks.workunit.client.0.smithi002.stdout:9/258: creat dc/d38/f5b x:0 0 0 2023-12-17T11:57:37.574 INFO:tasks.workunit.client.0.smithi002.stdout:1/282: dread d3/d6/d9/d30/f23 [0,4194304] 0 2023-12-17T11:57:37.574 INFO:tasks.workunit.client.0.smithi002.stdout:1/283: stat d3/d6/d9/d37/f53 0 2023-12-17T11:57:37.574 INFO:tasks.workunit.client.0.smithi002.stdout:0/161: mkdir d0/d6/d26/d14/d19/d37 0 2023-12-17T11:57:37.574 INFO:tasks.workunit.client.0.smithi002.stdout:0/162: creat d0/d6/d26/d14/d19/d2f/f38 x:0 0 0 2023-12-17T11:57:37.576 INFO:tasks.workunit.client.1.smithi119.stdout:1/123: rename d3/d5 to d3/db/d26 0 2023-12-17T11:57:37.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/222: mknod d9/d11/c4e 0 2023-12-17T11:57:37.581 INFO:tasks.workunit.client.1.smithi119.stdout:8/181: read d7/f35 [3792914,17610] 0 2023-12-17T11:57:37.583 INFO:tasks.workunit.client.1.smithi119.stdout:5/257: dread d1/f30 [0,4194304] 0 2023-12-17T11:57:37.586 INFO:tasks.workunit.client.1.smithi119.stdout:4/169: creat dd/d11/d26/f36 x:0 0 0 2023-12-17T11:57:37.586 INFO:tasks.workunit.client.1.smithi119.stdout:4/170: truncate dd/d15/d16/f1e 535253 0 2023-12-17T11:57:37.586 INFO:tasks.workunit.client.1.smithi119.stdout:4/171: fsync dd/f32 0 2023-12-17T11:57:37.586 INFO:tasks.workunit.client.1.smithi119.stdout:4/172: fdatasync dd/d2a/f30 0 2023-12-17T11:57:37.588 INFO:tasks.workunit.client.0.smithi002.stdout:9/259: creat dc/d42/d4f/d59/d47/f5c x:0 0 0 2023-12-17T11:57:37.590 INFO:tasks.workunit.client.0.smithi002.stdout:1/284: link d3/d6/d9/d30/f54 d3/d6/d9/d30/f5a 0 2023-12-17T11:57:37.592 INFO:tasks.workunit.client.1.smithi119.stdout:2/229: mknod d6/d9/d3a/c4f 0 2023-12-17T11:57:37.592 INFO:tasks.workunit.client.1.smithi119.stdout:2/230: getdents d6/d2b/d3f 0 2023-12-17T11:57:37.593 INFO:tasks.workunit.client.1.smithi119.stdout:1/124: mknod d3/db/c27 0 2023-12-17T11:57:37.593 INFO:tasks.workunit.client.1.smithi119.stdout:1/125: read - d3/db/d17/f1b zero size 2023-12-17T11:57:37.595 INFO:tasks.workunit.client.0.smithi002.stdout:9/260: creat dc/d42/d4f/d59/f5d x:0 0 0 2023-12-17T11:57:37.597 INFO:tasks.workunit.client.1.smithi119.stdout:3/223: mknod d9/da/df/d41/d33/c4f 0 2023-12-17T11:57:37.600 INFO:tasks.workunit.client.0.smithi002.stdout:9/261: truncate dc/f11 611344 0 2023-12-17T11:57:37.600 INFO:tasks.workunit.client.0.smithi002.stdout:9/262: creat dc/d38/f5e x:0 0 0 2023-12-17T11:57:37.603 INFO:tasks.workunit.client.1.smithi119.stdout:2/231: link d6/f1f d6/d9/d13/d1d/f50 0 2023-12-17T11:57:37.603 INFO:tasks.workunit.client.1.smithi119.stdout:8/182: rename d7/da/d11/d26/d2c/c37 to d7/d18/c3b 0 2023-12-17T11:57:37.603 INFO:tasks.workunit.client.1.smithi119.stdout:8/183: truncate d7/f17 1199518 0 2023-12-17T11:57:37.606 INFO:tasks.workunit.client.1.smithi119.stdout:5/258: creat d1/d25/f4f x:0 0 0 2023-12-17T11:57:37.607 INFO:tasks.workunit.client.1.smithi119.stdout:5/259: getdents d1/d36/d3a 0 2023-12-17T11:57:37.611 INFO:tasks.workunit.client.1.smithi119.stdout:5/260: read d1/d36/f3d [5798,55432] 0 2023-12-17T11:57:37.612 INFO:tasks.workunit.client.0.smithi002.stdout:9/263: mknod dc/d1d/d25/c5f 0 2023-12-17T11:57:37.613 INFO:tasks.workunit.client.0.smithi002.stdout:3/285: sync 2023-12-17T11:57:37.614 INFO:tasks.workunit.client.0.smithi002.stdout:3/286: read d9/f13 [2255480,38158] 0 2023-12-17T11:57:37.614 INFO:tasks.workunit.client.1.smithi119.stdout:3/224: creat d9/f50 x:0 0 0 2023-12-17T11:57:37.616 INFO:tasks.workunit.client.1.smithi119.stdout:2/232: mknod d6/d9/d3a/c51 0 2023-12-17T11:57:37.616 INFO:tasks.workunit.client.1.smithi119.stdout:2/233: fdatasync d6/d9/fd 0 2023-12-17T11:57:37.619 INFO:tasks.workunit.client.0.smithi002.stdout:9/264: creat dc/d1d/d23/f60 x:0 0 0 2023-12-17T11:57:37.623 INFO:tasks.workunit.client.1.smithi119.stdout:8/184: rename d7/da/l1e to d7/d12/d1f/l3c 0 2023-12-17T11:57:37.623 INFO:tasks.workunit.client.1.smithi119.stdout:4/173: rename dd/d11/d2d to dd/d11/d2d/d37 22 2023-12-17T11:57:37.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/287: symlink d9/d15/d31/l5d 0 2023-12-17T11:57:37.624 INFO:tasks.workunit.client.1.smithi119.stdout:8/185: write d7/da/d11/f1d [276023,121116] 0 2023-12-17T11:57:37.624 INFO:tasks.workunit.client.1.smithi119.stdout:8/186: truncate d7/d18/d15/f1b 895171 0 2023-12-17T11:57:37.624 INFO:tasks.workunit.client.1.smithi119.stdout:8/187: stat d7/d12/d23/l36 0 2023-12-17T11:57:37.626 INFO:tasks.workunit.client.0.smithi002.stdout:9/265: creat dc/d42/d4f/f61 x:0 0 0 2023-12-17T11:57:37.629 INFO:tasks.workunit.client.0.smithi002.stdout:9/266: mknod dc/d1d/d25/c62 0 2023-12-17T11:57:37.633 INFO:tasks.workunit.client.0.smithi002.stdout:9/267: mkdir dc/d42/d4f/d59/d47/d63 0 2023-12-17T11:57:37.633 INFO:tasks.workunit.client.0.smithi002.stdout:9/268: chown dc/d1d/c20 20680 1 2023-12-17T11:57:37.635 INFO:tasks.workunit.client.1.smithi119.stdout:5/261: unlink d1/fc 0 2023-12-17T11:57:37.637 INFO:tasks.workunit.client.1.smithi119.stdout:3/225: symlink d9/da/df/d41/l51 0 2023-12-17T11:57:37.637 INFO:tasks.workunit.client.1.smithi119.stdout:3/226: fsync d9/da/df/f17 0 2023-12-17T11:57:37.638 INFO:tasks.workunit.client.1.smithi119.stdout:2/234: truncate d6/d9/fb 2814066 0 2023-12-17T11:57:37.640 INFO:tasks.workunit.client.1.smithi119.stdout:4/174: link dd/f18 dd/f38 0 2023-12-17T11:57:37.640 INFO:tasks.workunit.client.1.smithi119.stdout:4/175: fsync dd/f1b 0 2023-12-17T11:57:37.640 INFO:tasks.workunit.client.1.smithi119.stdout:4/176: fdatasync dd/d2a/f30 0 2023-12-17T11:57:37.640 INFO:tasks.workunit.client.1.smithi119.stdout:4/177: truncate dd/f18 4965712 0 2023-12-17T11:57:37.640 INFO:tasks.workunit.client.1.smithi119.stdout:8/188: rmdir d7/da/d1a 39 2023-12-17T11:57:37.642 INFO:tasks.workunit.client.0.smithi002.stdout:7/230: dwrite d6/d17/f1a [4194304,4194304] 0 2023-12-17T11:57:37.643 INFO:tasks.workunit.client.0.smithi002.stdout:7/231: write d6/d17/dc/d13/f30 [1722441,45614] 0 2023-12-17T11:57:37.644 INFO:tasks.workunit.client.1.smithi119.stdout:3/227: creat d9/da/df/f52 x:0 0 0 2023-12-17T11:57:37.644 INFO:tasks.workunit.client.1.smithi119.stdout:2/235: mkdir d6/d9/d52 0 2023-12-17T11:57:37.646 INFO:tasks.workunit.client.1.smithi119.stdout:4/178: rename dd/d15/d16/c33 to dd/d15/c39 0 2023-12-17T11:57:37.648 INFO:tasks.workunit.client.0.smithi002.stdout:7/232: creat d6/d17/d16/d1d/d24/f43 x:0 0 0 2023-12-17T11:57:37.648 INFO:tasks.workunit.client.0.smithi002.stdout:7/233: creat d6/f44 x:0 0 0 2023-12-17T11:57:37.650 INFO:tasks.workunit.client.1.smithi119.stdout:8/189: rename d7/da/f2f to d7/d18/f3d 0 2023-12-17T11:57:37.653 INFO:tasks.workunit.client.0.smithi002.stdout:8/248: dwrite d3/d8/d55/f3a [0,4194304] 0 2023-12-17T11:57:37.654 INFO:tasks.workunit.client.0.smithi002.stdout:2/234: dwrite d3/d4/d7/d14/d42/f47 [0,4194304] 0 2023-12-17T11:57:37.656 INFO:tasks.workunit.client.0.smithi002.stdout:0/163: dwrite d0/d6/d26/f35 [0,4194304] 0 2023-12-17T11:57:37.657 INFO:tasks.workunit.client.0.smithi002.stdout:0/164: chown d0/d6/d26/d14/d19/d2f/f36 40403 1 2023-12-17T11:57:37.661 INFO:tasks.workunit.client.0.smithi002.stdout:8/249: symlink d3/d8/da/l59 0 2023-12-17T11:57:37.664 INFO:tasks.workunit.client.0.smithi002.stdout:0/165: truncate d0/f22 3868288 0 2023-12-17T11:57:37.668 INFO:tasks.workunit.client.0.smithi002.stdout:8/250: rename d3/d8/da/d4a to d3/d8/d28/d31/d5a 0 2023-12-17T11:57:37.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/234: dread d6/d17/d16/d1d/f35 [0,4194304] 0 2023-12-17T11:57:37.670 INFO:tasks.workunit.client.1.smithi119.stdout:8/190: write d7/f17 [618500,80505] 0 2023-12-17T11:57:37.670 INFO:tasks.workunit.client.1.smithi119.stdout:8/191: fdatasync d7/d12/f2b 0 2023-12-17T11:57:37.670 INFO:tasks.workunit.client.1.smithi119.stdout:8/192: fsync d7/d12/f25 0 2023-12-17T11:57:37.671 INFO:tasks.workunit.client.0.smithi002.stdout:0/166: creat d0/d6/d26/d14/d19/d37/f39 x:0 0 0 2023-12-17T11:57:37.671 INFO:tasks.workunit.client.0.smithi002.stdout:8/251: getdents d3/d7/d18 0 2023-12-17T11:57:37.672 INFO:tasks.workunit.client.0.smithi002.stdout:8/252: fsync d3/d7/f27 0 2023-12-17T11:57:37.672 INFO:tasks.workunit.client.0.smithi002.stdout:8/253: fdatasync d3/d8/f3d 0 2023-12-17T11:57:37.672 INFO:tasks.workunit.client.0.smithi002.stdout:8/254: write d3/d7/f58 [931801,12441] 0 2023-12-17T11:57:37.676 INFO:tasks.workunit.client.0.smithi002.stdout:7/235: truncate d6/f3b 195124 0 2023-12-17T11:57:37.678 INFO:tasks.workunit.client.0.smithi002.stdout:8/255: getdents d3/d7/d18/d3f 0 2023-12-17T11:57:37.687 INFO:tasks.workunit.client.0.smithi002.stdout:3/288: dread d9/d1b/f28 [0,4194304] 0 2023-12-17T11:57:37.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/289: fdatasync d9/d15/f32 0 2023-12-17T11:57:37.704 INFO:tasks.workunit.client.0.smithi002.stdout:3/290: write d9/d1b/d35/d41/d43/f46 [1248904,23722] 0 2023-12-17T11:57:37.704 INFO:tasks.workunit.client.0.smithi002.stdout:2/235: dread d3/d4/d7/d14/d1b/f29 [0,4194304] 0 2023-12-17T11:57:37.720 INFO:tasks.workunit.client.1.smithi119.stdout:1/126: dwrite d3/db/d26/d19/f1e [0,4194304] 0 2023-12-17T11:57:37.735 INFO:tasks.workunit.client.1.smithi119.stdout:4/179: dwrite dd/d11/d26/f36 [0,4194304] 0 2023-12-17T11:57:37.735 INFO:tasks.workunit.client.1.smithi119.stdout:4/180: truncate dd/d15/f2e 332667 0 2023-12-17T11:57:37.735 INFO:tasks.workunit.client.1.smithi119.stdout:4/181: read dd/f38 [2661941,122782] 0 2023-12-17T11:57:37.739 INFO:tasks.workunit.client.1.smithi119.stdout:3/228: dwrite d9/fc [0,4194304] 0 2023-12-17T11:57:37.747 INFO:tasks.workunit.client.0.smithi002.stdout:7/236: dwrite d6/d17/d16/d1d/d24/f43 [0,4194304] 0 2023-12-17T11:57:37.747 INFO:tasks.workunit.client.0.smithi002.stdout:7/237: write d6/d17/d16/d1d/f35 [1371363,130946] 0 2023-12-17T11:57:37.747 INFO:tasks.workunit.client.0.smithi002.stdout:7/238: chown d6/d17/dc/d13/d21/f3f 258 1 2023-12-17T11:57:37.748 INFO:tasks.workunit.client.0.smithi002.stdout:7/239: write d6/d17/dc/d13/f30 [444903,74795] 0 2023-12-17T11:57:37.753 INFO:tasks.workunit.client.0.smithi002.stdout:4/227: dwrite d0/d10/d14/f24 [0,4194304] 0 2023-12-17T11:57:37.753 INFO:tasks.workunit.client.0.smithi002.stdout:4/228: write d0/d10/f4b [681258,47138] 0 2023-12-17T11:57:37.765 INFO:tasks.workunit.client.0.smithi002.stdout:2/236: symlink d3/d4/d7/d14/l59 0 2023-12-17T11:57:37.765 INFO:tasks.workunit.client.0.smithi002.stdout:2/237: stat d3/d50/c58 0 2023-12-17T11:57:37.774 INFO:tasks.workunit.client.1.smithi119.stdout:2/236: dwrite d6/d9/d13/f4d [0,4194304] 0 2023-12-17T11:57:37.774 INFO:tasks.workunit.client.1.smithi119.stdout:2/237: chown d6/d9/f2a 0 1 2023-12-17T11:57:37.784 INFO:tasks.workunit.client.1.smithi119.stdout:3/229: link d9/d11/d1e/l31 d9/d11/d1e/l53 0 2023-12-17T11:57:37.791 INFO:tasks.workunit.client.1.smithi119.stdout:2/238: rmdir d6/d38/d42 0 2023-12-17T11:57:37.793 INFO:tasks.workunit.client.0.smithi002.stdout:0/167: dwrite d0/d6/d26/d14/d19/f21 [0,4194304] 0 2023-12-17T11:57:37.793 INFO:tasks.workunit.client.0.smithi002.stdout:1/285: dwrite d3/d6/d9/f57 [0,4194304] 0 2023-12-17T11:57:37.795 INFO:tasks.workunit.client.0.smithi002.stdout:2/238: unlink d3/l2b 0 2023-12-17T11:57:37.796 INFO:tasks.workunit.client.1.smithi119.stdout:1/127: truncate d3/db/d26/d19/f1e 316541 0 2023-12-17T11:57:37.796 INFO:tasks.workunit.client.1.smithi119.stdout:2/239: stat d6/d9/c29 0 2023-12-17T11:57:37.799 INFO:tasks.workunit.client.1.smithi119.stdout:2/240: mkdir d6/d9/d52/d53 0 2023-12-17T11:57:37.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/269: dwrite dc/f1f [0,4194304] 0 2023-12-17T11:57:37.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/270: creat dc/d42/f64 x:0 0 0 2023-12-17T11:57:37.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/271: truncate dc/d42/f57 858998 0 2023-12-17T11:57:37.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/272: write dc/f15 [1757608,119541] 0 2023-12-17T11:57:37.803 INFO:tasks.workunit.client.0.smithi002.stdout:9/273: truncate dc/d42/d4f/d59/f5d 208805 0 2023-12-17T11:57:37.804 INFO:tasks.workunit.client.0.smithi002.stdout:8/256: dwrite d3/d8/da/dd/f35 [4194304,4194304] 0 2023-12-17T11:57:37.804 INFO:tasks.workunit.client.0.smithi002.stdout:8/257: fdatasync d3/d7/d1a/f1c 0 2023-12-17T11:57:37.804 INFO:tasks.workunit.client.0.smithi002.stdout:8/258: chown d3/d7/d18 25950 1 2023-12-17T11:57:37.804 INFO:tasks.workunit.client.1.smithi119.stdout:2/241: mknod d6/d2b/c54 0 2023-12-17T11:57:37.806 INFO:tasks.workunit.client.0.smithi002.stdout:1/286: symlink d3/d6/l5b 0 2023-12-17T11:57:37.809 INFO:tasks.workunit.client.0.smithi002.stdout:2/239: creat d3/d4/d7/d14/d2e/d37/f5a x:0 0 0 2023-12-17T11:57:37.815 INFO:tasks.workunit.client.1.smithi119.stdout:2/242: rename d6/d9/d3a to d6/d9/d52/d53/d55 0 2023-12-17T11:57:37.815 INFO:tasks.workunit.client.1.smithi119.stdout:2/243: read d6/f40 [1968778,58509] 0 2023-12-17T11:57:37.816 INFO:tasks.workunit.client.1.smithi119.stdout:2/244: read - d6/d9/d52/d53/d55/f4c zero size 2023-12-17T11:57:37.816 INFO:tasks.workunit.client.1.smithi119.stdout:2/245: readlink d6/d9/d13/d1d/l27 0 2023-12-17T11:57:37.820 INFO:tasks.workunit.client.0.smithi002.stdout:8/259: rename d3/d8/da/d44/f24 to d3/d7/d18/d3f/d49/f5b 0 2023-12-17T11:57:37.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/260: getdents d3/d7/d18/d3f 0 2023-12-17T11:57:37.821 INFO:tasks.workunit.client.0.smithi002.stdout:4/229: dwrite d0/d10/d21/f42 [0,4194304] 0 2023-12-17T11:57:37.827 INFO:tasks.workunit.client.1.smithi119.stdout:7/258: sync 2023-12-17T11:57:37.827 INFO:tasks.workunit.client.1.smithi119.stdout:7/259: chown d2/d4e 3288 1 2023-12-17T11:57:37.828 INFO:tasks.workunit.client.0.smithi002.stdout:0/168: getdents d0/d6/d26 0 2023-12-17T11:57:37.829 INFO:tasks.workunit.client.0.smithi002.stdout:6/206: sync 2023-12-17T11:57:37.829 INFO:tasks.workunit.client.0.smithi002.stdout:6/207: dread - d0/f3a zero size 2023-12-17T11:57:37.832 INFO:tasks.workunit.client.1.smithi119.stdout:3/230: dwrite d9/d11/d1e/f37 [0,4194304] 0 2023-12-17T11:57:37.833 INFO:tasks.workunit.client.1.smithi119.stdout:4/182: dwrite dd/f28 [0,4194304] 0 2023-12-17T11:57:37.835 INFO:tasks.workunit.client.0.smithi002.stdout:1/287: mkdir d3/d5c 0 2023-12-17T11:57:37.835 INFO:tasks.workunit.client.1.smithi119.stdout:7/260: getdents d2/d4/d3e 0 2023-12-17T11:57:37.835 INFO:tasks.workunit.client.1.smithi119.stdout:7/261: readlink d2/lc 0 2023-12-17T11:57:37.835 INFO:tasks.workunit.client.1.smithi119.stdout:7/262: dread - d2/d4/d1f/f4c zero size 2023-12-17T11:57:37.835 INFO:tasks.workunit.client.0.smithi002.stdout:1/288: write d3/d6/d9/f2e [72253,84481] 0 2023-12-17T11:57:37.839 INFO:tasks.workunit.client.0.smithi002.stdout:3/291: dwrite d9/d15/f22 [0,4194304] 0 2023-12-17T11:57:37.839 INFO:tasks.workunit.client.0.smithi002.stdout:3/292: chown d9/d40 56933 1 2023-12-17T11:57:37.839 INFO:tasks.workunit.client.0.smithi002.stdout:3/293: write d9/f14 [1455031,9672] 0 2023-12-17T11:57:37.839 INFO:tasks.workunit.client.0.smithi002.stdout:2/240: mkdir d3/d4/d7/d14/d1b/d5b 0 2023-12-17T11:57:37.840 INFO:tasks.workunit.client.0.smithi002.stdout:2/241: chown d3/d4/f6 0 1 2023-12-17T11:57:37.840 INFO:tasks.workunit.client.1.smithi119.stdout:2/246: dread d6/f21 [0,4194304] 0 2023-12-17T11:57:37.840 INFO:tasks.workunit.client.1.smithi119.stdout:2/247: fsync d6/d9/d13/f3e 0 2023-12-17T11:57:37.843 INFO:tasks.workunit.client.0.smithi002.stdout:4/230: mkdir d0/d10/d14/d50 0 2023-12-17T11:57:37.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/169: creat d0/d6/d26/f3a x:0 0 0 2023-12-17T11:57:37.843 INFO:tasks.workunit.client.0.smithi002.stdout:4/231: dread - d0/d10/d14/d27/f3a zero size 2023-12-17T11:57:37.843 INFO:tasks.workunit.client.0.smithi002.stdout:7/240: dwrite d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:57:37.844 INFO:tasks.workunit.client.0.smithi002.stdout:7/241: write d6/f44 [709268,27971] 0 2023-12-17T11:57:37.853 INFO:tasks.workunit.client.1.smithi119.stdout:3/231: read d9/da/df/f17 [4712194,63072] 0 2023-12-17T11:57:37.854 INFO:tasks.workunit.client.1.smithi119.stdout:3/232: readlink d9/d11/l12 0 2023-12-17T11:57:37.857 INFO:tasks.workunit.client.0.smithi002.stdout:1/289: truncate d3/d6/d9/d30/f3d 1994137 0 2023-12-17T11:57:37.857 INFO:tasks.workunit.client.0.smithi002.stdout:3/294: truncate d9/d24/f3e 899365 0 2023-12-17T11:57:37.859 INFO:tasks.workunit.client.1.smithi119.stdout:3/233: creat d9/da/f54 x:0 0 0 2023-12-17T11:57:37.859 INFO:tasks.workunit.client.1.smithi119.stdout:3/234: stat d9/da/df/d41/d33/d3a/f3d 0 2023-12-17T11:57:37.863 INFO:tasks.workunit.client.0.smithi002.stdout:7/242: rename d6/d17/d16/d1d/l20 to d6/d17/d16/l45 0 2023-12-17T11:57:37.863 INFO:tasks.workunit.client.0.smithi002.stdout:5/166: sync 2023-12-17T11:57:37.864 INFO:tasks.workunit.client.1.smithi119.stdout:3/235: mkdir d9/d11/d1e/d55 0 2023-12-17T11:57:37.864 INFO:tasks.workunit.client.1.smithi119.stdout:3/236: truncate d9/f1b 1206871 0 2023-12-17T11:57:37.865 INFO:tasks.workunit.client.0.smithi002.stdout:4/232: read d0/f43 [3784072,3519] 0 2023-12-17T11:57:37.866 INFO:tasks.workunit.client.0.smithi002.stdout:6/208: dread d0/d1/dc/f34 [0,4194304] 0 2023-12-17T11:57:37.866 INFO:tasks.workunit.client.1.smithi119.stdout:3/237: creat d9/d11/d1e/f56 x:0 0 0 2023-12-17T11:57:37.867 INFO:tasks.workunit.client.1.smithi119.stdout:3/238: truncate d9/d11/f3f 713506 0 2023-12-17T11:57:37.868 INFO:tasks.workunit.client.0.smithi002.stdout:1/290: link d3/d6/f3a d3/d5c/f5d 0 2023-12-17T11:57:37.870 INFO:tasks.workunit.client.0.smithi002.stdout:5/167: mknod dc/d17/d1c/c2a 0 2023-12-17T11:57:37.870 INFO:tasks.workunit.client.0.smithi002.stdout:3/295: rmdir d9/d1b/d35/d41/d59 39 2023-12-17T11:57:37.875 INFO:tasks.workunit.client.0.smithi002.stdout:6/209: read d0/d1/d28/f32 [602599,72944] 0 2023-12-17T11:57:37.878 INFO:tasks.workunit.client.0.smithi002.stdout:6/210: truncate d0/d1/dc/f34 7939280 0 2023-12-17T11:57:37.879 INFO:tasks.workunit.client.0.smithi002.stdout:6/211: truncate d0/d1/dc/d17/f1f 1262815 0 2023-12-17T11:57:37.884 INFO:tasks.workunit.client.0.smithi002.stdout:4/233: dread d0/f43 [0,4194304] 0 2023-12-17T11:57:37.884 INFO:tasks.workunit.client.0.smithi002.stdout:4/234: write d0/d10/d14/d27/f3a [368013,43865] 0 2023-12-17T11:57:37.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/242: dread d3/d4/d17/f20 [0,4194304] 0 2023-12-17T11:57:37.887 INFO:tasks.workunit.client.0.smithi002.stdout:8/261: dwrite d3/d8/da/f46 [0,4194304] 0 2023-12-17T11:57:37.888 INFO:tasks.workunit.client.1.smithi119.stdout:3/239: dread d9/da/f2d [0,4194304] 0 2023-12-17T11:57:37.890 INFO:tasks.workunit.client.1.smithi119.stdout:3/240: symlink d9/da/df/d41/d33/l57 0 2023-12-17T11:57:37.890 INFO:tasks.workunit.client.1.smithi119.stdout:3/241: creat d9/d35/f58 x:0 0 0 2023-12-17T11:57:37.892 INFO:tasks.workunit.client.1.smithi119.stdout:1/128: dwrite d3/db/d26/d19/f1e [0,4194304] 0 2023-12-17T11:57:37.892 INFO:tasks.workunit.client.1.smithi119.stdout:3/242: mkdir d9/d59 0 2023-12-17T11:57:37.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/274: dwrite dc/f12 [0,4194304] 0 2023-12-17T11:57:37.893 INFO:tasks.workunit.client.0.smithi002.stdout:4/235: creat d0/d3e/d47/f51 x:0 0 0 2023-12-17T11:57:37.893 INFO:tasks.workunit.client.0.smithi002.stdout:4/236: fsync d0/d10/f40 0 2023-12-17T11:57:37.893 INFO:tasks.workunit.client.0.smithi002.stdout:7/243: dread d6/d17/dc/d13/d21/f3f [0,4194304] 0 2023-12-17T11:57:37.895 INFO:tasks.workunit.client.0.smithi002.stdout:2/243: mknod d3/d56/c5c 0 2023-12-17T11:57:37.897 INFO:tasks.workunit.client.1.smithi119.stdout:3/243: mkdir d9/da/df/d41/d33/d5a 0 2023-12-17T11:57:37.897 INFO:tasks.workunit.client.1.smithi119.stdout:3/244: chown d9/d11/d1e/l53 6439 1 2023-12-17T11:57:37.898 INFO:tasks.workunit.client.1.smithi119.stdout:3/245: write d9/da/df/d41/d33/d3a/f3d [1729547,104665] 0 2023-12-17T11:57:37.898 INFO:tasks.workunit.client.1.smithi119.stdout:3/246: chown d9/d35/f48 101 1 2023-12-17T11:57:37.898 INFO:tasks.workunit.client.1.smithi119.stdout:3/247: write d9/d11/d1e/f3e [1134449,97407] 0 2023-12-17T11:57:37.898 INFO:tasks.workunit.client.1.smithi119.stdout:4/183: dwrite dd/d15/f2e [0,4194304] 0 2023-12-17T11:57:37.899 INFO:tasks.workunit.client.1.smithi119.stdout:4/184: stat f2 0 2023-12-17T11:57:37.899 INFO:tasks.workunit.client.1.smithi119.stdout:4/185: chown dd/d15/l1f 4006 1 2023-12-17T11:57:37.899 INFO:tasks.workunit.client.1.smithi119.stdout:4/186: dread - dd/d2a/f30 zero size 2023-12-17T11:57:37.901 INFO:tasks.workunit.client.0.smithi002.stdout:1/291: dread d3/d6/f2b [0,4194304] 0 2023-12-17T11:57:37.901 INFO:tasks.workunit.client.0.smithi002.stdout:1/292: write d3/d6/d9/f29 [1603070,6052] 0 2023-12-17T11:57:37.905 INFO:tasks.workunit.client.0.smithi002.stdout:8/262: creat d3/d7/d1a/f5c x:0 0 0 2023-12-17T11:57:37.905 INFO:tasks.workunit.client.0.smithi002.stdout:8/263: readlink d3/l12 0 2023-12-17T11:57:37.908 INFO:tasks.workunit.client.0.smithi002.stdout:9/275: getdents dc/d1d 0 2023-12-17T11:57:37.916 INFO:tasks.workunit.client.0.smithi002.stdout:4/237: creat d0/d10/d14/f52 x:0 0 0 2023-12-17T11:57:37.916 INFO:tasks.workunit.client.0.smithi002.stdout:1/293: creat d3/d2f/d4d/f5e x:0 0 0 2023-12-17T11:57:37.918 INFO:tasks.workunit.client.0.smithi002.stdout:9/276: unlink dc/d1d/d23/c2d 0 2023-12-17T11:57:37.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/238: rmdir d0/d10/d14/d27 39 2023-12-17T11:57:37.924 INFO:tasks.workunit.client.0.smithi002.stdout:1/294: link d3/d6/d9/d37/f51 d3/d6/d9/d37/d39/d43/d4a/f5f 0 2023-12-17T11:57:37.927 INFO:tasks.workunit.client.1.smithi119.stdout:4/187: link dd/f32 dd/d11/d2d/f3a 0 2023-12-17T11:57:37.928 INFO:tasks.workunit.client.0.smithi002.stdout:0/170: dwrite d0/d6/d26/f24 [0,4194304] 0 2023-12-17T11:57:37.929 INFO:tasks.workunit.client.0.smithi002.stdout:3/296: dwrite d9/d1b/f1c [0,4194304] 0 2023-12-17T11:57:37.929 INFO:tasks.workunit.client.0.smithi002.stdout:3/297: creat d9/d1b/f5e x:0 0 0 2023-12-17T11:57:37.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/277: rename dc/f1f to dc/d1d/d25/f65 0 2023-12-17T11:57:37.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/278: fdatasync dc/d32/f51 0 2023-12-17T11:57:37.933 INFO:tasks.workunit.client.1.smithi119.stdout:4/188: mknod dd/c3b 0 2023-12-17T11:57:37.935 INFO:tasks.workunit.client.0.smithi002.stdout:5/168: write dc/d1a/f22 [135271,22615] 0 2023-12-17T11:57:37.936 INFO:tasks.workunit.client.1.smithi119.stdout:4/189: mknod dd/c3c 0 2023-12-17T11:57:37.936 INFO:tasks.workunit.client.1.smithi119.stdout:4/190: write dd/d11/d2d/f3a [688432,104403] 0 2023-12-17T11:57:37.938 INFO:tasks.workunit.client.0.smithi002.stdout:4/239: creat d0/d10/d14/d4e/f53 x:0 0 0 2023-12-17T11:57:37.938 INFO:tasks.workunit.client.0.smithi002.stdout:1/295: mknod d3/d5c/c60 0 2023-12-17T11:57:37.941 INFO:tasks.workunit.client.1.smithi119.stdout:4/191: mkdir dd/d15/d16/d3d 0 2023-12-17T11:57:37.944 INFO:tasks.workunit.client.0.smithi002.stdout:0/171: creat d0/d6/d26/f3b x:0 0 0 2023-12-17T11:57:37.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/244: dread d6/d17/d16/d1d/f35 [0,4194304] 0 2023-12-17T11:57:37.945 INFO:tasks.workunit.client.0.smithi002.stdout:7/245: write d6/d17/dc/d13/d21/f3f [4680272,123227] 0 2023-12-17T11:57:37.946 INFO:tasks.workunit.client.1.smithi119.stdout:4/192: creat dd/d11/d2d/f3e x:0 0 0 2023-12-17T11:57:37.952 INFO:tasks.workunit.client.0.smithi002.stdout:8/264: write d3/d7/d1a/f1c [219835,79036] 0 2023-12-17T11:57:37.952 INFO:tasks.workunit.client.0.smithi002.stdout:3/298: creat d9/d15/d31/f5f x:0 0 0 2023-12-17T11:57:37.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/299: chown d9/d15/l23 20593445 1 2023-12-17T11:57:37.953 INFO:tasks.workunit.client.0.smithi002.stdout:5/169: getdents dc/d17/d1c 0 2023-12-17T11:57:37.953 INFO:tasks.workunit.client.1.smithi119.stdout:9/241: sync 2023-12-17T11:57:37.953 INFO:tasks.workunit.client.1.smithi119.stdout:6/202: sync 2023-12-17T11:57:37.953 INFO:tasks.workunit.client.1.smithi119.stdout:4/193: symlink dd/d15/l3f 0 2023-12-17T11:57:37.954 INFO:tasks.workunit.client.1.smithi119.stdout:4/194: fdatasync f2 0 2023-12-17T11:57:37.954 INFO:tasks.workunit.client.1.smithi119.stdout:4/195: write dd/f1d [4473553,80470] 0 2023-12-17T11:57:37.955 INFO:tasks.workunit.client.1.smithi119.stdout:9/242: truncate d12/d1d/d28/f3a 603925 0 2023-12-17T11:57:37.955 INFO:tasks.workunit.client.1.smithi119.stdout:9/243: write d12/d1d/f2f [153948,36138] 0 2023-12-17T11:57:37.955 INFO:tasks.workunit.client.1.smithi119.stdout:9/244: fdatasync d12/f35 0 2023-12-17T11:57:37.957 INFO:tasks.workunit.client.0.smithi002.stdout:4/240: getdents d0/d10/d21/d33 0 2023-12-17T11:57:37.960 INFO:tasks.workunit.client.1.smithi119.stdout:4/196: symlink dd/d2a/l40 0 2023-12-17T11:57:37.961 INFO:tasks.workunit.client.1.smithi119.stdout:9/245: mkdir d12/d1d/d28/d4d 0 2023-12-17T11:57:37.962 INFO:tasks.workunit.client.1.smithi119.stdout:9/246: write d12/d1d/f36 [1125445,82218] 0 2023-12-17T11:57:37.964 INFO:tasks.workunit.client.0.smithi002.stdout:8/265: rename d3/d7/d18/d3f/d49/f5b to d3/d7/f5d 0 2023-12-17T11:57:37.966 INFO:tasks.workunit.client.1.smithi119.stdout:4/197: rename dd/d2a/f30 to dd/f41 0 2023-12-17T11:57:37.967 INFO:tasks.workunit.client.1.smithi119.stdout:4/198: write dd/d11/d2d/f3a [1246631,123213] 0 2023-12-17T11:57:37.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/244: dwrite d3/d4/f3a [0,4194304] 0 2023-12-17T11:57:37.968 INFO:tasks.workunit.client.0.smithi002.stdout:2/245: stat d3/d50/f53 0 2023-12-17T11:57:37.968 INFO:tasks.workunit.client.0.smithi002.stdout:2/246: creat d3/d4/f5d x:0 0 0 2023-12-17T11:57:37.970 INFO:tasks.workunit.client.1.smithi119.stdout:6/203: dread d2/d2b/f33 [0,4194304] 0 2023-12-17T11:57:37.970 INFO:tasks.workunit.client.1.smithi119.stdout:1/129: dwrite d3/f4 [4194304,4194304] 0 2023-12-17T11:57:37.970 INFO:tasks.workunit.client.1.smithi119.stdout:1/130: chown d3/db/d26/f6 983 1 2023-12-17T11:57:37.971 INFO:tasks.workunit.client.0.smithi002.stdout:4/241: unlink d0/l17 0 2023-12-17T11:57:37.971 INFO:tasks.workunit.client.0.smithi002.stdout:4/242: stat d0/d10/d21/d33/f35 0 2023-12-17T11:57:37.973 INFO:tasks.workunit.client.1.smithi119.stdout:4/199: mkdir dd/d15/d16/d20/d42 0 2023-12-17T11:57:37.974 INFO:tasks.workunit.client.1.smithi119.stdout:1/131: write d3/db/d26/f21 [599429,76027] 0 2023-12-17T11:57:37.977 INFO:tasks.workunit.client.0.smithi002.stdout:8/266: mknod d3/d8/d28/c5e 0 2023-12-17T11:57:37.977 INFO:tasks.workunit.client.0.smithi002.stdout:8/267: creat d3/d8/da/dd/f5f x:0 0 0 2023-12-17T11:57:37.982 INFO:tasks.workunit.client.1.smithi119.stdout:3/248: dwrite d9/da/df/f17 [4194304,4194304] 0 2023-12-17T11:57:37.983 INFO:tasks.workunit.client.0.smithi002.stdout:5/170: dread dc/f18 [0,4194304] 0 2023-12-17T11:57:37.986 INFO:tasks.workunit.client.1.smithi119.stdout:6/204: symlink d2/df/d17/l3c 0 2023-12-17T11:57:37.987 INFO:tasks.workunit.client.1.smithi119.stdout:6/205: chown d2/df/c15 548294 1 2023-12-17T11:57:37.987 INFO:tasks.workunit.client.1.smithi119.stdout:6/206: creat d2/d2b/f3d x:0 0 0 2023-12-17T11:57:37.988 INFO:tasks.workunit.client.0.smithi002.stdout:7/246: dwrite d6/f3b [0,4194304] 0 2023-12-17T11:57:37.990 INFO:tasks.workunit.client.1.smithi119.stdout:4/200: unlink dd/d11/d2d/f3a 0 2023-12-17T11:57:37.992 INFO:tasks.workunit.client.0.smithi002.stdout:2/247: rmdir d3/d4/d7/d14/d2e/d37/d3f 39 2023-12-17T11:57:37.993 INFO:tasks.workunit.client.0.smithi002.stdout:2/248: write d3/d4/d7/f11 [3106845,122013] 0 2023-12-17T11:57:37.994 INFO:tasks.workunit.client.1.smithi119.stdout:1/132: creat d3/db/d26/f28 x:0 0 0 2023-12-17T11:57:37.994 INFO:tasks.workunit.client.1.smithi119.stdout:1/133: fsync d3/db/d17/d24/f14 0 2023-12-17T11:57:37.994 INFO:tasks.workunit.client.1.smithi119.stdout:1/134: read - d3/f25 zero size 2023-12-17T11:57:37.994 INFO:tasks.workunit.client.1.smithi119.stdout:1/135: write d3/db/f1f [332746,6182] 0 2023-12-17T11:57:37.996 INFO:tasks.workunit.client.1.smithi119.stdout:9/247: write d12/f2c [98379,6068] 0 2023-12-17T11:57:37.997 INFO:tasks.workunit.client.0.smithi002.stdout:4/243: rename d0/d10/d14/d27/f3a to d0/d10/d21/f54 0 2023-12-17T11:57:37.998 INFO:tasks.workunit.client.0.smithi002.stdout:6/212: dwrite d0/d1/dc/d17/f2e [0,4194304] 0 2023-12-17T11:57:38.000 INFO:tasks.workunit.client.0.smithi002.stdout:0/172: link d0/d6/d26/d14/d19/c1c d0/d6/d26/d25/c3c 0 2023-12-17T11:57:38.003 INFO:tasks.workunit.client.1.smithi119.stdout:3/249: dread d9/d1c/f24 [0,4194304] 0 2023-12-17T11:57:38.008 INFO:tasks.workunit.client.0.smithi002.stdout:8/268: creat d3/d7/d18/d3f/f60 x:0 0 0 2023-12-17T11:57:38.010 INFO:tasks.workunit.client.1.smithi119.stdout:4/201: write f4 [1777082,34040] 0 2023-12-17T11:57:38.016 INFO:tasks.workunit.client.1.smithi119.stdout:1/136: dread d3/db/f1f [0,4194304] 0 2023-12-17T11:57:38.016 INFO:tasks.workunit.client.1.smithi119.stdout:6/207: rename d2/df/c12 to d2/df/c3e 0 2023-12-17T11:57:38.016 INFO:tasks.workunit.client.1.smithi119.stdout:6/208: creat d2/df/d17/f3f x:0 0 0 2023-12-17T11:57:38.020 INFO:tasks.workunit.client.0.smithi002.stdout:6/213: read d0/d1/dc/d17/f26 [2772786,126073] 0 2023-12-17T11:57:38.020 INFO:tasks.workunit.client.0.smithi002.stdout:6/214: readlink d0/d1/dc/d10/l1d 0 2023-12-17T11:57:38.022 INFO:tasks.workunit.client.0.smithi002.stdout:0/173: dread d0/d15/f23 [0,4194304] 0 2023-12-17T11:57:38.022 INFO:tasks.workunit.client.0.smithi002.stdout:0/174: fdatasync d0/d6/d26/d14/d19/d2b/f30 0 2023-12-17T11:57:38.022 INFO:tasks.workunit.client.1.smithi119.stdout:9/248: creat d12/d1d/d28/d46/f4e x:0 0 0 2023-12-17T11:57:38.026 INFO:tasks.workunit.client.0.smithi002.stdout:4/244: rename d0/d10/d21/d33/f35 to d0/f55 0 2023-12-17T11:57:38.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/245: getdents d0/d10/d14/d50 0 2023-12-17T11:57:38.027 INFO:tasks.workunit.client.0.smithi002.stdout:5/171: mkdir dc/d2b 0 2023-12-17T11:57:38.027 INFO:tasks.workunit.client.1.smithi119.stdout:9/249: write d12/d1d/d28/f43 [939854,32248] 0 2023-12-17T11:57:38.028 INFO:tasks.workunit.client.0.smithi002.stdout:8/269: link d3/d7/l2b d3/l61 0 2023-12-17T11:57:38.031 INFO:tasks.workunit.client.0.smithi002.stdout:0/175: unlink d0/d6/d26/d14/d19/d2f/f38 0 2023-12-17T11:57:38.032 INFO:tasks.workunit.client.1.smithi119.stdout:3/250: mknod d9/da/df/d41/d33/d3a/c5b 0 2023-12-17T11:57:38.032 INFO:tasks.workunit.client.1.smithi119.stdout:3/251: readlink l8 0 2023-12-17T11:57:38.032 INFO:tasks.workunit.client.1.smithi119.stdout:3/252: chown d9/da/f54 0 1 2023-12-17T11:57:38.035 INFO:tasks.workunit.client.0.smithi002.stdout:7/247: rename d6/d17/dc/d13/l34 to d6/d17/dc/l46 0 2023-12-17T11:57:38.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/246: mkdir d0/d3e/d56 0 2023-12-17T11:57:38.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/247: stat d0/d3e/d41 0 2023-12-17T11:57:38.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/248: stat d0/ff 0 2023-12-17T11:57:38.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/249: truncate d0/d10/d21/d33/f45 919484 0 2023-12-17T11:57:38.035 INFO:tasks.workunit.client.0.smithi002.stdout:4/250: fsync d0/d10/d21/f49 0 2023-12-17T11:57:38.036 INFO:tasks.workunit.client.1.smithi119.stdout:4/202: symlink dd/d11/d26/l43 0 2023-12-17T11:57:38.036 INFO:tasks.workunit.client.0.smithi002.stdout:6/215: dread d0/d1/dc/ff [0,4194304] 0 2023-12-17T11:57:38.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/270: truncate d3/d7/f58 154612 0 2023-12-17T11:57:38.039 INFO:tasks.workunit.client.0.smithi002.stdout:8/271: getdents d3/d7/d18 0 2023-12-17T11:57:38.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/176: mkdir d0/d15/d3d 0 2023-12-17T11:57:38.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/177: dread - d0/d6/d26/f3a zero size 2023-12-17T11:57:38.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/178: write d0/d15/f32 [56430,62615] 0 2023-12-17T11:57:38.041 INFO:tasks.workunit.client.1.smithi119.stdout:6/209: mknod d2/d2b/c40 0 2023-12-17T11:57:38.041 INFO:tasks.workunit.client.1.smithi119.stdout:6/210: write d2/df/d17/f3f [1023194,82151] 0 2023-12-17T11:57:38.041 INFO:tasks.workunit.client.0.smithi002.stdout:0/179: truncate d0/d6/d26/d14/d19/d37/f39 790324 0 2023-12-17T11:57:38.042 INFO:tasks.workunit.client.0.smithi002.stdout:6/216: mkdir d0/d1/dc/d17/d3c 0 2023-12-17T11:57:38.045 INFO:tasks.workunit.client.0.smithi002.stdout:1/296: dwrite d3/f49 [0,4194304] 0 2023-12-17T11:57:38.046 INFO:tasks.workunit.client.0.smithi002.stdout:6/217: creat d0/d1/d28/f3d x:0 0 0 2023-12-17T11:57:38.047 INFO:tasks.workunit.client.0.smithi002.stdout:1/297: write d3/d6/d16/f26 [66252,54904] 0 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:9/250: mknod d12/c4f 0 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:9/251: fdatasync fe 0 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:5/262: sync 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:8/193: sync 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:0/174: sync 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:3/253: mknod d9/da/df/d41/d33/d3a/c5c 0 2023-12-17T11:57:38.051 INFO:tasks.workunit.client.1.smithi119.stdout:7/263: sync 2023-12-17T11:57:38.054 INFO:tasks.workunit.client.1.smithi119.stdout:6/211: mkdir d2/d41 0 2023-12-17T11:57:38.054 INFO:tasks.workunit.client.1.smithi119.stdout:2/248: sync 2023-12-17T11:57:38.057 INFO:tasks.workunit.client.1.smithi119.stdout:5/263: rename d1/d25/l40 to d1/d36/d3a/l50 0 2023-12-17T11:57:38.057 INFO:tasks.workunit.client.1.smithi119.stdout:5/264: stat d1/l1c 0 2023-12-17T11:57:38.057 INFO:tasks.workunit.client.0.smithi002.stdout:4/251: write d0/d10/f40 [114814,96909] 0 2023-12-17T11:57:38.058 INFO:tasks.workunit.client.0.smithi002.stdout:7/248: read d6/f44 [385097,92714] 0 2023-12-17T11:57:38.058 INFO:tasks.workunit.client.0.smithi002.stdout:7/249: chown d6/d17/dc/d13/d21/c22 927 1 2023-12-17T11:57:38.058 INFO:tasks.workunit.client.0.smithi002.stdout:7/250: fdatasync d6/f1c 0 2023-12-17T11:57:38.058 INFO:tasks.workunit.client.0.smithi002.stdout:7/251: chown d6/d17/d16/d1d/d24/c28 223356 1 2023-12-17T11:57:38.059 INFO:tasks.workunit.client.1.smithi119.stdout:9/252: dread d12/f37 [4194304,4194304] 0 2023-12-17T11:57:38.059 INFO:tasks.workunit.client.1.smithi119.stdout:0/175: symlink d2/d3/d5/dc/l34 0 2023-12-17T11:57:38.059 INFO:tasks.workunit.client.1.smithi119.stdout:0/176: truncate d2/d16/d12/f25 714182 0 2023-12-17T11:57:38.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/272: write d3/d8/da/d44/f3b [890482,96944] 0 2023-12-17T11:57:38.061 INFO:tasks.workunit.client.1.smithi119.stdout:3/254: creat d9/d59/f5d x:0 0 0 2023-12-17T11:57:38.063 INFO:tasks.workunit.client.1.smithi119.stdout:6/212: mknod d2/c42 0 2023-12-17T11:57:38.063 INFO:tasks.workunit.client.1.smithi119.stdout:6/213: chown d2/df/c1c 6708 1 2023-12-17T11:57:38.065 INFO:tasks.workunit.client.1.smithi119.stdout:2/249: mkdir d6/d9/d13/d34/d56 0 2023-12-17T11:57:38.065 INFO:tasks.workunit.client.0.smithi002.stdout:0/180: read d0/d6/fe [526973,4633] 0 2023-12-17T11:57:38.067 INFO:tasks.workunit.client.0.smithi002.stdout:6/218: symlink d0/d1/dc/d17/d3c/l3e 0 2023-12-17T11:57:38.067 INFO:tasks.workunit.client.0.smithi002.stdout:6/219: write d0/d1/d21/f2d [1244799,55183] 0 2023-12-17T11:57:38.069 INFO:tasks.workunit.client.1.smithi119.stdout:7/264: dread d2/d4e/f33 [0,4194304] 0 2023-12-17T11:57:38.069 INFO:tasks.workunit.client.1.smithi119.stdout:5/265: rename d1/d36/f48 to d1/f51 0 2023-12-17T11:57:38.069 INFO:tasks.workunit.client.1.smithi119.stdout:4/203: dread dd/d11/d26/f36 [0,4194304] 0 2023-12-17T11:57:38.069 INFO:tasks.workunit.client.1.smithi119.stdout:5/266: write d1/d44/f4c [1133435,75825] 0 2023-12-17T11:57:38.071 INFO:tasks.workunit.client.0.smithi002.stdout:2/249: dwrite d3/d4/d7/d14/d2e/d37/f5a [0,4194304] 0 2023-12-17T11:57:38.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/298: mkdir d3/d6/d16/d61 0 2023-12-17T11:57:38.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/299: chown d3/d6/d9/d30/l19 53649 1 2023-12-17T11:57:38.073 INFO:tasks.workunit.client.0.smithi002.stdout:4/252: mkdir d0/d10/d14/d27/d57 0 2023-12-17T11:57:38.075 INFO:tasks.workunit.client.1.smithi119.stdout:0/177: mkdir d2/d16/d35 0 2023-12-17T11:57:38.075 INFO:tasks.workunit.client.1.smithi119.stdout:3/255: link d9/da/df/d41/d33/d3a/f40 d9/d35/f5e 0 2023-12-17T11:57:38.080 INFO:tasks.workunit.client.0.smithi002.stdout:7/252: creat d6/d17/f47 x:0 0 0 2023-12-17T11:57:38.080 INFO:tasks.workunit.client.0.smithi002.stdout:0/181: write d0/f22 [3166990,39316] 0 2023-12-17T11:57:38.080 INFO:tasks.workunit.client.0.smithi002.stdout:7/253: creat d6/d17/f48 x:0 0 0 2023-12-17T11:57:38.080 INFO:tasks.workunit.client.1.smithi119.stdout:2/250: link d6/d9/d13/d1d/f50 d6/d38/f57 0 2023-12-17T11:57:38.083 INFO:tasks.workunit.client.1.smithi119.stdout:6/214: dread d2/f19 [0,4194304] 0 2023-12-17T11:57:38.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/273: mknod d3/d8/da/c62 0 2023-12-17T11:57:38.087 INFO:tasks.workunit.client.1.smithi119.stdout:7/265: mknod d2/d4/d11/d3c/c51 0 2023-12-17T11:57:38.087 INFO:tasks.workunit.client.1.smithi119.stdout:7/266: chown d2/d4/d1f 0 1 2023-12-17T11:57:38.099 INFO:tasks.workunit.client.1.smithi119.stdout:2/251: read d6/d9/d13/d1d/f50 [2528889,50883] 0 2023-12-17T11:57:38.100 INFO:tasks.workunit.client.1.smithi119.stdout:9/253: rename d12/d4a to d12/d1d/d28/d46/d50 0 2023-12-17T11:57:38.100 INFO:tasks.workunit.client.1.smithi119.stdout:4/204: mknod dd/d15/d16/d20/c44 0 2023-12-17T11:57:38.100 INFO:tasks.workunit.client.1.smithi119.stdout:9/254: write d12/d1d/f2f [428818,124604] 0 2023-12-17T11:57:38.100 INFO:tasks.workunit.client.1.smithi119.stdout:9/255: truncate d12/d1d/f44 491941 0 2023-12-17T11:57:38.100 INFO:tasks.workunit.client.1.smithi119.stdout:9/256: dread - d12/f42 zero size 2023-12-17T11:57:38.101 INFO:tasks.workunit.client.1.smithi119.stdout:5/267: truncate d1/f8 1129877 0 2023-12-17T11:57:38.103 INFO:tasks.workunit.client.1.smithi119.stdout:5/268: write d1/f2e [1214044,34846] 0 2023-12-17T11:57:38.105 INFO:tasks.workunit.client.0.smithi002.stdout:1/300: mknod d3/d6/d9/d37/d39/d43/c62 0 2023-12-17T11:57:38.105 INFO:tasks.workunit.client.0.smithi002.stdout:1/301: chown d3/f49 12365606 1 2023-12-17T11:57:38.110 INFO:tasks.workunit.client.0.smithi002.stdout:0/182: truncate d0/d15/f27 195623 0 2023-12-17T11:57:38.111 INFO:tasks.workunit.client.1.smithi119.stdout:7/267: creat d2/d4b/f52 x:0 0 0 2023-12-17T11:57:38.117 INFO:tasks.workunit.client.1.smithi119.stdout:0/178: dread d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:38.124 INFO:tasks.workunit.client.0.smithi002.stdout:7/254: symlink d6/d17/dc/l49 0 2023-12-17T11:57:38.126 INFO:tasks.workunit.client.1.smithi119.stdout:2/252: mkdir d6/d9/d52/d53/d55/d58 0 2023-12-17T11:57:38.127 INFO:tasks.workunit.client.0.smithi002.stdout:8/274: truncate d3/d8/da/dd/f35 5761356 0 2023-12-17T11:57:38.128 INFO:tasks.workunit.client.0.smithi002.stdout:8/275: chown d3/d8/da/d44 0 1 2023-12-17T11:57:38.128 INFO:tasks.workunit.client.0.smithi002.stdout:8/276: fsync d3/d7/f5d 0 2023-12-17T11:57:38.128 INFO:tasks.workunit.client.1.smithi119.stdout:4/205: creat dd/d15/d16/f45 x:0 0 0 2023-12-17T11:57:38.129 INFO:tasks.workunit.client.0.smithi002.stdout:8/277: creat d3/d7/f63 x:0 0 0 2023-12-17T11:57:38.131 INFO:tasks.workunit.client.1.smithi119.stdout:9/257: creat d12/d1d/f51 x:0 0 0 2023-12-17T11:57:38.134 INFO:tasks.workunit.client.1.smithi119.stdout:7/268: rename d2/d4e/c36 to d2/d4/d11/d3c/c53 0 2023-12-17T11:57:38.138 INFO:tasks.workunit.client.1.smithi119.stdout:3/256: dwrite d9/d35/f58 [0,4194304] 0 2023-12-17T11:57:38.138 INFO:tasks.workunit.client.1.smithi119.stdout:3/257: creat d9/d11/f5f x:0 0 0 2023-12-17T11:57:38.140 INFO:tasks.workunit.client.0.smithi002.stdout:6/220: rmdir d0 39 2023-12-17T11:57:38.142 INFO:tasks.workunit.client.1.smithi119.stdout:2/253: symlink d6/d9/l59 0 2023-12-17T11:57:38.145 INFO:tasks.workunit.client.1.smithi119.stdout:9/258: creat d12/d1d/d49/f52 x:0 0 0 2023-12-17T11:57:38.145 INFO:tasks.workunit.client.1.smithi119.stdout:9/259: readlink d12/d1d/l45 0 2023-12-17T11:57:38.148 INFO:tasks.workunit.client.0.smithi002.stdout:1/302: mknod d3/d6/d9/d37/d39/d43/d4a/c63 0 2023-12-17T11:57:38.148 INFO:tasks.workunit.client.0.smithi002.stdout:0/183: mknod d0/d6/d26/d14/d19/d37/c3e 0 2023-12-17T11:57:38.148 INFO:tasks.workunit.client.1.smithi119.stdout:7/269: symlink d2/d4/l54 0 2023-12-17T11:57:38.149 INFO:tasks.workunit.client.0.smithi002.stdout:7/255: mkdir d6/d17/dc/d13/d21/d2e/d4a 0 2023-12-17T11:57:38.152 INFO:tasks.workunit.client.1.smithi119.stdout:4/206: rename dd/c3c to dd/d15/d16/d3d/c46 0 2023-12-17T11:57:38.156 INFO:tasks.workunit.client.0.smithi002.stdout:6/221: creat d0/d1/d21/f3f x:0 0 0 2023-12-17T11:57:38.158 INFO:tasks.workunit.client.0.smithi002.stdout:0/184: creat d0/d6/d26/d14/f3f x:0 0 0 2023-12-17T11:57:38.158 INFO:tasks.workunit.client.0.smithi002.stdout:0/185: write d0/d6/d26/d14/d19/d37/f39 [1275976,4513] 0 2023-12-17T11:57:38.161 INFO:tasks.workunit.client.0.smithi002.stdout:7/256: dread d6/f1c [0,4194304] 0 2023-12-17T11:57:38.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/257: fdatasync d6/d17/d16/d1d/f35 0 2023-12-17T11:57:38.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/258: chown d6/d17/f1a 10 1 2023-12-17T11:57:38.162 INFO:tasks.workunit.client.0.smithi002.stdout:7/259: fdatasync d6/d17/dc/d13/f30 0 2023-12-17T11:57:38.162 INFO:tasks.workunit.client.0.smithi002.stdout:6/222: mkdir d0/d1/dc/d17/d40 0 2023-12-17T11:57:38.162 INFO:tasks.workunit.client.0.smithi002.stdout:6/223: stat d0/la 0 2023-12-17T11:57:38.162 INFO:tasks.workunit.client.1.smithi119.stdout:3/258: symlink d9/d1c/l60 0 2023-12-17T11:57:38.163 INFO:tasks.workunit.client.0.smithi002.stdout:0/186: unlink d0/d6/d26/d14/d19/d2f/f36 0 2023-12-17T11:57:38.163 INFO:tasks.workunit.client.0.smithi002.stdout:0/187: fdatasync d0/f2e 0 2023-12-17T11:57:38.163 INFO:tasks.workunit.client.1.smithi119.stdout:2/254: mkdir d6/d9/d52/d5a 0 2023-12-17T11:57:38.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/253: dwrite d0/f55 [0,4194304] 0 2023-12-17T11:57:38.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/254: stat d0/d10/l34 0 2023-12-17T11:57:38.165 INFO:tasks.workunit.client.0.smithi002.stdout:4/255: truncate d0/d10/f30 677137 0 2023-12-17T11:57:38.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/260: creat d6/d17/dc/d13/d3e/f4b x:0 0 0 2023-12-17T11:57:38.166 INFO:tasks.workunit.client.0.smithi002.stdout:2/250: dwrite d3/d4/f5d [0,4194304] 0 2023-12-17T11:57:38.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/261: write d6/d17/dc/d13/f14 [372295,71840] 0 2023-12-17T11:57:38.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/262: write d6/d17/d16/d1d/d24/f31 [4635239,29414] 0 2023-12-17T11:57:38.166 INFO:tasks.workunit.client.0.smithi002.stdout:2/251: creat d3/d4/d7/d14/d34/f5e x:0 0 0 2023-12-17T11:57:38.167 INFO:tasks.workunit.client.0.smithi002.stdout:0/188: mknod d0/d6/d26/d14/d19/d2b/c40 0 2023-12-17T11:57:38.168 INFO:tasks.workunit.client.1.smithi119.stdout:6/215: dwrite d2/d2b/f2d [0,4194304] 0 2023-12-17T11:57:38.169 INFO:tasks.workunit.client.1.smithi119.stdout:6/216: fsync d2/d2b/f2d 0 2023-12-17T11:57:38.169 INFO:tasks.workunit.client.1.smithi119.stdout:7/270: mkdir d2/d4/d11/d2c/d55 0 2023-12-17T11:57:38.174 INFO:tasks.workunit.client.1.smithi119.stdout:0/179: dwrite d2/d16/d12/d21/f26 [4194304,4194304] 0 2023-12-17T11:57:38.176 INFO:tasks.workunit.client.1.smithi119.stdout:3/259: symlink d9/l61 0 2023-12-17T11:57:38.180 INFO:tasks.workunit.client.1.smithi119.stdout:2/255: mkdir d6/d2b/d3f/d5b 0 2023-12-17T11:57:38.184 INFO:tasks.workunit.client.1.smithi119.stdout:7/271: dread d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:38.184 INFO:tasks.workunit.client.1.smithi119.stdout:7/272: write d2/d4/f29 [182335,6530] 0 2023-12-17T11:57:38.184 INFO:tasks.workunit.client.1.smithi119.stdout:7/273: chown d2/lc 0 1 2023-12-17T11:57:38.184 INFO:tasks.workunit.client.1.smithi119.stdout:7/274: chown d2/d4/c34 733619 1 2023-12-17T11:57:38.185 INFO:tasks.workunit.client.1.smithi119.stdout:5/269: dwrite d1/f8 [0,4194304] 0 2023-12-17T11:57:38.185 INFO:tasks.workunit.client.1.smithi119.stdout:4/207: dread dd/f32 [0,4194304] 0 2023-12-17T11:57:38.187 INFO:tasks.workunit.client.0.smithi002.stdout:8/278: dwrite d3/d7/d1a/f1c [4194304,4194304] 0 2023-12-17T11:57:38.187 INFO:tasks.workunit.client.0.smithi002.stdout:8/279: chown d3/f40 95141494 1 2023-12-17T11:57:38.191 INFO:tasks.workunit.client.0.smithi002.stdout:1/303: dwrite d3/d6/d16/d28/f58 [0,4194304] 0 2023-12-17T11:57:38.192 INFO:tasks.workunit.client.1.smithi119.stdout:2/256: dread f5 [0,4194304] 0 2023-12-17T11:57:38.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/260: getdents d12/d1d/d49 0 2023-12-17T11:57:38.196 INFO:tasks.workunit.client.1.smithi119.stdout:6/217: mkdir d2/d2b/d43 0 2023-12-17T11:57:38.201 INFO:tasks.workunit.client.1.smithi119.stdout:6/218: creat d2/d2b/f44 x:0 0 0 2023-12-17T11:57:38.201 INFO:tasks.workunit.client.1.smithi119.stdout:6/219: chown d2/df/d17/f2f 98 1 2023-12-17T11:57:38.202 INFO:tasks.workunit.client.1.smithi119.stdout:7/275: dread d2/d4/f28 [0,4194304] 0 2023-12-17T11:57:38.206 INFO:tasks.workunit.client.0.smithi002.stdout:4/256: unlink d0/d3e/d47/f51 0 2023-12-17T11:57:38.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/208: dread dd/d15/f2e [0,4194304] 0 2023-12-17T11:57:38.214 INFO:tasks.workunit.client.1.smithi119.stdout:0/180: link d2/d3/d5/dc/l15 d2/d3/d5/dc/l36 0 2023-12-17T11:57:38.214 INFO:tasks.workunit.client.1.smithi119.stdout:0/181: chown d2/d3/d5/dc/l36 918 1 2023-12-17T11:57:38.217 INFO:tasks.workunit.client.0.smithi002.stdout:0/189: rmdir d0/d15/d3d 0 2023-12-17T11:57:38.217 INFO:tasks.workunit.client.0.smithi002.stdout:0/190: chown d0/d6/d26/f3a 65735086 1 2023-12-17T11:57:38.217 INFO:tasks.workunit.client.0.smithi002.stdout:0/191: write d0/d6/fe [4539675,88612] 0 2023-12-17T11:57:38.217 INFO:tasks.workunit.client.0.smithi002.stdout:0/192: write d0/d6/d26/f3b [31592,38867] 0 2023-12-17T11:57:38.219 INFO:tasks.workunit.client.1.smithi119.stdout:3/260: creat d9/da/df/d41/d33/f62 x:0 0 0 2023-12-17T11:57:38.223 INFO:tasks.workunit.client.1.smithi119.stdout:5/270: mkdir d1/d44/d52 0 2023-12-17T11:57:38.223 INFO:tasks.workunit.client.1.smithi119.stdout:5/271: dread - d1/f29 zero size 2023-12-17T11:57:38.223 INFO:tasks.workunit.client.1.smithi119.stdout:5/272: write d1/f33 [4509262,1108] 0 2023-12-17T11:57:38.223 INFO:tasks.workunit.client.1.smithi119.stdout:5/273: fdatasync d1/f20 0 2023-12-17T11:57:38.228 INFO:tasks.workunit.client.1.smithi119.stdout:9/261: rename d12/d1d/d28/c2e to d12/d1d/d28/d46/d50/c53 0 2023-12-17T11:57:38.228 INFO:tasks.workunit.client.1.smithi119.stdout:9/262: fdatasync d12/f48 0 2023-12-17T11:57:38.237 INFO:tasks.workunit.client.0.smithi002.stdout:1/304: link d3/d6/d9/d37/c3b d3/d6/d16/d61/c64 0 2023-12-17T11:57:38.237 INFO:tasks.workunit.client.0.smithi002.stdout:6/224: dwrite d0/d1/dc/d17/f2e [0,4194304] 0 2023-12-17T11:57:38.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/305: creat d3/d6/d9/d37/f65 x:0 0 0 2023-12-17T11:57:38.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/306: readlink d3/d6/d9/d30/l19 0 2023-12-17T11:57:38.238 INFO:tasks.workunit.client.0.smithi002.stdout:1/307: readlink d3/d6/d9/d30/l19 0 2023-12-17T11:57:38.240 INFO:tasks.workunit.client.1.smithi119.stdout:7/276: mkdir d2/d49/d56 0 2023-12-17T11:57:38.244 INFO:tasks.workunit.client.0.smithi002.stdout:4/257: symlink d0/d10/d14/d27/d57/l58 0 2023-12-17T11:57:38.247 INFO:tasks.workunit.client.0.smithi002.stdout:7/263: rename d6/d17/d16/d1d to d6/d17/dc/d13/d37/d4c 0 2023-12-17T11:57:38.248 INFO:tasks.workunit.client.1.smithi119.stdout:4/209: symlink dd/d15/d16/d20/l47 0 2023-12-17T11:57:38.248 INFO:tasks.workunit.client.1.smithi119.stdout:3/261: mknod d9/c63 0 2023-12-17T11:57:38.248 INFO:tasks.workunit.client.1.smithi119.stdout:3/262: dread - d9/d35/f48 zero size 2023-12-17T11:57:38.250 INFO:tasks.workunit.client.0.smithi002.stdout:0/193: unlink d0/d6/c1b 0 2023-12-17T11:57:38.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/225: creat d0/d1/dc/d17/f41 x:0 0 0 2023-12-17T11:57:38.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/226: creat d0/d1/dc/d17/f42 x:0 0 0 2023-12-17T11:57:38.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/227: write d0/d1/dc/f8 [5021567,76298] 0 2023-12-17T11:57:38.255 INFO:tasks.workunit.client.0.smithi002.stdout:6/228: creat d0/d1/dc/d17/f43 x:0 0 0 2023-12-17T11:57:38.256 INFO:tasks.workunit.client.1.smithi119.stdout:5/274: mknod d1/d25/c53 0 2023-12-17T11:57:38.257 INFO:tasks.workunit.client.0.smithi002.stdout:5/172: sync 2023-12-17T11:57:38.257 INFO:tasks.workunit.client.0.smithi002.stdout:9/279: sync 2023-12-17T11:57:38.257 INFO:tasks.workunit.client.0.smithi002.stdout:3/300: sync 2023-12-17T11:57:38.257 INFO:tasks.workunit.client.0.smithi002.stdout:5/173: stat fb 0 2023-12-17T11:57:38.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/308: truncate d3/f17 3264557 0 2023-12-17T11:57:38.262 INFO:tasks.workunit.client.0.smithi002.stdout:4/258: dread d0/ff [0,4194304] 0 2023-12-17T11:57:38.262 INFO:tasks.workunit.client.0.smithi002.stdout:4/259: truncate d0/d10/d14/f52 573492 0 2023-12-17T11:57:38.262 INFO:tasks.workunit.client.0.smithi002.stdout:4/260: chown d0/d3e/d41/c44 50 1 2023-12-17T11:57:38.266 INFO:tasks.workunit.client.0.smithi002.stdout:6/229: unlink d0/d1/f13 0 2023-12-17T11:57:38.266 INFO:tasks.workunit.client.0.smithi002.stdout:9/280: mknod dc/d42/d4f/d59/d47/d4b/c66 0 2023-12-17T11:57:38.266 INFO:tasks.workunit.client.0.smithi002.stdout:0/194: write d0/fd [1851556,123080] 0 2023-12-17T11:57:38.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/280: dwrite d3/d7/d18/d3f/f57 [0,4194304] 0 2023-12-17T11:57:38.269 INFO:tasks.workunit.client.1.smithi119.stdout:2/257: dwrite d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:38.272 INFO:tasks.workunit.client.1.smithi119.stdout:1/137: sync 2023-12-17T11:57:38.272 INFO:tasks.workunit.client.1.smithi119.stdout:1/138: write d3/db/d26/f28 [352204,62024] 0 2023-12-17T11:57:38.272 INFO:tasks.workunit.client.1.smithi119.stdout:1/139: chown d3/db/f1f 13553 1 2023-12-17T11:57:38.272 INFO:tasks.workunit.client.0.smithi002.stdout:5/174: read f6 [11656509,47195] 0 2023-12-17T11:57:38.272 INFO:tasks.workunit.client.0.smithi002.stdout:4/261: read d0/d10/d21/f48 [232917,83787] 0 2023-12-17T11:57:38.272 INFO:tasks.workunit.client.0.smithi002.stdout:5/175: creat dc/d17/f2c x:0 0 0 2023-12-17T11:57:38.273 INFO:tasks.workunit.client.0.smithi002.stdout:3/301: symlink d9/d1b/d35/d41/d43/l60 0 2023-12-17T11:57:38.273 INFO:tasks.workunit.client.0.smithi002.stdout:3/302: write d9/d1b/d35/d41/d43/d4b/f57 [670686,114234] 0 2023-12-17T11:57:38.277 INFO:tasks.workunit.client.0.smithi002.stdout:1/309: unlink d3/d6/d9/d30/f5a 0 2023-12-17T11:57:38.277 INFO:tasks.workunit.client.0.smithi002.stdout:6/230: mknod d0/c44 0 2023-12-17T11:57:38.277 INFO:tasks.workunit.client.0.smithi002.stdout:1/310: fsync d3/d6/d9/d30/f41 0 2023-12-17T11:57:38.277 INFO:tasks.workunit.client.0.smithi002.stdout:1/311: readlink d3/d6/ld 0 2023-12-17T11:57:38.277 INFO:tasks.workunit.client.0.smithi002.stdout:1/312: chown d3/d6/d16/l22 12 1 2023-12-17T11:57:38.278 INFO:tasks.workunit.client.0.smithi002.stdout:9/281: unlink dc/f12 0 2023-12-17T11:57:38.281 INFO:tasks.workunit.client.1.smithi119.stdout:5/275: dread d1/f20 [0,4194304] 0 2023-12-17T11:57:38.281 INFO:tasks.workunit.client.1.smithi119.stdout:7/277: dread d2/d4e/f2b [0,4194304] 0 2023-12-17T11:57:38.281 INFO:tasks.workunit.client.1.smithi119.stdout:7/278: fdatasync d2/d4/f38 0 2023-12-17T11:57:38.281 INFO:tasks.workunit.client.0.smithi002.stdout:0/195: rmdir d0/d6/d26/d14/d19 39 2023-12-17T11:57:38.281 INFO:tasks.workunit.client.1.smithi119.stdout:6/220: dwrite d2/df/f30 [0,4194304] 0 2023-12-17T11:57:38.283 INFO:tasks.workunit.client.1.smithi119.stdout:0/182: dwrite d2/d16/d12/f1c [0,4194304] 0 2023-12-17T11:57:38.285 INFO:tasks.workunit.client.0.smithi002.stdout:4/262: rename d0/d10/d14/f24 to d0/d10/d14/f59 0 2023-12-17T11:57:38.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/176: mkdir dc/d1b/d2d 0 2023-12-17T11:57:38.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/177: write fb [2332381,14599] 0 2023-12-17T11:57:38.289 INFO:tasks.workunit.client.0.smithi002.stdout:5/178: creat dc/d17/f2e x:0 0 0 2023-12-17T11:57:38.290 INFO:tasks.workunit.client.0.smithi002.stdout:3/303: rename f7 to d9/d1b/d35/d41/d43/f61 0 2023-12-17T11:57:38.293 INFO:tasks.workunit.client.1.smithi119.stdout:7/279: dread d2/d4/d11/f43 [0,4194304] 0 2023-12-17T11:57:38.298 INFO:tasks.workunit.client.1.smithi119.stdout:6/221: dread d2/f19 [0,4194304] 0 2023-12-17T11:57:38.299 INFO:tasks.workunit.client.1.smithi119.stdout:5/276: write d1/f8 [2346358,38061] 0 2023-12-17T11:57:38.301 INFO:tasks.workunit.client.0.smithi002.stdout:3/304: dread f3 [0,4194304] 0 2023-12-17T11:57:38.303 INFO:tasks.workunit.client.1.smithi119.stdout:1/140: getdents d3/db/d26/d19 0 2023-12-17T11:57:38.303 INFO:tasks.workunit.client.1.smithi119.stdout:1/141: creat d3/db/f29 x:0 0 0 2023-12-17T11:57:38.305 INFO:tasks.workunit.client.1.smithi119.stdout:8/194: sync 2023-12-17T11:57:38.305 INFO:tasks.workunit.client.1.smithi119.stdout:8/195: dread - d7/d18/f3d zero size 2023-12-17T11:57:38.305 INFO:tasks.workunit.client.1.smithi119.stdout:8/196: truncate d7/d12/f2b 5193767 0 2023-12-17T11:57:38.305 INFO:tasks.workunit.client.0.smithi002.stdout:1/313: mkdir d3/d5c/d66 0 2023-12-17T11:57:38.305 INFO:tasks.workunit.client.0.smithi002.stdout:0/196: mknod d0/d6/d26/d25/c41 0 2023-12-17T11:57:38.306 INFO:tasks.workunit.client.1.smithi119.stdout:8/197: write d7/f35 [185027,70121] 0 2023-12-17T11:57:38.306 INFO:tasks.workunit.client.1.smithi119.stdout:8/198: fsync d7/d18/d15/f39 0 2023-12-17T11:57:38.306 INFO:tasks.workunit.client.1.smithi119.stdout:8/199: chown d7/d18/d15/f39 0 1 2023-12-17T11:57:38.309 INFO:tasks.workunit.client.1.smithi119.stdout:4/210: dwrite f8 [0,4194304] 0 2023-12-17T11:57:38.309 INFO:tasks.workunit.client.1.smithi119.stdout:4/211: write dd/f18 [5735063,82235] 0 2023-12-17T11:57:38.310 INFO:tasks.workunit.client.1.smithi119.stdout:8/200: fsync d7/f35 0 2023-12-17T11:57:38.311 INFO:tasks.workunit.client.1.smithi119.stdout:8/201: creat d7/da/f3e x:0 0 0 2023-12-17T11:57:38.312 INFO:tasks.workunit.client.0.smithi002.stdout:5/179: mkdir dc/d17/d2f 0 2023-12-17T11:57:38.314 INFO:tasks.workunit.client.0.smithi002.stdout:6/231: symlink d0/d1/l45 0 2023-12-17T11:57:38.318 INFO:tasks.workunit.client.0.smithi002.stdout:2/252: dwrite d3/d4/d7/d14/d1b/f29 [4194304,4194304] 0 2023-12-17T11:57:38.318 INFO:tasks.workunit.client.0.smithi002.stdout:2/253: write d3/d4/d7/d14/d1b/f40 [478920,104545] 0 2023-12-17T11:57:38.318 INFO:tasks.workunit.client.0.smithi002.stdout:2/254: dread - d3/d4/d7/d14/f48 zero size 2023-12-17T11:57:38.319 INFO:tasks.workunit.client.1.smithi119.stdout:7/280: dread d2/f19 [0,4194304] 0 2023-12-17T11:57:38.320 INFO:tasks.workunit.client.1.smithi119.stdout:7/281: stat d2/d4/d11/d2c/d55 0 2023-12-17T11:57:38.320 INFO:tasks.workunit.client.1.smithi119.stdout:5/277: dread d1/f35 [0,4194304] 0 2023-12-17T11:57:38.320 INFO:tasks.workunit.client.1.smithi119.stdout:5/278: stat d1/l1f 0 2023-12-17T11:57:38.321 INFO:tasks.workunit.client.1.smithi119.stdout:5/279: chown d1/l14 0 1 2023-12-17T11:57:38.321 INFO:tasks.workunit.client.1.smithi119.stdout:5/280: write d1/f17 [8496098,48281] 0 2023-12-17T11:57:38.321 INFO:tasks.workunit.client.1.smithi119.stdout:5/281: fsync d1/f30 0 2023-12-17T11:57:38.321 INFO:tasks.workunit.client.0.smithi002.stdout:3/305: symlink d9/d15/d31/l62 0 2023-12-17T11:57:38.324 INFO:tasks.workunit.client.0.smithi002.stdout:7/264: dwrite d6/d17/dc/d13/d21/f3f [0,4194304] 0 2023-12-17T11:57:38.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/314: unlink d3/d6/d9/d30/f23 0 2023-12-17T11:57:38.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/315: chown d3/d6/d9/f35 14224 1 2023-12-17T11:57:38.325 INFO:tasks.workunit.client.0.smithi002.stdout:1/316: write d3/d6/d9/d30/f4c [805620,8275] 0 2023-12-17T11:57:38.326 INFO:tasks.workunit.client.1.smithi119.stdout:6/222: link d2/l22 d2/l45 0 2023-12-17T11:57:38.326 INFO:tasks.workunit.client.1.smithi119.stdout:6/223: chown d2/df/f31 26144863 1 2023-12-17T11:57:38.328 INFO:tasks.workunit.client.0.smithi002.stdout:0/197: creat d0/d6/d26/d14/d19/d2b/f42 x:0 0 0 2023-12-17T11:57:38.328 INFO:tasks.workunit.client.0.smithi002.stdout:0/198: write d0/f13 [1543210,94832] 0 2023-12-17T11:57:38.330 INFO:tasks.workunit.client.1.smithi119.stdout:3/263: rmdir d9 39 2023-12-17T11:57:38.331 INFO:tasks.workunit.client.0.smithi002.stdout:5/180: symlink dc/d1a/l30 0 2023-12-17T11:57:38.334 INFO:tasks.workunit.client.1.smithi119.stdout:1/142: mkdir d3/db/d2a 0 2023-12-17T11:57:38.337 INFO:tasks.workunit.client.0.smithi002.stdout:6/232: creat d0/d1/dc/d10/f46 x:0 0 0 2023-12-17T11:57:38.340 INFO:tasks.workunit.client.0.smithi002.stdout:3/306: mkdir d9/d1b/d35/d41/d43/d4b/d63 0 2023-12-17T11:57:38.340 INFO:tasks.workunit.client.0.smithi002.stdout:3/307: write d9/d24/f3e [1482474,126222] 0 2023-12-17T11:57:38.340 INFO:tasks.workunit.client.1.smithi119.stdout:4/212: symlink dd/d15/d16/d20/l48 0 2023-12-17T11:57:38.342 INFO:tasks.workunit.client.0.smithi002.stdout:7/265: mknod d6/d17/dc/d13/c4d 0 2023-12-17T11:57:38.345 INFO:tasks.workunit.client.0.smithi002.stdout:1/317: mknod d3/d6/d16/c67 0 2023-12-17T11:57:38.345 INFO:tasks.workunit.client.0.smithi002.stdout:1/318: truncate d3/d2f/d4d/f5e 63308 0 2023-12-17T11:57:38.345 INFO:tasks.workunit.client.0.smithi002.stdout:1/319: chown d3/d2f/f48 2395689 1 2023-12-17T11:57:38.346 INFO:tasks.workunit.client.0.smithi002.stdout:4/263: dwrite d0/d10/f2d [0,4194304] 0 2023-12-17T11:57:38.346 INFO:tasks.workunit.client.0.smithi002.stdout:4/264: chown d0/d3e/d41/l4d 261 1 2023-12-17T11:57:38.348 INFO:tasks.workunit.client.0.smithi002.stdout:9/282: write dc/d42/d4f/d59/d49/f58 [291950,60507] 0 2023-12-17T11:57:38.349 INFO:tasks.workunit.client.0.smithi002.stdout:8/281: dwrite d3/d7/d1a/f5c [0,4194304] 0 2023-12-17T11:57:38.352 INFO:tasks.workunit.client.0.smithi002.stdout:5/181: creat dc/d2b/f31 x:0 0 0 2023-12-17T11:57:38.353 INFO:tasks.workunit.client.1.smithi119.stdout:8/202: rename d7/da/d1a/f34 to d7/da/f3f 0 2023-12-17T11:57:38.353 INFO:tasks.workunit.client.1.smithi119.stdout:0/183: dwrite d2/f28 [0,4194304] 0 2023-12-17T11:57:38.354 INFO:tasks.workunit.client.1.smithi119.stdout:6/224: dread d2/df/f30 [0,4194304] 0 2023-12-17T11:57:38.354 INFO:tasks.workunit.client.1.smithi119.stdout:5/282: mknod d1/c54 0 2023-12-17T11:57:38.355 INFO:tasks.workunit.client.0.smithi002.stdout:6/233: creat d0/d1/dc/d17/d3c/f47 x:0 0 0 2023-12-17T11:57:38.357 INFO:tasks.workunit.client.1.smithi119.stdout:4/213: mknod dd/d15/d16/d20/d42/c49 0 2023-12-17T11:57:38.357 INFO:tasks.workunit.client.1.smithi119.stdout:3/264: mknod d9/d11/d1e/d55/c64 0 2023-12-17T11:57:38.358 INFO:tasks.workunit.client.1.smithi119.stdout:4/214: write dd/f18 [1889810,49854] 0 2023-12-17T11:57:38.358 INFO:tasks.workunit.client.1.smithi119.stdout:3/265: write d9/d1c/f4d [937812,32621] 0 2023-12-17T11:57:38.359 INFO:tasks.workunit.client.0.smithi002.stdout:3/308: mknod d9/d1b/d35/d41/d43/c64 0 2023-12-17T11:57:38.361 INFO:tasks.workunit.client.1.smithi119.stdout:7/282: rename d2/d49 to d2/d4/d3e/d57 0 2023-12-17T11:57:38.362 INFO:tasks.workunit.client.0.smithi002.stdout:1/320: symlink d3/d6/d9/d37/l68 0 2023-12-17T11:57:38.368 INFO:tasks.workunit.client.1.smithi119.stdout:8/203: write d7/d18/d15/f21 [3143617,62471] 0 2023-12-17T11:57:38.370 INFO:tasks.workunit.client.1.smithi119.stdout:5/283: creat d1/d44/d52/f55 x:0 0 0 2023-12-17T11:57:38.370 INFO:tasks.workunit.client.1.smithi119.stdout:5/284: readlink d1/l1c 0 2023-12-17T11:57:38.382 INFO:tasks.workunit.client.0.smithi002.stdout:4/265: mkdir d0/d5a 0 2023-12-17T11:57:38.385 INFO:tasks.workunit.client.1.smithi119.stdout:4/215: getdents dd/d15/d16 0 2023-12-17T11:57:38.385 INFO:tasks.workunit.client.1.smithi119.stdout:5/285: dread d1/f1a [0,4194304] 0 2023-12-17T11:57:38.385 INFO:tasks.workunit.client.1.smithi119.stdout:4/216: dread - dd/f41 zero size 2023-12-17T11:57:38.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/283: unlink dc/d42/d4f/d59/f5d 0 2023-12-17T11:57:38.389 INFO:tasks.workunit.client.1.smithi119.stdout:3/266: truncate d9/fc 2662947 0 2023-12-17T11:57:38.390 INFO:tasks.workunit.client.0.smithi002.stdout:5/182: rename dc/c13 to dc/d17/d1c/c32 0 2023-12-17T11:57:38.392 INFO:tasks.workunit.client.1.smithi119.stdout:7/283: truncate d2/d4/ff 2567485 0 2023-12-17T11:57:38.392 INFO:tasks.workunit.client.1.smithi119.stdout:7/284: stat d2/d4/c34 0 2023-12-17T11:57:38.399 INFO:tasks.workunit.client.0.smithi002.stdout:9/284: truncate dc/d32/f51 567951 0 2023-12-17T11:57:38.406 INFO:tasks.workunit.client.1.smithi119.stdout:8/204: symlink d7/d18/d15/l40 0 2023-12-17T11:57:38.406 INFO:tasks.workunit.client.1.smithi119.stdout:8/205: fdatasync d7/d18/f3d 0 2023-12-17T11:57:38.410 INFO:tasks.workunit.client.1.smithi119.stdout:6/225: rmdir d2/d2b 39 2023-12-17T11:57:38.412 INFO:tasks.workunit.client.0.smithi002.stdout:3/309: rename d9/d1b/d35/d41/d43/d4b/d63 to d9/d1b/d35/d41/d59/d65 0 2023-12-17T11:57:38.412 INFO:tasks.workunit.client.0.smithi002.stdout:5/183: mknod dc/c33 0 2023-12-17T11:57:38.412 INFO:tasks.workunit.client.0.smithi002.stdout:3/310: creat d9/d15/f66 x:0 0 0 2023-12-17T11:57:38.412 INFO:tasks.workunit.client.0.smithi002.stdout:5/184: dread - dc/d17/f2e zero size 2023-12-17T11:57:38.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/321: getdents d3/d2f/d4d 0 2023-12-17T11:57:38.415 INFO:tasks.workunit.client.0.smithi002.stdout:1/322: creat d3/d6/d16/d28/f69 x:0 0 0 2023-12-17T11:57:38.417 INFO:tasks.workunit.client.1.smithi119.stdout:5/286: rename d1/f21 to d1/d44/f56 0 2023-12-17T11:57:38.417 INFO:tasks.workunit.client.1.smithi119.stdout:5/287: chown d1/f29 423834110 1 2023-12-17T11:57:38.417 INFO:tasks.workunit.client.1.smithi119.stdout:5/288: write d1/d25/d39/f41 [906757,11961] 0 2023-12-17T11:57:38.423 INFO:tasks.workunit.client.1.smithi119.stdout:1/143: dwrite d3/db/d26/f1d [4194304,4194304] 0 2023-12-17T11:57:38.423 INFO:tasks.workunit.client.1.smithi119.stdout:1/144: stat d3/f12 0 2023-12-17T11:57:38.423 INFO:tasks.workunit.client.1.smithi119.stdout:1/145: truncate d3/db/d17/d24/f1a 1785474 0 2023-12-17T11:57:38.426 INFO:tasks.workunit.client.0.smithi002.stdout:6/234: dwrite d0/d1/d28/f3d [0,4194304] 0 2023-12-17T11:57:38.426 INFO:tasks.workunit.client.1.smithi119.stdout:6/226: stat d2/c20 0 2023-12-17T11:57:38.429 INFO:tasks.workunit.client.0.smithi002.stdout:2/255: dwrite d3/d4/d7/d14/d1b/f27 [4194304,4194304] 0 2023-12-17T11:57:38.429 INFO:tasks.workunit.client.0.smithi002.stdout:7/266: dwrite d6/f1c [0,4194304] 0 2023-12-17T11:57:38.430 INFO:tasks.workunit.client.0.smithi002.stdout:3/311: mknod d9/d15/c67 0 2023-12-17T11:57:38.430 INFO:tasks.workunit.client.0.smithi002.stdout:3/312: chown d9/d1b/d35/d41/d59/l5a 3512 1 2023-12-17T11:57:38.432 INFO:tasks.workunit.client.0.smithi002.stdout:0/199: dwrite d0/d6/d26/f2d [0,4194304] 0 2023-12-17T11:57:38.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/266: dread d0/d10/f40 [0,4194304] 0 2023-12-17T11:57:38.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/267: chown d0/d3e/d41/l4d 260213564 1 2023-12-17T11:57:38.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/268: stat d0/d10/d21 0 2023-12-17T11:57:38.440 INFO:tasks.workunit.client.0.smithi002.stdout:4/269: write d0/ff [1665130,2309] 0 2023-12-17T11:57:38.445 INFO:tasks.workunit.client.1.smithi119.stdout:7/285: dwrite d2/d4e/f4a [0,4194304] 0 2023-12-17T11:57:38.449 INFO:tasks.workunit.client.1.smithi119.stdout:5/289: dread d1/d36/f47 [0,4194304] 0 2023-12-17T11:57:38.452 INFO:tasks.workunit.client.1.smithi119.stdout:4/217: dwrite dd/f1d [4194304,4194304] 0 2023-12-17T11:57:38.453 INFO:tasks.workunit.client.1.smithi119.stdout:4/218: creat dd/f4a x:0 0 0 2023-12-17T11:57:38.453 INFO:tasks.workunit.client.0.smithi002.stdout:6/235: dread d0/d1/d28/f32 [0,4194304] 0 2023-12-17T11:57:38.455 INFO:tasks.workunit.client.0.smithi002.stdout:2/256: symlink d3/d4/d7/d14/d1b/d5b/l5f 0 2023-12-17T11:57:38.455 INFO:tasks.workunit.client.0.smithi002.stdout:2/257: fsync d3/d4/d17/d19/f24 0 2023-12-17T11:57:38.455 INFO:tasks.workunit.client.0.smithi002.stdout:2/258: creat d3/d4/f60 x:0 0 0 2023-12-17T11:57:38.455 INFO:tasks.workunit.client.0.smithi002.stdout:2/259: stat d3/d4/d7/d14/d34/f5e 0 2023-12-17T11:57:38.458 INFO:tasks.workunit.client.0.smithi002.stdout:3/313: unlink d9/d15/d31/l62 0 2023-12-17T11:57:38.461 INFO:tasks.workunit.client.1.smithi119.stdout:1/146: link d3/db/d17/d24/f1a d3/db/f2b 0 2023-12-17T11:57:38.465 INFO:tasks.workunit.client.1.smithi119.stdout:6/227: unlink d2/df/f3b 0 2023-12-17T11:57:38.465 INFO:tasks.workunit.client.1.smithi119.stdout:6/228: fsync d2/f2e 0 2023-12-17T11:57:38.465 INFO:tasks.workunit.client.1.smithi119.stdout:6/229: chown d2/df/d17/l3c 5084611 1 2023-12-17T11:57:38.466 INFO:tasks.workunit.client.0.smithi002.stdout:5/185: rename dc/d2b/f31 to dc/d17/d2f/f34 0 2023-12-17T11:57:38.468 INFO:tasks.workunit.client.0.smithi002.stdout:0/200: symlink d0/d33/l43 0 2023-12-17T11:57:38.470 INFO:tasks.workunit.client.0.smithi002.stdout:5/186: read dc/d17/f26 [25640,89862] 0 2023-12-17T11:57:38.471 INFO:tasks.workunit.client.0.smithi002.stdout:5/187: creat dc/d2b/f35 x:0 0 0 2023-12-17T11:57:38.475 INFO:tasks.workunit.client.1.smithi119.stdout:4/219: mkdir dd/d4b 0 2023-12-17T11:57:38.477 INFO:tasks.workunit.client.1.smithi119.stdout:5/290: write d1/f17 [1728727,119855] 0 2023-12-17T11:57:38.478 INFO:tasks.workunit.client.1.smithi119.stdout:8/206: dwrite d7/da/d11/f1d [0,4194304] 0 2023-12-17T11:57:38.478 INFO:tasks.workunit.client.1.smithi119.stdout:8/207: stat d7/d12/d23/f38 0 2023-12-17T11:57:38.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/291: write d1/d25/d39/f41 [823123,94262] 0 2023-12-17T11:57:38.479 INFO:tasks.workunit.client.1.smithi119.stdout:4/220: getdents dd/d15/d16/d20/d42 0 2023-12-17T11:57:38.479 INFO:tasks.workunit.client.1.smithi119.stdout:4/221: stat dd/d15/d16/f1a 0 2023-12-17T11:57:38.479 INFO:tasks.workunit.client.1.smithi119.stdout:4/222: fdatasync f4 0 2023-12-17T11:57:38.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/292: write d1/d25/f4f [117857,39950] 0 2023-12-17T11:57:38.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/293: fsync d1/d44/f4c 0 2023-12-17T11:57:38.480 INFO:tasks.workunit.client.1.smithi119.stdout:3/267: dwrite d9/da/df/f15 [4194304,4194304] 0 2023-12-17T11:57:38.481 INFO:tasks.workunit.client.0.smithi002.stdout:1/323: dwrite d3/d6/d9/f57 [4194304,4194304] 0 2023-12-17T11:57:38.481 INFO:tasks.workunit.client.0.smithi002.stdout:4/270: symlink d0/d10/d21/l5b 0 2023-12-17T11:57:38.481 INFO:tasks.workunit.client.0.smithi002.stdout:4/271: creat d0/d10/d14/d4e/f5c x:0 0 0 2023-12-17T11:57:38.485 INFO:tasks.workunit.client.0.smithi002.stdout:8/282: dwrite d3/d7/f58 [0,4194304] 0 2023-12-17T11:57:38.489 INFO:tasks.workunit.client.1.smithi119.stdout:4/223: rename dd/d15/f31 to dd/d15/d16/d3d/f4c 0 2023-12-17T11:57:38.492 INFO:tasks.workunit.client.1.smithi119.stdout:5/294: mkdir d1/d36/d57 0 2023-12-17T11:57:38.494 INFO:tasks.workunit.client.1.smithi119.stdout:1/147: dread d3/db/d26/f11 [0,4194304] 0 2023-12-17T11:57:38.494 INFO:tasks.workunit.client.1.smithi119.stdout:1/148: write d3/f4 [9157718,8813] 0 2023-12-17T11:57:38.502 INFO:tasks.workunit.client.1.smithi119.stdout:8/208: dread d7/d12/f2b [0,4194304] 0 2023-12-17T11:57:38.504 INFO:tasks.workunit.client.0.smithi002.stdout:7/267: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:38.504 INFO:tasks.workunit.client.0.smithi002.stdout:7/268: write d6/d17/dc/d13/f14 [1939444,7591] 0 2023-12-17T11:57:38.506 INFO:tasks.workunit.client.1.smithi119.stdout:6/230: dwrite d2/f11 [4194304,4194304] 0 2023-12-17T11:57:38.508 INFO:tasks.workunit.client.1.smithi119.stdout:4/224: dread dd/f1b [0,4194304] 0 2023-12-17T11:57:38.510 INFO:tasks.workunit.client.1.smithi119.stdout:8/209: dread d7/d12/f2b [4194304,4194304] 0 2023-12-17T11:57:38.513 INFO:tasks.workunit.client.1.smithi119.stdout:6/231: dread d2/df/d17/f23 [0,4194304] 0 2023-12-17T11:57:38.513 INFO:tasks.workunit.client.1.smithi119.stdout:3/268: mkdir d9/d11/d1e/d55/d65 0 2023-12-17T11:57:38.516 INFO:tasks.workunit.client.1.smithi119.stdout:2/258: sync 2023-12-17T11:57:38.517 INFO:tasks.workunit.client.1.smithi119.stdout:7/286: rmdir d2/d4/d1f 39 2023-12-17T11:57:38.517 INFO:tasks.workunit.client.1.smithi119.stdout:9/263: sync 2023-12-17T11:57:38.529 INFO:tasks.workunit.client.1.smithi119.stdout:4/225: link dd/d15/d16/f1a dd/f4d 0 2023-12-17T11:57:38.531 INFO:tasks.workunit.client.1.smithi119.stdout:8/210: link d7/da/d11/d26/f28 d7/da/f41 0 2023-12-17T11:57:38.537 INFO:tasks.workunit.client.1.smithi119.stdout:3/269: creat d9/d11/d1e/d55/f66 x:0 0 0 2023-12-17T11:57:38.538 INFO:tasks.workunit.client.1.smithi119.stdout:5/295: dread d1/f8 [0,4194304] 0 2023-12-17T11:57:38.538 INFO:tasks.workunit.client.1.smithi119.stdout:5/296: dread - d1/f51 zero size 2023-12-17T11:57:38.540 INFO:tasks.workunit.client.1.smithi119.stdout:7/287: creat d2/d4/d11/d2c/f58 x:0 0 0 2023-12-17T11:57:38.543 INFO:tasks.workunit.client.0.smithi002.stdout:2/260: unlink d3/c18 0 2023-12-17T11:57:38.544 INFO:tasks.workunit.client.1.smithi119.stdout:2/259: mkdir d6/d2b/d3f/d5c 0 2023-12-17T11:57:38.544 INFO:tasks.workunit.client.1.smithi119.stdout:2/260: write d6/f1f [2971076,28585] 0 2023-12-17T11:57:38.547 INFO:tasks.workunit.client.0.smithi002.stdout:3/314: creat d9/d1b/d4f/f68 x:0 0 0 2023-12-17T11:57:38.549 INFO:tasks.workunit.client.1.smithi119.stdout:4/226: symlink dd/d15/d16/l4e 0 2023-12-17T11:57:38.549 INFO:tasks.workunit.client.1.smithi119.stdout:4/227: write dd/f4d [1726884,61077] 0 2023-12-17T11:57:38.549 INFO:tasks.workunit.client.1.smithi119.stdout:4/228: write dd/f38 [6640782,88763] 0 2023-12-17T11:57:38.554 INFO:tasks.workunit.client.1.smithi119.stdout:8/211: link d7/d12/l2d d7/da/d11/d26/d2c/l42 0 2023-12-17T11:57:38.554 INFO:tasks.workunit.client.1.smithi119.stdout:1/149: dwrite d3/db/f1f [0,4194304] 0 2023-12-17T11:57:38.555 INFO:tasks.workunit.client.1.smithi119.stdout:1/150: write d3/f12 [346897,49118] 0 2023-12-17T11:57:38.555 INFO:tasks.workunit.client.1.smithi119.stdout:1/151: stat d3/db/d17/f1b 0 2023-12-17T11:57:38.555 INFO:tasks.workunit.client.1.smithi119.stdout:1/152: fdatasync d3/db/d26/f1d 0 2023-12-17T11:57:38.555 INFO:tasks.workunit.client.1.smithi119.stdout:4/229: write dd/f38 [5376307,117047] 0 2023-12-17T11:57:38.555 INFO:tasks.workunit.client.1.smithi119.stdout:4/230: chown dd/d4b 6224 1 2023-12-17T11:57:38.556 INFO:tasks.workunit.client.0.smithi002.stdout:6/236: rename d0/d1/d28/f32 to d0/f48 0 2023-12-17T11:57:38.558 INFO:tasks.workunit.client.1.smithi119.stdout:3/270: mkdir d9/da/df/d67 0 2023-12-17T11:57:38.564 INFO:tasks.workunit.client.0.smithi002.stdout:0/201: rename d0/fd to d0/f44 0 2023-12-17T11:57:38.565 INFO:tasks.workunit.client.1.smithi119.stdout:8/212: fsync d7/d18/d15/f21 0 2023-12-17T11:57:38.565 INFO:tasks.workunit.client.1.smithi119.stdout:9/264: dwrite d12/d1d/f31 [4194304,4194304] 0 2023-12-17T11:57:38.565 INFO:tasks.workunit.client.1.smithi119.stdout:5/297: symlink d1/d44/d52/l58 0 2023-12-17T11:57:38.565 INFO:tasks.workunit.client.1.smithi119.stdout:7/288: link d2/f3 d2/d4/d3e/d57/d56/f59 0 2023-12-17T11:57:38.567 INFO:tasks.workunit.client.1.smithi119.stdout:2/261: mkdir d6/d2b/d4b/d5d 0 2023-12-17T11:57:38.567 INFO:tasks.workunit.client.1.smithi119.stdout:0/184: sync 2023-12-17T11:57:38.578 INFO:tasks.workunit.client.0.smithi002.stdout:4/272: unlink d0/d10/d21/f36 0 2023-12-17T11:57:38.585 INFO:tasks.workunit.client.1.smithi119.stdout:7/289: read d2/d4e/f37 [2841846,121358] 0 2023-12-17T11:57:38.586 INFO:tasks.workunit.client.1.smithi119.stdout:1/153: rmdir d3/db/d26/d16 0 2023-12-17T11:57:38.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/283: getdents d3/d8/d28/d31 0 2023-12-17T11:57:38.590 INFO:tasks.workunit.client.1.smithi119.stdout:3/271: mknod d9/da/df/d41/c68 0 2023-12-17T11:57:38.590 INFO:tasks.workunit.client.1.smithi119.stdout:3/272: chown d9/d11/l16 1383975 1 2023-12-17T11:57:38.596 INFO:tasks.workunit.client.1.smithi119.stdout:9/265: mkdir d12/d54 0 2023-12-17T11:57:38.599 INFO:tasks.workunit.client.1.smithi119.stdout:8/213: dread d7/da/d11/f1d [0,4194304] 0 2023-12-17T11:57:38.604 INFO:tasks.workunit.client.1.smithi119.stdout:5/298: getdents d1/d36/d3a 0 2023-12-17T11:57:38.605 INFO:tasks.workunit.client.0.smithi002.stdout:7/269: stat d6/d17/d16/l45 0 2023-12-17T11:57:38.608 INFO:tasks.workunit.client.0.smithi002.stdout:6/237: mknod d0/c49 0 2023-12-17T11:57:38.608 INFO:tasks.workunit.client.0.smithi002.stdout:6/238: write d0/d1/dc/d10/f37 [4063079,81758] 0 2023-12-17T11:57:38.609 INFO:tasks.workunit.client.1.smithi119.stdout:6/232: truncate d2/f11 6175295 0 2023-12-17T11:57:38.609 INFO:tasks.workunit.client.1.smithi119.stdout:6/233: dread - d2/d2b/f44 zero size 2023-12-17T11:57:38.611 INFO:tasks.workunit.client.0.smithi002.stdout:8/284: dread d3/d8/da/dd/f2d [0,4194304] 0 2023-12-17T11:57:38.618 INFO:tasks.workunit.client.0.smithi002.stdout:6/239: read d0/d1/dc/f8 [4949361,27485] 0 2023-12-17T11:57:38.618 INFO:tasks.workunit.client.0.smithi002.stdout:6/240: creat d0/d1/dc/d10/f4a x:0 0 0 2023-12-17T11:57:38.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/270: write d6/f1c [1862391,14708] 0 2023-12-17T11:57:38.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/271: readlink d6/d17/dc/d13/d21/d2e/l41 0 2023-12-17T11:57:38.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/272: chown d6/d17/d16/c2c 3812 1 2023-12-17T11:57:38.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/273: write d6/d17/dc/d13/d37/f3c [185460,65010] 0 2023-12-17T11:57:38.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/274: truncate d6/f1c 4466346 0 2023-12-17T11:57:38.624 INFO:tasks.workunit.client.1.smithi119.stdout:1/154: mknod d3/db/d17/d24/d20/c2c 0 2023-12-17T11:57:38.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/261: dwrite d3/d4/f16 [0,4194304] 0 2023-12-17T11:57:38.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/262: write d3/d4/d7/d14/d34/f4b [4203226,11130] 0 2023-12-17T11:57:38.627 INFO:tasks.workunit.client.1.smithi119.stdout:3/273: rename d9/da/f43 to d9/d11/d1e/f69 0 2023-12-17T11:57:38.630 INFO:tasks.workunit.client.1.smithi119.stdout:9/266: symlink d12/d1d/d28/d4d/l55 0 2023-12-17T11:57:38.631 INFO:tasks.workunit.client.1.smithi119.stdout:8/214: symlink d7/da/d11/l43 0 2023-12-17T11:57:38.634 INFO:tasks.workunit.client.1.smithi119.stdout:1/155: creat d3/db/d17/d24/d20/f2d x:0 0 0 2023-12-17T11:57:38.637 INFO:tasks.workunit.client.1.smithi119.stdout:1/156: creat d3/db/d17/d24/f2e x:0 0 0 2023-12-17T11:57:38.637 INFO:tasks.workunit.client.1.smithi119.stdout:5/299: rmdir d1/d36/d3a 39 2023-12-17T11:57:38.638 INFO:tasks.workunit.client.1.smithi119.stdout:1/157: rename d3/db/d26/f6 to d3/db/d26/d19/f2f 0 2023-12-17T11:57:38.645 INFO:tasks.workunit.client.0.smithi002.stdout:4/273: dwrite d0/d10/f4b [0,4194304] 0 2023-12-17T11:57:38.645 INFO:tasks.workunit.client.0.smithi002.stdout:4/274: fdatasync d0/f43 0 2023-12-17T11:57:38.646 INFO:tasks.workunit.client.1.smithi119.stdout:6/234: dread d2/df/f30 [0,4194304] 0 2023-12-17T11:57:38.649 INFO:tasks.workunit.client.0.smithi002.stdout:3/315: dwrite d9/f14 [0,4194304] 0 2023-12-17T11:57:38.650 INFO:tasks.workunit.client.1.smithi119.stdout:6/235: rename d2/le to d2/d2b/d43/l46 0 2023-12-17T11:57:38.650 INFO:tasks.workunit.client.1.smithi119.stdout:4/231: dwrite f4 [4194304,4194304] 0 2023-12-17T11:57:38.650 INFO:tasks.workunit.client.1.smithi119.stdout:4/232: chown dd/c3b 3681 1 2023-12-17T11:57:38.651 INFO:tasks.workunit.client.1.smithi119.stdout:4/233: chown la 1 1 2023-12-17T11:57:38.656 INFO:tasks.workunit.client.1.smithi119.stdout:6/236: creat d2/d2b/f47 x:0 0 0 2023-12-17T11:57:38.656 INFO:tasks.workunit.client.1.smithi119.stdout:2/262: truncate d6/f1f 1148480 0 2023-12-17T11:57:38.657 INFO:tasks.workunit.client.1.smithi119.stdout:7/290: dwrite d2/d4/d11/d2c/f3a [0,4194304] 0 2023-12-17T11:57:38.658 INFO:tasks.workunit.client.0.smithi002.stdout:4/275: dread d0/d10/d14/f4c [0,4194304] 0 2023-12-17T11:57:38.659 INFO:tasks.workunit.client.1.smithi119.stdout:2/263: symlink d6/l5e 0 2023-12-17T11:57:38.661 INFO:tasks.workunit.client.1.smithi119.stdout:3/274: dread d9/da/f30 [0,4194304] 0 2023-12-17T11:57:38.661 INFO:tasks.workunit.client.1.smithi119.stdout:3/275: write d9/f1b [453381,80401] 0 2023-12-17T11:57:38.670 INFO:tasks.workunit.client.1.smithi119.stdout:4/234: write dd/d11/f14 [4007419,32592] 0 2023-12-17T11:57:38.671 INFO:tasks.workunit.client.1.smithi119.stdout:7/291: rename d2/f25 to d2/d40/f5a 0 2023-12-17T11:57:38.671 INFO:tasks.workunit.client.1.smithi119.stdout:7/292: dread - d2/d4/d1f/f27 zero size 2023-12-17T11:57:38.673 INFO:tasks.workunit.client.0.smithi002.stdout:5/188: truncate fb 4069799 0 2023-12-17T11:57:38.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/202: rename d0/f22 to d0/d6/d26/d25/f45 0 2023-12-17T11:57:38.673 INFO:tasks.workunit.client.0.smithi002.stdout:1/324: getdents d3/d6 0 2023-12-17T11:57:38.673 INFO:tasks.workunit.client.0.smithi002.stdout:5/189: creat dc/d2b/f36 x:0 0 0 2023-12-17T11:57:38.673 INFO:tasks.workunit.client.0.smithi002.stdout:8/285: mknod d3/d8/c64 0 2023-12-17T11:57:38.673 INFO:tasks.workunit.client.0.smithi002.stdout:9/285: sync 2023-12-17T11:57:38.678 INFO:tasks.workunit.client.1.smithi119.stdout:7/293: mkdir d2/d5b 0 2023-12-17T11:57:38.692 INFO:tasks.workunit.client.0.smithi002.stdout:6/241: unlink d0/d1/d21/f3f 0 2023-12-17T11:57:38.701 INFO:tasks.workunit.client.0.smithi002.stdout:7/275: symlink d6/d17/dc/d13/d3e/l4e 0 2023-12-17T11:57:38.701 INFO:tasks.workunit.client.0.smithi002.stdout:1/325: write d3/d6/fa [2360276,127861] 0 2023-12-17T11:57:38.702 INFO:tasks.workunit.client.1.smithi119.stdout:4/235: read dd/f32 [789577,96484] 0 2023-12-17T11:57:38.702 INFO:tasks.workunit.client.1.smithi119.stdout:4/236: write f8 [4487645,110878] 0 2023-12-17T11:57:38.702 INFO:tasks.workunit.client.1.smithi119.stdout:4/237: fsync dd/f18 0 2023-12-17T11:57:38.703 INFO:tasks.workunit.client.0.smithi002.stdout:2/263: mknod d3/d4/d7/d14/d2e/c61 0 2023-12-17T11:57:38.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/267: dwrite d12/d1d/f2f [0,4194304] 0 2023-12-17T11:57:38.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/268: chown d12/f2c 14729 1 2023-12-17T11:57:38.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/269: read - d12/d1d/d49/f52 zero size 2023-12-17T11:57:38.705 INFO:tasks.workunit.client.1.smithi119.stdout:1/158: dwrite d3/fa [0,4194304] 0 2023-12-17T11:57:38.705 INFO:tasks.workunit.client.1.smithi119.stdout:1/159: chown d3/db/d17/d24/ce 217109 1 2023-12-17T11:57:38.711 INFO:tasks.workunit.client.0.smithi002.stdout:3/316: rmdir d9/d1b/d35/d41/d49 0 2023-12-17T11:57:38.712 INFO:tasks.workunit.client.1.smithi119.stdout:2/264: dread d6/d9/d13/d1d/f50 [0,4194304] 0 2023-12-17T11:57:38.716 INFO:tasks.workunit.client.0.smithi002.stdout:0/203: truncate d0/d6/d26/f20 5708842 0 2023-12-17T11:57:38.716 INFO:tasks.workunit.client.0.smithi002.stdout:0/204: creat d0/d6/d26/d25/f46 x:0 0 0 2023-12-17T11:57:38.716 INFO:tasks.workunit.client.0.smithi002.stdout:5/190: mknod dc/d1a/c37 0 2023-12-17T11:57:38.718 INFO:tasks.workunit.client.0.smithi002.stdout:8/286: mkdir d3/d8/d55/d65 0 2023-12-17T11:57:38.718 INFO:tasks.workunit.client.0.smithi002.stdout:8/287: creat d3/d8/da/dd/f66 x:0 0 0 2023-12-17T11:57:38.719 INFO:tasks.workunit.client.1.smithi119.stdout:4/238: write f8 [996513,24299] 0 2023-12-17T11:57:38.720 INFO:tasks.workunit.client.1.smithi119.stdout:1/160: dread d3/db/d17/d24/f14 [0,4194304] 0 2023-12-17T11:57:38.721 INFO:tasks.workunit.client.1.smithi119.stdout:1/161: chown d3 8270 1 2023-12-17T11:57:38.721 INFO:tasks.workunit.client.0.smithi002.stdout:6/242: mknod d0/d1/dc/d17/d40/c4b 0 2023-12-17T11:57:38.721 INFO:tasks.workunit.client.0.smithi002.stdout:6/243: chown d0/d1/dc/f20 53541670 1 2023-12-17T11:57:38.722 INFO:tasks.workunit.client.0.smithi002.stdout:7/276: mkdir d6/d17/dc/d13/d37/d4f 0 2023-12-17T11:57:38.723 INFO:tasks.workunit.client.1.smithi119.stdout:4/239: mkdir dd/d15/d4f 0 2023-12-17T11:57:38.727 INFO:tasks.workunit.client.1.smithi119.stdout:9/270: write d12/d1d/f31 [1629180,57640] 0 2023-12-17T11:57:38.727 INFO:tasks.workunit.client.1.smithi119.stdout:1/162: creat d3/db/d17/f30 x:0 0 0 2023-12-17T11:57:38.727 INFO:tasks.workunit.client.1.smithi119.stdout:1/163: readlink d3/db/d17/d24/l18 0 2023-12-17T11:57:38.727 INFO:tasks.workunit.client.0.smithi002.stdout:1/326: mkdir d3/d6/d9/d37/d6a 0 2023-12-17T11:57:38.728 INFO:tasks.workunit.client.1.smithi119.stdout:4/240: mknod dd/d11/c50 0 2023-12-17T11:57:38.728 INFO:tasks.workunit.client.1.smithi119.stdout:4/241: chown dd/d15/d4f 0 1 2023-12-17T11:57:38.728 INFO:tasks.workunit.client.1.smithi119.stdout:4/242: chown dd/f1b 224 1 2023-12-17T11:57:38.728 INFO:tasks.workunit.client.1.smithi119.stdout:4/243: chown dd/d11 160531 1 2023-12-17T11:57:38.728 INFO:tasks.workunit.client.1.smithi119.stdout:4/244: chown dd/d15/c24 3535481 1 2023-12-17T11:57:38.728 INFO:tasks.workunit.client.0.smithi002.stdout:2/264: dread d3/d4/d7/f1a [4194304,4194304] 0 2023-12-17T11:57:38.730 INFO:tasks.workunit.client.1.smithi119.stdout:1/164: rename d3/db/f29 to d3/db/d17/f31 0 2023-12-17T11:57:38.731 INFO:tasks.workunit.client.1.smithi119.stdout:1/165: fsync d3/db/d17/d24/d20/f2d 0 2023-12-17T11:57:38.731 INFO:tasks.workunit.client.1.smithi119.stdout:1/166: creat d3/db/d17/d24/f32 x:0 0 0 2023-12-17T11:57:38.736 INFO:tasks.workunit.client.1.smithi119.stdout:4/245: creat dd/d15/d16/f51 x:0 0 0 2023-12-17T11:57:38.736 INFO:tasks.workunit.client.1.smithi119.stdout:1/167: mknod d3/db/d2a/c33 0 2023-12-17T11:57:38.737 INFO:tasks.workunit.client.0.smithi002.stdout:3/317: link d9/d15/f2b d9/d1b/d35/d41/d59/d65/f69 0 2023-12-17T11:57:38.739 INFO:tasks.workunit.client.0.smithi002.stdout:5/191: rename f6 to dc/d2b/f38 0 2023-12-17T11:57:38.739 INFO:tasks.workunit.client.0.smithi002.stdout:5/192: chown dc/l23 134474 1 2023-12-17T11:57:38.740 INFO:tasks.workunit.client.0.smithi002.stdout:5/193: stat dc 0 2023-12-17T11:57:38.740 INFO:tasks.workunit.client.0.smithi002.stdout:5/194: write dc/d17/f2c [308813,60502] 0 2023-12-17T11:57:38.741 INFO:tasks.workunit.client.1.smithi119.stdout:1/168: creat d3/db/d2a/f34 x:0 0 0 2023-12-17T11:57:38.742 INFO:tasks.workunit.client.0.smithi002.stdout:9/286: getdents dc/d42/d4f/d59/d47 0 2023-12-17T11:57:38.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/288: symlink d3/d8/da/l67 0 2023-12-17T11:57:38.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/289: creat d3/d8/d28/f68 x:0 0 0 2023-12-17T11:57:38.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/290: readlink d3/d8/da/l11 0 2023-12-17T11:57:38.749 INFO:tasks.workunit.client.0.smithi002.stdout:8/291: creat d3/d7/d1a/f69 x:0 0 0 2023-12-17T11:57:38.750 INFO:tasks.workunit.client.0.smithi002.stdout:1/327: getdents d3/d5c 0 2023-12-17T11:57:38.750 INFO:tasks.workunit.client.0.smithi002.stdout:1/328: truncate d3/d6/d9/d37/d39/d43/f50 234758 0 2023-12-17T11:57:38.750 INFO:tasks.workunit.client.0.smithi002.stdout:1/329: chown d3/d6/d9/f3c 3031545 1 2023-12-17T11:57:38.750 INFO:tasks.workunit.client.0.smithi002.stdout:1/330: read d3/d6/f3a [3694565,130797] 0 2023-12-17T11:57:38.750 INFO:tasks.workunit.client.0.smithi002.stdout:1/331: write d3/d6/d9/d37/f65 [223467,41579] 0 2023-12-17T11:57:38.751 INFO:tasks.workunit.client.0.smithi002.stdout:0/205: getdents d0/d6/d26/d14/d19/d2b 0 2023-12-17T11:57:38.756 INFO:tasks.workunit.client.0.smithi002.stdout:7/277: rename d6/d17/dc/d13/d21/d2e/l41 to d6/d17/dc/d13/d3e/l50 0 2023-12-17T11:57:38.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/287: creat dc/d1d/f67 x:0 0 0 2023-12-17T11:57:38.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/292: getdents d3/d8/da/d44 0 2023-12-17T11:57:38.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/293: dread - d3/d7/d18/d3f/d49/f52 zero size 2023-12-17T11:57:38.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/294: read - d3/d7/d18/d3f/d49/f4b zero size 2023-12-17T11:57:38.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/295: readlink d3/d8/da/l43 0 2023-12-17T11:57:38.762 INFO:tasks.workunit.client.0.smithi002.stdout:1/332: truncate d3/d6/d9/f35 129144 0 2023-12-17T11:57:38.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/288: symlink dc/d1d/l68 0 2023-12-17T11:57:38.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/289: creat dc/d1d/f69 x:0 0 0 2023-12-17T11:57:38.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/333: rename d3/ff to d3/d2f/d4d/f6b 0 2023-12-17T11:57:38.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/334: fdatasync d3/d2f/f48 0 2023-12-17T11:57:38.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/335: creat d3/d6/d9/d37/f6c x:0 0 0 2023-12-17T11:57:38.776 INFO:tasks.workunit.client.0.smithi002.stdout:1/336: write d3/d6/d16/d28/f69 [667522,28558] 0 2023-12-17T11:57:38.776 INFO:tasks.workunit.client.0.smithi002.stdout:9/290: truncate dc/d42/d4f/d59/f30 1297283 0 2023-12-17T11:57:38.795 INFO:tasks.workunit.client.1.smithi119.stdout:2/265: dwrite d6/d9/d13/d1d/f37 [0,4194304] 0 2023-12-17T11:57:38.795 INFO:tasks.workunit.client.1.smithi119.stdout:2/266: write d6/f1f [789145,80893] 0 2023-12-17T11:57:38.799 INFO:tasks.workunit.client.1.smithi119.stdout:6/237: dwrite d2/d2b/f3a [0,4194304] 0 2023-12-17T11:57:38.799 INFO:tasks.workunit.client.1.smithi119.stdout:3/276: dwrite d9/da/df/d41/d33/d3a/f3d [0,4194304] 0 2023-12-17T11:57:38.802 INFO:tasks.workunit.client.1.smithi119.stdout:7/294: dwrite d2/d4e/f37 [0,4194304] 0 2023-12-17T11:57:38.808 INFO:tasks.workunit.client.1.smithi119.stdout:3/277: creat d9/d35/f6a x:0 0 0 2023-12-17T11:57:38.815 INFO:tasks.workunit.client.1.smithi119.stdout:3/278: symlink d9/da/df/d41/d33/d5a/l6b 0 2023-12-17T11:57:38.818 INFO:tasks.workunit.client.1.smithi119.stdout:4/246: dwrite dd/f1b [4194304,4194304] 0 2023-12-17T11:57:38.818 INFO:tasks.workunit.client.1.smithi119.stdout:9/271: dread ff [0,4194304] 0 2023-12-17T11:57:38.818 INFO:tasks.workunit.client.1.smithi119.stdout:9/272: dread - d12/d1d/d28/f38 zero size 2023-12-17T11:57:38.824 INFO:tasks.workunit.client.1.smithi119.stdout:1/169: rmdir d3 39 2023-12-17T11:57:38.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/265: dwrite d3/d4/f16 [0,4194304] 0 2023-12-17T11:57:38.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/266: chown d3/d4/d7/d14/d1b/l1d 8337700 1 2023-12-17T11:57:38.828 INFO:tasks.workunit.client.0.smithi002.stdout:2/267: rename d3/d4/d7/d14/d2e/d37 to d3/d4/d7/d14/d2e/d37/d3f/d62 22 2023-12-17T11:57:38.831 INFO:tasks.workunit.client.0.smithi002.stdout:8/296: rmdir d3/d8/d28 39 2023-12-17T11:57:38.831 INFO:tasks.workunit.client.0.smithi002.stdout:8/297: getdents d3/d8/d55/d65 0 2023-12-17T11:57:38.831 INFO:tasks.workunit.client.1.smithi119.stdout:1/170: creat d3/db/d2a/f35 x:0 0 0 2023-12-17T11:57:38.835 INFO:tasks.workunit.client.0.smithi002.stdout:8/298: rename d3/f38 to d3/d7/d1a/f6a 0 2023-12-17T11:57:38.838 INFO:tasks.workunit.client.1.smithi119.stdout:1/171: mkdir d3/d36 0 2023-12-17T11:57:38.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/195: dwrite dc/d17/d1c/f20 [0,4194304] 0 2023-12-17T11:57:38.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/196: fsync dc/d17/d1c/f20 0 2023-12-17T11:57:38.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/244: dwrite d0/d1/dc/d17/f2e [0,4194304] 0 2023-12-17T11:57:38.845 INFO:tasks.workunit.client.0.smithi002.stdout:5/197: symlink dc/d2b/l39 0 2023-12-17T11:57:38.845 INFO:tasks.workunit.client.0.smithi002.stdout:5/198: readlink dc/l27 0 2023-12-17T11:57:38.845 INFO:tasks.workunit.client.0.smithi002.stdout:5/199: dread - dc/d2b/f35 zero size 2023-12-17T11:57:38.846 INFO:tasks.workunit.client.0.smithi002.stdout:6/245: mkdir d0/d1/dc/d17/d4c 0 2023-12-17T11:57:38.849 INFO:tasks.workunit.client.0.smithi002.stdout:5/200: creat dc/d17/d2f/f3a x:0 0 0 2023-12-17T11:57:38.849 INFO:tasks.workunit.client.0.smithi002.stdout:5/201: fdatasync dc/d17/f26 0 2023-12-17T11:57:38.850 INFO:tasks.workunit.client.0.smithi002.stdout:2/268: dread d3/d4/f3a [0,4194304] 0 2023-12-17T11:57:38.850 INFO:tasks.workunit.client.0.smithi002.stdout:2/269: chown d3/l35 811 1 2023-12-17T11:57:38.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/206: dwrite d0/d6/d26/f35 [0,4194304] 0 2023-12-17T11:57:38.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/207: dread - d0/d15/f28 zero size 2023-12-17T11:57:38.850 INFO:tasks.workunit.client.0.smithi002.stdout:0/208: truncate d0/d6/d26/f35 4579910 0 2023-12-17T11:57:38.852 INFO:tasks.workunit.client.0.smithi002.stdout:5/202: symlink dc/d17/d2f/l3b 0 2023-12-17T11:57:38.855 INFO:tasks.workunit.client.0.smithi002.stdout:5/203: write f4 [3103854,80952] 0 2023-12-17T11:57:38.855 INFO:tasks.workunit.client.0.smithi002.stdout:5/204: write fb [490587,65572] 0 2023-12-17T11:57:38.855 INFO:tasks.workunit.client.0.smithi002.stdout:5/205: fdatasync f8 0 2023-12-17T11:57:38.856 INFO:tasks.workunit.client.0.smithi002.stdout:5/206: stat dc/d17/d1c/c2a 0 2023-12-17T11:57:38.856 INFO:tasks.workunit.client.0.smithi002.stdout:3/318: dwrite d9/d1b/d35/d41/f42 [0,4194304] 0 2023-12-17T11:57:38.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/278: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:38.856 INFO:tasks.workunit.client.0.smithi002.stdout:2/270: creat d3/d4/d7/d14/d1b/d5b/f63 x:0 0 0 2023-12-17T11:57:38.856 INFO:tasks.workunit.client.0.smithi002.stdout:8/299: dread d3/d8/da/dd/f2d [0,4194304] 0 2023-12-17T11:57:38.861 INFO:tasks.workunit.client.0.smithi002.stdout:7/279: creat d6/d17/dc/f51 x:0 0 0 2023-12-17T11:57:38.865 INFO:tasks.workunit.client.1.smithi119.stdout:2/267: dwrite d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:38.867 INFO:tasks.workunit.client.0.smithi002.stdout:8/300: mknod d3/d8/da/dd/c6b 0 2023-12-17T11:57:38.867 INFO:tasks.workunit.client.0.smithi002.stdout:8/301: fsync d3/d7/f37 0 2023-12-17T11:57:38.867 INFO:tasks.workunit.client.0.smithi002.stdout:8/302: truncate d3/d7/d18/d3f/d49/f4b 124333 0 2023-12-17T11:57:38.868 INFO:tasks.workunit.client.0.smithi002.stdout:6/246: dread d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:38.868 INFO:tasks.workunit.client.0.smithi002.stdout:9/291: dwrite dc/d1d/d23/f2b [0,4194304] 0 2023-12-17T11:57:38.868 INFO:tasks.workunit.client.0.smithi002.stdout:8/303: creat d3/d8/da/dd/f6c x:0 0 0 2023-12-17T11:57:38.869 INFO:tasks.workunit.client.1.smithi119.stdout:0/185: sync 2023-12-17T11:57:38.869 INFO:tasks.workunit.client.1.smithi119.stdout:1/172: fsync d3/db/d2a/f35 0 2023-12-17T11:57:38.869 INFO:tasks.workunit.client.1.smithi119.stdout:1/173: dread - d3/db/d17/f30 zero size 2023-12-17T11:57:38.869 INFO:tasks.workunit.client.1.smithi119.stdout:0/186: link d2/d16/l33 d2/d16/d35/l37 0 2023-12-17T11:57:38.870 INFO:tasks.workunit.client.0.smithi002.stdout:3/319: dread d9/d1b/d35/d41/d43/f61 [4194304,4194304] 0 2023-12-17T11:57:38.871 INFO:tasks.workunit.client.0.smithi002.stdout:5/207: write f4 [1187016,27867] 0 2023-12-17T11:57:38.872 INFO:tasks.workunit.client.1.smithi119.stdout:3/279: dread d9/f1b [0,4194304] 0 2023-12-17T11:57:38.872 INFO:tasks.workunit.client.1.smithi119.stdout:3/280: chown d9/da/df/d41/d33/d3a/c5c 0 1 2023-12-17T11:57:38.872 INFO:tasks.workunit.client.0.smithi002.stdout:6/247: symlink d0/d1/dc/d17/d4c/l4d 0 2023-12-17T11:57:38.874 INFO:tasks.workunit.client.1.smithi119.stdout:3/281: rmdir d9/da/df/d41/d33/d5a 39 2023-12-17T11:57:38.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/337: dwrite d3/d6/d9/d37/f65 [0,4194304] 0 2023-12-17T11:57:38.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/338: stat d3/d6/d9/d37/d39/d43/d4a/f5f 0 2023-12-17T11:57:38.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/339: fsync d3/d6/d9/d37/f53 0 2023-12-17T11:57:38.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/340: chown d3/d6/d9/c18 89386078 1 2023-12-17T11:57:38.878 INFO:tasks.workunit.client.1.smithi119.stdout:2/268: dread d6/f40 [0,4194304] 0 2023-12-17T11:57:38.878 INFO:tasks.workunit.client.0.smithi002.stdout:9/292: mknod dc/d42/d4f/d59/d47/d63/c6a 0 2023-12-17T11:57:38.878 INFO:tasks.workunit.client.0.smithi002.stdout:8/304: truncate d3/d8/da/dd/f1d 1408097 0 2023-12-17T11:57:38.878 INFO:tasks.workunit.client.0.smithi002.stdout:8/305: fsync d3/d7/d18/d3f/f57 0 2023-12-17T11:57:38.879 INFO:tasks.workunit.client.1.smithi119.stdout:3/282: rename d9/da/df/d41/d33/d3a/c5b to d9/d11/c6c 0 2023-12-17T11:57:38.879 INFO:tasks.workunit.client.1.smithi119.stdout:3/283: stat d9/da/df/d41/d33/d3a 0 2023-12-17T11:57:38.880 INFO:tasks.workunit.client.1.smithi119.stdout:4/247: dwrite dd/d15/d16/d3d/f4c [0,4194304] 0 2023-12-17T11:57:38.881 INFO:tasks.workunit.client.1.smithi119.stdout:2/269: mknod d6/d9/d13/d34/d56/c5f 0 2023-12-17T11:57:38.884 INFO:tasks.workunit.client.1.smithi119.stdout:3/284: rename d9/d11/f2f to d9/d11/d1e/d55/f6d 0 2023-12-17T11:57:38.884 INFO:tasks.workunit.client.1.smithi119.stdout:3/285: stat d9/d11/l21 0 2023-12-17T11:57:38.889 INFO:tasks.workunit.client.1.smithi119.stdout:9/273: dwrite d12/d1d/d28/f3a [0,4194304] 0 2023-12-17T11:57:38.889 INFO:tasks.workunit.client.1.smithi119.stdout:9/274: chown d12/d1d/d28/l2a 6616939 1 2023-12-17T11:57:38.889 INFO:tasks.workunit.client.1.smithi119.stdout:9/275: fsync d12/d1d/f31 0 2023-12-17T11:57:38.892 INFO:tasks.workunit.client.1.smithi119.stdout:4/248: link dd/d11/d2d/f3e dd/d11/d26/f52 0 2023-12-17T11:57:38.892 INFO:tasks.workunit.client.1.smithi119.stdout:4/249: dread - dd/d11/d26/f52 zero size 2023-12-17T11:57:38.892 INFO:tasks.workunit.client.1.smithi119.stdout:4/250: chown dd/d11/d2d 1303714 1 2023-12-17T11:57:38.896 INFO:tasks.workunit.client.0.smithi002.stdout:0/209: truncate d0/d6/d26/f20 641230 0 2023-12-17T11:57:38.896 INFO:tasks.workunit.client.0.smithi002.stdout:0/210: chown d0/l29 799766421 1 2023-12-17T11:57:38.896 INFO:tasks.workunit.client.0.smithi002.stdout:6/248: read d0/d1/fd [3777098,129935] 0 2023-12-17T11:57:38.897 INFO:tasks.workunit.client.0.smithi002.stdout:7/280: dread d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:38.897 INFO:tasks.workunit.client.0.smithi002.stdout:1/341: dread d3/d6/d16/d28/f69 [0,4194304] 0 2023-12-17T11:57:38.900 INFO:tasks.workunit.client.1.smithi119.stdout:2/270: creat d6/d9/f60 x:0 0 0 2023-12-17T11:57:38.901 INFO:tasks.workunit.client.1.smithi119.stdout:9/276: rename d12/d1d/d28/f38 to d12/d1d/d49/f56 0 2023-12-17T11:57:38.901 INFO:tasks.workunit.client.1.smithi119.stdout:3/286: dread d9/d35/f58 [0,4194304] 0 2023-12-17T11:57:38.904 INFO:tasks.workunit.client.1.smithi119.stdout:3/287: creat d9/d11/d1e/d55/f6e x:0 0 0 2023-12-17T11:57:38.905 INFO:tasks.workunit.client.0.smithi002.stdout:3/320: mkdir d9/d15/d6a 0 2023-12-17T11:57:38.907 INFO:tasks.workunit.client.1.smithi119.stdout:9/277: getdents d12/d1d 0 2023-12-17T11:57:38.909 INFO:tasks.workunit.client.0.smithi002.stdout:5/208: mknod dc/d2b/c3c 0 2023-12-17T11:57:38.914 INFO:tasks.workunit.client.1.smithi119.stdout:9/278: creat d12/d1d/d49/f57 x:0 0 0 2023-12-17T11:57:38.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/293: rename dc/l44 to dc/d42/d4f/l6b 0 2023-12-17T11:57:38.914 INFO:tasks.workunit.client.0.smithi002.stdout:9/294: dread - dc/d42/d4f/d59/d47/f5c zero size 2023-12-17T11:57:38.917 INFO:tasks.workunit.client.0.smithi002.stdout:8/306: unlink d3/d7/d1a/f1c 0 2023-12-17T11:57:38.917 INFO:tasks.workunit.client.0.smithi002.stdout:9/295: write dc/d32/f51 [420831,111306] 0 2023-12-17T11:57:38.917 INFO:tasks.workunit.client.0.smithi002.stdout:6/249: getdents d0/d1/dc/d17/d4c 0 2023-12-17T11:57:38.917 INFO:tasks.workunit.client.0.smithi002.stdout:6/250: chown d0/d1/d21 0 1 2023-12-17T11:57:38.917 INFO:tasks.workunit.client.0.smithi002.stdout:6/251: chown d0/d1/dc/d10/c22 3960819 1 2023-12-17T11:57:38.919 INFO:tasks.workunit.client.0.smithi002.stdout:7/281: mknod d6/d17/c52 0 2023-12-17T11:57:38.920 INFO:tasks.workunit.client.1.smithi119.stdout:9/279: symlink d12/d1d/d49/l58 0 2023-12-17T11:57:38.920 INFO:tasks.workunit.client.1.smithi119.stdout:9/280: dread - d12/f42 zero size 2023-12-17T11:57:38.920 INFO:tasks.workunit.client.0.smithi002.stdout:2/271: dwrite d3/d4/f60 [0,4194304] 0 2023-12-17T11:57:38.925 INFO:tasks.workunit.client.0.smithi002.stdout:0/211: rename d0/l10 to d0/d6/d26/d14/d19/d2b/l47 0 2023-12-17T11:57:38.926 INFO:tasks.workunit.client.0.smithi002.stdout:8/307: rmdir d3/d8/d28 39 2023-12-17T11:57:38.931 INFO:tasks.workunit.client.0.smithi002.stdout:9/296: truncate dc/d32/f35 2453584 0 2023-12-17T11:57:38.935 INFO:tasks.workunit.client.0.smithi002.stdout:6/252: unlink d0/d1/dc/d10/f4a 0 2023-12-17T11:57:38.935 INFO:tasks.workunit.client.0.smithi002.stdout:5/209: write fa [1577815,80381] 0 2023-12-17T11:57:38.941 INFO:tasks.workunit.client.0.smithi002.stdout:3/321: write d9/f1d [310898,63160] 0 2023-12-17T11:57:38.942 INFO:tasks.workunit.client.0.smithi002.stdout:2/272: link d3/d50/c58 d3/d56/c64 0 2023-12-17T11:57:38.943 INFO:tasks.workunit.client.0.smithi002.stdout:1/342: rmdir d3/d6/d9/d37 39 2023-12-17T11:57:38.944 INFO:tasks.workunit.client.1.smithi119.stdout:9/281: dread d12/d1d/f31 [0,4194304] 0 2023-12-17T11:57:38.944 INFO:tasks.workunit.client.1.smithi119.stdout:9/282: readlink d12/d1d/l45 0 2023-12-17T11:57:38.944 INFO:tasks.workunit.client.1.smithi119.stdout:9/283: stat d12/f17 0 2023-12-17T11:57:38.944 INFO:tasks.workunit.client.1.smithi119.stdout:9/284: creat d12/d1d/d28/d46/f59 x:0 0 0 2023-12-17T11:57:38.946 INFO:tasks.workunit.client.0.smithi002.stdout:4/276: sync 2023-12-17T11:57:38.947 INFO:tasks.workunit.client.0.smithi002.stdout:7/282: rename d6/d17/dc/d13/d37/d4c/d27 to d6/d17/dc/d13/d21/d2e/d4a/d53 0 2023-12-17T11:57:38.947 INFO:tasks.workunit.client.0.smithi002.stdout:7/283: fdatasync d6/f1c 0 2023-12-17T11:57:38.949 INFO:tasks.workunit.client.0.smithi002.stdout:0/212: creat d0/f48 x:0 0 0 2023-12-17T11:57:38.952 INFO:tasks.workunit.client.0.smithi002.stdout:9/297: mkdir dc/d42/d4f/d59/d47/d63/d6c 0 2023-12-17T11:57:38.952 INFO:tasks.workunit.client.0.smithi002.stdout:9/298: chown dc/d42/d4f/d59/d47/d4b/c66 2 1 2023-12-17T11:57:38.952 INFO:tasks.workunit.client.0.smithi002.stdout:5/210: write dc/d17/d1c/f20 [921775,49840] 0 2023-12-17T11:57:38.953 INFO:tasks.workunit.client.0.smithi002.stdout:5/211: write dc/d17/f26 [961717,15865] 0 2023-12-17T11:57:38.953 INFO:tasks.workunit.client.1.smithi119.stdout:9/285: creat d12/d1d/d28/d46/d50/f5a x:0 0 0 2023-12-17T11:57:38.953 INFO:tasks.workunit.client.1.smithi119.stdout:9/286: write d12/d1d/d28/d46/f4e [497543,44408] 0 2023-12-17T11:57:38.953 INFO:tasks.workunit.client.1.smithi119.stdout:9/287: fdatasync d12/d1d/f44 0 2023-12-17T11:57:38.953 INFO:tasks.workunit.client.1.smithi119.stdout:9/288: creat d12/d1d/d49/f5b x:0 0 0 2023-12-17T11:57:38.955 INFO:tasks.workunit.client.0.smithi002.stdout:5/212: readlink dc/d2b/l39 0 2023-12-17T11:57:38.957 INFO:tasks.workunit.client.1.smithi119.stdout:3/288: dwrite d9/d35/f58 [0,4194304] 0 2023-12-17T11:57:38.961 INFO:tasks.workunit.client.0.smithi002.stdout:3/322: dread f6 [0,4194304] 0 2023-12-17T11:57:38.961 INFO:tasks.workunit.client.0.smithi002.stdout:3/323: fdatasync d9/d15/f22 0 2023-12-17T11:57:38.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/273: truncate d3/d4/d17/f20 1938342 0 2023-12-17T11:57:38.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/274: creat d3/d4/f65 x:0 0 0 2023-12-17T11:57:38.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/275: write d3/d4/f16 [4603069,34206] 0 2023-12-17T11:57:38.962 INFO:tasks.workunit.client.1.smithi119.stdout:4/251: dwrite f4 [4194304,4194304] 0 2023-12-17T11:57:38.962 INFO:tasks.workunit.client.1.smithi119.stdout:4/252: dread - dd/f41 zero size 2023-12-17T11:57:38.963 INFO:tasks.workunit.client.0.smithi002.stdout:1/343: creat d3/d6/d9/d37/d39/d43/f6d x:0 0 0 2023-12-17T11:57:38.964 INFO:tasks.workunit.client.1.smithi119.stdout:2/271: dwrite d6/d9/d13/d1d/f50 [0,4194304] 0 2023-12-17T11:57:38.966 INFO:tasks.workunit.client.0.smithi002.stdout:4/277: creat d0/d10/d21/f5d x:0 0 0 2023-12-17T11:57:38.969 INFO:tasks.workunit.client.1.smithi119.stdout:9/289: truncate fe 873644 0 2023-12-17T11:57:38.969 INFO:tasks.workunit.client.1.smithi119.stdout:3/289: dread d9/d11/f3f [0,4194304] 0 2023-12-17T11:57:38.969 INFO:tasks.workunit.client.1.smithi119.stdout:3/290: chown d9/d11/f3f 26224 1 2023-12-17T11:57:38.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/253: rename d0/d1/dc/d17/f41 to d0/d1/dc/d17/d40/f4e 0 2023-12-17T11:57:38.970 INFO:tasks.workunit.client.1.smithi119.stdout:2/272: mkdir d6/d9/d13/d61 0 2023-12-17T11:57:38.975 INFO:tasks.workunit.client.1.smithi119.stdout:3/291: creat d9/d11/d1e/f6f x:0 0 0 2023-12-17T11:57:38.976 INFO:tasks.workunit.client.0.smithi002.stdout:9/299: rmdir dc/d32 39 2023-12-17T11:57:38.978 INFO:tasks.workunit.client.0.smithi002.stdout:4/278: dread d0/d10/f30 [0,4194304] 0 2023-12-17T11:57:38.978 INFO:tasks.workunit.client.0.smithi002.stdout:4/279: chown d0/d10/f40 21909844 1 2023-12-17T11:57:38.987 INFO:tasks.workunit.client.1.smithi119.stdout:3/292: mknod d9/d11/c70 0 2023-12-17T11:57:38.989 INFO:tasks.workunit.client.0.smithi002.stdout:3/324: rename d9/d24/f3e to d9/d15/d31/f6b 0 2023-12-17T11:57:38.990 INFO:tasks.workunit.client.1.smithi119.stdout:9/290: dread d12/f2c [0,4194304] 0 2023-12-17T11:57:38.996 INFO:tasks.workunit.client.0.smithi002.stdout:5/213: write dc/d2b/f38 [6114301,89160] 0 2023-12-17T11:57:38.996 INFO:tasks.workunit.client.0.smithi002.stdout:5/214: stat dc/d17/d1c 0 2023-12-17T11:57:39.002 INFO:tasks.workunit.client.0.smithi002.stdout:9/300: link dc/d1d/l3c dc/d38/l6d 0 2023-12-17T11:57:39.003 INFO:tasks.workunit.client.0.smithi002.stdout:9/301: write dc/d42/f64 [704603,29019] 0 2023-12-17T11:57:39.004 INFO:tasks.workunit.client.1.smithi119.stdout:3/293: link d9/l61 d9/l71 0 2023-12-17T11:57:39.004 INFO:tasks.workunit.client.1.smithi119.stdout:3/294: read - d9/f50 zero size 2023-12-17T11:57:39.006 INFO:tasks.workunit.client.0.smithi002.stdout:5/215: creat dc/d1b/f3d x:0 0 0 2023-12-17T11:57:39.009 INFO:tasks.workunit.client.0.smithi002.stdout:4/280: write d0/d10/f25 [3146578,14091] 0 2023-12-17T11:57:39.010 INFO:tasks.workunit.client.0.smithi002.stdout:4/281: write d0/d10/d21/f54 [1437100,97865] 0 2023-12-17T11:57:39.011 INFO:tasks.workunit.client.0.smithi002.stdout:5/216: creat dc/f3e x:0 0 0 2023-12-17T11:57:39.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/302: rmdir dc/d1d/d23 39 2023-12-17T11:57:39.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/303: write dc/d32/f53 [1039717,52175] 0 2023-12-17T11:57:39.014 INFO:tasks.workunit.client.0.smithi002.stdout:9/304: creat dc/d42/d4f/d59/f6e x:0 0 0 2023-12-17T11:57:39.015 INFO:tasks.workunit.client.0.smithi002.stdout:3/325: dread d9/d15/f19 [0,4194304] 0 2023-12-17T11:57:39.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/284: dwrite d6/d17/dc/d13/d37/d4c/f35 [0,4194304] 0 2023-12-17T11:57:39.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/285: chown d6/d17/dc/d13/d37/d4c/c40 376964 1 2023-12-17T11:57:39.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/286: truncate d6/d17/f48 234069 0 2023-12-17T11:57:39.017 INFO:tasks.workunit.client.0.smithi002.stdout:4/282: mkdir d0/d3e/d5e 0 2023-12-17T11:57:39.019 INFO:tasks.workunit.client.0.smithi002.stdout:5/217: rename dc/d17/d2f/l3b to dc/d2b/l3f 0 2023-12-17T11:57:39.021 INFO:tasks.workunit.client.0.smithi002.stdout:9/305: truncate dc/d1d/d23/f2b 2469168 0 2023-12-17T11:57:39.022 INFO:tasks.workunit.client.0.smithi002.stdout:3/326: symlink d9/d1b/d35/d41/d59/d65/l6c 0 2023-12-17T11:57:39.022 INFO:tasks.workunit.client.0.smithi002.stdout:3/327: write d9/d15/d31/f6b [1931942,109232] 0 2023-12-17T11:57:39.022 INFO:tasks.workunit.client.0.smithi002.stdout:3/328: write d9/d1b/d4f/f68 [257883,52050] 0 2023-12-17T11:57:39.024 INFO:tasks.workunit.client.0.smithi002.stdout:7/287: link d6/d17/dc/l49 d6/d17/dc/d13/d37/d4f/l54 0 2023-12-17T11:57:39.026 INFO:tasks.workunit.client.0.smithi002.stdout:9/306: creat dc/d1d/d23/f6f x:0 0 0 2023-12-17T11:57:39.026 INFO:tasks.workunit.client.0.smithi002.stdout:9/307: readlink dc/d38/l6d 0 2023-12-17T11:57:39.026 INFO:tasks.workunit.client.0.smithi002.stdout:7/288: symlink d6/d17/dc/d13/d21/d2e/l55 0 2023-12-17T11:57:39.026 INFO:tasks.workunit.client.0.smithi002.stdout:7/289: stat d6/d17/dc/d13/d21 0 2023-12-17T11:57:39.028 INFO:tasks.workunit.client.0.smithi002.stdout:3/329: read d9/d24/f51 [416565,48031] 0 2023-12-17T11:57:39.028 INFO:tasks.workunit.client.0.smithi002.stdout:7/290: mknod d6/d17/dc/d13/d21/c56 0 2023-12-17T11:57:39.029 INFO:tasks.workunit.client.1.smithi119.stdout:4/253: dwrite dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:39.029 INFO:tasks.workunit.client.1.smithi119.stdout:4/254: truncate dd/d11/d26/f52 102256 0 2023-12-17T11:57:39.030 INFO:tasks.workunit.client.0.smithi002.stdout:3/330: truncate d9/d24/f25 2860775 0 2023-12-17T11:57:39.031 INFO:tasks.workunit.client.0.smithi002.stdout:0/213: dwrite d0/d6/d26/f20 [0,4194304] 0 2023-12-17T11:57:39.038 INFO:tasks.workunit.client.1.smithi119.stdout:2/273: dwrite d6/f45 [0,4194304] 0 2023-12-17T11:57:39.042 INFO:tasks.workunit.client.1.smithi119.stdout:9/291: dwrite d12/f35 [0,4194304] 0 2023-12-17T11:57:39.044 INFO:tasks.workunit.client.1.smithi119.stdout:2/274: symlink d6/d2b/d3f/d5c/l62 0 2023-12-17T11:57:39.048 INFO:tasks.workunit.client.1.smithi119.stdout:3/295: truncate d9/d35/f58 1619908 0 2023-12-17T11:57:39.058 INFO:tasks.workunit.client.1.smithi119.stdout:2/275: dread d6/d9/fb [0,4194304] 0 2023-12-17T11:57:39.063 INFO:tasks.workunit.client.0.smithi002.stdout:6/254: dwrite d0/d1/dc/d10/f14 [0,4194304] 0 2023-12-17T11:57:39.068 INFO:tasks.workunit.client.1.smithi119.stdout:9/292: getdents d12/d1d/d28/d4d 0 2023-12-17T11:57:39.068 INFO:tasks.workunit.client.1.smithi119.stdout:3/296: creat d9/d11/f72 x:0 0 0 2023-12-17T11:57:39.069 INFO:tasks.workunit.client.0.smithi002.stdout:7/291: dread d6/f1c [0,4194304] 0 2023-12-17T11:57:39.070 INFO:tasks.workunit.client.1.smithi119.stdout:3/297: write d9/f1b [1114304,96092] 0 2023-12-17T11:57:39.075 INFO:tasks.workunit.client.1.smithi119.stdout:3/298: symlink d9/d59/l73 0 2023-12-17T11:57:39.075 INFO:tasks.workunit.client.1.smithi119.stdout:3/299: write d9/d11/d1e/f6f [848902,18393] 0 2023-12-17T11:57:39.076 INFO:tasks.workunit.client.1.smithi119.stdout:3/300: dread - d9/d11/f72 zero size 2023-12-17T11:57:39.076 INFO:tasks.workunit.client.1.smithi119.stdout:3/301: fdatasync d9/da/df/d41/d33/d3a/f3d 0 2023-12-17T11:57:39.076 INFO:tasks.workunit.client.0.smithi002.stdout:4/283: dwrite d0/d10/d21/f49 [0,4194304] 0 2023-12-17T11:57:39.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/284: write d0/d10/f30 [38695,3652] 0 2023-12-17T11:57:39.079 INFO:tasks.workunit.client.1.smithi119.stdout:3/302: mkdir d9/da/df/d41/d74 0 2023-12-17T11:57:39.079 INFO:tasks.workunit.client.0.smithi002.stdout:5/218: dwrite fa [4194304,4194304] 0 2023-12-17T11:57:39.080 INFO:tasks.workunit.client.1.smithi119.stdout:2/276: read d6/d9/d13/d1d/f2d [3342459,59792] 0 2023-12-17T11:57:39.082 INFO:tasks.workunit.client.1.smithi119.stdout:3/303: mknod d9/d1c/c75 0 2023-12-17T11:57:39.084 INFO:tasks.workunit.client.0.smithi002.stdout:7/292: unlink d6/d17/c12 0 2023-12-17T11:57:39.086 INFO:tasks.workunit.client.1.smithi119.stdout:2/277: mknod d6/d2b/d3f/d5c/c63 0 2023-12-17T11:57:39.087 INFO:tasks.workunit.client.1.smithi119.stdout:9/293: dread d12/f35 [0,4194304] 0 2023-12-17T11:57:39.090 INFO:tasks.workunit.client.1.smithi119.stdout:2/278: rename d6/d9/d13/f3e to d6/d9/d13/d34/f64 0 2023-12-17T11:57:39.090 INFO:tasks.workunit.client.1.smithi119.stdout:2/279: stat d6/f1f 0 2023-12-17T11:57:39.090 INFO:tasks.workunit.client.1.smithi119.stdout:2/280: chown d6/d2b/d3f/d5c/c63 21235 1 2023-12-17T11:57:39.093 INFO:tasks.workunit.client.1.smithi119.stdout:1/174: sync 2023-12-17T11:57:39.093 INFO:tasks.workunit.client.1.smithi119.stdout:8/215: sync 2023-12-17T11:57:39.093 INFO:tasks.workunit.client.1.smithi119.stdout:1/175: fdatasync d3/db/d26/d19/f2f 0 2023-12-17T11:57:39.093 INFO:tasks.workunit.client.1.smithi119.stdout:1/176: truncate d3/db/d17/d24/f32 852527 0 2023-12-17T11:57:39.096 INFO:tasks.workunit.client.1.smithi119.stdout:6/238: sync 2023-12-17T11:57:39.096 INFO:tasks.workunit.client.1.smithi119.stdout:6/239: chown d2/df/d17/f34 87 1 2023-12-17T11:57:39.096 INFO:tasks.workunit.client.1.smithi119.stdout:6/240: write d2/df/d17/f23 [1213847,58906] 0 2023-12-17T11:57:39.101 INFO:tasks.workunit.client.1.smithi119.stdout:1/177: rename d3/db/d17/d24/f14 to d3/db/d17/d24/f37 0 2023-12-17T11:57:39.101 INFO:tasks.workunit.client.1.smithi119.stdout:1/178: chown d3/db/d17/d24/d20/c2c 231267 1 2023-12-17T11:57:39.101 INFO:tasks.workunit.client.1.smithi119.stdout:1/179: chown d3/db/c27 4934 1 2023-12-17T11:57:39.104 INFO:tasks.workunit.client.0.smithi002.stdout:5/219: mkdir dc/d1a/d40 0 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:0/187: sync 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:7/295: sync 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:7/296: write d2/d4/d11/f21 [617928,118774] 0 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:7/297: write d2/d4/f38 [724765,35999] 0 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:6/241: symlink d2/d2b/l48 0 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:5/300: sync 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:5/301: stat d1/d25/c53 0 2023-12-17T11:57:39.105 INFO:tasks.workunit.client.1.smithi119.stdout:5/302: chown d1/l18 16 1 2023-12-17T11:57:39.106 INFO:tasks.workunit.client.0.smithi002.stdout:5/220: rename dc/l10 to dc/d1a/l41 0 2023-12-17T11:57:39.107 INFO:tasks.workunit.client.1.smithi119.stdout:0/188: symlink d2/d16/d12/d21/l38 0 2023-12-17T11:57:39.107 INFO:tasks.workunit.client.1.smithi119.stdout:0/189: write d2/d16/f27 [1145019,21510] 0 2023-12-17T11:57:39.113 INFO:tasks.workunit.client.1.smithi119.stdout:7/298: link d2/d4/d11/d2c/f3a d2/d4/d1f/f5c 0 2023-12-17T11:57:39.115 INFO:tasks.workunit.client.1.smithi119.stdout:2/281: write d6/d9/d13/d1d/f24 [1231766,69184] 0 2023-12-17T11:57:39.119 INFO:tasks.workunit.client.1.smithi119.stdout:6/242: symlink d2/df/l49 0 2023-12-17T11:57:39.123 INFO:tasks.workunit.client.1.smithi119.stdout:5/303: symlink d1/d36/l59 0 2023-12-17T11:57:39.123 INFO:tasks.workunit.client.1.smithi119.stdout:5/304: getdents d1/d36/d57 0 2023-12-17T11:57:39.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/293: dread d6/d17/dc/d13/d37/d4c/d24/f43 [0,4194304] 0 2023-12-17T11:57:39.126 INFO:tasks.workunit.client.1.smithi119.stdout:6/243: creat d2/d2b/d43/f4a x:0 0 0 2023-12-17T11:57:39.128 INFO:tasks.workunit.client.1.smithi119.stdout:5/305: truncate d1/fa 781393 0 2023-12-17T11:57:39.136 INFO:tasks.workunit.client.0.smithi002.stdout:7/294: dread d6/f44 [0,4194304] 0 2023-12-17T11:57:39.136 INFO:tasks.workunit.client.0.smithi002.stdout:7/295: truncate d6/d17/dc/d13/d37/d4c/d24/f43 4380521 0 2023-12-17T11:57:39.149 INFO:tasks.workunit.client.0.smithi002.stdout:7/296: creat d6/d17/dc/d13/f57 x:0 0 0 2023-12-17T11:57:39.149 INFO:tasks.workunit.client.0.smithi002.stdout:7/297: fsync d6/d17/dc/d13/f2d 0 2023-12-17T11:57:39.149 INFO:tasks.workunit.client.0.smithi002.stdout:7/298: write d6/d17/dc/d13/f57 [931735,71350] 0 2023-12-17T11:57:39.154 INFO:tasks.workunit.client.0.smithi002.stdout:4/285: dwrite d0/f43 [0,4194304] 0 2023-12-17T11:57:39.154 INFO:tasks.workunit.client.0.smithi002.stdout:9/308: dwrite dc/f1e [0,4194304] 0 2023-12-17T11:57:39.158 INFO:tasks.workunit.client.0.smithi002.stdout:7/299: symlink d6/l58 0 2023-12-17T11:57:39.174 INFO:tasks.workunit.client.0.smithi002.stdout:4/286: dread d0/d10/f31 [0,4194304] 0 2023-12-17T11:57:39.177 INFO:tasks.workunit.client.0.smithi002.stdout:4/287: rmdir d0/d3e/d5e 0 2023-12-17T11:57:39.179 INFO:tasks.workunit.client.0.smithi002.stdout:4/288: mknod d0/d3e/d56/c5f 0 2023-12-17T11:57:39.183 INFO:tasks.workunit.client.0.smithi002.stdout:0/214: dwrite d0/d6/d26/d25/f45 [0,4194304] 0 2023-12-17T11:57:39.183 INFO:tasks.workunit.client.0.smithi002.stdout:7/300: dread d6/f1c [0,4194304] 0 2023-12-17T11:57:39.185 INFO:tasks.workunit.client.0.smithi002.stdout:0/215: mknod d0/d6/d26/d14/d19/d2b/c49 0 2023-12-17T11:57:39.186 INFO:tasks.workunit.client.1.smithi119.stdout:8/216: dwrite d7/da/d11/d26/f28 [0,4194304] 0 2023-12-17T11:57:39.187 INFO:tasks.workunit.client.1.smithi119.stdout:3/304: truncate d9/f1b 632726 0 2023-12-17T11:57:39.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/255: dwrite d0/d1/dc/d17/f26 [0,4194304] 0 2023-12-17T11:57:39.191 INFO:tasks.workunit.client.0.smithi002.stdout:6/256: write d0/d1/dc/d17/d3c/f47 [586434,112092] 0 2023-12-17T11:57:39.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/216: rmdir d0/d6/d26/d14/d19/d37 39 2023-12-17T11:57:39.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/217: dread - d0/d6/d26/f3a zero size 2023-12-17T11:57:39.193 INFO:tasks.workunit.client.0.smithi002.stdout:0/218: dread - d0/d6/d26/d25/f31 zero size 2023-12-17T11:57:39.195 INFO:tasks.workunit.client.1.smithi119.stdout:9/294: dwrite ff [0,4194304] 0 2023-12-17T11:57:39.197 INFO:tasks.workunit.client.1.smithi119.stdout:9/295: write d12/f48 [2411622,111159] 0 2023-12-17T11:57:39.197 INFO:tasks.workunit.client.1.smithi119.stdout:9/296: fdatasync d12/f35 0 2023-12-17T11:57:39.197 INFO:tasks.workunit.client.1.smithi119.stdout:8/217: mknod d7/da/d11/d26/d2c/c44 0 2023-12-17T11:57:39.198 INFO:tasks.workunit.client.1.smithi119.stdout:3/305: rename d9/d11/d1e/f56 to d9/d11/f76 0 2023-12-17T11:57:39.198 INFO:tasks.workunit.client.0.smithi002.stdout:0/219: rmdir d0/d6/d26/d14/d19/d2b 39 2023-12-17T11:57:39.199 INFO:tasks.workunit.client.0.smithi002.stdout:0/220: truncate d0/d15/f28 203419 0 2023-12-17T11:57:39.201 INFO:tasks.workunit.client.1.smithi119.stdout:9/297: creat d12/d1d/d40/f5c x:0 0 0 2023-12-17T11:57:39.201 INFO:tasks.workunit.client.1.smithi119.stdout:9/298: fsync d12/d1d/f41 0 2023-12-17T11:57:39.202 INFO:tasks.workunit.client.1.smithi119.stdout:6/244: rmdir d2/df 39 2023-12-17T11:57:39.202 INFO:tasks.workunit.client.1.smithi119.stdout:6/245: fdatasync d2/df/d17/f2f 0 2023-12-17T11:57:39.202 INFO:tasks.workunit.client.1.smithi119.stdout:6/246: stat d2/d2b/f3a 0 2023-12-17T11:57:39.203 INFO:tasks.workunit.client.1.smithi119.stdout:3/306: mkdir d9/d11/d1e/d55/d77 0 2023-12-17T11:57:39.205 INFO:tasks.workunit.client.1.smithi119.stdout:9/299: creat d12/d1d/f5d x:0 0 0 2023-12-17T11:57:39.205 INFO:tasks.workunit.client.1.smithi119.stdout:9/300: chown c3 0 1 2023-12-17T11:57:39.205 INFO:tasks.workunit.client.1.smithi119.stdout:9/301: chown d12/d1d/f51 93 1 2023-12-17T11:57:39.206 INFO:tasks.workunit.client.0.smithi002.stdout:0/221: rename d0/l29 to d0/d6/d26/l4a 0 2023-12-17T11:57:39.206 INFO:tasks.workunit.client.0.smithi002.stdout:0/222: stat d0/f13 0 2023-12-17T11:57:39.206 INFO:tasks.workunit.client.0.smithi002.stdout:0/223: truncate d0/d6/fe 4670229 0 2023-12-17T11:57:39.207 INFO:tasks.workunit.client.1.smithi119.stdout:6/247: creat d2/df/f4b x:0 0 0 2023-12-17T11:57:39.207 INFO:tasks.workunit.client.1.smithi119.stdout:6/248: truncate d2/df/d17/f37 672461 0 2023-12-17T11:57:39.207 INFO:tasks.workunit.client.1.smithi119.stdout:6/249: creat d2/d2b/f4c x:0 0 0 2023-12-17T11:57:39.208 INFO:tasks.workunit.client.1.smithi119.stdout:3/307: mknod d9/d11/d1e/d55/d77/c78 0 2023-12-17T11:57:39.208 INFO:tasks.workunit.client.1.smithi119.stdout:3/308: write d9/da/f28 [889621,34931] 0 2023-12-17T11:57:39.208 INFO:tasks.workunit.client.1.smithi119.stdout:3/309: write f3 [171653,40036] 0 2023-12-17T11:57:39.209 INFO:tasks.workunit.client.1.smithi119.stdout:9/302: creat d12/d1d/d28/d4d/f5e x:0 0 0 2023-12-17T11:57:39.209 INFO:tasks.workunit.client.1.smithi119.stdout:9/303: chown d12/d1d/c4c 6114583 1 2023-12-17T11:57:39.209 INFO:tasks.workunit.client.1.smithi119.stdout:9/304: fsync d12/d1d/f51 0 2023-12-17T11:57:39.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/257: dread d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:39.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/258: chown d0/d1/dc/d10/l33 0 1 2023-12-17T11:57:39.213 INFO:tasks.workunit.client.1.smithi119.stdout:6/250: unlink d2/d2b/f44 0 2023-12-17T11:57:39.213 INFO:tasks.workunit.client.1.smithi119.stdout:6/251: chown d2/df/f36 9147885 1 2023-12-17T11:57:39.214 INFO:tasks.workunit.client.1.smithi119.stdout:9/305: symlink d12/d1d/d28/l5f 0 2023-12-17T11:57:39.214 INFO:tasks.workunit.client.1.smithi119.stdout:9/306: readlink d12/d1d/d28/d4d/l55 0 2023-12-17T11:57:39.214 INFO:tasks.workunit.client.1.smithi119.stdout:9/307: stat d12/d1d/d28/c30 0 2023-12-17T11:57:39.214 INFO:tasks.workunit.client.1.smithi119.stdout:9/308: write d12/d1d/d28/d46/d50/f5a [404553,108786] 0 2023-12-17T11:57:39.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/259: link d0/d1/dc/f39 d0/d1/dc/d17/d40/f4f 0 2023-12-17T11:57:39.216 INFO:tasks.workunit.client.0.smithi002.stdout:6/260: chown d0/d1/fd 1 1 2023-12-17T11:57:39.217 INFO:tasks.workunit.client.1.smithi119.stdout:6/252: mknod d2/c4d 0 2023-12-17T11:57:39.218 INFO:tasks.workunit.client.0.smithi002.stdout:0/224: dread d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:39.218 INFO:tasks.workunit.client.0.smithi002.stdout:0/225: chown d0/d6/d26/d14/f3f 0 1 2023-12-17T11:57:39.219 INFO:tasks.workunit.client.1.smithi119.stdout:9/309: truncate d12/f17 4688515 0 2023-12-17T11:57:39.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/221: dwrite fb [0,4194304] 0 2023-12-17T11:57:39.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/222: dread - dc/d17/d2f/f3a zero size 2023-12-17T11:57:39.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/223: write dc/d17/f26 [80571,43527] 0 2023-12-17T11:57:39.223 INFO:tasks.workunit.client.0.smithi002.stdout:0/226: symlink d0/d6/d26/d14/d19/d2f/l4b 0 2023-12-17T11:57:39.223 INFO:tasks.workunit.client.0.smithi002.stdout:0/227: write d0/f48 [730768,55929] 0 2023-12-17T11:57:39.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/261: symlink d0/d1/l50 0 2023-12-17T11:57:39.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/262: chown d0/d1/d21/l3b 6 1 2023-12-17T11:57:39.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:38 smithi002 ceph-mon[107131]: pgmap v22: 65 pgs: 65 active+clean; 947 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 82 MiB/s rd, 122 MiB/s wr, 886 op/s 2023-12-17T11:57:39.227 INFO:tasks.workunit.client.1.smithi119.stdout:2/282: dwrite d6/f1f [0,4194304] 0 2023-12-17T11:57:39.228 INFO:tasks.workunit.client.0.smithi002.stdout:9/309: dwrite dc/d42/f64 [0,4194304] 0 2023-12-17T11:57:39.228 INFO:tasks.workunit.client.0.smithi002.stdout:9/310: fdatasync dc/d1d/d23/f60 0 2023-12-17T11:57:39.229 INFO:tasks.workunit.client.1.smithi119.stdout:8/218: dread d7/da/d11/d26/f28 [0,4194304] 0 2023-12-17T11:57:39.229 INFO:tasks.workunit.client.1.smithi119.stdout:8/219: chown d7/d12/f2b 51863632 1 2023-12-17T11:57:39.229 INFO:tasks.workunit.client.1.smithi119.stdout:5/306: dwrite d1/d25/f46 [0,4194304] 0 2023-12-17T11:57:39.229 INFO:tasks.workunit.client.1.smithi119.stdout:5/307: chown d1/f1a 0 1 2023-12-17T11:57:39.229 INFO:tasks.workunit.client.1.smithi119.stdout:6/253: rename d2/d2b/f33 to d2/df/d17/f4e 0 2023-12-17T11:57:39.230 INFO:tasks.workunit.client.1.smithi119.stdout:6/254: getdents d2/d41 0 2023-12-17T11:57:39.230 INFO:tasks.workunit.client.1.smithi119.stdout:6/255: truncate d2/df/d17/f34 4268060 0 2023-12-17T11:57:39.230 INFO:tasks.workunit.client.1.smithi119.stdout:6/256: write d2/d2b/d43/f4a [644849,37337] 0 2023-12-17T11:57:39.231 INFO:tasks.workunit.client.0.smithi002.stdout:4/289: dwrite d0/d10/d14/f52 [0,4194304] 0 2023-12-17T11:57:39.231 INFO:tasks.workunit.client.0.smithi002.stdout:4/290: creat d0/d10/d14/f60 x:0 0 0 2023-12-17T11:57:39.231 INFO:tasks.workunit.client.1.smithi119.stdout:6/257: creat d2/d2b/f4f x:0 0 0 2023-12-17T11:57:39.231 INFO:tasks.workunit.client.1.smithi119.stdout:2/283: getdents d6/d38 0 2023-12-17T11:57:39.232 INFO:tasks.workunit.client.1.smithi119.stdout:1/180: dwrite d3/db/d26/d19/f1e [0,4194304] 0 2023-12-17T11:57:39.234 INFO:tasks.workunit.client.1.smithi119.stdout:0/190: dwrite d2/d16/d12/f32 [0,4194304] 0 2023-12-17T11:57:39.242 INFO:tasks.workunit.client.1.smithi119.stdout:9/310: rename d12/f37 to d12/d1d/d28/d46/d50/f60 0 2023-12-17T11:57:39.243 INFO:tasks.workunit.client.1.smithi119.stdout:9/311: fdatasync d12/f35 0 2023-12-17T11:57:39.250 INFO:tasks.workunit.client.1.smithi119.stdout:2/284: dread d6/f33 [0,4194304] 0 2023-12-17T11:57:39.250 INFO:tasks.workunit.client.1.smithi119.stdout:2/285: fdatasync d6/d9/fd 0 2023-12-17T11:57:39.250 INFO:tasks.workunit.client.1.smithi119.stdout:8/220: dread d7/da/d1a/f1c [4194304,4194304] 0 2023-12-17T11:57:39.251 INFO:tasks.workunit.client.0.smithi002.stdout:5/224: dread fa [4194304,4194304] 0 2023-12-17T11:57:39.256 INFO:tasks.workunit.client.1.smithi119.stdout:3/310: dwrite d9/da/df/f27 [0,4194304] 0 2023-12-17T11:57:39.270 INFO:tasks.workunit.client.0.smithi002.stdout:0/228: mkdir d0/d6/d26/d14/d19/d4c 0 2023-12-17T11:57:39.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/311: mknod dc/d1d/d23/c70 0 2023-12-17T11:57:39.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/312: chown dc/d38/l6d 0 1 2023-12-17T11:57:39.278 INFO:tasks.workunit.client.0.smithi002.stdout:9/313: fsync dc/d32/f51 0 2023-12-17T11:57:39.278 INFO:tasks.workunit.client.1.smithi119.stdout:0/191: mkdir d2/d16/d35/d39 0 2023-12-17T11:57:39.280 INFO:tasks.workunit.client.0.smithi002.stdout:7/301: dwrite d6/d17/dc/d13/f57 [0,4194304] 0 2023-12-17T11:57:39.280 INFO:tasks.workunit.client.0.smithi002.stdout:7/302: fdatasync d6/d17/f47 0 2023-12-17T11:57:39.281 INFO:tasks.workunit.client.1.smithi119.stdout:1/181: dwrite d3/db/d26/f11 [4194304,4194304] 0 2023-12-17T11:57:39.283 INFO:tasks.workunit.client.1.smithi119.stdout:5/308: unlink d1/d25/c26 0 2023-12-17T11:57:39.284 INFO:tasks.workunit.client.1.smithi119.stdout:9/312: rmdir d12/d54 0 2023-12-17T11:57:39.284 INFO:tasks.workunit.client.1.smithi119.stdout:2/286: link d6/d9/d52/d53/d55/f4e d6/d9/d52/d5a/f65 0 2023-12-17T11:57:39.284 INFO:tasks.workunit.client.1.smithi119.stdout:2/287: truncate d6/d2b/f3c 954109 0 2023-12-17T11:57:39.286 INFO:tasks.workunit.client.1.smithi119.stdout:8/221: mkdir d7/d18/d45 0 2023-12-17T11:57:39.288 INFO:tasks.workunit.client.0.smithi002.stdout:4/291: dwrite d0/d10/d14/f4c [0,4194304] 0 2023-12-17T11:57:39.288 INFO:tasks.workunit.client.0.smithi002.stdout:4/292: readlink d0/d10/d14/l18 0 2023-12-17T11:57:39.297 INFO:tasks.workunit.client.1.smithi119.stdout:6/258: rmdir d2/d2b 39 2023-12-17T11:57:39.297 INFO:tasks.workunit.client.1.smithi119.stdout:3/311: creat d9/da/df/d41/d33/d5a/f79 x:0 0 0 2023-12-17T11:57:39.297 INFO:tasks.workunit.client.1.smithi119.stdout:3/312: chown d9/l71 1726315 1 2023-12-17T11:57:39.297 INFO:tasks.workunit.client.0.smithi002.stdout:9/314: dread dc/f14 [0,4194304] 0 2023-12-17T11:57:39.297 INFO:tasks.workunit.client.0.smithi002.stdout:9/315: readlink dc/d1d/l68 0 2023-12-17T11:57:39.297 INFO:tasks.workunit.client.0.smithi002.stdout:9/316: dread - dc/d1d/d23/f46 zero size 2023-12-17T11:57:39.299 INFO:tasks.workunit.client.0.smithi002.stdout:4/293: mknod d0/d10/d14/d27/d57/c61 0 2023-12-17T11:57:39.299 INFO:tasks.workunit.client.1.smithi119.stdout:0/192: rename d2/d3/d5/dc/c1d to d2/d16/d12/d1f/d24/c3a 0 2023-12-17T11:57:39.302 INFO:tasks.workunit.client.0.smithi002.stdout:8/308: sync 2023-12-17T11:57:39.302 INFO:tasks.workunit.client.0.smithi002.stdout:8/309: write d3/d7/f58 [4531162,30904] 0 2023-12-17T11:57:39.302 INFO:tasks.workunit.client.0.smithi002.stdout:8/310: dread - d3/d7/f63 zero size 2023-12-17T11:57:39.302 INFO:tasks.workunit.client.0.smithi002.stdout:1/344: sync 2023-12-17T11:57:39.304 INFO:tasks.workunit.client.0.smithi002.stdout:2/276: sync 2023-12-17T11:57:39.304 INFO:tasks.workunit.client.0.smithi002.stdout:3/331: sync 2023-12-17T11:57:39.304 INFO:tasks.workunit.client.0.smithi002.stdout:3/332: chown d9/d15/f66 61 1 2023-12-17T11:57:39.304 INFO:tasks.workunit.client.0.smithi002.stdout:6/263: dwrite d0/d1/fd [4194304,4194304] 0 2023-12-17T11:57:39.305 INFO:tasks.workunit.client.0.smithi002.stdout:2/277: write d3/d4/d7/d14/d1b/f26 [3842805,95764] 0 2023-12-17T11:57:39.305 INFO:tasks.workunit.client.0.smithi002.stdout:2/278: chown d3/d4/d17/l55 147550 1 2023-12-17T11:57:39.305 INFO:tasks.workunit.client.0.smithi002.stdout:2/279: stat d3/d4/d17/l2a 0 2023-12-17T11:57:39.306 INFO:tasks.workunit.client.1.smithi119.stdout:5/309: mkdir d1/d25/d39/d5a 0 2023-12-17T11:57:39.313 INFO:tasks.workunit.client.1.smithi119.stdout:2/288: rmdir d6/d9/d13/d61 0 2023-12-17T11:57:39.313 INFO:tasks.workunit.client.1.smithi119.stdout:1/182: write d3/fa [3858090,15081] 0 2023-12-17T11:57:39.321 INFO:tasks.workunit.client.1.smithi119.stdout:3/313: link d9/fc d9/d11/d1e/d55/d65/f7a 0 2023-12-17T11:57:39.326 INFO:tasks.workunit.client.0.smithi002.stdout:8/311: truncate d3/d8/da/dd/f2d 2399526 0 2023-12-17T11:57:39.326 INFO:tasks.workunit.client.0.smithi002.stdout:8/312: chown d3/d8/da/dd/c6b 323 1 2023-12-17T11:57:39.326 INFO:tasks.workunit.client.0.smithi002.stdout:8/313: chown d3/d7/d1a/f69 99 1 2023-12-17T11:57:39.326 INFO:tasks.workunit.client.0.smithi002.stdout:8/314: truncate d3/d8/f3d 4375267 0 2023-12-17T11:57:39.328 INFO:tasks.workunit.client.1.smithi119.stdout:0/193: creat d2/d3/d5/f3b x:0 0 0 2023-12-17T11:57:39.328 INFO:tasks.workunit.client.1.smithi119.stdout:0/194: chown d2/d16/d35/d39 34 1 2023-12-17T11:57:39.330 INFO:tasks.workunit.client.1.smithi119.stdout:5/310: read d1/d36/d3a/f4b [5936336,73541] 0 2023-12-17T11:57:39.330 INFO:tasks.workunit.client.1.smithi119.stdout:5/311: chown d1/d25/f2c 3745205 1 2023-12-17T11:57:39.330 INFO:tasks.workunit.client.1.smithi119.stdout:5/312: fdatasync d1/f17 0 2023-12-17T11:57:39.330 INFO:tasks.workunit.client.0.smithi002.stdout:1/345: mkdir d3/d6/d16/d6e 0 2023-12-17T11:57:39.331 INFO:tasks.workunit.client.0.smithi002.stdout:1/346: readlink d3/d6/ld 0 2023-12-17T11:57:39.331 INFO:tasks.workunit.client.1.smithi119.stdout:7/299: sync 2023-12-17T11:57:39.331 INFO:tasks.workunit.client.1.smithi119.stdout:4/255: sync 2023-12-17T11:57:39.331 INFO:tasks.workunit.client.1.smithi119.stdout:4/256: creat dd/d15/f53 x:0 0 0 2023-12-17T11:57:39.332 INFO:tasks.workunit.client.0.smithi002.stdout:5/225: dwrite dc/d17/f2c [0,4194304] 0 2023-12-17T11:57:39.332 INFO:tasks.workunit.client.1.smithi119.stdout:9/313: rmdir d12/d1d/d49 39 2023-12-17T11:57:39.332 INFO:tasks.workunit.client.1.smithi119.stdout:2/289: symlink d6/d2b/l66 0 2023-12-17T11:57:39.335 INFO:tasks.workunit.client.0.smithi002.stdout:6/264: unlink d0/d1/dc/l2f 0 2023-12-17T11:57:39.335 INFO:tasks.workunit.client.0.smithi002.stdout:6/265: fdatasync d0/d1/dc/ff 0 2023-12-17T11:57:39.338 INFO:tasks.workunit.client.1.smithi119.stdout:1/183: symlink d3/db/d17/d24/l38 0 2023-12-17T11:57:39.338 INFO:tasks.workunit.client.1.smithi119.stdout:1/184: fsync d3/db/d26/f21 0 2023-12-17T11:57:39.341 INFO:tasks.workunit.client.0.smithi002.stdout:2/280: mknod d3/d4/d7/c66 0 2023-12-17T11:57:39.350 INFO:tasks.workunit.client.1.smithi119.stdout:3/314: creat d9/d1c/f7b x:0 0 0 2023-12-17T11:57:39.354 INFO:tasks.workunit.client.0.smithi002.stdout:4/294: dwrite d0/d10/d21/f42 [0,4194304] 0 2023-12-17T11:57:39.355 INFO:tasks.workunit.client.1.smithi119.stdout:0/195: unlink d2/d3/d5/f3b 0 2023-12-17T11:57:39.356 INFO:tasks.workunit.client.1.smithi119.stdout:8/222: dwrite d7/d18/d15/f39 [0,4194304] 0 2023-12-17T11:57:39.357 INFO:tasks.workunit.client.1.smithi119.stdout:1/185: write d3/f4 [6879968,38284] 0 2023-12-17T11:57:39.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/303: dwrite d6/d17/dc/f51 [0,4194304] 0 2023-12-17T11:57:39.357 INFO:tasks.workunit.client.1.smithi119.stdout:5/313: mknod d1/d36/c5b 0 2023-12-17T11:57:39.364 INFO:tasks.workunit.client.0.smithi002.stdout:8/315: mkdir d3/d7/d18/d3f/d49/d6d 0 2023-12-17T11:57:39.367 INFO:tasks.workunit.client.0.smithi002.stdout:0/229: dwrite d0/d6/d26/f24 [0,4194304] 0 2023-12-17T11:57:39.367 INFO:tasks.workunit.client.0.smithi002.stdout:7/304: write d6/d17/dc/d13/f2d [237007,11899] 0 2023-12-17T11:57:39.370 INFO:tasks.workunit.client.1.smithi119.stdout:4/257: truncate f2 1703340 0 2023-12-17T11:57:39.370 INFO:tasks.workunit.client.0.smithi002.stdout:4/295: write d0/d10/d21/f49 [2777773,128345] 0 2023-12-17T11:57:39.372 INFO:tasks.workunit.client.1.smithi119.stdout:3/315: dread d9/da/df/f27 [0,4194304] 0 2023-12-17T11:57:39.372 INFO:tasks.workunit.client.1.smithi119.stdout:3/316: stat d9/f19 0 2023-12-17T11:57:39.375 INFO:tasks.workunit.client.0.smithi002.stdout:2/281: read d3/d50/f53 [6353685,92250] 0 2023-12-17T11:57:39.375 INFO:tasks.workunit.client.1.smithi119.stdout:9/314: rename d12/l15 to d12/d1d/d28/d46/l61 0 2023-12-17T11:57:39.375 INFO:tasks.workunit.client.1.smithi119.stdout:9/315: chown d12/d1d/f44 69718 1 2023-12-17T11:57:39.375 INFO:tasks.workunit.client.1.smithi119.stdout:9/316: fsync d12/d1d/d28/d46/f4e 0 2023-12-17T11:57:39.377 INFO:tasks.workunit.client.0.smithi002.stdout:6/266: dwrite d0/d1/f23 [0,4194304] 0 2023-12-17T11:57:39.377 INFO:tasks.workunit.client.1.smithi119.stdout:2/290: symlink d6/d38/l67 0 2023-12-17T11:57:39.379 INFO:tasks.workunit.client.1.smithi119.stdout:7/300: dwrite d2/d4/d11/d2c/f58 [0,4194304] 0 2023-12-17T11:57:39.380 INFO:tasks.workunit.client.1.smithi119.stdout:5/314: write d1/d25/d39/f3b [1062549,13696] 0 2023-12-17T11:57:39.386 INFO:tasks.workunit.client.0.smithi002.stdout:1/347: creat d3/d6/d16/d61/f6f x:0 0 0 2023-12-17T11:57:39.387 INFO:tasks.workunit.client.0.smithi002.stdout:1/348: readlink d3/d6/ld 0 2023-12-17T11:57:39.387 INFO:tasks.workunit.client.0.smithi002.stdout:1/349: stat d3/d6/d16/d28/l32 0 2023-12-17T11:57:39.387 INFO:tasks.workunit.client.0.smithi002.stdout:1/350: fdatasync d3/d6/fa 0 2023-12-17T11:57:39.391 INFO:tasks.workunit.client.1.smithi119.stdout:0/196: link d2/d16/d12/f1c d2/d16/d12/d1f/f3c 0 2023-12-17T11:57:39.391 INFO:tasks.workunit.client.1.smithi119.stdout:0/197: chown d2/d16/d12/d21/l38 482055204 1 2023-12-17T11:57:39.392 INFO:tasks.workunit.client.1.smithi119.stdout:5/315: dread d1/d25/f4f [0,4194304] 0 2023-12-17T11:57:39.393 INFO:tasks.workunit.client.0.smithi002.stdout:3/333: rmdir d9/d1b 39 2023-12-17T11:57:39.393 INFO:tasks.workunit.client.0.smithi002.stdout:4/296: dread d0/d10/f2d [0,4194304] 0 2023-12-17T11:57:39.394 INFO:tasks.workunit.client.1.smithi119.stdout:3/317: dread d9/da/df/f27 [0,4194304] 0 2023-12-17T11:57:39.394 INFO:tasks.workunit.client.1.smithi119.stdout:2/291: dread d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:39.395 INFO:tasks.workunit.client.1.smithi119.stdout:2/292: readlink d6/d2b/l31 0 2023-12-17T11:57:39.395 INFO:tasks.workunit.client.1.smithi119.stdout:2/293: stat d6/d9/d52/d53/d55 0 2023-12-17T11:57:39.395 INFO:tasks.workunit.client.0.smithi002.stdout:4/297: read d0/d10/d21/f54 [1209094,61550] 0 2023-12-17T11:57:39.395 INFO:tasks.workunit.client.0.smithi002.stdout:4/298: chown d0/d10/d14/d4e 573 1 2023-12-17T11:57:39.399 INFO:tasks.workunit.client.1.smithi119.stdout:8/223: link d7/ce d7/da/d11/c46 0 2023-12-17T11:57:39.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/186: link d3/db/d17/d24/f1a d3/db/d26/f39 0 2023-12-17T11:57:39.408 INFO:tasks.workunit.client.1.smithi119.stdout:4/258: creat dd/d4b/f54 x:0 0 0 2023-12-17T11:57:39.408 INFO:tasks.workunit.client.1.smithi119.stdout:4/259: truncate dd/d4b/f54 538955 0 2023-12-17T11:57:39.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:38 smithi119 ceph-mon[117414]: pgmap v22: 65 pgs: 65 active+clean; 947 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 82 MiB/s rd, 122 MiB/s wr, 886 op/s 2023-12-17T11:57:39.411 INFO:tasks.workunit.client.0.smithi002.stdout:8/316: mkdir d3/d7/d6e 0 2023-12-17T11:57:39.413 INFO:tasks.workunit.client.1.smithi119.stdout:9/317: truncate d12/f23 3397621 0 2023-12-17T11:57:39.413 INFO:tasks.workunit.client.1.smithi119.stdout:9/318: write d12/d1d/d49/f57 [1011525,75792] 0 2023-12-17T11:57:39.417 INFO:tasks.workunit.client.0.smithi002.stdout:0/230: creat d0/d6/d26/d14/d19/d37/f4d x:0 0 0 2023-12-17T11:57:39.417 INFO:tasks.workunit.client.0.smithi002.stdout:0/231: creat d0/d6/d26/d14/d19/d2f/f4e x:0 0 0 2023-12-17T11:57:39.418 INFO:tasks.workunit.client.0.smithi002.stdout:1/351: dread d3/d6/d9/d37/d39/d43/d4a/f5f [0,4194304] 0 2023-12-17T11:57:39.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/282: truncate d3/d4/d7/d14/d34/f46 220703 0 2023-12-17T11:57:39.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/283: fdatasync d3/d4/fd 0 2023-12-17T11:57:39.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/284: fsync d3/d4/d7/d14/d1b/f29 0 2023-12-17T11:57:39.421 INFO:tasks.workunit.client.0.smithi002.stdout:2/285: write d3/d4/fe [2687554,2307] 0 2023-12-17T11:57:39.424 INFO:tasks.workunit.client.0.smithi002.stdout:7/305: dwrite d6/d17/dc/d13/d3e/f4b [0,4194304] 0 2023-12-17T11:57:39.424 INFO:tasks.workunit.client.0.smithi002.stdout:6/267: dwrite d0/d1/dc/d10/f14 [0,4194304] 0 2023-12-17T11:57:39.427 INFO:tasks.workunit.client.1.smithi119.stdout:7/301: unlink d2/d4/f38 0 2023-12-17T11:57:39.428 INFO:tasks.workunit.client.1.smithi119.stdout:5/316: creat d1/d25/d39/f5c x:0 0 0 2023-12-17T11:57:39.429 INFO:tasks.workunit.client.0.smithi002.stdout:3/334: truncate d9/d15/f22 1193367 0 2023-12-17T11:57:39.429 INFO:tasks.workunit.client.0.smithi002.stdout:3/335: creat d9/d24/f6d x:0 0 0 2023-12-17T11:57:39.431 INFO:tasks.workunit.client.1.smithi119.stdout:3/318: rename d9/d11/d1e/f69 to d9/da/df/d41/d74/f7c 0 2023-12-17T11:57:39.431 INFO:tasks.workunit.client.1.smithi119.stdout:3/319: write d9/d11/d1e/f3e [1485149,14887] 0 2023-12-17T11:57:39.433 INFO:tasks.workunit.client.0.smithi002.stdout:5/226: getdents dc/d17 0 2023-12-17T11:57:39.436 INFO:tasks.workunit.client.1.smithi119.stdout:2/294: creat d6/d9/d52/d53/d55/d58/f68 x:0 0 0 2023-12-17T11:57:39.436 INFO:tasks.workunit.client.1.smithi119.stdout:2/295: fdatasync d6/d9/d52/d53/d55/f4c 0 2023-12-17T11:57:39.437 INFO:tasks.workunit.client.0.smithi002.stdout:4/299: mknod d0/d5a/c62 0 2023-12-17T11:57:39.438 INFO:tasks.workunit.client.1.smithi119.stdout:8/224: link d7/d12/l2d d7/d18/l47 0 2023-12-17T11:57:39.441 INFO:tasks.workunit.client.1.smithi119.stdout:4/260: mkdir dd/d2a/d55 0 2023-12-17T11:57:39.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/352: symlink d3/d2f/d4d/l70 0 2023-12-17T11:57:39.445 INFO:tasks.workunit.client.1.smithi119.stdout:5/317: link d1/d44/d52/l58 d1/d36/d57/l5d 0 2023-12-17T11:57:39.449 INFO:tasks.workunit.client.0.smithi002.stdout:2/286: getdents d3/d4/d7/d14/d2e/d37/d3f 0 2023-12-17T11:57:39.449 INFO:tasks.workunit.client.0.smithi002.stdout:2/287: chown d3/d4/d7/d14/c2c 32376 1 2023-12-17T11:57:39.451 INFO:tasks.workunit.client.1.smithi119.stdout:3/320: unlink d9/da/df/d41/d33/d5a/f79 0 2023-12-17T11:57:39.455 INFO:tasks.workunit.client.1.smithi119.stdout:1/187: rename d3/d36 to d3/db/d17/d24/d20/d3a 0 2023-12-17T11:57:39.455 INFO:tasks.workunit.client.1.smithi119.stdout:1/188: write d3/db/d26/f1d [1644219,21395] 0 2023-12-17T11:57:39.455 INFO:tasks.workunit.client.1.smithi119.stdout:1/189: fdatasync d3/db/d26/f39 0 2023-12-17T11:57:39.457 INFO:tasks.workunit.client.1.smithi119.stdout:2/296: link d6/d9/d13/d34/f43 d6/d9/d52/f69 0 2023-12-17T11:57:39.462 INFO:tasks.workunit.client.1.smithi119.stdout:5/318: mknod d1/d36/c5e 0 2023-12-17T11:57:39.464 INFO:tasks.workunit.client.0.smithi002.stdout:3/336: creat d9/d40/f6e x:0 0 0 2023-12-17T11:57:39.465 INFO:tasks.workunit.client.1.smithi119.stdout:0/198: dwrite d2/d16/d12/f1a [0,4194304] 0 2023-12-17T11:57:39.465 INFO:tasks.workunit.client.1.smithi119.stdout:0/199: readlink d2/d16/l33 0 2023-12-17T11:57:39.471 INFO:tasks.workunit.client.0.smithi002.stdout:5/227: link dc/d2b/l39 dc/d2b/l42 0 2023-12-17T11:57:39.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/300: creat d0/d3e/d56/f63 x:0 0 0 2023-12-17T11:57:39.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/301: stat d0/d10/f4b 0 2023-12-17T11:57:39.474 INFO:tasks.workunit.client.1.smithi119.stdout:9/319: rename d12/d1d/d28/f43 to d12/d1d/d28/d46/d50/f62 0 2023-12-17T11:57:39.474 INFO:tasks.workunit.client.1.smithi119.stdout:9/320: chown d12/d1d/d28/d46/d50/f60 1 1 2023-12-17T11:57:39.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/353: symlink d3/d2f/l71 0 2023-12-17T11:57:39.480 INFO:tasks.workunit.client.0.smithi002.stdout:2/288: creat d3/d4/d17/d19/f67 x:0 0 0 2023-12-17T11:57:39.481 INFO:tasks.workunit.client.0.smithi002.stdout:2/289: dread - d3/d4/d7/d14/d1b/d5b/f63 zero size 2023-12-17T11:57:39.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/306: write d6/d17/dc/d13/d3e/f4b [4897921,18142] 0 2023-12-17T11:57:39.487 INFO:tasks.workunit.client.0.smithi002.stdout:1/354: link d3/d6/f42 d3/d6/d9/d37/d39/d43/d4a/f72 0 2023-12-17T11:57:39.488 INFO:tasks.workunit.client.0.smithi002.stdout:4/302: mknod d0/d10/d14/d27/c64 0 2023-12-17T11:57:39.492 INFO:tasks.workunit.client.0.smithi002.stdout:2/290: symlink d3/d4/l68 0 2023-12-17T11:57:39.492 INFO:tasks.workunit.client.0.smithi002.stdout:2/291: creat d3/d4/d7/d14/d2e/f69 x:0 0 0 2023-12-17T11:57:39.498 INFO:tasks.workunit.client.1.smithi119.stdout:8/225: rename l6 to d7/l48 0 2023-12-17T11:57:39.501 INFO:tasks.workunit.client.0.smithi002.stdout:1/355: creat d3/d6/d9/d37/f73 x:0 0 0 2023-12-17T11:57:39.505 INFO:tasks.workunit.client.1.smithi119.stdout:4/261: rename dd/d15/d16/d20/l47 to dd/d15/d16/d20/d42/l56 0 2023-12-17T11:57:39.508 INFO:tasks.workunit.client.0.smithi002.stdout:2/292: mknod d3/d4/d17/d19/d4d/c6a 0 2023-12-17T11:57:39.508 INFO:tasks.workunit.client.0.smithi002.stdout:1/356: rmdir d3/d6/d16/d6e 0 2023-12-17T11:57:39.508 INFO:tasks.workunit.client.0.smithi002.stdout:1/357: write d3/d6/d9/f35 [577866,49389] 0 2023-12-17T11:57:39.508 INFO:tasks.workunit.client.0.smithi002.stdout:1/358: write d3/d5c/f5d [2563180,60667] 0 2023-12-17T11:57:39.513 INFO:tasks.workunit.client.1.smithi119.stdout:3/321: rename l8 to d9/da/l7d 0 2023-12-17T11:57:39.513 INFO:tasks.workunit.client.1.smithi119.stdout:7/302: dwrite d2/d4/d11/d3c/f4d [0,4194304] 0 2023-12-17T11:57:39.514 INFO:tasks.workunit.client.0.smithi002.stdout:0/232: dwrite d0/d15/f27 [0,4194304] 0 2023-12-17T11:57:39.514 INFO:tasks.workunit.client.0.smithi002.stdout:0/233: chown d0/d6/d26/d25/f46 458186388 1 2023-12-17T11:57:39.514 INFO:tasks.workunit.client.0.smithi002.stdout:5/228: dread dc/d2b/f38 [0,4194304] 0 2023-12-17T11:57:39.514 INFO:tasks.workunit.client.0.smithi002.stdout:0/234: truncate d0/d6/d26/d14/d19/d37/f4d 287509 0 2023-12-17T11:57:39.514 INFO:tasks.workunit.client.0.smithi002.stdout:6/268: dwrite d0/d1/dc/d10/f37 [4194304,4194304] 0 2023-12-17T11:57:39.521 INFO:tasks.workunit.client.1.smithi119.stdout:7/303: rename d2/d4/d11/d2c/c32 to d2/d4/d11/d2c/c5d 0 2023-12-17T11:57:39.525 INFO:tasks.workunit.client.1.smithi119.stdout:2/297: rename d6/c7 to d6/d9/d52/d53/d55/d58/c6a 0 2023-12-17T11:57:39.526 INFO:tasks.workunit.client.0.smithi002.stdout:7/307: dread d6/d17/f1a [4194304,4194304] 0 2023-12-17T11:57:39.529 INFO:tasks.workunit.client.1.smithi119.stdout:3/322: dread d9/fc [0,4194304] 0 2023-12-17T11:57:39.529 INFO:tasks.workunit.client.1.smithi119.stdout:3/323: creat d9/d11/d1e/d55/f7e x:0 0 0 2023-12-17T11:57:39.530 INFO:tasks.workunit.client.1.smithi119.stdout:2/298: mkdir d6/d9/d52/d53/d55/d58/d6b 0 2023-12-17T11:57:39.532 INFO:tasks.workunit.client.1.smithi119.stdout:2/299: getdents d6/d2b/d3f/d5c 0 2023-12-17T11:57:39.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/337: dwrite d9/d1b/f5e [0,4194304] 0 2023-12-17T11:57:39.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/338: write d9/d24/f6d [593022,50781] 0 2023-12-17T11:57:39.533 INFO:tasks.workunit.client.0.smithi002.stdout:3/339: fsync d9/f1d 0 2023-12-17T11:57:39.534 INFO:tasks.workunit.client.0.smithi002.stdout:2/293: mknod d3/d4/c6b 0 2023-12-17T11:57:39.539 INFO:tasks.workunit.client.1.smithi119.stdout:4/262: write dd/f28 [1138313,85558] 0 2023-12-17T11:57:39.539 INFO:tasks.workunit.client.1.smithi119.stdout:9/321: dwrite d12/f17 [0,4194304] 0 2023-12-17T11:57:39.543 INFO:tasks.workunit.client.1.smithi119.stdout:1/190: dwrite d3/db/d17/f1b [0,4194304] 0 2023-12-17T11:57:39.543 INFO:tasks.workunit.client.1.smithi119.stdout:0/200: dwrite d2/d16/d12/f32 [0,4194304] 0 2023-12-17T11:57:39.544 INFO:tasks.workunit.client.1.smithi119.stdout:0/201: write d2/d16/d12/d1f/f22 [4987830,38634] 0 2023-12-17T11:57:39.544 INFO:tasks.workunit.client.1.smithi119.stdout:5/319: dwrite d1/f17 [0,4194304] 0 2023-12-17T11:57:39.545 INFO:tasks.workunit.client.1.smithi119.stdout:5/320: creat d1/d44/d52/f5f x:0 0 0 2023-12-17T11:57:39.545 INFO:tasks.workunit.client.1.smithi119.stdout:4/263: unlink dd/f4d 0 2023-12-17T11:57:39.548 INFO:tasks.workunit.client.1.smithi119.stdout:7/304: read d2/d4/d1f/f5c [3917285,58592] 0 2023-12-17T11:57:39.548 INFO:tasks.workunit.client.1.smithi119.stdout:7/305: truncate d2/f26 216780 0 2023-12-17T11:57:39.550 INFO:tasks.workunit.client.1.smithi119.stdout:6/259: sync 2023-12-17T11:57:39.552 INFO:tasks.workunit.client.0.smithi002.stdout:7/308: symlink d6/d17/dc/d13/d21/l59 0 2023-12-17T11:57:39.552 INFO:tasks.workunit.client.0.smithi002.stdout:3/340: mkdir d9/d24/d6f 0 2023-12-17T11:57:39.552 INFO:tasks.workunit.client.0.smithi002.stdout:3/341: dread - d9/d40/f6e zero size 2023-12-17T11:57:39.552 INFO:tasks.workunit.client.0.smithi002.stdout:6/269: dread d0/d1/f23 [0,4194304] 0 2023-12-17T11:57:39.553 INFO:tasks.workunit.client.0.smithi002.stdout:0/235: rename d0/d6/d26/f20 to d0/d15/f4f 0 2023-12-17T11:57:39.559 INFO:tasks.workunit.client.1.smithi119.stdout:0/202: rmdir d2/d16/d12/d21 39 2023-12-17T11:57:39.562 INFO:tasks.workunit.client.0.smithi002.stdout:7/309: truncate d6/f3b 196034 0 2023-12-17T11:57:39.562 INFO:tasks.workunit.client.0.smithi002.stdout:7/310: chown d6/d17/dc/l46 0 1 2023-12-17T11:57:39.562 INFO:tasks.workunit.client.1.smithi119.stdout:1/191: mknod d3/db/d26/d19/c3b 0 2023-12-17T11:57:39.563 INFO:tasks.workunit.client.1.smithi119.stdout:1/192: write d3/db/f2b [2522365,126976] 0 2023-12-17T11:57:39.563 INFO:tasks.workunit.client.1.smithi119.stdout:2/300: dread d6/d9/fd [0,4194304] 0 2023-12-17T11:57:39.563 INFO:tasks.workunit.client.1.smithi119.stdout:2/301: chown d6/c36 471854 1 2023-12-17T11:57:39.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/342: rmdir d9/d1b/d35 39 2023-12-17T11:57:39.565 INFO:tasks.workunit.client.0.smithi002.stdout:3/343: read d9/f1e [149135,116842] 0 2023-12-17T11:57:39.568 INFO:tasks.workunit.client.1.smithi119.stdout:1/193: write d3/db/d17/d24/f37 [127962,95826] 0 2023-12-17T11:57:39.569 INFO:tasks.workunit.client.0.smithi002.stdout:6/270: unlink d0/d1/dc/d10/f14 0 2023-12-17T11:57:39.570 INFO:tasks.workunit.client.1.smithi119.stdout:5/321: symlink d1/d25/d39/l60 0 2023-12-17T11:57:39.573 INFO:tasks.workunit.client.0.smithi002.stdout:7/311: creat d6/d17/dc/d13/d21/d2e/f5a x:0 0 0 2023-12-17T11:57:39.573 INFO:tasks.workunit.client.0.smithi002.stdout:7/312: stat d6/d17/d16/l2f 0 2023-12-17T11:57:39.573 INFO:tasks.workunit.client.0.smithi002.stdout:7/313: read d6/d17/dc/d13/f2d [1307841,366] 0 2023-12-17T11:57:39.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/314: chown d6/d17/dc/d13/d37/d4c/d24/f43 12333 1 2023-12-17T11:57:39.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/315: fsync d6/f1c 0 2023-12-17T11:57:39.574 INFO:tasks.workunit.client.1.smithi119.stdout:7/306: read d2/d4/f16 [169494,125857] 0 2023-12-17T11:57:39.574 INFO:tasks.workunit.client.1.smithi119.stdout:4/264: mknod dd/d15/d16/c57 0 2023-12-17T11:57:39.574 INFO:tasks.workunit.client.1.smithi119.stdout:4/265: creat dd/d15/d16/f58 x:0 0 0 2023-12-17T11:57:39.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/266: fsync dd/d15/d16/f1e 0 2023-12-17T11:57:39.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/267: write dd/f41 [782824,35876] 0 2023-12-17T11:57:39.576 INFO:tasks.workunit.client.0.smithi002.stdout:3/344: symlink d9/d40/l70 0 2023-12-17T11:57:39.577 INFO:tasks.workunit.client.0.smithi002.stdout:4/303: dwrite d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:39.580 INFO:tasks.workunit.client.1.smithi119.stdout:6/260: unlink d2/df/l39 0 2023-12-17T11:57:39.582 INFO:tasks.workunit.client.0.smithi002.stdout:3/345: getdents d9/d1b/d35/d41 0 2023-12-17T11:57:39.587 INFO:tasks.workunit.client.1.smithi119.stdout:5/322: unlink d1/l22 0 2023-12-17T11:57:39.588 INFO:tasks.workunit.client.0.smithi002.stdout:1/359: dwrite d3/d2f/f48 [4194304,4194304] 0 2023-12-17T11:57:39.588 INFO:tasks.workunit.client.0.smithi002.stdout:1/360: write d3/d6/d9/d37/f6c [487916,32599] 0 2023-12-17T11:57:39.590 INFO:tasks.workunit.client.0.smithi002.stdout:5/229: dwrite dc/f3e [0,4194304] 0 2023-12-17T11:57:39.591 INFO:tasks.workunit.client.1.smithi119.stdout:3/324: dwrite d9/da/df/f32 [0,4194304] 0 2023-12-17T11:57:39.591 INFO:tasks.workunit.client.1.smithi119.stdout:7/307: mknod d2/d4/d1f/c5e 0 2023-12-17T11:57:39.591 INFO:tasks.workunit.client.1.smithi119.stdout:4/268: dread dd/f32 [0,4194304] 0 2023-12-17T11:57:39.591 INFO:tasks.workunit.client.0.smithi002.stdout:6/271: write d0/d1/fd [5989316,31197] 0 2023-12-17T11:57:39.596 INFO:tasks.workunit.client.1.smithi119.stdout:6/261: creat d2/df/d17/f50 x:0 0 0 2023-12-17T11:57:39.596 INFO:tasks.workunit.client.1.smithi119.stdout:6/262: write d2/d2b/f4c [802755,93807] 0 2023-12-17T11:57:39.601 INFO:tasks.workunit.client.1.smithi119.stdout:0/203: getdents d2/d3/d5 0 2023-12-17T11:57:39.611 INFO:tasks.workunit.client.0.smithi002.stdout:4/304: mkdir d0/d3e/d56/d65 0 2023-12-17T11:57:39.612 INFO:tasks.workunit.client.1.smithi119.stdout:4/269: write dd/d11/d26/f36 [2728843,46601] 0 2023-12-17T11:57:39.612 INFO:tasks.workunit.client.1.smithi119.stdout:4/270: fdatasync dd/f28 0 2023-12-17T11:57:39.613 INFO:tasks.workunit.client.0.smithi002.stdout:1/361: mkdir d3/d2f/d74 0 2023-12-17T11:57:39.618 INFO:tasks.workunit.client.1.smithi119.stdout:3/325: read d9/d11/d1e/f6f [560948,113933] 0 2023-12-17T11:57:39.621 INFO:tasks.workunit.client.0.smithi002.stdout:5/230: link dc/d17/d2f/f34 dc/d17/d2f/f43 0 2023-12-17T11:57:39.628 INFO:tasks.workunit.client.0.smithi002.stdout:1/362: rename d3/d6/d16/f52 to d3/d6/d9/d37/d39/d43/d4a/f75 0 2023-12-17T11:57:39.628 INFO:tasks.workunit.client.0.smithi002.stdout:1/363: truncate d3/d6/d16/f31 989601 0 2023-12-17T11:57:39.630 INFO:tasks.workunit.client.1.smithi119.stdout:7/308: link d2/d4/d1f/c5e d2/d4e/c5f 0 2023-12-17T11:57:39.631 INFO:tasks.workunit.client.0.smithi002.stdout:1/364: read d3/d6/d16/f46 [315896,86610] 0 2023-12-17T11:57:39.633 INFO:tasks.workunit.client.0.smithi002.stdout:0/236: dwrite d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:39.633 INFO:tasks.workunit.client.1.smithi119.stdout:6/263: unlink d2/df/f36 0 2023-12-17T11:57:39.635 INFO:tasks.workunit.client.1.smithi119.stdout:0/204: unlink d2/d16/d12/d1f/f3c 0 2023-12-17T11:57:39.635 INFO:tasks.workunit.client.1.smithi119.stdout:0/205: readlink d2/d16/d12/d21/l38 0 2023-12-17T11:57:39.637 INFO:tasks.workunit.client.0.smithi002.stdout:0/237: link d0/d6/d26/d14/c34 d0/d6/d26/d25/c50 0 2023-12-17T11:57:39.639 INFO:tasks.workunit.client.1.smithi119.stdout:4/271: symlink dd/d15/l59 0 2023-12-17T11:57:39.641 INFO:tasks.workunit.client.1.smithi119.stdout:1/194: dwrite d3/db/f22 [0,4194304] 0 2023-12-17T11:57:39.642 INFO:tasks.workunit.client.0.smithi002.stdout:0/238: unlink d0/d6/d26/d14/d19/d2b/c49 0 2023-12-17T11:57:39.642 INFO:tasks.workunit.client.0.smithi002.stdout:0/239: read d0/d15/f32 [59027,50887] 0 2023-12-17T11:57:39.642 INFO:tasks.workunit.client.0.smithi002.stdout:0/240: fsync d0/d6/d26/f35 0 2023-12-17T11:57:39.644 INFO:tasks.workunit.client.1.smithi119.stdout:5/323: symlink d1/d25/l61 0 2023-12-17T11:57:39.644 INFO:tasks.workunit.client.1.smithi119.stdout:7/309: symlink d2/d40/l60 0 2023-12-17T11:57:39.644 INFO:tasks.workunit.client.0.smithi002.stdout:0/241: mkdir d0/d33/d51 0 2023-12-17T11:57:39.647 INFO:tasks.workunit.client.1.smithi119.stdout:0/206: unlink d2/c7 0 2023-12-17T11:57:39.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/231: write fb [1277712,58156] 0 2023-12-17T11:57:39.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/232: dread - dc/d17/d2f/f34 zero size 2023-12-17T11:57:39.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/233: chown dc/d2b/c3c 2376535 1 2023-12-17T11:57:39.648 INFO:tasks.workunit.client.0.smithi002.stdout:5/234: truncate dc/d17/d2f/f3a 857926 0 2023-12-17T11:57:39.650 INFO:tasks.workunit.client.1.smithi119.stdout:6/264: write d2/d2b/f2d [2932011,103114] 0 2023-12-17T11:57:39.651 INFO:tasks.workunit.client.1.smithi119.stdout:4/272: unlink dd/d15/d16/d20/c44 0 2023-12-17T11:57:39.652 INFO:tasks.workunit.client.0.smithi002.stdout:0/242: creat d0/d6/d26/d14/d19/d4c/f52 x:0 0 0 2023-12-17T11:57:39.652 INFO:tasks.workunit.client.0.smithi002.stdout:0/243: creat d0/d6/d26/d14/f53 x:0 0 0 2023-12-17T11:57:39.653 INFO:tasks.workunit.client.1.smithi119.stdout:5/324: unlink d1/cf 0 2023-12-17T11:57:39.655 INFO:tasks.workunit.client.1.smithi119.stdout:7/310: unlink d2/d4/c4f 0 2023-12-17T11:57:39.656 INFO:tasks.workunit.client.0.smithi002.stdout:7/316: dwrite d6/d17/dc/d13/f2d [0,4194304] 0 2023-12-17T11:57:39.658 INFO:tasks.workunit.client.0.smithi002.stdout:5/235: dread dc/f18 [0,4194304] 0 2023-12-17T11:57:39.659 INFO:tasks.workunit.client.1.smithi119.stdout:9/322: dwrite d12/d1d/d49/f52 [0,4194304] 0 2023-12-17T11:57:39.662 INFO:tasks.workunit.client.0.smithi002.stdout:6/272: dwrite d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:39.666 INFO:tasks.workunit.client.0.smithi002.stdout:1/365: dread d3/d6/fa [0,4194304] 0 2023-12-17T11:57:39.666 INFO:tasks.workunit.client.0.smithi002.stdout:1/366: chown d3/d6/l25 0 1 2023-12-17T11:57:39.669 INFO:tasks.workunit.client.1.smithi119.stdout:4/273: truncate dd/d11/f14 3928248 0 2023-12-17T11:57:39.669 INFO:tasks.workunit.client.1.smithi119.stdout:7/311: symlink d2/d4/d11/d2c/d55/l61 0 2023-12-17T11:57:39.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/305: dwrite d0/d10/d14/f59 [0,4194304] 0 2023-12-17T11:57:39.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/306: fsync d0/d10/d21/f48 0 2023-12-17T11:57:39.671 INFO:tasks.workunit.client.0.smithi002.stdout:4/307: chown d0/d10/d21/d33/f45 66 1 2023-12-17T11:57:39.672 INFO:tasks.workunit.client.1.smithi119.stdout:9/323: stat c1 0 2023-12-17T11:57:39.674 INFO:tasks.workunit.client.0.smithi002.stdout:7/317: symlink d6/d17/dc/d13/d21/d2e/d4a/d53/l5b 0 2023-12-17T11:57:39.675 INFO:tasks.workunit.client.0.smithi002.stdout:7/318: readlink d6/d17/dc/d13/d37/d4f/l54 0 2023-12-17T11:57:39.676 INFO:tasks.workunit.client.0.smithi002.stdout:8/317: sync 2023-12-17T11:57:39.676 INFO:tasks.workunit.client.0.smithi002.stdout:9/317: sync 2023-12-17T11:57:39.681 INFO:tasks.workunit.client.1.smithi119.stdout:5/325: mknod d1/d25/c62 0 2023-12-17T11:57:39.685 INFO:tasks.workunit.client.1.smithi119.stdout:9/324: truncate d12/f23 2017209 0 2023-12-17T11:57:39.688 INFO:tasks.workunit.client.0.smithi002.stdout:1/367: mknod d3/d6/d9/c76 0 2023-12-17T11:57:39.693 INFO:tasks.workunit.client.0.smithi002.stdout:4/308: unlink d0/d10/l29 0 2023-12-17T11:57:39.695 INFO:tasks.workunit.client.1.smithi119.stdout:4/274: write dd/d15/f2e [1263435,53036] 0 2023-12-17T11:57:39.697 INFO:tasks.workunit.client.0.smithi002.stdout:7/319: symlink d6/d17/dc/d13/d21/l5c 0 2023-12-17T11:57:39.698 INFO:tasks.workunit.client.1.smithi119.stdout:6/265: rmdir d2/df 39 2023-12-17T11:57:39.698 INFO:tasks.workunit.client.1.smithi119.stdout:6/266: chown d2/df/c1c 79 1 2023-12-17T11:57:39.703 INFO:tasks.workunit.client.1.smithi119.stdout:3/326: dwrite d9/d11/d1e/f3e [0,4194304] 0 2023-12-17T11:57:39.704 INFO:tasks.workunit.client.0.smithi002.stdout:4/309: dread d0/d10/d21/d33/f45 [0,4194304] 0 2023-12-17T11:57:39.705 INFO:tasks.workunit.client.1.smithi119.stdout:1/195: dwrite d3/db/d17/d24/f37 [0,4194304] 0 2023-12-17T11:57:39.705 INFO:tasks.workunit.client.1.smithi119.stdout:1/196: readlink d3/db/d17/d24/l38 0 2023-12-17T11:57:39.705 INFO:tasks.workunit.client.1.smithi119.stdout:9/325: truncate d12/d1d/d28/d46/d50/f62 3921560 0 2023-12-17T11:57:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:6/273: dread d0/d1/f23 [0,4194304] 0 2023-12-17T11:57:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:5/236: dwrite dc/d17/d2f/f3a [0,4194304] 0 2023-12-17T11:57:39.707 INFO:tasks.workunit.client.0.smithi002.stdout:9/318: write f1 [3930346,23798] 0 2023-12-17T11:57:39.711 INFO:tasks.workunit.client.1.smithi119.stdout:4/275: unlink dd/d11/d26/l43 0 2023-12-17T11:57:39.713 INFO:tasks.workunit.client.1.smithi119.stdout:6/267: dread d2/f9 [0,4194304] 0 2023-12-17T11:57:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:0/244: dwrite d0/d6/d26/f3b [0,4194304] 0 2023-12-17T11:57:39.714 INFO:tasks.workunit.client.0.smithi002.stdout:0/245: stat d0/d6/d26/f24 0 2023-12-17T11:57:39.719 INFO:tasks.workunit.client.1.smithi119.stdout:5/326: mknod d1/d25/c63 0 2023-12-17T11:57:39.721 INFO:tasks.workunit.client.1.smithi119.stdout:3/327: mknod d9/d11/c7f 0 2023-12-17T11:57:39.726 INFO:tasks.workunit.client.0.smithi002.stdout:5/237: read dc/f3e [3741349,102207] 0 2023-12-17T11:57:39.726 INFO:tasks.workunit.client.0.smithi002.stdout:8/318: symlink d3/d8/d28/d31/l6f 0 2023-12-17T11:57:39.726 INFO:tasks.workunit.client.0.smithi002.stdout:1/368: link d3/d6/d9/f35 d3/d6/d9/d37/d39/d43/d4a/f77 0 2023-12-17T11:57:39.727 INFO:tasks.workunit.client.0.smithi002.stdout:0/246: dread d0/d6/d26/f3b [0,4194304] 0 2023-12-17T11:57:39.728 INFO:tasks.workunit.client.0.smithi002.stdout:4/310: mknod d0/d10/d21/d33/c66 0 2023-12-17T11:57:39.730 INFO:tasks.workunit.client.1.smithi119.stdout:0/207: dwrite d2/d16/d12/f25 [0,4194304] 0 2023-12-17T11:57:39.731 INFO:tasks.workunit.client.1.smithi119.stdout:4/276: mkdir dd/d15/d16/d5a 0 2023-12-17T11:57:39.733 INFO:tasks.workunit.client.0.smithi002.stdout:7/320: write d6/d17/dc/d13/d21/f3f [734192,127625] 0 2023-12-17T11:57:39.733 INFO:tasks.workunit.client.0.smithi002.stdout:7/321: write d6/d17/dc/d13/f14 [1027291,28499] 0 2023-12-17T11:57:39.734 INFO:tasks.workunit.client.1.smithi119.stdout:3/328: rename d9/da/df/d41/d33/d3a/f3d to d9/da/df/d41/d74/f80 0 2023-12-17T11:57:39.736 INFO:tasks.workunit.client.0.smithi002.stdout:6/274: rename d0/d1/dc/d17/d40/c4b to d0/d1/dc/d17/d40/c51 0 2023-12-17T11:57:39.736 INFO:tasks.workunit.client.0.smithi002.stdout:6/275: fdatasync d0/d1/dc/d17/d40/f4e 0 2023-12-17T11:57:39.739 INFO:tasks.workunit.client.0.smithi002.stdout:1/369: dread d3/d6/d9/f35 [0,4194304] 0 2023-12-17T11:57:39.739 INFO:tasks.workunit.client.0.smithi002.stdout:1/370: fsync d3/d6/d9/d30/f41 0 2023-12-17T11:57:39.739 INFO:tasks.workunit.client.1.smithi119.stdout:1/197: rmdir d3 39 2023-12-17T11:57:39.740 INFO:tasks.workunit.client.1.smithi119.stdout:1/198: dread - d3/db/d17/d24/f2e zero size 2023-12-17T11:57:39.740 INFO:tasks.workunit.client.0.smithi002.stdout:9/319: creat dc/d32/f71 x:0 0 0 2023-12-17T11:57:39.742 INFO:tasks.workunit.client.1.smithi119.stdout:6/268: write d2/f9 [501154,55226] 0 2023-12-17T11:57:39.744 INFO:tasks.workunit.client.1.smithi119.stdout:0/208: creat d2/d3/f3d x:0 0 0 2023-12-17T11:57:39.746 INFO:tasks.workunit.client.0.smithi002.stdout:0/247: dread d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:39.746 INFO:tasks.workunit.client.0.smithi002.stdout:0/248: dread - d0/d6/d26/d25/f31 zero size 2023-12-17T11:57:39.746 INFO:tasks.workunit.client.0.smithi002.stdout:0/249: fsync d0/d6/d26/d14/d19/d37/f4d 0 2023-12-17T11:57:39.746 INFO:tasks.workunit.client.1.smithi119.stdout:4/277: getdents dd/d15/d16/d20/d42 0 2023-12-17T11:57:39.747 INFO:tasks.workunit.client.1.smithi119.stdout:4/278: readlink dd/d15/d16/d20/l2c 0 2023-12-17T11:57:39.747 INFO:tasks.workunit.client.1.smithi119.stdout:4/279: readlink dd/d15/d16/d20/l48 0 2023-12-17T11:57:39.747 INFO:tasks.workunit.client.1.smithi119.stdout:4/280: chown f4 2 1 2023-12-17T11:57:39.747 INFO:tasks.workunit.client.0.smithi002.stdout:5/238: fdatasync fb 0 2023-12-17T11:57:39.747 INFO:tasks.workunit.client.0.smithi002.stdout:8/319: write d3/d7/d18/d3f/f57 [469229,71643] 0 2023-12-17T11:57:39.747 INFO:tasks.workunit.client.0.smithi002.stdout:4/311: unlink d0/f55 0 2023-12-17T11:57:39.748 INFO:tasks.workunit.client.1.smithi119.stdout:3/329: symlink d9/da/df/l81 0 2023-12-17T11:57:39.751 INFO:tasks.workunit.client.0.smithi002.stdout:7/322: creat d6/d17/d16/f5d x:0 0 0 2023-12-17T11:57:39.752 INFO:tasks.workunit.client.0.smithi002.stdout:1/371: truncate d3/d6/d9/f13 5205729 0 2023-12-17T11:57:39.755 INFO:tasks.workunit.client.1.smithi119.stdout:1/199: creat d3/db/d17/d24/f3c x:0 0 0 2023-12-17T11:57:39.755 INFO:tasks.workunit.client.1.smithi119.stdout:1/200: chown d3/db/d17/d24/d20/f2d 98577 1 2023-12-17T11:57:39.755 INFO:tasks.workunit.client.1.smithi119.stdout:9/326: dwrite d12/d1d/f5d [0,4194304] 0 2023-12-17T11:57:39.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/320: mkdir dc/d42/d4f/d59/d49/d72 0 2023-12-17T11:57:39.756 INFO:tasks.workunit.client.0.smithi002.stdout:3/346: sync 2023-12-17T11:57:39.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/321: creat dc/d1d/d23/f73 x:0 0 0 2023-12-17T11:57:39.756 INFO:tasks.workunit.client.0.smithi002.stdout:2/294: sync 2023-12-17T11:57:39.758 INFO:tasks.workunit.client.1.smithi119.stdout:6/269: link d2/df/c3e d2/d2b/c51 0 2023-12-17T11:57:39.759 INFO:tasks.workunit.client.0.smithi002.stdout:5/239: symlink dc/d1a/l44 0 2023-12-17T11:57:39.760 INFO:tasks.workunit.client.0.smithi002.stdout:5/240: truncate dc/d17/f26 1835935 0 2023-12-17T11:57:39.760 INFO:tasks.workunit.client.0.smithi002.stdout:5/241: chown f4 1630883 1 2023-12-17T11:57:39.761 INFO:tasks.workunit.client.0.smithi002.stdout:6/276: dread d0/d1/dc/f20 [0,4194304] 0 2023-12-17T11:57:39.763 INFO:tasks.workunit.client.0.smithi002.stdout:6/277: write d0/d1/fd [6053429,94450] 0 2023-12-17T11:57:39.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/278: write d0/f3a [143426,57503] 0 2023-12-17T11:57:39.764 INFO:tasks.workunit.client.0.smithi002.stdout:8/320: symlink d3/d8/d55/l70 0 2023-12-17T11:57:39.764 INFO:tasks.workunit.client.0.smithi002.stdout:7/323: truncate d6/d17/dc/d13/d37/d4c/d24/f43 2276935 0 2023-12-17T11:57:39.764 INFO:tasks.workunit.client.0.smithi002.stdout:7/324: chown d6/d17/d16/l2f 184322 1 2023-12-17T11:57:39.766 INFO:tasks.workunit.client.1.smithi119.stdout:1/201: creat d3/db/d17/f3d x:0 0 0 2023-12-17T11:57:39.769 INFO:tasks.workunit.client.0.smithi002.stdout:1/372: creat d3/d5c/d66/f78 x:0 0 0 2023-12-17T11:57:39.772 INFO:tasks.workunit.client.0.smithi002.stdout:0/250: dread d0/d6/d26/f35 [0,4194304] 0 2023-12-17T11:57:39.772 INFO:tasks.workunit.client.0.smithi002.stdout:0/251: fsync d0/d6/d26/d25/f31 0 2023-12-17T11:57:39.772 INFO:tasks.workunit.client.0.smithi002.stdout:0/252: chown d0/d6/d26/d25/f31 4514941 1 2023-12-17T11:57:39.775 INFO:tasks.workunit.client.0.smithi002.stdout:4/312: dread d0/fd [0,4194304] 0 2023-12-17T11:57:39.775 INFO:tasks.workunit.client.0.smithi002.stdout:4/313: chown d0/d10/d21 15 1 2023-12-17T11:57:39.776 INFO:tasks.workunit.client.0.smithi002.stdout:9/322: rmdir dc/d42/d4f/d59/d47/d63/d6c 0 2023-12-17T11:57:39.776 INFO:tasks.workunit.client.0.smithi002.stdout:9/323: write dc/d1d/d23/f6f [22182,115745] 0 2023-12-17T11:57:39.776 INFO:tasks.workunit.client.0.smithi002.stdout:9/324: truncate dc/d42/f55 490992 0 2023-12-17T11:57:39.777 INFO:tasks.workunit.client.1.smithi119.stdout:9/327: rename d12/d1d/l3f to d12/l63 0 2023-12-17T11:57:39.777 INFO:tasks.workunit.client.1.smithi119.stdout:9/328: truncate d12/d1d/d49/f56 1010053 0 2023-12-17T11:57:39.778 INFO:tasks.workunit.client.1.smithi119.stdout:9/329: fdatasync d12/d1d/d28/f3a 0 2023-12-17T11:57:39.779 INFO:tasks.workunit.client.0.smithi002.stdout:8/321: unlink d3/d7/d1a/f69 0 2023-12-17T11:57:39.781 INFO:tasks.workunit.client.1.smithi119.stdout:5/327: dwrite d1/f35 [0,4194304] 0 2023-12-17T11:57:39.781 INFO:tasks.workunit.client.1.smithi119.stdout:6/270: creat d2/d2b/f52 x:0 0 0 2023-12-17T11:57:39.782 INFO:tasks.workunit.client.1.smithi119.stdout:6/271: chown d2/df/d17 3797 1 2023-12-17T11:57:39.782 INFO:tasks.workunit.client.1.smithi119.stdout:6/272: fdatasync d2/df/d17/f4e 0 2023-12-17T11:57:39.784 INFO:tasks.workunit.client.0.smithi002.stdout:1/373: unlink d3/d6/d9/c55 0 2023-12-17T11:57:39.786 INFO:tasks.workunit.client.0.smithi002.stdout:0/253: truncate d0/d6/d26/f35 1842555 0 2023-12-17T11:57:39.787 INFO:tasks.workunit.client.1.smithi119.stdout:0/209: rmdir d2/d16/d12/d1f 39 2023-12-17T11:57:39.791 INFO:tasks.workunit.client.1.smithi119.stdout:4/281: getdents dd/d15/d16/d20 0 2023-12-17T11:57:39.791 INFO:tasks.workunit.client.1.smithi119.stdout:4/282: fsync dd/d11/d26/f52 0 2023-12-17T11:57:39.792 INFO:tasks.workunit.client.0.smithi002.stdout:4/314: creat d0/d3e/d56/d65/f67 x:0 0 0 2023-12-17T11:57:39.794 INFO:tasks.workunit.client.0.smithi002.stdout:9/325: symlink dc/d1d/d23/l74 0 2023-12-17T11:57:39.794 INFO:tasks.workunit.client.0.smithi002.stdout:9/326: fdatasync dc/f14 0 2023-12-17T11:57:39.795 INFO:tasks.workunit.client.1.smithi119.stdout:8/226: sync 2023-12-17T11:57:39.795 INFO:tasks.workunit.client.1.smithi119.stdout:8/227: chown d7/d12/f33 457519 1 2023-12-17T11:57:39.795 INFO:tasks.workunit.client.1.smithi119.stdout:8/228: chown d7/da/d11/d26/d2c/l42 36 1 2023-12-17T11:57:39.796 INFO:tasks.workunit.client.1.smithi119.stdout:1/202: mknod d3/db/d17/d24/c3e 0 2023-12-17T11:57:39.798 INFO:tasks.workunit.client.0.smithi002.stdout:8/322: getdents d3 0 2023-12-17T11:57:39.802 INFO:tasks.workunit.client.1.smithi119.stdout:9/330: symlink d12/d1d/d40/l64 0 2023-12-17T11:57:39.802 INFO:tasks.workunit.client.1.smithi119.stdout:9/331: fsync d12/d1d/f2f 0 2023-12-17T11:57:39.802 INFO:tasks.workunit.client.1.smithi119.stdout:3/330: dwrite d9/da/f2d [4194304,4194304] 0 2023-12-17T11:57:39.803 INFO:tasks.workunit.client.1.smithi119.stdout:0/210: unlink d2/d3/d5/ld 0 2023-12-17T11:57:39.806 INFO:tasks.workunit.client.0.smithi002.stdout:2/295: read d3/d4/f5 [769909,87255] 0 2023-12-17T11:57:39.806 INFO:tasks.workunit.client.0.smithi002.stdout:2/296: creat d3/d4/d7/d14/d34/f6c x:0 0 0 2023-12-17T11:57:39.807 INFO:tasks.workunit.client.1.smithi119.stdout:4/283: mknod dd/d15/d4f/c5b 0 2023-12-17T11:57:39.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/297: creat d3/d4/d7/d14/d2e/f6d x:0 0 0 2023-12-17T11:57:39.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/298: write d3/d4/d7/d14/d2e/f6d [984529,129852] 0 2023-12-17T11:57:39.812 INFO:tasks.workunit.client.1.smithi119.stdout:1/203: mkdir d3/db/d26/d19/d3f 0 2023-12-17T11:57:39.812 INFO:tasks.workunit.client.1.smithi119.stdout:1/204: stat d3/db/d26/f28 0 2023-12-17T11:57:39.812 INFO:tasks.workunit.client.1.smithi119.stdout:8/229: mkdir d7/da/d11/d26/d49 0 2023-12-17T11:57:39.812 INFO:tasks.workunit.client.1.smithi119.stdout:8/230: write d7/d18/f3d [309784,118156] 0 2023-12-17T11:57:39.818 INFO:tasks.workunit.client.0.smithi002.stdout:1/374: creat d3/d2f/f79 x:0 0 0 2023-12-17T11:57:39.818 INFO:tasks.workunit.client.0.smithi002.stdout:1/375: chown d3/d6/d16/c2a 1221 1 2023-12-17T11:57:39.829 INFO:tasks.workunit.client.1.smithi119.stdout:6/273: dread d2/df/f1f [0,4194304] 0 2023-12-17T11:57:39.830 INFO:tasks.workunit.client.1.smithi119.stdout:0/211: write d2/d16/d12/f1a [11130,113383] 0 2023-12-17T11:57:39.830 INFO:tasks.workunit.client.1.smithi119.stdout:0/212: creat d2/d3/f3e x:0 0 0 2023-12-17T11:57:39.830 INFO:tasks.workunit.client.1.smithi119.stdout:9/332: mkdir d12/d65 0 2023-12-17T11:57:39.832 INFO:tasks.workunit.client.1.smithi119.stdout:1/205: dread d3/db/fc [0,4194304] 0 2023-12-17T11:57:39.832 INFO:tasks.workunit.client.1.smithi119.stdout:1/206: truncate d3/db/d2a/f35 304871 0 2023-12-17T11:57:39.832 INFO:tasks.workunit.client.1.smithi119.stdout:1/207: write d3/f12 [776135,107262] 0 2023-12-17T11:57:39.836 INFO:tasks.workunit.client.0.smithi002.stdout:7/325: write d6/d17/dc/d13/d3e/f4b [3293095,15931] 0 2023-12-17T11:57:39.837 INFO:tasks.workunit.client.0.smithi002.stdout:3/347: dwrite d9/d15/f66 [0,4194304] 0 2023-12-17T11:57:39.839 INFO:tasks.workunit.client.1.smithi119.stdout:6/274: mknod d2/c53 0 2023-12-17T11:57:39.840 INFO:tasks.workunit.client.0.smithi002.stdout:2/299: creat d3/d4/d7/d14/d2e/d37/d3f/f6e x:0 0 0 2023-12-17T11:57:39.847 INFO:tasks.workunit.client.1.smithi119.stdout:1/208: dread d3/db/d26/f21 [0,4194304] 0 2023-12-17T11:57:39.848 INFO:tasks.workunit.client.1.smithi119.stdout:1/209: write d3/fa [4421247,116531] 0 2023-12-17T11:57:39.848 INFO:tasks.workunit.client.1.smithi119.stdout:1/210: fdatasync d3/db/d17/f31 0 2023-12-17T11:57:39.854 INFO:tasks.workunit.client.1.smithi119.stdout:5/328: dwrite d1/f29 [0,4194304] 0 2023-12-17T11:57:39.856 INFO:tasks.workunit.client.1.smithi119.stdout:6/275: rename d2/df/d17/f3f to d2/d2b/f54 0 2023-12-17T11:57:39.856 INFO:tasks.workunit.client.1.smithi119.stdout:6/276: truncate d2/f38 600532 0 2023-12-17T11:57:39.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/279: dwrite d0/d1/dc/d17/d3c/f47 [0,4194304] 0 2023-12-17T11:57:39.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/280: creat d0/d1/dc/d10/f52 x:0 0 0 2023-12-17T11:57:39.857 INFO:tasks.workunit.client.0.smithi002.stdout:6/281: dread - d0/d1/dc/d17/d40/f4e zero size 2023-12-17T11:57:39.860 INFO:tasks.workunit.client.0.smithi002.stdout:2/300: unlink d3/d4/f60 0 2023-12-17T11:57:39.861 INFO:tasks.workunit.client.0.smithi002.stdout:2/301: write d3/d4/f6 [5242438,83253] 0 2023-12-17T11:57:39.861 INFO:tasks.workunit.client.1.smithi119.stdout:5/329: mknod d1/d44/d52/c64 0 2023-12-17T11:57:39.864 INFO:tasks.workunit.client.1.smithi119.stdout:5/330: stat d1/d36/d3a/l43 0 2023-12-17T11:57:39.866 INFO:tasks.workunit.client.0.smithi002.stdout:6/282: mknod d0/d1/dc/d17/d4c/c53 0 2023-12-17T11:57:39.870 INFO:tasks.workunit.client.0.smithi002.stdout:2/302: symlink d3/d4/d43/l6f 0 2023-12-17T11:57:39.870 INFO:tasks.workunit.client.0.smithi002.stdout:6/283: creat d0/d1/dc/f54 x:0 0 0 2023-12-17T11:57:39.871 INFO:tasks.workunit.client.0.smithi002.stdout:2/303: chown d3/d4/d7/d14/l39 891683 1 2023-12-17T11:57:39.876 INFO:tasks.workunit.client.0.smithi002.stdout:2/304: symlink d3/d50/l70 0 2023-12-17T11:57:39.877 INFO:tasks.workunit.client.0.smithi002.stdout:2/305: write d3/d4/d43/f4f [330505,22225] 0 2023-12-17T11:57:39.878 INFO:tasks.workunit.client.0.smithi002.stdout:2/306: rmdir d3/d56 39 2023-12-17T11:57:39.878 INFO:tasks.workunit.client.0.smithi002.stdout:2/307: stat d3/d4/d7/d14/d1b/f29 0 2023-12-17T11:57:39.884 INFO:tasks.workunit.client.0.smithi002.stdout:2/308: rename d3/d4/d43/l45 to d3/d4/d7/d14/d1b/d5b/l71 0 2023-12-17T11:57:39.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/309: mkdir d3/d4/d17/d19/d4d/d72 0 2023-12-17T11:57:39.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/310: fsync d3/d50/f53 0 2023-12-17T11:57:39.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/311: chown d3/d4/d7/d14/d42 3084223 1 2023-12-17T11:57:39.891 INFO:tasks.workunit.client.0.smithi002.stdout:2/312: write d3/d4/d7/d14/f48 [382357,94001] 0 2023-12-17T11:57:39.892 INFO:tasks.workunit.client.0.smithi002.stdout:4/315: dwrite d0/d10/d21/d33/f45 [0,4194304] 0 2023-12-17T11:57:39.893 INFO:tasks.workunit.client.1.smithi119.stdout:3/331: dwrite d9/d35/f58 [0,4194304] 0 2023-12-17T11:57:39.893 INFO:tasks.workunit.client.1.smithi119.stdout:3/332: fdatasync d9/da/df/d41/d33/f62 0 2023-12-17T11:57:39.893 INFO:tasks.workunit.client.1.smithi119.stdout:3/333: chown d9/da/df 16826 1 2023-12-17T11:57:39.897 INFO:tasks.workunit.client.0.smithi002.stdout:2/313: symlink d3/d50/l73 0 2023-12-17T11:57:39.898 INFO:tasks.workunit.client.0.smithi002.stdout:5/242: dwrite f8 [8388608,4194304] 0 2023-12-17T11:57:39.902 INFO:tasks.workunit.client.0.smithi002.stdout:4/316: mknod d0/d5a/c68 0 2023-12-17T11:57:39.905 INFO:tasks.workunit.client.1.smithi119.stdout:3/334: symlink d9/d59/l82 0 2023-12-17T11:57:39.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/314: mknod d3/d4/d7/d14/d1b/d5b/c74 0 2023-12-17T11:57:39.907 INFO:tasks.workunit.client.0.smithi002.stdout:8/323: dwrite d3/d8/d28/f68 [0,4194304] 0 2023-12-17T11:57:39.907 INFO:tasks.workunit.client.0.smithi002.stdout:6/284: dread d0/f1a [0,4194304] 0 2023-12-17T11:57:39.908 INFO:tasks.workunit.client.0.smithi002.stdout:0/254: dwrite d0/d6/d26/d14/d19/f21 [0,4194304] 0 2023-12-17T11:57:39.909 INFO:tasks.workunit.client.0.smithi002.stdout:5/243: mknod dc/d1b/d2d/c45 0 2023-12-17T11:57:39.909 INFO:tasks.workunit.client.0.smithi002.stdout:5/244: fdatasync dc/f18 0 2023-12-17T11:57:39.911 INFO:tasks.workunit.client.1.smithi119.stdout:8/231: dwrite d7/da/d11/f1d [4194304,4194304] 0 2023-12-17T11:57:39.917 INFO:tasks.workunit.client.1.smithi119.stdout:1/211: dwrite d3/db/d17/d24/f2e [0,4194304] 0 2023-12-17T11:57:39.919 INFO:tasks.workunit.client.1.smithi119.stdout:9/333: dwrite d12/d1d/d28/d46/d50/f60 [0,4194304] 0 2023-12-17T11:57:39.919 INFO:tasks.workunit.client.1.smithi119.stdout:9/334: chown d12/d1d/d28/d46/d50/f60 29 1 2023-12-17T11:57:39.921 INFO:tasks.workunit.client.1.smithi119.stdout:3/335: dread d9/d11/d1e/f6f [0,4194304] 0 2023-12-17T11:57:39.923 INFO:tasks.workunit.client.0.smithi002.stdout:2/315: dread d3/d50/f53 [0,4194304] 0 2023-12-17T11:57:39.924 INFO:tasks.workunit.client.0.smithi002.stdout:8/324: dread d3/d7/d18/d3f/f57 [0,4194304] 0 2023-12-17T11:57:39.925 INFO:tasks.workunit.client.0.smithi002.stdout:6/285: creat d0/d1/dc/d17/d4c/f55 x:0 0 0 2023-12-17T11:57:39.928 INFO:tasks.workunit.client.0.smithi002.stdout:5/245: rename dc/d1b/f3d to dc/d1a/f46 0 2023-12-17T11:57:39.930 INFO:tasks.workunit.client.1.smithi119.stdout:7/312: sync 2023-12-17T11:57:39.930 INFO:tasks.workunit.client.1.smithi119.stdout:2/302: sync 2023-12-17T11:57:39.931 INFO:tasks.workunit.client.1.smithi119.stdout:0/213: dwrite d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:39.931 INFO:tasks.workunit.client.0.smithi002.stdout:5/246: read dc/f18 [644715,86064] 0 2023-12-17T11:57:39.931 INFO:tasks.workunit.client.0.smithi002.stdout:5/247: fdatasync dc/d1a/f46 0 2023-12-17T11:57:39.934 INFO:tasks.workunit.client.1.smithi119.stdout:5/331: dwrite d1/f51 [0,4194304] 0 2023-12-17T11:57:39.938 INFO:tasks.workunit.client.0.smithi002.stdout:7/326: dwrite d6/d17/dc/d13/d37/d4c/d24/f43 [0,4194304] 0 2023-12-17T11:57:39.942 INFO:tasks.workunit.client.0.smithi002.stdout:8/325: mkdir d3/d8/da/d71 0 2023-12-17T11:57:39.942 INFO:tasks.workunit.client.0.smithi002.stdout:9/327: dwrite dc/d42/d4f/f61 [0,4194304] 0 2023-12-17T11:57:39.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/376: dwrite d3/d6/f42 [0,4194304] 0 2023-12-17T11:57:39.945 INFO:tasks.workunit.client.0.smithi002.stdout:1/377: creat d3/d6/d16/f7a x:0 0 0 2023-12-17T11:57:39.945 INFO:tasks.workunit.client.0.smithi002.stdout:6/286: dread d0/d1/fd [0,4194304] 0 2023-12-17T11:57:39.946 INFO:tasks.workunit.client.0.smithi002.stdout:6/287: chown d0/d1/f23 63 1 2023-12-17T11:57:39.947 INFO:tasks.workunit.client.1.smithi119.stdout:6/277: rename d2/d2b/f54 to d2/df/f55 0 2023-12-17T11:57:39.947 INFO:tasks.workunit.client.1.smithi119.stdout:1/212: mkdir d3/db/d17/d24/d20/d40 0 2023-12-17T11:57:39.954 INFO:tasks.workunit.client.1.smithi119.stdout:9/335: dread d12/f19 [0,4194304] 0 2023-12-17T11:57:39.955 INFO:tasks.workunit.client.0.smithi002.stdout:5/248: mkdir dc/d1a/d47 0 2023-12-17T11:57:39.958 INFO:tasks.workunit.client.1.smithi119.stdout:0/214: write d2/d16/f17 [281991,8307] 0 2023-12-17T11:57:39.958 INFO:tasks.workunit.client.1.smithi119.stdout:0/215: chown d2 1210 1 2023-12-17T11:57:39.959 INFO:tasks.workunit.client.1.smithi119.stdout:0/216: readlink d2/d16/l33 0 2023-12-17T11:57:39.965 INFO:tasks.workunit.client.1.smithi119.stdout:8/232: dwrite d7/f16 [4194304,4194304] 0 2023-12-17T11:57:39.965 INFO:tasks.workunit.client.1.smithi119.stdout:3/336: creat d9/da/f83 x:0 0 0 2023-12-17T11:57:39.966 INFO:tasks.workunit.client.1.smithi119.stdout:7/313: link d2/d4/d11/f21 d2/d4/d3e/d57/d56/f62 0 2023-12-17T11:57:39.966 INFO:tasks.workunit.client.0.smithi002.stdout:0/255: dwrite d0/f48 [0,4194304] 0 2023-12-17T11:57:39.966 INFO:tasks.workunit.client.0.smithi002.stdout:0/256: stat d0/d33 0 2023-12-17T11:57:39.973 INFO:tasks.workunit.client.1.smithi119.stdout:2/303: link d6/d9/l30 d6/d2b/d3f/d5c/l6c 0 2023-12-17T11:57:39.985 INFO:tasks.workunit.client.0.smithi002.stdout:9/328: dwrite dc/d1d/d25/f43 [0,4194304] 0 2023-12-17T11:57:39.991 INFO:tasks.workunit.client.0.smithi002.stdout:2/316: dwrite d3/d4/d7/d14/d2e/f57 [0,4194304] 0 2023-12-17T11:57:39.998 INFO:tasks.workunit.client.1.smithi119.stdout:6/278: dread d2/f9 [0,4194304] 0 2023-12-17T11:57:40.003 INFO:tasks.workunit.client.0.smithi002.stdout:1/378: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b 0 2023-12-17T11:57:40.004 INFO:tasks.workunit.client.1.smithi119.stdout:9/336: write fe [1465817,30499] 0 2023-12-17T11:57:40.004 INFO:tasks.workunit.client.1.smithi119.stdout:9/337: creat d12/d1d/d28/d46/f66 x:0 0 0 2023-12-17T11:57:40.004 INFO:tasks.workunit.client.1.smithi119.stdout:9/338: fsync d12/d1d/f2f 0 2023-12-17T11:57:40.007 INFO:tasks.workunit.client.0.smithi002.stdout:6/288: unlink d0/d1/dc/ff 0 2023-12-17T11:57:40.010 INFO:tasks.workunit.client.1.smithi119.stdout:1/213: creat d3/db/d17/d24/d20/d40/f41 x:0 0 0 2023-12-17T11:57:40.010 INFO:tasks.workunit.client.1.smithi119.stdout:1/214: write d3/db/d2a/f34 [52744,29822] 0 2023-12-17T11:57:40.010 INFO:tasks.workunit.client.1.smithi119.stdout:1/215: readlink d3/db/d17/d24/l38 0 2023-12-17T11:57:40.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/326: dwrite d3/d7/f58 [0,4194304] 0 2023-12-17T11:57:40.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/327: dread - d3/d7/d1a/f6a zero size 2023-12-17T11:57:40.013 INFO:tasks.workunit.client.0.smithi002.stdout:8/328: truncate d3/d7/f63 735691 0 2023-12-17T11:57:40.016 INFO:tasks.workunit.client.0.smithi002.stdout:0/257: dwrite d0/d6/d26/f35 [0,4194304] 0 2023-12-17T11:57:40.017 INFO:tasks.workunit.client.1.smithi119.stdout:8/233: rename d7/d12/d23/c31 to d7/c4a 0 2023-12-17T11:57:40.017 INFO:tasks.workunit.client.1.smithi119.stdout:8/234: stat d7/da/d11/l2e 0 2023-12-17T11:57:40.017 INFO:tasks.workunit.client.1.smithi119.stdout:3/337: mkdir d9/d11/d1e/d55/d65/d84 0 2023-12-17T11:57:40.024 INFO:tasks.workunit.client.1.smithi119.stdout:7/314: unlink d2/d4/d11/d2c/f42 0 2023-12-17T11:57:40.024 INFO:tasks.workunit.client.1.smithi119.stdout:7/315: readlink d2/d4/d11/d2c/d55/l61 0 2023-12-17T11:57:40.024 INFO:tasks.workunit.client.1.smithi119.stdout:7/316: fsync d2/f31 0 2023-12-17T11:57:40.024 INFO:tasks.workunit.client.1.smithi119.stdout:0/217: dwrite d2/d16/d12/d1f/f20 [0,4194304] 0 2023-12-17T11:57:40.024 INFO:tasks.workunit.client.1.smithi119.stdout:7/317: write d2/d4/d11/d2c/f3a [2345273,97808] 0 2023-12-17T11:57:40.030 INFO:tasks.workunit.client.1.smithi119.stdout:6/279: creat d2/d41/f56 x:0 0 0 2023-12-17T11:57:40.031 INFO:tasks.workunit.client.1.smithi119.stdout:1/216: dread d3/db/d26/d19/f2f [0,4194304] 0 2023-12-17T11:57:40.034 INFO:tasks.workunit.client.1.smithi119.stdout:8/235: dread d7/d12/d1f/f24 [0,4194304] 0 2023-12-17T11:57:40.034 INFO:tasks.workunit.client.0.smithi002.stdout:5/249: creat dc/d1a/f48 x:0 0 0 2023-12-17T11:57:40.034 INFO:tasks.workunit.client.0.smithi002.stdout:5/250: write dc/f18 [167687,36120] 0 2023-12-17T11:57:40.036 INFO:tasks.workunit.client.0.smithi002.stdout:0/258: dread d0/d6/d26/d25/f45 [0,4194304] 0 2023-12-17T11:57:40.036 INFO:tasks.workunit.client.0.smithi002.stdout:5/251: write dc/d17/f26 [989267,42151] 0 2023-12-17T11:57:40.036 INFO:tasks.workunit.client.1.smithi119.stdout:9/339: fdatasync fe 0 2023-12-17T11:57:40.037 INFO:tasks.workunit.client.1.smithi119.stdout:2/304: dwrite d6/f40 [0,4194304] 0 2023-12-17T11:57:40.037 INFO:tasks.workunit.client.1.smithi119.stdout:2/305: readlink d6/d9/l1e 0 2023-12-17T11:57:40.038 INFO:tasks.workunit.client.0.smithi002.stdout:7/327: getdents d6/d17/dc/d13/d21 0 2023-12-17T11:57:40.039 INFO:tasks.workunit.client.1.smithi119.stdout:3/338: creat d9/f85 x:0 0 0 2023-12-17T11:57:40.041 INFO:tasks.workunit.client.1.smithi119.stdout:0/218: dread d2/d16/f27 [0,4194304] 0 2023-12-17T11:57:40.051 INFO:tasks.workunit.client.1.smithi119.stdout:7/318: symlink d2/d5b/l63 0 2023-12-17T11:57:40.051 INFO:tasks.workunit.client.0.smithi002.stdout:9/329: rename dc/d1d/c41 to dc/d42/d4f/d59/d49/c75 0 2023-12-17T11:57:40.052 INFO:tasks.workunit.client.1.smithi119.stdout:1/217: symlink d3/db/l42 0 2023-12-17T11:57:40.052 INFO:tasks.workunit.client.1.smithi119.stdout:1/218: stat d3/db/d17/d24/f2e 0 2023-12-17T11:57:40.055 INFO:tasks.workunit.client.1.smithi119.stdout:8/236: truncate d7/d12/d23/f38 1854594 0 2023-12-17T11:57:40.058 INFO:tasks.workunit.client.1.smithi119.stdout:3/339: dread d9/d1c/f49 [0,4194304] 0 2023-12-17T11:57:40.063 INFO:tasks.workunit.client.1.smithi119.stdout:9/340: mknod d12/d1d/d28/c67 0 2023-12-17T11:57:40.066 INFO:tasks.workunit.client.0.smithi002.stdout:6/289: mkdir d0/d1/d21/d56 0 2023-12-17T11:57:40.066 INFO:tasks.workunit.client.0.smithi002.stdout:6/290: dread - d0/d1/dc/d17/f1e zero size 2023-12-17T11:57:40.067 INFO:tasks.workunit.client.0.smithi002.stdout:6/291: truncate d0/d1/dc/d10/f52 45754 0 2023-12-17T11:57:40.071 INFO:tasks.workunit.client.0.smithi002.stdout:0/259: link d0/d15/f4f d0/d15/f54 0 2023-12-17T11:57:40.075 INFO:tasks.workunit.client.0.smithi002.stdout:5/252: creat dc/d1a/d47/f49 x:0 0 0 2023-12-17T11:57:40.077 INFO:tasks.workunit.client.0.smithi002.stdout:8/329: rename d3/d8/da/dd/c4f to d3/d7/d18/c72 0 2023-12-17T11:57:40.077 INFO:tasks.workunit.client.0.smithi002.stdout:8/330: creat d3/d7/f73 x:0 0 0 2023-12-17T11:57:40.077 INFO:tasks.workunit.client.0.smithi002.stdout:8/331: chown d3/d8/da/dd/f5f 232 1 2023-12-17T11:57:40.079 INFO:tasks.workunit.client.1.smithi119.stdout:2/306: creat d6/d2b/d3f/f6d x:0 0 0 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/330: mkdir dc/d1d/d23/d76 0 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/331: write dc/d1d/d23/f6f [603496,27780] 0 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/332: creat dc/d32/f77 x:0 0 0 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/333: creat dc/d1d/f78 x:0 0 0 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/334: write f0 [2249198,62591] 0 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/335: chown dc/d42/d4f 12 1 2023-12-17T11:57:40.081 INFO:tasks.workunit.client.0.smithi002.stdout:9/336: write dc/d1d/f78 [966987,70300] 0 2023-12-17T11:57:40.082 INFO:tasks.workunit.client.1.smithi119.stdout:7/319: link d2/f31 d2/d4/d3e/f64 0 2023-12-17T11:57:40.083 INFO:tasks.workunit.client.1.smithi119.stdout:0/219: dwrite d2/d16/d12/f32 [0,4194304] 0 2023-12-17T11:57:40.083 INFO:tasks.workunit.client.1.smithi119.stdout:0/220: chown d2/d3/c9 1 1 2023-12-17T11:57:40.083 INFO:tasks.workunit.client.1.smithi119.stdout:0/221: read d2/d16/d12/f1a [3855551,65615] 0 2023-12-17T11:57:40.085 INFO:tasks.workunit.client.1.smithi119.stdout:1/219: rmdir d3/db/d26/d19 39 2023-12-17T11:57:40.087 INFO:tasks.workunit.client.1.smithi119.stdout:6/280: dwrite d2/df/f55 [0,4194304] 0 2023-12-17T11:57:40.087 INFO:tasks.workunit.client.1.smithi119.stdout:6/281: write d2/f11 [3942403,20098] 0 2023-12-17T11:57:40.089 INFO:tasks.workunit.client.1.smithi119.stdout:8/237: link d7/da/d11/f1d d7/da/d11/d26/d49/f4b 0 2023-12-17T11:57:40.096 INFO:tasks.workunit.client.1.smithi119.stdout:7/320: creat d2/d5b/f65 x:0 0 0 2023-12-17T11:57:40.101 INFO:tasks.workunit.client.1.smithi119.stdout:0/222: mkdir d2/d3/d5/d3f 0 2023-12-17T11:57:40.101 INFO:tasks.workunit.client.1.smithi119.stdout:4/284: sync 2023-12-17T11:57:40.101 INFO:tasks.workunit.client.1.smithi119.stdout:4/285: read dd/f18 [1444702,57150] 0 2023-12-17T11:57:40.101 INFO:tasks.workunit.client.1.smithi119.stdout:4/286: creat dd/d15/f5c x:0 0 0 2023-12-17T11:57:40.106 INFO:tasks.workunit.client.1.smithi119.stdout:1/220: creat d3/db/d26/f43 x:0 0 0 2023-12-17T11:57:40.106 INFO:tasks.workunit.client.1.smithi119.stdout:1/221: dread - d3/db/d17/d24/d20/f2d zero size 2023-12-17T11:57:40.106 INFO:tasks.workunit.client.1.smithi119.stdout:1/222: stat d3/db/d26/c9 0 2023-12-17T11:57:40.109 INFO:tasks.workunit.client.1.smithi119.stdout:9/341: dwrite d12/d1d/d49/f56 [0,4194304] 0 2023-12-17T11:57:40.109 INFO:tasks.workunit.client.1.smithi119.stdout:9/342: chown d12/d1d/f51 2 1 2023-12-17T11:57:40.109 INFO:tasks.workunit.client.1.smithi119.stdout:9/343: write d12/d1d/d40/f5c [332968,91634] 0 2023-12-17T11:57:40.112 INFO:tasks.workunit.client.1.smithi119.stdout:2/307: rename d6/d2b/l31 to d6/d9/d52/d53/d55/d58/d6b/l6e 0 2023-12-17T11:57:40.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/260: dwrite d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:40.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/261: fsync d0/f44 0 2023-12-17T11:57:40.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/262: write d0/d6/fe [3327077,21174] 0 2023-12-17T11:57:40.117 INFO:tasks.workunit.client.0.smithi002.stdout:1/379: rmdir d3/d6/d9 39 2023-12-17T11:57:40.117 INFO:tasks.workunit.client.0.smithi002.stdout:1/380: creat d3/d6/d16/d61/f7c x:0 0 0 2023-12-17T11:57:40.120 INFO:tasks.workunit.client.1.smithi119.stdout:6/282: creat d2/df/d17/f57 x:0 0 0 2023-12-17T11:57:40.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/292: symlink d0/d1/dc/d10/l57 0 2023-12-17T11:57:40.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/293: truncate d0/d1/d21/f2d 4355822 0 2023-12-17T11:57:40.123 INFO:tasks.workunit.client.1.smithi119.stdout:5/332: sync 2023-12-17T11:57:40.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/381: dread d3/d6/d9/f38 [0,4194304] 0 2023-12-17T11:57:40.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/328: rename d6/d17/d16/l45 to d6/d17/dc/d13/d37/d4f/l5e 0 2023-12-17T11:57:40.126 INFO:tasks.workunit.client.0.smithi002.stdout:7/329: fsync d6/d17/dc/d13/d37/d4c/d24/f43 0 2023-12-17T11:57:40.126 INFO:tasks.workunit.client.1.smithi119.stdout:6/283: write d2/df/f55 [4645177,17888] 0 2023-12-17T11:57:40.128 INFO:tasks.workunit.client.1.smithi119.stdout:4/287: write dd/d15/d16/d3d/f4c [2524500,107834] 0 2023-12-17T11:57:40.130 INFO:tasks.workunit.client.0.smithi002.stdout:3/348: sync 2023-12-17T11:57:40.131 INFO:tasks.workunit.client.0.smithi002.stdout:4/317: sync 2023-12-17T11:57:40.132 INFO:tasks.workunit.client.1.smithi119.stdout:7/321: symlink d2/d4/d11/l66 0 2023-12-17T11:57:40.134 INFO:tasks.workunit.client.0.smithi002.stdout:7/330: dread d6/d17/dc/d13/d37/f3c [4194304,4194304] 0 2023-12-17T11:57:40.135 INFO:tasks.workunit.client.1.smithi119.stdout:2/308: write d6/d9/d13/d1d/f50 [1462427,59882] 0 2023-12-17T11:57:40.136 INFO:tasks.workunit.client.1.smithi119.stdout:0/223: symlink d2/d3/d5/d3f/l40 0 2023-12-17T11:57:40.136 INFO:tasks.workunit.client.1.smithi119.stdout:0/224: creat d2/d16/d12/f41 x:0 0 0 2023-12-17T11:57:40.139 INFO:tasks.workunit.client.0.smithi002.stdout:6/294: dread d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:40.139 INFO:tasks.workunit.client.0.smithi002.stdout:6/295: chown d0/d1/dc/d17/f1e 56 1 2023-12-17T11:57:40.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/337: mknod dc/c79 0 2023-12-17T11:57:40.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/338: creat dc/d32/f7a x:0 0 0 2023-12-17T11:57:40.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/339: truncate dc/d1d/d23/f60 575153 0 2023-12-17T11:57:40.140 INFO:tasks.workunit.client.1.smithi119.stdout:1/223: mkdir d3/d44 0 2023-12-17T11:57:40.142 INFO:tasks.workunit.client.0.smithi002.stdout:0/263: creat d0/d6/d26/f55 x:0 0 0 2023-12-17T11:57:40.143 INFO:tasks.workunit.client.1.smithi119.stdout:9/344: rename d12/d1d/d28/d4d/l55 to d12/d1d/d28/d46/d50/l68 0 2023-12-17T11:57:40.143 INFO:tasks.workunit.client.1.smithi119.stdout:9/345: write d12/d1d/f44 [1332076,45291] 0 2023-12-17T11:57:40.144 INFO:tasks.workunit.client.0.smithi002.stdout:5/253: rmdir dc/d1b 39 2023-12-17T11:57:40.145 INFO:tasks.workunit.client.0.smithi002.stdout:5/254: creat dc/d1a/d47/f4a x:0 0 0 2023-12-17T11:57:40.145 INFO:tasks.workunit.client.1.smithi119.stdout:5/333: mkdir d1/d36/d65 0 2023-12-17T11:57:40.146 INFO:tasks.workunit.client.1.smithi119.stdout:8/238: dwrite d7/da/f41 [4194304,4194304] 0 2023-12-17T11:57:40.148 INFO:tasks.workunit.client.1.smithi119.stdout:8/239: write d7/f35 [222926,90759] 0 2023-12-17T11:57:40.148 INFO:tasks.workunit.client.1.smithi119.stdout:8/240: write d7/da/d11/d26/f32 [759583,92154] 0 2023-12-17T11:57:40.148 INFO:tasks.workunit.client.0.smithi002.stdout:1/382: mknod d3/d2f/d74/c7d 0 2023-12-17T11:57:40.149 INFO:tasks.workunit.client.0.smithi002.stdout:1/383: read - d3/d5c/d66/f78 zero size 2023-12-17T11:57:40.149 INFO:tasks.workunit.client.0.smithi002.stdout:1/384: creat d3/d6/d16/f7e x:0 0 0 2023-12-17T11:57:40.150 INFO:tasks.workunit.client.1.smithi119.stdout:2/309: truncate d6/d9/f20 1571937 0 2023-12-17T11:57:40.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/332: rename d3/d8/da/d71 to d3/d7/d18/d74 0 2023-12-17T11:57:40.153 INFO:tasks.workunit.client.0.smithi002.stdout:4/318: mkdir d0/d10/d14/d27/d69 0 2023-12-17T11:57:40.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/333: read - d3/d8/da/dd/f66 zero size 2023-12-17T11:57:40.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/349: mkdir d9/d15/d71 0 2023-12-17T11:57:40.156 INFO:tasks.workunit.client.1.smithi119.stdout:7/322: dread d2/d4/d3e/d57/d56/f59 [0,4194304] 0 2023-12-17T11:57:40.157 INFO:tasks.workunit.client.1.smithi119.stdout:7/323: write d2/d4/d1f/f4c [819648,38575] 0 2023-12-17T11:57:40.157 INFO:tasks.workunit.client.1.smithi119.stdout:1/224: unlink d3/db/d2a/f35 0 2023-12-17T11:57:40.158 INFO:tasks.workunit.client.0.smithi002.stdout:7/331: creat d6/d17/dc/d13/d21/d2e/d4a/d53/f5f x:0 0 0 2023-12-17T11:57:40.161 INFO:tasks.workunit.client.1.smithi119.stdout:9/346: symlink d12/l69 0 2023-12-17T11:57:40.162 INFO:tasks.workunit.client.1.smithi119.stdout:9/347: write fe [3512425,62818] 0 2023-12-17T11:57:40.162 INFO:tasks.workunit.client.1.smithi119.stdout:9/348: dread - d12/d1d/d28/d46/f66 zero size 2023-12-17T11:57:40.162 INFO:tasks.workunit.client.1.smithi119.stdout:9/349: write d12/f42 [861781,26667] 0 2023-12-17T11:57:40.166 INFO:tasks.workunit.client.1.smithi119.stdout:5/334: creat d1/d36/d57/f66 x:0 0 0 2023-12-17T11:57:40.172 INFO:tasks.workunit.client.1.smithi119.stdout:8/241: mknod d7/da/d11/d26/c4c 0 2023-12-17T11:57:40.174 INFO:tasks.workunit.client.1.smithi119.stdout:2/310: creat d6/d2b/d3f/d5b/f6f x:0 0 0 2023-12-17T11:57:40.175 INFO:tasks.workunit.client.1.smithi119.stdout:2/311: truncate d6/d9/f60 47169 0 2023-12-17T11:57:40.177 INFO:tasks.workunit.client.0.smithi002.stdout:6/296: mkdir d0/d1/dc/d58 0 2023-12-17T11:57:40.178 INFO:tasks.workunit.client.0.smithi002.stdout:6/297: dread - d0/d1/dc/d17/f1e zero size 2023-12-17T11:57:40.178 INFO:tasks.workunit.client.1.smithi119.stdout:4/288: dwrite dd/f28 [0,4194304] 0 2023-12-17T11:57:40.179 INFO:tasks.workunit.client.1.smithi119.stdout:7/324: mkdir d2/d4/d11/d2c/d55/d67 0 2023-12-17T11:57:40.179 INFO:tasks.workunit.client.1.smithi119.stdout:7/325: fdatasync d2/d4e/f33 0 2023-12-17T11:57:40.191 INFO:tasks.workunit.client.1.smithi119.stdout:9/350: creat d12/d65/f6a x:0 0 0 2023-12-17T11:57:40.191 INFO:tasks.workunit.client.1.smithi119.stdout:9/351: truncate d12/d1d/d28/d46/d50/f60 4633421 0 2023-12-17T11:57:40.197 INFO:tasks.workunit.client.0.smithi002.stdout:8/334: dwrite d3/d7/d18/d3f/f60 [0,4194304] 0 2023-12-17T11:57:40.197 INFO:tasks.workunit.client.0.smithi002.stdout:8/335: creat d3/d7/d1a/f75 x:0 0 0 2023-12-17T11:57:40.198 INFO:tasks.workunit.client.0.smithi002.stdout:7/332: dread d6/d17/dc/d13/f57 [0,4194304] 0 2023-12-17T11:57:40.203 INFO:tasks.workunit.client.1.smithi119.stdout:5/335: creat d1/d36/d3a/f67 x:0 0 0 2023-12-17T11:57:40.203 INFO:tasks.workunit.client.1.smithi119.stdout:7/326: dread d2/f10 [4194304,4194304] 0 2023-12-17T11:57:40.203 INFO:tasks.workunit.client.1.smithi119.stdout:7/327: read - d2/d5b/f65 zero size 2023-12-17T11:57:40.215 INFO:tasks.workunit.client.0.smithi002.stdout:3/350: mkdir d9/d1b/d35/d41/d59/d72 0 2023-12-17T11:57:40.219 INFO:tasks.workunit.client.1.smithi119.stdout:8/242: symlink d7/da/d11/l4d 0 2023-12-17T11:57:40.221 INFO:tasks.workunit.client.0.smithi002.stdout:1/385: write d3/d6/d9/f57 [4968165,37985] 0 2023-12-17T11:57:40.222 INFO:tasks.workunit.client.0.smithi002.stdout:1/386: getdents d3/d5c 0 2023-12-17T11:57:40.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/298: mknod d0/d1/dc/d10/c59 0 2023-12-17T11:57:40.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/299: truncate d0/d1/dc/f39 324291 0 2023-12-17T11:57:40.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/300: stat d0/d1/dc/d17/f1f 0 2023-12-17T11:57:40.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/301: chown d0/d1/dc/ce 64515 1 2023-12-17T11:57:40.225 INFO:tasks.workunit.client.0.smithi002.stdout:6/302: chown d0/d1/dc/ce 1840766904 1 2023-12-17T11:57:40.231 INFO:tasks.workunit.client.1.smithi119.stdout:4/289: symlink dd/d4b/l5d 0 2023-12-17T11:57:40.231 INFO:tasks.workunit.client.1.smithi119.stdout:4/290: chown dd/d15/d16/f51 222 1 2023-12-17T11:57:40.231 INFO:tasks.workunit.client.1.smithi119.stdout:4/291: dread - dd/d15/f53 zero size 2023-12-17T11:57:40.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/264: unlink d0/d6/d26/f55 0 2023-12-17T11:57:40.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/265: dread - d0/d6/d26/d14/d19/d2f/f4e zero size 2023-12-17T11:57:40.233 INFO:tasks.workunit.client.1.smithi119.stdout:1/225: rmdir d3/db/d17/d24/d20/d40 39 2023-12-17T11:57:40.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/255: dwrite dc/d17/d2f/f43 [0,4194304] 0 2023-12-17T11:57:40.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/256: fdatasync f4 0 2023-12-17T11:57:40.240 INFO:tasks.workunit.client.0.smithi002.stdout:4/319: dwrite d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:40.240 INFO:tasks.workunit.client.0.smithi002.stdout:8/336: mknod d3/d7/d1a/c76 0 2023-12-17T11:57:40.240 INFO:tasks.workunit.client.0.smithi002.stdout:8/337: chown d3/d7/d1a 918971463 1 2023-12-17T11:57:40.240 INFO:tasks.workunit.client.0.smithi002.stdout:8/338: chown d3/d7/l22 8973 1 2023-12-17T11:57:40.241 INFO:tasks.workunit.client.1.smithi119.stdout:9/352: link d12/d1d/d28/c67 d12/d65/c6b 0 2023-12-17T11:57:40.241 INFO:tasks.workunit.client.0.smithi002.stdout:2/317: sync 2023-12-17T11:57:40.244 INFO:tasks.workunit.client.1.smithi119.stdout:2/312: dwrite d6/d9/d52/d53/d55/f4c [0,4194304] 0 2023-12-17T11:57:40.244 INFO:tasks.workunit.client.1.smithi119.stdout:4/292: creat dd/d11/f5e x:0 0 0 2023-12-17T11:57:40.245 INFO:tasks.workunit.client.1.smithi119.stdout:8/243: dread d7/f16 [0,4194304] 0 2023-12-17T11:57:40.245 INFO:tasks.workunit.client.1.smithi119.stdout:8/244: fdatasync d7/d12/d1f/f24 0 2023-12-17T11:57:40.245 INFO:tasks.workunit.client.1.smithi119.stdout:8/245: getdents d7/d18/d45 0 2023-12-17T11:57:40.246 INFO:tasks.workunit.client.0.smithi002.stdout:7/333: symlink d6/d17/dc/d13/d37/l60 0 2023-12-17T11:57:40.250 INFO:tasks.workunit.client.0.smithi002.stdout:9/340: dwrite dc/d32/f35 [0,4194304] 0 2023-12-17T11:57:40.250 INFO:tasks.workunit.client.0.smithi002.stdout:9/341: chown dc/d1d/d25/l40 16 1 2023-12-17T11:57:40.250 INFO:tasks.workunit.client.1.smithi119.stdout:1/226: unlink d3/db/d2a/c33 0 2023-12-17T11:57:40.252 INFO:tasks.workunit.client.0.smithi002.stdout:3/351: unlink d9/d15/d31/f6b 0 2023-12-17T11:57:40.253 INFO:tasks.workunit.client.1.smithi119.stdout:5/336: link d1/fa d1/d25/f68 0 2023-12-17T11:57:40.257 INFO:tasks.workunit.client.0.smithi002.stdout:0/266: mknod d0/d6/d26/d25/c56 0 2023-12-17T11:57:40.262 INFO:tasks.workunit.client.1.smithi119.stdout:7/328: dwrite d2/d4/d11/f2d [4194304,4194304] 0 2023-12-17T11:57:40.263 INFO:tasks.workunit.client.1.smithi119.stdout:4/293: mknod dd/d2a/c5f 0 2023-12-17T11:57:40.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/257: mknod dc/d1b/d2d/c4b 0 2023-12-17T11:57:40.266 INFO:tasks.workunit.client.0.smithi002.stdout:1/387: dwrite d3/d6/d9/d37/f51 [0,4194304] 0 2023-12-17T11:57:40.267 INFO:tasks.workunit.client.0.smithi002.stdout:1/388: write d3/d6/d16/f31 [1255071,116554] 0 2023-12-17T11:57:40.269 INFO:tasks.workunit.client.1.smithi119.stdout:2/313: dread d6/d9/d52/d53/d55/f4c [0,4194304] 0 2023-12-17T11:57:40.269 INFO:tasks.workunit.client.1.smithi119.stdout:8/246: link d7/d18/d15/f39 d7/d18/f4e 0 2023-12-17T11:57:40.271 INFO:tasks.workunit.client.1.smithi119.stdout:5/337: creat d1/d36/f69 x:0 0 0 2023-12-17T11:57:40.271 INFO:tasks.workunit.client.1.smithi119.stdout:5/338: chown d1/d36/d3a/l43 205826755 1 2023-12-17T11:57:40.271 INFO:tasks.workunit.client.1.smithi119.stdout:5/339: fdatasync d1/d44/d52/f5f 0 2023-12-17T11:57:40.272 INFO:tasks.workunit.client.0.smithi002.stdout:8/339: creat d3/d7/d6e/f77 x:0 0 0 2023-12-17T11:57:40.273 INFO:tasks.workunit.client.1.smithi119.stdout:9/353: rmdir d12/d1d/d28/d46 39 2023-12-17T11:57:40.273 INFO:tasks.workunit.client.1.smithi119.stdout:9/354: fdatasync d12/d1d/d49/f56 0 2023-12-17T11:57:40.274 INFO:tasks.workunit.client.0.smithi002.stdout:2/318: symlink d3/d4/d7/d14/d1b/l75 0 2023-12-17T11:57:40.279 INFO:tasks.workunit.client.0.smithi002.stdout:9/342: rmdir dc/d42/d4f/d59/d47 39 2023-12-17T11:57:40.281 INFO:tasks.workunit.client.0.smithi002.stdout:3/352: mkdir d9/d1b/d35/d41/d43/d73 0 2023-12-17T11:57:40.283 INFO:tasks.workunit.client.1.smithi119.stdout:9/355: write d12/d1d/d40/f5c [286509,84211] 0 2023-12-17T11:57:40.283 INFO:tasks.workunit.client.1.smithi119.stdout:9/356: chown d12/d1d/d49 113688183 1 2023-12-17T11:57:40.283 INFO:tasks.workunit.client.1.smithi119.stdout:9/357: creat d12/d1d/d28/d4d/f6c x:0 0 0 2023-12-17T11:57:40.283 INFO:tasks.workunit.client.1.smithi119.stdout:8/247: dread d7/da/d11/d26/f28 [0,4194304] 0 2023-12-17T11:57:40.286 INFO:tasks.workunit.client.1.smithi119.stdout:4/294: dread dd/d11/d26/f52 [0,4194304] 0 2023-12-17T11:57:40.287 INFO:tasks.workunit.client.1.smithi119.stdout:4/295: readlink dd/d15/d16/l23 0 2023-12-17T11:57:40.289 INFO:tasks.workunit.client.0.smithi002.stdout:1/389: symlink d3/d6/d9/d37/d39/d43/d4a/l7f 0 2023-12-17T11:57:40.292 INFO:tasks.workunit.client.0.smithi002.stdout:2/319: creat d3/d4/d7/d14/d42/f76 x:0 0 0 2023-12-17T11:57:40.292 INFO:tasks.workunit.client.0.smithi002.stdout:2/320: chown d3/d4/d7/d14/d1b/d5b/f63 0 1 2023-12-17T11:57:40.292 INFO:tasks.workunit.client.0.smithi002.stdout:2/321: fdatasync d3/d4/d17/d19/f67 0 2023-12-17T11:57:40.293 INFO:tasks.workunit.client.0.smithi002.stdout:6/303: dwrite d0/f48 [0,4194304] 0 2023-12-17T11:57:40.293 INFO:tasks.workunit.client.1.smithi119.stdout:1/227: dwrite d3/db/d26/d19/f1e [0,4194304] 0 2023-12-17T11:57:40.298 INFO:tasks.workunit.client.1.smithi119.stdout:7/329: unlink d2/d4/f28 0 2023-12-17T11:57:40.301 INFO:tasks.workunit.client.0.smithi002.stdout:7/334: dwrite d6/d17/dc/d13/d37/d4c/d24/f43 [0,4194304] 0 2023-12-17T11:57:40.304 INFO:tasks.workunit.client.1.smithi119.stdout:4/296: write dd/f28 [3562204,80734] 0 2023-12-17T11:57:40.305 INFO:tasks.workunit.client.1.smithi119.stdout:4/297: write dd/f4a [808832,117226] 0 2023-12-17T11:57:40.305 INFO:tasks.workunit.client.1.smithi119.stdout:4/298: chown dd/d11 7 1 2023-12-17T11:57:40.305 INFO:tasks.workunit.client.1.smithi119.stdout:4/299: read - dd/d15/d16/f51 zero size 2023-12-17T11:57:40.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/343: mknod dc/c7b 0 2023-12-17T11:57:40.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/344: write dc/d1d/d25/f65 [4846083,74858] 0 2023-12-17T11:57:40.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/345: truncate dc/d1d/d23/f60 873365 0 2023-12-17T11:57:40.306 INFO:tasks.workunit.client.0.smithi002.stdout:5/258: rmdir dc/d1a 39 2023-12-17T11:57:40.308 INFO:tasks.workunit.client.1.smithi119.stdout:9/358: symlink d12/d65/l6d 0 2023-12-17T11:57:40.310 INFO:tasks.workunit.client.0.smithi002.stdout:1/390: rmdir d3/d6/d9/d37/d6a 0 2023-12-17T11:57:40.311 INFO:tasks.workunit.client.1.smithi119.stdout:8/248: creat d7/d18/f4f x:0 0 0 2023-12-17T11:57:40.311 INFO:tasks.workunit.client.1.smithi119.stdout:8/249: write d7/fb [909946,116426] 0 2023-12-17T11:57:40.311 INFO:tasks.workunit.client.1.smithi119.stdout:8/250: stat d7/da/d11/l43 0 2023-12-17T11:57:40.312 INFO:tasks.workunit.client.1.smithi119.stdout:8/251: stat d7/d18/f3d 0 2023-12-17T11:57:40.312 INFO:tasks.workunit.client.1.smithi119.stdout:9/359: write d12/d1d/f44 [944952,85002] 0 2023-12-17T11:57:40.314 INFO:tasks.workunit.client.1.smithi119.stdout:3/340: sync 2023-12-17T11:57:40.316 INFO:tasks.workunit.client.1.smithi119.stdout:1/228: creat d3/db/d17/f45 x:0 0 0 2023-12-17T11:57:40.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/322: rmdir d3/d4/d7/d14/d1b 39 2023-12-17T11:57:40.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/323: chown d3/d4/d7/d14/d2e/d37/d3f/l4e 17182 1 2023-12-17T11:57:40.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/324: chown d3/d4/f5 0 1 2023-12-17T11:57:40.319 INFO:tasks.workunit.client.1.smithi119.stdout:7/330: mkdir d2/d4/d11/d2c/d68 0 2023-12-17T11:57:40.319 INFO:tasks.workunit.client.1.smithi119.stdout:7/331: chown d2/d4e/f2b 63567467 1 2023-12-17T11:57:40.323 INFO:tasks.workunit.client.0.smithi002.stdout:5/259: getdents dc/d1a/d47 0 2023-12-17T11:57:40.323 INFO:tasks.workunit.client.0.smithi002.stdout:5/260: dread - dc/d1a/f48 zero size 2023-12-17T11:57:40.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/353: write d9/d15/f19 [1378373,100614] 0 2023-12-17T11:57:40.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/354: write d9/d1b/d35/d41/d43/f50 [41713,96902] 0 2023-12-17T11:57:40.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/355: fdatasync d9/d1b/d35/d41/d43/f61 0 2023-12-17T11:57:40.327 INFO:tasks.workunit.client.0.smithi002.stdout:0/267: dwrite d0/d15/f32 [0,4194304] 0 2023-12-17T11:57:40.327 INFO:tasks.workunit.client.0.smithi002.stdout:1/391: mkdir d3/d6/d59/d80 0 2023-12-17T11:57:40.327 INFO:tasks.workunit.client.0.smithi002.stdout:1/392: dread - d3/d6/d9/d37/f53 zero size 2023-12-17T11:57:40.328 INFO:tasks.workunit.client.1.smithi119.stdout:8/252: link d7/da/d1a/c29 d7/d18/d15/c50 0 2023-12-17T11:57:40.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/325: mkdir d3/d4/d17/d19/d4d/d72/d77 0 2023-12-17T11:57:40.329 INFO:tasks.workunit.client.0.smithi002.stdout:2/326: dread - d3/d4/d7/d14/d34/f6c zero size 2023-12-17T11:57:40.330 INFO:tasks.workunit.client.0.smithi002.stdout:5/261: mknod dc/d1b/d2d/c4c 0 2023-12-17T11:57:40.332 INFO:tasks.workunit.client.1.smithi119.stdout:2/314: rmdir d6/d2b 39 2023-12-17T11:57:40.333 INFO:tasks.workunit.client.0.smithi002.stdout:3/356: link d9/d1b/d35/d41/d59/d65/f69 d9/d1b/d35/d41/d59/d65/f74 0 2023-12-17T11:57:40.337 INFO:tasks.workunit.client.0.smithi002.stdout:1/393: dread d3/d6/d9/d30/f4c [0,4194304] 0 2023-12-17T11:57:40.337 INFO:tasks.workunit.client.0.smithi002.stdout:1/394: chown d3/d5c/d66/f78 7807597 1 2023-12-17T11:57:40.337 INFO:tasks.workunit.client.1.smithi119.stdout:9/360: mkdir d12/d1d/d28/d46/d6e 0 2023-12-17T11:57:40.337 INFO:tasks.workunit.client.1.smithi119.stdout:9/361: write d12/d1d/d28/d46/d50/f5a [575566,32461] 0 2023-12-17T11:57:40.337 INFO:tasks.workunit.client.1.smithi119.stdout:3/341: rename d9/da/df/d41/d74/f80 to d9/d44/f86 0 2023-12-17T11:57:40.338 INFO:tasks.workunit.client.1.smithi119.stdout:5/340: rmdir d1/d36/d3a 39 2023-12-17T11:57:40.340 INFO:tasks.workunit.client.0.smithi002.stdout:0/268: mkdir d0/d33/d57 0 2023-12-17T11:57:40.341 INFO:tasks.workunit.client.1.smithi119.stdout:1/229: creat d3/db/d26/d19/d3f/f46 x:0 0 0 2023-12-17T11:57:40.348 INFO:tasks.workunit.client.0.smithi002.stdout:3/357: symlink d9/d1b/d35/d41/d59/l75 0 2023-12-17T11:57:40.352 INFO:tasks.workunit.client.0.smithi002.stdout:5/262: getdents dc/d17/d2f 0 2023-12-17T11:57:40.352 INFO:tasks.workunit.client.0.smithi002.stdout:5/263: readlink dc/d1a/l41 0 2023-12-17T11:57:40.355 INFO:tasks.workunit.client.0.smithi002.stdout:2/327: dread d3/d4/d7/d14/d1b/f26 [0,4194304] 0 2023-12-17T11:57:40.357 INFO:tasks.workunit.client.1.smithi119.stdout:8/253: getdents d7/da/d11/d26/d2c 0 2023-12-17T11:57:40.357 INFO:tasks.workunit.client.0.smithi002.stdout:3/358: unlink d9/d15/c17 0 2023-12-17T11:57:40.360 INFO:tasks.workunit.client.1.smithi119.stdout:2/315: mkdir d6/d9/d13/d34/d70 0 2023-12-17T11:57:40.362 INFO:tasks.workunit.client.1.smithi119.stdout:7/332: write d2/d4/d11/f2d [6221599,105945] 0 2023-12-17T11:57:40.362 INFO:tasks.workunit.client.1.smithi119.stdout:7/333: write d2/d4e/f37 [4793411,107530] 0 2023-12-17T11:57:40.362 INFO:tasks.workunit.client.0.smithi002.stdout:3/359: symlink d9/d15/d52/l76 0 2023-12-17T11:57:40.363 INFO:tasks.workunit.client.1.smithi119.stdout:9/362: creat d12/d1d/d28/d46/d6e/f6f x:0 0 0 2023-12-17T11:57:40.363 INFO:tasks.workunit.client.1.smithi119.stdout:5/341: mknod d1/d36/d57/c6a 0 2023-12-17T11:57:40.369 INFO:tasks.workunit.client.1.smithi119.stdout:1/230: link d3/db/d17/d24/d20/c2c d3/db/d2a/c47 0 2023-12-17T11:57:40.369 INFO:tasks.workunit.client.1.smithi119.stdout:1/231: creat d3/db/d17/d24/f48 x:0 0 0 2023-12-17T11:57:40.370 INFO:tasks.workunit.client.1.smithi119.stdout:2/316: creat d6/d9/d13/d34/d70/f71 x:0 0 0 2023-12-17T11:57:40.370 INFO:tasks.workunit.client.1.smithi119.stdout:2/317: write d6/d9/d13/d34/d70/f71 [655366,5834] 0 2023-12-17T11:57:40.371 INFO:tasks.workunit.client.0.smithi002.stdout:5/264: dread dc/d17/f2c [0,4194304] 0 2023-12-17T11:57:40.371 INFO:tasks.workunit.client.1.smithi119.stdout:5/342: mkdir d1/d25/d39/d5a/d6b 0 2023-12-17T11:57:40.375 INFO:tasks.workunit.client.0.smithi002.stdout:5/265: truncate fa 7731768 0 2023-12-17T11:57:40.376 INFO:tasks.workunit.client.1.smithi119.stdout:8/254: getdents d7/da/d11/d26 0 2023-12-17T11:57:40.381 INFO:tasks.workunit.client.0.smithi002.stdout:6/304: dwrite d0/d1/fd [8388608,4194304] 0 2023-12-17T11:57:40.382 INFO:tasks.workunit.client.1.smithi119.stdout:1/232: getdents d3/db/d17 0 2023-12-17T11:57:40.382 INFO:tasks.workunit.client.1.smithi119.stdout:1/233: chown d3/db/d17/d24/d20 1431452 1 2023-12-17T11:57:40.382 INFO:tasks.workunit.client.1.smithi119.stdout:2/318: creat d6/d9/d52/f72 x:0 0 0 2023-12-17T11:57:40.382 INFO:tasks.workunit.client.1.smithi119.stdout:5/343: creat d1/d25/f6c x:0 0 0 2023-12-17T11:57:40.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/266: getdents dc 0 2023-12-17T11:57:40.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/267: dread - dc/d2b/f36 zero size 2023-12-17T11:57:40.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/268: write dc/f18 [21988,57375] 0 2023-12-17T11:57:40.384 INFO:tasks.workunit.client.0.smithi002.stdout:6/305: creat d0/d1/d21/d56/f5a x:0 0 0 2023-12-17T11:57:40.385 INFO:tasks.workunit.client.1.smithi119.stdout:8/255: truncate d7/da/d11/f1d 2268114 0 2023-12-17T11:57:40.385 INFO:tasks.workunit.client.1.smithi119.stdout:8/256: stat d7/d12/d1f/d2a 0 2023-12-17T11:57:40.386 INFO:tasks.workunit.client.0.smithi002.stdout:5/269: mknod dc/d2b/c4d 0 2023-12-17T11:57:40.391 INFO:tasks.workunit.client.0.smithi002.stdout:5/270: symlink dc/d1b/l4e 0 2023-12-17T11:57:40.393 INFO:tasks.workunit.client.0.smithi002.stdout:6/306: mkdir d0/d1/d5b 0 2023-12-17T11:57:40.393 INFO:tasks.workunit.client.0.smithi002.stdout:2/328: dread d3/d4/d7/d14/d1b/f27 [0,4194304] 0 2023-12-17T11:57:40.395 INFO:tasks.workunit.client.1.smithi119.stdout:1/234: symlink d3/db/d17/d24/d20/l49 0 2023-12-17T11:57:40.395 INFO:tasks.workunit.client.1.smithi119.stdout:1/235: dread - d3/db/d17/f3d zero size 2023-12-17T11:57:40.395 INFO:tasks.workunit.client.1.smithi119.stdout:2/319: rename d6/d9/d52/f69 to d6/f73 0 2023-12-17T11:57:40.395 INFO:tasks.workunit.client.0.smithi002.stdout:5/271: symlink dc/d2b/l4f 0 2023-12-17T11:57:40.396 INFO:tasks.workunit.client.1.smithi119.stdout:1/236: write d3/db/d17/d24/d20/f2d [385147,99020] 0 2023-12-17T11:57:40.407 INFO:tasks.workunit.client.0.smithi002.stdout:1/395: dwrite d3/d6/d9/d37/d39/d43/d4a/f75 [0,4194304] 0 2023-12-17T11:57:40.407 INFO:tasks.workunit.client.0.smithi002.stdout:1/396: chown d3/d6/f3e 10581067 1 2023-12-17T11:57:40.408 INFO:tasks.workunit.client.1.smithi119.stdout:2/320: mkdir d6/d9/d52/d74 0 2023-12-17T11:57:40.408 INFO:tasks.workunit.client.1.smithi119.stdout:2/321: write d6/f1f [4934583,73722] 0 2023-12-17T11:57:40.413 INFO:tasks.workunit.client.1.smithi119.stdout:4/300: dwrite dd/d15/d16/f1a [0,4194304] 0 2023-12-17T11:57:40.423 INFO:tasks.workunit.client.1.smithi119.stdout:6/284: sync 2023-12-17T11:57:40.423 INFO:tasks.workunit.client.1.smithi119.stdout:0/225: sync 2023-12-17T11:57:40.423 INFO:tasks.workunit.client.1.smithi119.stdout:0/226: chown d2/d3/d5/l2b 220793784 1 2023-12-17T11:57:40.423 INFO:tasks.workunit.client.0.smithi002.stdout:2/329: mknod d3/d4/d7/d14/c78 0 2023-12-17T11:57:40.424 INFO:tasks.workunit.client.1.smithi119.stdout:1/237: link d3/db/d26/f28 d3/db/d26/d19/d3f/f4a 0 2023-12-17T11:57:40.424 INFO:tasks.workunit.client.1.smithi119.stdout:1/238: fsync d3/db/f2b 0 2023-12-17T11:57:40.426 INFO:tasks.workunit.client.0.smithi002.stdout:1/397: dread d3/d6/d9/d30/f3d [0,4194304] 0 2023-12-17T11:57:40.430 INFO:tasks.workunit.client.1.smithi119.stdout:1/239: rename d3/db/fc to d3/db/d26/d19/f4b 0 2023-12-17T11:57:40.434 INFO:tasks.workunit.client.1.smithi119.stdout:1/240: symlink d3/db/d26/l4c 0 2023-12-17T11:57:40.434 INFO:tasks.workunit.client.1.smithi119.stdout:1/241: chown d3/db/d17/d24/d20/d3a 250 1 2023-12-17T11:57:40.436 INFO:tasks.workunit.client.1.smithi119.stdout:1/242: creat d3/db/f4d x:0 0 0 2023-12-17T11:57:40.437 INFO:tasks.workunit.client.0.smithi002.stdout:6/307: rename d0/d1/dc/d10/l57 to d0/d1/l5c 0 2023-12-17T11:57:40.437 INFO:tasks.workunit.client.0.smithi002.stdout:2/330: unlink d3/d50/l70 0 2023-12-17T11:57:40.437 INFO:tasks.workunit.client.0.smithi002.stdout:2/331: chown d3/d4/d7/d14/d42/f76 12009 1 2023-12-17T11:57:40.437 INFO:tasks.workunit.client.0.smithi002.stdout:6/308: dread - d0/d1/dc/d10/f46 zero size 2023-12-17T11:57:40.437 INFO:tasks.workunit.client.0.smithi002.stdout:2/332: chown d3/d4/d17/c25 129113 1 2023-12-17T11:57:40.437 INFO:tasks.workunit.client.0.smithi002.stdout:2/333: creat d3/d4/d7/d14/d1b/d5b/f79 x:0 0 0 2023-12-17T11:57:40.441 INFO:tasks.workunit.client.0.smithi002.stdout:1/398: symlink d3/l81 0 2023-12-17T11:57:40.441 INFO:tasks.workunit.client.0.smithi002.stdout:1/399: chown d3/d6/d16/d61/c64 496977965 1 2023-12-17T11:57:40.441 INFO:tasks.workunit.client.0.smithi002.stdout:1/400: getdents d3/d6/d9/d37/d39/d43/d4a/d7b 0 2023-12-17T11:57:40.442 INFO:tasks.workunit.client.1.smithi119.stdout:1/243: unlink d3/db/d17/f1b 0 2023-12-17T11:57:40.445 INFO:tasks.workunit.client.0.smithi002.stdout:5/272: rename dc/d17/f2e to dc/f50 0 2023-12-17T11:57:40.445 INFO:tasks.workunit.client.0.smithi002.stdout:5/273: chown dc/d2b/f36 15589961 1 2023-12-17T11:57:40.445 INFO:tasks.workunit.client.1.smithi119.stdout:1/244: rename d3/db/d17/f3d to d3/db/d2a/f4e 0 2023-12-17T11:57:40.446 INFO:tasks.workunit.client.0.smithi002.stdout:1/401: symlink d3/d6/d16/d61/l82 0 2023-12-17T11:57:40.449 INFO:tasks.workunit.client.1.smithi119.stdout:6/285: dread d2/d2b/f4c [0,4194304] 0 2023-12-17T11:57:40.449 INFO:tasks.workunit.client.1.smithi119.stdout:7/334: dwrite d2/d4/ff [0,4194304] 0 2023-12-17T11:57:40.449 INFO:tasks.workunit.client.0.smithi002.stdout:5/274: mkdir dc/d17/d2f/d51 0 2023-12-17T11:57:40.450 INFO:tasks.workunit.client.1.smithi119.stdout:1/245: symlink d3/l4f 0 2023-12-17T11:57:40.453 INFO:tasks.workunit.client.0.smithi002.stdout:1/402: link d3/d6/d16/d28/f58 d3/f83 0 2023-12-17T11:57:40.453 INFO:tasks.workunit.client.0.smithi002.stdout:1/403: chown d3/d6/d9/f2e 163562 1 2023-12-17T11:57:40.454 INFO:tasks.workunit.client.0.smithi002.stdout:5/275: mknod dc/d1a/d47/c52 0 2023-12-17T11:57:40.455 INFO:tasks.workunit.client.1.smithi119.stdout:1/246: creat d3/db/d17/d24/d20/f50 x:0 0 0 2023-12-17T11:57:40.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/335: rmdir d2/d5b 39 2023-12-17T11:57:40.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/336: chown d2/d40/l60 7448 1 2023-12-17T11:57:40.463 INFO:tasks.workunit.client.1.smithi119.stdout:7/337: mknod d2/d40/c69 0 2023-12-17T11:57:40.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/338: stat d2/ca 0 2023-12-17T11:57:40.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/339: stat d2/f35 0 2023-12-17T11:57:40.464 INFO:tasks.workunit.client.1.smithi119.stdout:0/227: dread d2/d16/f27 [0,4194304] 0 2023-12-17T11:57:40.464 INFO:tasks.workunit.client.1.smithi119.stdout:0/228: dread - d2/d16/d12/f41 zero size 2023-12-17T11:57:40.465 INFO:tasks.workunit.client.0.smithi002.stdout:5/276: mkdir dc/d1a/d53 0 2023-12-17T11:57:40.466 INFO:tasks.workunit.client.1.smithi119.stdout:7/340: mkdir d2/d4/d11/d2c/d68/d6a 0 2023-12-17T11:57:40.471 INFO:tasks.workunit.client.1.smithi119.stdout:0/229: symlink d2/d16/d12/d1f/l42 0 2023-12-17T11:57:40.471 INFO:tasks.workunit.client.1.smithi119.stdout:9/363: dwrite d12/d1d/d28/d4d/f6c [0,4194304] 0 2023-12-17T11:57:40.472 INFO:tasks.workunit.client.0.smithi002.stdout:5/277: symlink dc/d17/d2f/l54 0 2023-12-17T11:57:40.472 INFO:tasks.workunit.client.1.smithi119.stdout:9/364: chown d12/d1d/d49/f56 60 1 2023-12-17T11:57:40.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/278: rmdir dc/d1a/d40 0 2023-12-17T11:57:40.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/279: read - dc/d1a/f48 zero size 2023-12-17T11:57:40.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/346: dwrite dc/d1d/d23/f73 [0,4194304] 0 2023-12-17T11:57:40.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/347: fdatasync dc/d38/f5b 0 2023-12-17T11:57:40.481 INFO:tasks.workunit.client.1.smithi119.stdout:7/341: dread d2/f3 [4194304,4194304] 0 2023-12-17T11:57:40.483 INFO:tasks.workunit.client.1.smithi119.stdout:7/342: truncate d2/d4/d11/f21 1588915 0 2023-12-17T11:57:40.483 INFO:tasks.workunit.client.1.smithi119.stdout:7/343: read d2/f24 [2641227,25832] 0 2023-12-17T11:57:40.483 INFO:tasks.workunit.client.1.smithi119.stdout:5/344: dwrite d1/d44/f56 [4194304,4194304] 0 2023-12-17T11:57:40.483 INFO:tasks.workunit.client.1.smithi119.stdout:1/247: dread d3/db/f22 [0,4194304] 0 2023-12-17T11:57:40.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/248: creat d3/db/d26/d19/d3f/f51 x:0 0 0 2023-12-17T11:57:40.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/249: getdents d3/d44 0 2023-12-17T11:57:40.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/250: stat d3/db/d26 0 2023-12-17T11:57:40.484 INFO:tasks.workunit.client.0.smithi002.stdout:0/269: dwrite d0/d6/d26/d14/d19/d4c/f52 [0,4194304] 0 2023-12-17T11:57:40.484 INFO:tasks.workunit.client.1.smithi119.stdout:4/301: dwrite f8 [0,4194304] 0 2023-12-17T11:57:40.484 INFO:tasks.workunit.client.1.smithi119.stdout:4/302: readlink dd/d15/d16/d20/l2c 0 2023-12-17T11:57:40.485 INFO:tasks.workunit.client.1.smithi119.stdout:4/303: readlink dd/d11/l13 0 2023-12-17T11:57:40.485 INFO:tasks.workunit.client.1.smithi119.stdout:4/304: stat dd/d2a 0 2023-12-17T11:57:40.488 INFO:tasks.workunit.client.0.smithi002.stdout:3/360: dwrite f3 [0,4194304] 0 2023-12-17T11:57:40.488 INFO:tasks.workunit.client.1.smithi119.stdout:7/344: creat d2/d40/f6b x:0 0 0 2023-12-17T11:57:40.489 INFO:tasks.workunit.client.0.smithi002.stdout:7/335: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:40.494 INFO:tasks.workunit.client.1.smithi119.stdout:5/345: creat d1/f6d x:0 0 0 2023-12-17T11:57:40.495 INFO:tasks.workunit.client.1.smithi119.stdout:0/230: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:40.498 INFO:tasks.workunit.client.1.smithi119.stdout:8/257: dwrite d7/d18/d15/f1b [0,4194304] 0 2023-12-17T11:57:40.501 INFO:tasks.workunit.client.1.smithi119.stdout:1/251: rename d3/db/d17/d24/c3e to d3/db/d17/d24/d20/d40/c52 0 2023-12-17T11:57:40.501 INFO:tasks.workunit.client.1.smithi119.stdout:1/252: fsync d3/db/f1f 0 2023-12-17T11:57:40.505 INFO:tasks.workunit.client.0.smithi002.stdout:9/348: getdents dc/d1d/d25 0 2023-12-17T11:57:40.505 INFO:tasks.workunit.client.1.smithi119.stdout:5/346: dread d1/d36/f3d [0,4194304] 0 2023-12-17T11:57:40.509 INFO:tasks.workunit.client.1.smithi119.stdout:4/305: mknod dd/d15/d16/c60 0 2023-12-17T11:57:40.513 INFO:tasks.workunit.client.0.smithi002.stdout:0/270: dread d0/d15/f27 [0,4194304] 0 2023-12-17T11:57:40.514 INFO:tasks.workunit.client.0.smithi002.stdout:3/361: creat d9/d1b/d35/d41/d59/d65/f77 x:0 0 0 2023-12-17T11:57:40.514 INFO:tasks.workunit.client.1.smithi119.stdout:0/231: rmdir d2/d16/d12/d1f 39 2023-12-17T11:57:40.515 INFO:tasks.workunit.client.1.smithi119.stdout:7/345: truncate d2/f10 903307 0 2023-12-17T11:57:40.517 INFO:tasks.workunit.client.0.smithi002.stdout:7/336: write d6/d17/dc/d13/d37/d4c/f35 [4031856,50664] 0 2023-12-17T11:57:40.517 INFO:tasks.workunit.client.0.smithi002.stdout:7/337: truncate d6/d17/dc/d13/d21/d2e/f5a 211968 0 2023-12-17T11:57:40.519 INFO:tasks.workunit.client.0.smithi002.stdout:6/309: dread d0/d1/f23 [0,4194304] 0 2023-12-17T11:57:40.532 INFO:tasks.workunit.client.1.smithi119.stdout:5/347: write d1/d44/f56 [4072992,128396] 0 2023-12-17T11:57:40.536 INFO:tasks.workunit.client.1.smithi119.stdout:8/258: mknod d7/d18/d45/c51 0 2023-12-17T11:57:40.537 INFO:tasks.workunit.client.0.smithi002.stdout:9/349: write dc/d42/f4a [4157603,43198] 0 2023-12-17T11:57:40.541 INFO:tasks.workunit.client.0.smithi002.stdout:0/271: readlink d0/d6/d26/l1f 0 2023-12-17T11:57:40.541 INFO:tasks.workunit.client.1.smithi119.stdout:1/253: truncate d3/db/d26/f39 343815 0 2023-12-17T11:57:40.541 INFO:tasks.workunit.client.1.smithi119.stdout:4/306: mknod dd/d15/d4f/c61 0 2023-12-17T11:57:40.544 INFO:tasks.workunit.client.0.smithi002.stdout:3/362: symlink d9/d1b/d35/d41/d43/d73/l78 0 2023-12-17T11:57:40.544 INFO:tasks.workunit.client.0.smithi002.stdout:3/363: chown d9/f1d 15 1 2023-12-17T11:57:40.544 INFO:tasks.workunit.client.1.smithi119.stdout:5/348: symlink d1/d44/l6e 0 2023-12-17T11:57:40.545 INFO:tasks.workunit.client.0.smithi002.stdout:2/334: dwrite d3/d50/f53 [4194304,4194304] 0 2023-12-17T11:57:40.545 INFO:tasks.workunit.client.0.smithi002.stdout:2/335: chown d3/d4/d7/d14/d1b/l2f 21796196 1 2023-12-17T11:57:40.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/349: write d1/d44/d52/f5f [574592,130050] 0 2023-12-17T11:57:40.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/350: write d1/d25/f68 [847860,66280] 0 2023-12-17T11:57:40.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/351: chown d1/d36/c5e 1 1 2023-12-17T11:57:40.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/352: write d1/f8 [2335164,47316] 0 2023-12-17T11:57:40.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/353: read - d1/d36/d3a/f67 zero size 2023-12-17T11:57:40.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/354: write d1/d36/d3a/f67 [257532,9389] 0 2023-12-17T11:57:40.547 INFO:tasks.workunit.client.0.smithi002.stdout:7/338: rename d6/d17/dc/d13/f2d to d6/d17/f61 0 2023-12-17T11:57:40.549 INFO:tasks.workunit.client.1.smithi119.stdout:8/259: symlink d7/d12/d1f/l52 0 2023-12-17T11:57:40.549 INFO:tasks.workunit.client.0.smithi002.stdout:9/350: mkdir dc/d1d/d7c 0 2023-12-17T11:57:40.552 INFO:tasks.workunit.client.1.smithi119.stdout:1/254: unlink d3/db/l42 0 2023-12-17T11:57:40.553 INFO:tasks.workunit.client.0.smithi002.stdout:0/272: symlink d0/d15/l58 0 2023-12-17T11:57:40.555 INFO:tasks.workunit.client.0.smithi002.stdout:5/280: dwrite f4 [0,4194304] 0 2023-12-17T11:57:40.557 INFO:tasks.workunit.client.1.smithi119.stdout:1/255: creat d3/db/d17/d24/f53 x:0 0 0 2023-12-17T11:57:40.557 INFO:tasks.workunit.client.1.smithi119.stdout:4/307: mknod dd/d15/d16/d5a/c62 0 2023-12-17T11:57:40.558 INFO:tasks.workunit.client.0.smithi002.stdout:2/336: creat d3/d4/d17/d19/d4d/d72/d77/f7a x:0 0 0 2023-12-17T11:57:40.558 INFO:tasks.workunit.client.0.smithi002.stdout:2/337: fsync d3/d4/d17/d19/f67 0 2023-12-17T11:57:40.558 INFO:tasks.workunit.client.0.smithi002.stdout:2/338: write d3/d4/d7/d14/d1b/f29 [433276,19365] 0 2023-12-17T11:57:40.560 INFO:tasks.workunit.client.0.smithi002.stdout:4/320: sync 2023-12-17T11:57:40.561 INFO:tasks.workunit.client.0.smithi002.stdout:8/340: sync 2023-12-17T11:57:40.562 INFO:tasks.workunit.client.1.smithi119.stdout:8/260: creat d7/d18/d45/f53 x:0 0 0 2023-12-17T11:57:40.564 INFO:tasks.workunit.client.1.smithi119.stdout:0/232: dread d2/d16/d12/f32 [0,4194304] 0 2023-12-17T11:57:40.564 INFO:tasks.workunit.client.1.smithi119.stdout:0/233: fsync d2/d16/d12/f1c 0 2023-12-17T11:57:40.568 INFO:tasks.workunit.client.1.smithi119.stdout:1/256: symlink d3/db/d17/d24/d20/d3a/l54 0 2023-12-17T11:57:40.569 INFO:tasks.workunit.client.1.smithi119.stdout:4/308: dread dd/d11/d2d/f3e [0,4194304] 0 2023-12-17T11:57:40.569 INFO:tasks.workunit.client.1.smithi119.stdout:4/309: fdatasync dd/d11/d26/f52 0 2023-12-17T11:57:40.570 INFO:tasks.workunit.client.0.smithi002.stdout:1/404: dwrite d3/d6/f3e [0,4194304] 0 2023-12-17T11:57:40.570 INFO:tasks.workunit.client.0.smithi002.stdout:0/273: mkdir d0/d15/d59 0 2023-12-17T11:57:40.573 INFO:tasks.workunit.client.0.smithi002.stdout:9/351: dread dc/d1d/d23/f2b [0,4194304] 0 2023-12-17T11:57:40.573 INFO:tasks.workunit.client.1.smithi119.stdout:5/355: dread d1/d25/f46 [0,4194304] 0 2023-12-17T11:57:40.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/281: rename dc/d2b/f38 to dc/d17/f55 0 2023-12-17T11:57:40.578 INFO:tasks.workunit.client.0.smithi002.stdout:5/282: fsync dc/d17/f26 0 2023-12-17T11:57:40.582 INFO:tasks.workunit.client.0.smithi002.stdout:8/341: write d3/d7/d18/d3f/f60 [1898583,58658] 0 2023-12-17T11:57:40.585 INFO:tasks.workunit.client.1.smithi119.stdout:4/310: getdents dd/d15/d16/d3d 0 2023-12-17T11:57:40.586 INFO:tasks.workunit.client.1.smithi119.stdout:5/356: mknod d1/d25/d39/d5a/d6b/c6f 0 2023-12-17T11:57:40.589 INFO:tasks.workunit.client.0.smithi002.stdout:7/339: dread d6/d17/f1a [4194304,4194304] 0 2023-12-17T11:57:40.590 INFO:tasks.workunit.client.0.smithi002.stdout:0/274: creat d0/d6/d26/d14/d19/d2b/f5a x:0 0 0 2023-12-17T11:57:40.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/283: creat dc/d1b/d2d/f56 x:0 0 0 2023-12-17T11:57:40.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/284: dread - dc/f50 zero size 2023-12-17T11:57:40.591 INFO:tasks.workunit.client.0.smithi002.stdout:5/285: chown dc/l1e 827912 1 2023-12-17T11:57:40.591 INFO:tasks.workunit.client.0.smithi002.stdout:9/352: dread dc/f14 [0,4194304] 0 2023-12-17T11:57:40.592 INFO:tasks.workunit.client.1.smithi119.stdout:4/311: mknod dd/c63 0 2023-12-17T11:57:40.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/405: rename d3/d6/d9/d37/d39/d43/d4a/f72 to d3/d6/f84 0 2023-12-17T11:57:40.595 INFO:tasks.workunit.client.0.smithi002.stdout:1/406: fdatasync d3/d6/d16/f26 0 2023-12-17T11:57:40.595 INFO:tasks.workunit.client.1.smithi119.stdout:4/312: symlink dd/d15/l64 0 2023-12-17T11:57:40.596 INFO:tasks.workunit.client.0.smithi002.stdout:8/342: symlink d3/d7/d6e/l78 0 2023-12-17T11:57:40.598 INFO:tasks.workunit.client.1.smithi119.stdout:8/261: dread d7/d18/d15/f1b [0,4194304] 0 2023-12-17T11:57:40.600 INFO:tasks.workunit.client.1.smithi119.stdout:4/313: creat dd/d15/d16/d20/d42/f65 x:0 0 0 2023-12-17T11:57:40.600 INFO:tasks.workunit.client.1.smithi119.stdout:4/314: readlink dd/d2a/l40 0 2023-12-17T11:57:40.600 INFO:tasks.workunit.client.0.smithi002.stdout:7/340: creat d6/d17/dc/d13/d21/f62 x:0 0 0 2023-12-17T11:57:40.600 INFO:tasks.workunit.client.0.smithi002.stdout:7/341: truncate d6/d17/dc/f51 4396094 0 2023-12-17T11:57:40.601 INFO:tasks.workunit.client.0.smithi002.stdout:7/342: fdatasync d6/d17/f48 0 2023-12-17T11:57:40.602 INFO:tasks.workunit.client.0.smithi002.stdout:9/353: dread dc/f11 [0,4194304] 0 2023-12-17T11:57:40.603 INFO:tasks.workunit.client.0.smithi002.stdout:5/286: symlink dc/d1b/l57 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:8/262: getdents d7/da/d1a 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:8/263: chown d7/d18/f4f 5021458 1 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:8/264: write d7/da/f3e [836554,123427] 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:1/257: write d3/db/d26/f11 [2051599,83891] 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:1/258: write d3/db/d26/f21 [1769201,97479] 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:1/259: creat d3/db/d26/f55 x:0 0 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:6/286: dwrite d2/df/f55 [0,4194304] 0 2023-12-17T11:57:40.604 INFO:tasks.workunit.client.1.smithi119.stdout:7/346: dwrite d2/d4b/f52 [0,4194304] 0 2023-12-17T11:57:40.609 INFO:tasks.workunit.client.1.smithi119.stdout:4/315: unlink dd/d15/d16/c60 0 2023-12-17T11:57:40.611 INFO:tasks.workunit.client.1.smithi119.stdout:9/365: dwrite d12/f2c [0,4194304] 0 2023-12-17T11:57:40.612 INFO:tasks.workunit.client.0.smithi002.stdout:4/321: rmdir d0/d10/d14/d50 0 2023-12-17T11:57:40.614 INFO:tasks.workunit.client.1.smithi119.stdout:5/357: write d1/d36/f47 [1211213,100643] 0 2023-12-17T11:57:40.614 INFO:tasks.workunit.client.1.smithi119.stdout:8/265: symlink d7/da/d11/d26/d49/l54 0 2023-12-17T11:57:40.614 INFO:tasks.workunit.client.1.smithi119.stdout:8/266: creat d7/f55 x:0 0 0 2023-12-17T11:57:40.615 INFO:tasks.workunit.client.1.smithi119.stdout:7/347: dread d2/d4/d3e/d57/d56/f62 [0,4194304] 0 2023-12-17T11:57:40.615 INFO:tasks.workunit.client.1.smithi119.stdout:7/348: dread - d2/f31 zero size 2023-12-17T11:57:40.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/343: creat d3/d7/d18/d74/f79 x:0 0 0 2023-12-17T11:57:40.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/344: chown d3/d7/d1a/c56 32239598 1 2023-12-17T11:57:40.619 INFO:tasks.workunit.client.0.smithi002.stdout:7/343: creat d6/d17/dc/d13/d37/d4f/f63 x:0 0 0 2023-12-17T11:57:40.623 INFO:tasks.workunit.client.0.smithi002.stdout:0/275: rmdir d0/d6/d26/d14/d19/d37 39 2023-12-17T11:57:40.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/287: mknod dc/d1a/d53/c58 0 2023-12-17T11:57:40.624 INFO:tasks.workunit.client.1.smithi119.stdout:6/287: write d2/f2e [9597,77246] 0 2023-12-17T11:57:40.625 INFO:tasks.workunit.client.1.smithi119.stdout:0/234: dwrite d2/d16/d12/f1c [0,4194304] 0 2023-12-17T11:57:40.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/339: dwrite d3/d4/d17/d19/f24 [0,4194304] 0 2023-12-17T11:57:40.626 INFO:tasks.workunit.client.0.smithi002.stdout:2/340: creat d3/d4/d7/d14/d2e/f7b x:0 0 0 2023-12-17T11:57:40.627 INFO:tasks.workunit.client.0.smithi002.stdout:3/364: dwrite d9/d15/f19 [0,4194304] 0 2023-12-17T11:57:40.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/407: rmdir d3/d6/d16/d61 39 2023-12-17T11:57:40.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/408: chown d3/d6/d16/d28 1 1 2023-12-17T11:57:40.632 INFO:tasks.workunit.client.0.smithi002.stdout:8/345: creat d3/d8/d28/d31/d5a/f7a x:0 0 0 2023-12-17T11:57:40.632 INFO:tasks.workunit.client.0.smithi002.stdout:8/346: chown d3/d7/c14 164235133 1 2023-12-17T11:57:40.632 INFO:tasks.workunit.client.0.smithi002.stdout:1/409: chown d3/d6/d9/d37/d39/c4b 773055 1 2023-12-17T11:57:40.632 INFO:tasks.workunit.client.0.smithi002.stdout:8/347: truncate d3/d7/d18/d3f/d49/f4b 894115 0 2023-12-17T11:57:40.635 INFO:tasks.workunit.client.1.smithi119.stdout:1/260: mknod d3/db/d17/c56 0 2023-12-17T11:57:40.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/288: mknod dc/d1a/d53/c59 0 2023-12-17T11:57:40.637 INFO:tasks.workunit.client.1.smithi119.stdout:4/316: truncate dd/d4b/f54 172755 0 2023-12-17T11:57:40.637 INFO:tasks.workunit.client.1.smithi119.stdout:4/317: creat dd/d11/d26/f66 x:0 0 0 2023-12-17T11:57:40.637 INFO:tasks.workunit.client.1.smithi119.stdout:4/318: write dd/f4a [1479376,79716] 0 2023-12-17T11:57:40.638 INFO:tasks.workunit.client.1.smithi119.stdout:4/319: creat dd/d15/d16/d20/d42/f67 x:0 0 0 2023-12-17T11:57:40.638 INFO:tasks.workunit.client.1.smithi119.stdout:4/320: write dd/f38 [2536876,14939] 0 2023-12-17T11:57:40.638 INFO:tasks.workunit.client.1.smithi119.stdout:4/321: creat dd/d11/d2d/f68 x:0 0 0 2023-12-17T11:57:40.638 INFO:tasks.workunit.client.1.smithi119.stdout:4/322: read - dd/d11/d26/f66 zero size 2023-12-17T11:57:40.649 INFO:tasks.workunit.client.0.smithi002.stdout:1/410: write d3/d6/f3e [2267952,68290] 0 2023-12-17T11:57:40.649 INFO:tasks.workunit.client.0.smithi002.stdout:1/411: fsync d3/d2f/f79 0 2023-12-17T11:57:40.653 INFO:tasks.workunit.client.0.smithi002.stdout:4/322: getdents d0/d10 0 2023-12-17T11:57:40.656 INFO:tasks.workunit.client.0.smithi002.stdout:3/365: read f3 [3868075,37404] 0 2023-12-17T11:57:40.656 INFO:tasks.workunit.client.0.smithi002.stdout:8/348: mkdir d3/d7/d18/d74/d7b 0 2023-12-17T11:57:40.659 INFO:tasks.workunit.client.0.smithi002.stdout:9/354: dwrite dc/d32/f7a [0,4194304] 0 2023-12-17T11:57:40.659 INFO:tasks.workunit.client.0.smithi002.stdout:9/355: fsync dc/d1d/d23/f29 0 2023-12-17T11:57:40.662 INFO:tasks.workunit.client.0.smithi002.stdout:5/289: mkdir dc/d1b/d5a 0 2023-12-17T11:57:40.667 INFO:tasks.workunit.client.0.smithi002.stdout:7/344: dwrite d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:40.667 INFO:tasks.workunit.client.0.smithi002.stdout:7/345: readlink d6/d17/dc/d13/d21/d2e/l39 0 2023-12-17T11:57:40.667 INFO:tasks.workunit.client.0.smithi002.stdout:7/346: readlink d6/d17/dc/d13/d21/d2e/l39 0 2023-12-17T11:57:40.667 INFO:tasks.workunit.client.1.smithi119.stdout:9/366: symlink d12/d1d/d28/d46/l70 0 2023-12-17T11:57:40.667 INFO:tasks.workunit.client.1.smithi119.stdout:5/358: dwrite d1/f20 [0,4194304] 0 2023-12-17T11:57:40.669 INFO:tasks.workunit.client.0.smithi002.stdout:3/366: write d9/d1b/d35/d41/f42 [75036,68298] 0 2023-12-17T11:57:40.673 INFO:tasks.workunit.client.1.smithi119.stdout:8/267: rename d7/f17 to d7/d18/d45/f56 0 2023-12-17T11:57:40.675 INFO:tasks.workunit.client.1.smithi119.stdout:7/349: mkdir d2/d4e/d6c 0 2023-12-17T11:57:40.675 INFO:tasks.workunit.client.0.smithi002.stdout:3/367: dread d9/f1e [0,4194304] 0 2023-12-17T11:57:40.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/412: link c0 d3/d6/d9/d30/c85 0 2023-12-17T11:57:40.682 INFO:tasks.workunit.client.1.smithi119.stdout:3/342: sync 2023-12-17T11:57:40.682 INFO:tasks.workunit.client.1.smithi119.stdout:3/343: dread - d9/d59/f5d zero size 2023-12-17T11:57:40.682 INFO:tasks.workunit.client.1.smithi119.stdout:3/344: fdatasync d9/da/df/f27 0 2023-12-17T11:57:40.682 INFO:tasks.workunit.client.1.smithi119.stdout:3/345: chown d9/f1b 1 1 2023-12-17T11:57:40.684 INFO:tasks.workunit.client.1.smithi119.stdout:0/235: symlink d2/d3/l43 0 2023-12-17T11:57:40.684 INFO:tasks.workunit.client.1.smithi119.stdout:0/236: fsync d2/f4 0 2023-12-17T11:57:40.685 INFO:tasks.workunit.client.0.smithi002.stdout:2/341: rmdir d3/d4/d7/d14/d2e 39 2023-12-17T11:57:40.687 INFO:tasks.workunit.client.1.smithi119.stdout:2/322: sync 2023-12-17T11:57:40.687 INFO:tasks.workunit.client.1.smithi119.stdout:2/323: chown d6/d38/l67 0 1 2023-12-17T11:57:40.687 INFO:tasks.workunit.client.1.smithi119.stdout:2/324: truncate d6/d9/d13/f32 1400516 0 2023-12-17T11:57:40.687 INFO:tasks.workunit.client.1.smithi119.stdout:2/325: fdatasync d6/d9/d13/d34/f64 0 2023-12-17T11:57:40.688 INFO:tasks.workunit.client.0.smithi002.stdout:4/323: symlink d0/d3e/d47/l6a 0 2023-12-17T11:57:40.691 INFO:tasks.workunit.client.1.smithi119.stdout:8/268: dread d7/da/f41 [4194304,4194304] 0 2023-12-17T11:57:40.691 INFO:tasks.workunit.client.1.smithi119.stdout:8/269: chown d7/da/d11/d26/f28 100505 1 2023-12-17T11:57:40.691 INFO:tasks.workunit.client.0.smithi002.stdout:8/349: mkdir d3/d8/d28/d31/d5a/d7c 0 2023-12-17T11:57:40.692 INFO:tasks.workunit.client.0.smithi002.stdout:3/368: write d9/d15/f19 [2959446,84536] 0 2023-12-17T11:57:40.695 INFO:tasks.workunit.client.1.smithi119.stdout:4/323: symlink dd/d15/d16/d5a/l69 0 2023-12-17T11:57:40.703 INFO:tasks.workunit.client.0.smithi002.stdout:5/290: rmdir dc/d17/d2f/d51 0 2023-12-17T11:57:40.705 INFO:tasks.workunit.client.1.smithi119.stdout:9/367: rename d12/d1d/d28/c67 to d12/d1d/d49/c71 0 2023-12-17T11:57:40.705 INFO:tasks.workunit.client.1.smithi119.stdout:0/237: read d2/d16/d12/d1f/f22 [3744717,44797] 0 2023-12-17T11:57:40.706 INFO:tasks.workunit.client.1.smithi119.stdout:9/368: stat d12/d1d/c29 0 2023-12-17T11:57:40.706 INFO:tasks.workunit.client.1.smithi119.stdout:0/238: stat d2/d16/d12/f32 0 2023-12-17T11:57:40.706 INFO:tasks.workunit.client.1.smithi119.stdout:0/239: chown d2/d16/d12/d21/c2c 18292 1 2023-12-17T11:57:40.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/288: getdents d2 0 2023-12-17T11:57:40.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/289: fsync d2/df/f4b 0 2023-12-17T11:57:40.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/290: readlink d2/l22 0 2023-12-17T11:57:40.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/347: rename d6/d17/dc/d13/d37/d4f/l54 to d6/d17/dc/d13/d37/d4c/l64 0 2023-12-17T11:57:40.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/348: fsync d6/d17/dc/d13/d21/f62 0 2023-12-17T11:57:40.712 INFO:tasks.workunit.client.0.smithi002.stdout:1/413: creat d3/d6/d16/d61/f86 x:0 0 0 2023-12-17T11:57:40.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/324: symlink d0/d10/d14/d27/d57/l6b 0 2023-12-17T11:57:40.717 INFO:tasks.workunit.client.1.smithi119.stdout:8/270: symlink d7/d18/d45/l57 0 2023-12-17T11:57:40.719 INFO:tasks.workunit.client.0.smithi002.stdout:6/310: sync 2023-12-17T11:57:40.719 INFO:tasks.workunit.client.0.smithi002.stdout:8/350: link d3/d7/f63 d3/d8/d28/d31/d5a/d7c/f7d 0 2023-12-17T11:57:40.721 INFO:tasks.workunit.client.1.smithi119.stdout:9/369: write d12/d1d/d28/f3d [4291747,14819] 0 2023-12-17T11:57:40.721 INFO:tasks.workunit.client.1.smithi119.stdout:9/370: creat d12/d65/f72 x:0 0 0 2023-12-17T11:57:40.721 INFO:tasks.workunit.client.1.smithi119.stdout:4/324: unlink dd/d15/d16/f58 0 2023-12-17T11:57:40.722 INFO:tasks.workunit.client.0.smithi002.stdout:7/349: write d6/d17/dc/d13/f57 [3667696,7507] 0 2023-12-17T11:57:40.723 INFO:tasks.workunit.client.0.smithi002.stdout:7/350: creat d6/d17/f65 x:0 0 0 2023-12-17T11:57:40.723 INFO:tasks.workunit.client.0.smithi002.stdout:7/351: chown d6/d17/dc/d13/d3e/f4b 818 1 2023-12-17T11:57:40.723 INFO:tasks.workunit.client.0.smithi002.stdout:3/369: mkdir d9/d15/d52/d79 0 2023-12-17T11:57:40.723 INFO:tasks.workunit.client.0.smithi002.stdout:3/370: getdents d9/d24/d6f 0 2023-12-17T11:57:40.723 INFO:tasks.workunit.client.0.smithi002.stdout:4/325: dread d0/d10/d21/f2f [0,4194304] 0 2023-12-17T11:57:40.724 INFO:tasks.workunit.client.1.smithi119.stdout:0/240: dread d2/d16/f27 [0,4194304] 0 2023-12-17T11:57:40.724 INFO:tasks.workunit.client.1.smithi119.stdout:0/241: stat d2/d16/d12/d1f/l42 0 2023-12-17T11:57:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:40 smithi002 ceph-mon[107131]: pgmap v23: 65 pgs: 65 active+clean; 947 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 82 MiB/s rd, 119 MiB/s wr, 587 op/s 2023-12-17T11:57:40.725 INFO:tasks.workunit.client.1.smithi119.stdout:5/359: rename d1/d25/d39/d5a to d1/d70 0 2023-12-17T11:57:40.726 INFO:tasks.workunit.client.0.smithi002.stdout:9/356: rmdir dc/d1d/d23 39 2023-12-17T11:57:40.729 INFO:tasks.workunit.client.0.smithi002.stdout:5/291: mkdir dc/d1b/d2d/d5b 0 2023-12-17T11:57:40.731 INFO:tasks.workunit.client.0.smithi002.stdout:4/326: dread d0/d10/f31 [0,4194304] 0 2023-12-17T11:57:40.733 INFO:tasks.workunit.client.0.smithi002.stdout:2/342: rename d3/d4/d7/d14/d1b/f27 to d3/d4/d17/d19/f7c 0 2023-12-17T11:57:40.735 INFO:tasks.workunit.client.1.smithi119.stdout:8/271: dread d7/f35 [0,4194304] 0 2023-12-17T11:57:40.736 INFO:tasks.workunit.client.1.smithi119.stdout:8/272: write d7/f27 [1727936,75672] 0 2023-12-17T11:57:40.736 INFO:tasks.workunit.client.1.smithi119.stdout:2/326: dwrite f5 [0,4194304] 0 2023-12-17T11:57:40.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/414: mkdir d3/d6/d9/d30/d87 0 2023-12-17T11:57:40.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/415: write d3/d6/d9/d30/f56 [588055,6969] 0 2023-12-17T11:57:40.737 INFO:tasks.workunit.client.0.smithi002.stdout:6/311: mknod d0/d1/d21/c5d 0 2023-12-17T11:57:40.737 INFO:tasks.workunit.client.0.smithi002.stdout:6/312: fsync d0/d1/d21/f38 0 2023-12-17T11:57:40.738 INFO:tasks.workunit.client.0.smithi002.stdout:3/371: dread d9/d15/f2b [0,4194304] 0 2023-12-17T11:57:40.738 INFO:tasks.workunit.client.1.smithi119.stdout:6/291: getdents d2/d2b 0 2023-12-17T11:57:40.738 INFO:tasks.workunit.client.1.smithi119.stdout:6/292: readlink d2/d2b/l48 0 2023-12-17T11:57:40.738 INFO:tasks.workunit.client.1.smithi119.stdout:5/360: dread d1/f2e [0,4194304] 0 2023-12-17T11:57:40.739 INFO:tasks.workunit.client.0.smithi002.stdout:4/327: dread d0/d10/f31 [0,4194304] 0 2023-12-17T11:57:40.739 INFO:tasks.workunit.client.0.smithi002.stdout:4/328: write d0/d10/f39 [4389421,71753] 0 2023-12-17T11:57:40.741 INFO:tasks.workunit.client.0.smithi002.stdout:8/351: creat d3/d8/d28/d31/d5a/d7c/f7e x:0 0 0 2023-12-17T11:57:40.741 INFO:tasks.workunit.client.0.smithi002.stdout:8/352: readlink d3/d8/l4d 0 2023-12-17T11:57:40.742 INFO:tasks.workunit.client.1.smithi119.stdout:4/325: getdents dd/d2a 0 2023-12-17T11:57:40.745 INFO:tasks.workunit.client.0.smithi002.stdout:2/343: dread d3/d4/d7/f1a [0,4194304] 0 2023-12-17T11:57:40.745 INFO:tasks.workunit.client.0.smithi002.stdout:2/344: write d3/d4/d7/d14/d2e/f7b [191946,103376] 0 2023-12-17T11:57:40.746 INFO:tasks.workunit.client.1.smithi119.stdout:8/273: creat d7/da/d11/d26/f58 x:0 0 0 2023-12-17T11:57:40.749 INFO:tasks.workunit.client.0.smithi002.stdout:7/352: symlink d6/d17/dc/d13/d21/l66 0 2023-12-17T11:57:40.749 INFO:tasks.workunit.client.0.smithi002.stdout:7/353: dread - d6/d17/dc/d13/d37/d4f/f63 zero size 2023-12-17T11:57:40.749 INFO:tasks.workunit.client.0.smithi002.stdout:9/357: symlink dc/l7d 0 2023-12-17T11:57:40.750 INFO:tasks.workunit.client.1.smithi119.stdout:5/361: mkdir d1/d25/d39/d71 0 2023-12-17T11:57:40.752 INFO:tasks.workunit.client.1.smithi119.stdout:4/326: mkdir dd/d4b/d6a 0 2023-12-17T11:57:40.753 INFO:tasks.workunit.client.1.smithi119.stdout:7/350: rename d2/d4e/f33 to d2/d40/f6d 0 2023-12-17T11:57:40.753 INFO:tasks.workunit.client.0.smithi002.stdout:1/416: mknod d3/d6/d59/c88 0 2023-12-17T11:57:40.757 INFO:tasks.workunit.client.0.smithi002.stdout:6/313: mknod d0/d1/dc/d10/c5e 0 2023-12-17T11:57:40.760 INFO:tasks.workunit.client.1.smithi119.stdout:0/242: rename d2/d16/d12/d21 to d2/d16/d12/d2e/d44 0 2023-12-17T11:57:40.761 INFO:tasks.workunit.client.1.smithi119.stdout:0/243: stat d2/d3/d5/d3f 0 2023-12-17T11:57:40.761 INFO:tasks.workunit.client.1.smithi119.stdout:0/244: readlink d2/d3/d5/lb 0 2023-12-17T11:57:40.761 INFO:tasks.workunit.client.1.smithi119.stdout:0/245: write d2/d16/d12/f32 [4393514,93267] 0 2023-12-17T11:57:40.764 INFO:tasks.workunit.client.1.smithi119.stdout:5/362: dread d1/d25/f2c [0,4194304] 0 2023-12-17T11:57:40.764 INFO:tasks.workunit.client.1.smithi119.stdout:5/363: fdatasync d1/d36/d57/f66 0 2023-12-17T11:57:40.764 INFO:tasks.workunit.client.1.smithi119.stdout:5/364: fsync d1/f20 0 2023-12-17T11:57:40.764 INFO:tasks.workunit.client.1.smithi119.stdout:7/351: creat d2/d4/d11/d2c/d55/f6e x:0 0 0 2023-12-17T11:57:40.764 INFO:tasks.workunit.client.1.smithi119.stdout:5/365: read d1/d44/f4c [103503,13298] 0 2023-12-17T11:57:40.766 INFO:tasks.workunit.client.1.smithi119.stdout:6/293: unlink d2/df/d17/f23 0 2023-12-17T11:57:40.766 INFO:tasks.workunit.client.1.smithi119.stdout:6/294: readlink d2/d2b/l48 0 2023-12-17T11:57:40.767 INFO:tasks.workunit.client.0.smithi002.stdout:4/329: mkdir d0/d6c 0 2023-12-17T11:57:40.771 INFO:tasks.workunit.client.1.smithi119.stdout:8/274: rmdir d7/d18/d45 39 2023-12-17T11:57:40.771 INFO:tasks.workunit.client.1.smithi119.stdout:8/275: chown d7/d18/d45/l57 247544825 1 2023-12-17T11:57:40.771 INFO:tasks.workunit.client.1.smithi119.stdout:4/327: read dd/d15/d16/f1a [3038380,60723] 0 2023-12-17T11:57:40.771 INFO:tasks.workunit.client.1.smithi119.stdout:4/328: dread - dd/d11/f5e zero size 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:0/246: symlink d2/d16/d35/l45 0 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:7/352: mknod d2/d4e/c6f 0 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:7/353: write d2/f24 [1208173,6919] 0 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:7/354: chown d2/d4/d3e/d57/d56/f62 997142 1 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:5/366: creat d1/d44/f72 x:0 0 0 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:5/367: write d1/d36/d3a/f4b [3364779,29634] 0 2023-12-17T11:57:40.777 INFO:tasks.workunit.client.1.smithi119.stdout:5/368: chown d1/d36/d3a/f4b 0 1 2023-12-17T11:57:40.779 INFO:tasks.workunit.client.1.smithi119.stdout:6/295: rename d2/d2b/f2d to d2/d2b/d43/f58 0 2023-12-17T11:57:40.779 INFO:tasks.workunit.client.1.smithi119.stdout:2/327: dwrite d6/f40 [0,4194304] 0 2023-12-17T11:57:40.781 INFO:tasks.workunit.client.0.smithi002.stdout:8/353: unlink d3/d8/d28/f68 0 2023-12-17T11:57:40.781 INFO:tasks.workunit.client.0.smithi002.stdout:8/354: write d3/d7/d1a/f6a [50684,5986] 0 2023-12-17T11:57:40.781 INFO:tasks.workunit.client.0.smithi002.stdout:8/355: write d3/d7/d1a/f6a [90085,75041] 0 2023-12-17T11:57:40.781 INFO:tasks.workunit.client.1.smithi119.stdout:4/329: unlink dd/d15/d16/d3d/c46 0 2023-12-17T11:57:40.783 INFO:tasks.workunit.client.0.smithi002.stdout:2/345: truncate d3/d4/fd 7707840 0 2023-12-17T11:57:40.789 INFO:tasks.workunit.client.1.smithi119.stdout:5/369: creat d1/d25/d39/d71/f73 x:0 0 0 2023-12-17T11:57:40.790 INFO:tasks.workunit.client.1.smithi119.stdout:5/370: creat d1/d44/f74 x:0 0 0 2023-12-17T11:57:40.793 INFO:tasks.workunit.client.0.smithi002.stdout:9/358: creat dc/d42/d4f/d59/d47/d4b/f7e x:0 0 0 2023-12-17T11:57:40.796 INFO:tasks.workunit.client.0.smithi002.stdout:5/292: getdents dc/d2b 0 2023-12-17T11:57:40.800 INFO:tasks.workunit.client.1.smithi119.stdout:2/328: mknod d6/d2b/d3f/c75 0 2023-12-17T11:57:40.800 INFO:tasks.workunit.client.1.smithi119.stdout:2/329: readlink d6/d38/l67 0 2023-12-17T11:57:40.802 INFO:tasks.workunit.client.0.smithi002.stdout:6/314: truncate d0/d1/dc/f34 259640 0 2023-12-17T11:57:40.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/372: dwrite d9/d15/f32 [0,4194304] 0 2023-12-17T11:57:40.805 INFO:tasks.workunit.client.1.smithi119.stdout:6/296: creat d2/f59 x:0 0 0 2023-12-17T11:57:40.805 INFO:tasks.workunit.client.1.smithi119.stdout:6/297: chown d2/f26 207356 1 2023-12-17T11:57:40.805 INFO:tasks.workunit.client.1.smithi119.stdout:6/298: creat d2/f5a x:0 0 0 2023-12-17T11:57:40.805 INFO:tasks.workunit.client.1.smithi119.stdout:6/299: stat d2/d2b/c40 0 2023-12-17T11:57:40.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/346: creat d3/d4/d7/d14/d2e/d37/f7d x:0 0 0 2023-12-17T11:57:40.809 INFO:tasks.workunit.client.1.smithi119.stdout:4/330: creat dd/d15/d4f/f6b x:0 0 0 2023-12-17T11:57:40.809 INFO:tasks.workunit.client.1.smithi119.stdout:4/331: write dd/d11/d26/f36 [99364,73347] 0 2023-12-17T11:57:40.811 INFO:tasks.workunit.client.0.smithi002.stdout:8/356: dread d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:40.816 INFO:tasks.workunit.client.0.smithi002.stdout:9/359: creat dc/d1d/d23/f7f x:0 0 0 2023-12-17T11:57:40.816 INFO:tasks.workunit.client.0.smithi002.stdout:9/360: readlink dc/d1d/l68 0 2023-12-17T11:57:40.818 INFO:tasks.workunit.client.0.smithi002.stdout:0/276: sync 2023-12-17T11:57:40.820 INFO:tasks.workunit.client.1.smithi119.stdout:5/371: unlink d1/d36/f69 0 2023-12-17T11:57:40.826 INFO:tasks.workunit.client.1.smithi119.stdout:4/332: symlink dd/d4b/d6a/l6c 0 2023-12-17T11:57:40.828 INFO:tasks.workunit.client.1.smithi119.stdout:0/247: dwrite d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:40.829 INFO:tasks.workunit.client.1.smithi119.stdout:5/372: symlink d1/l75 0 2023-12-17T11:57:40.830 INFO:tasks.workunit.client.1.smithi119.stdout:4/333: symlink dd/d4b/d6a/l6d 0 2023-12-17T11:57:40.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/361: link dc/l7d dc/d1d/d23/l80 0 2023-12-17T11:57:40.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/362: stat dc/f14 0 2023-12-17T11:57:40.832 INFO:tasks.workunit.client.0.smithi002.stdout:7/354: rename d6/d17/d16 to d6/d17/dc/d67 0 2023-12-17T11:57:40.833 INFO:tasks.workunit.client.1.smithi119.stdout:0/248: truncate d2/d16/f17 1173273 0 2023-12-17T11:57:40.836 INFO:tasks.workunit.client.1.smithi119.stdout:5/373: mkdir d1/d25/d39/d71/d76 0 2023-12-17T11:57:40.836 INFO:tasks.workunit.client.1.smithi119.stdout:5/374: read d1/d36/d3a/f4b [1555839,20461] 0 2023-12-17T11:57:40.837 INFO:tasks.workunit.client.1.smithi119.stdout:5/375: fsync d1/d44/d52/f55 0 2023-12-17T11:57:40.837 INFO:tasks.workunit.client.1.smithi119.stdout:5/376: fsync d1/d36/f4e 0 2023-12-17T11:57:40.838 INFO:tasks.workunit.client.1.smithi119.stdout:4/334: mkdir dd/d2a/d6e 0 2023-12-17T11:57:40.838 INFO:tasks.workunit.client.0.smithi002.stdout:1/417: dwrite d3/d2f/f48 [0,4194304] 0 2023-12-17T11:57:40.839 INFO:tasks.workunit.client.0.smithi002.stdout:6/315: read d0/d1/dc/d17/d3c/f47 [2939263,78112] 0 2023-12-17T11:57:40.842 INFO:tasks.workunit.client.0.smithi002.stdout:1/418: write d3/d6/d9/d37/f73 [442397,25629] 0 2023-12-17T11:57:40.842 INFO:tasks.workunit.client.0.smithi002.stdout:9/363: mkdir dc/d32/d81 0 2023-12-17T11:57:40.843 INFO:tasks.workunit.client.0.smithi002.stdout:3/373: fsync d9/d1b/d35/d41/f42 0 2023-12-17T11:57:40.843 INFO:tasks.workunit.client.0.smithi002.stdout:3/374: getdents d9/d24/d6f 0 2023-12-17T11:57:40.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/277: getdents d0/d6/d26/d14 0 2023-12-17T11:57:40.843 INFO:tasks.workunit.client.0.smithi002.stdout:3/375: write d9/d15/d31/f5f [728155,119277] 0 2023-12-17T11:57:40.843 INFO:tasks.workunit.client.0.smithi002.stdout:4/330: dwrite d0/d10/f31 [0,4194304] 0 2023-12-17T11:57:40.845 INFO:tasks.workunit.client.0.smithi002.stdout:6/316: creat d0/d1/dc/d17/d40/f5f x:0 0 0 2023-12-17T11:57:40.846 INFO:tasks.workunit.client.0.smithi002.stdout:9/364: mkdir dc/d42/d4f/d59/d49/d82 0 2023-12-17T11:57:40.848 INFO:tasks.workunit.client.0.smithi002.stdout:3/376: creat d9/d1b/d35/f7a x:0 0 0 2023-12-17T11:57:40.850 INFO:tasks.workunit.client.1.smithi119.stdout:0/249: rename d2/d3/d5/dc/l34 to d2/d16/d35/l46 0 2023-12-17T11:57:40.853 INFO:tasks.workunit.client.1.smithi119.stdout:4/335: mknod dd/d15/d16/d20/c6f 0 2023-12-17T11:57:40.853 INFO:tasks.workunit.client.1.smithi119.stdout:4/336: chown dd/f4a 794076 1 2023-12-17T11:57:40.853 INFO:tasks.workunit.client.1.smithi119.stdout:4/337: truncate dd/d11/d26/f36 4501248 0 2023-12-17T11:57:40.853 INFO:tasks.workunit.client.1.smithi119.stdout:4/338: fdatasync dd/d15/d4f/f6b 0 2023-12-17T11:57:40.853 INFO:tasks.workunit.client.1.smithi119.stdout:4/339: truncate dd/d11/d2d/f3e 329221 0 2023-12-17T11:57:40.854 INFO:tasks.workunit.client.1.smithi119.stdout:2/330: dwrite d6/d2b/d3f/d5b/f6f [0,4194304] 0 2023-12-17T11:57:40.854 INFO:tasks.workunit.client.1.smithi119.stdout:2/331: write d6/d9/d52/d53/d55/f4e [27465,31037] 0 2023-12-17T11:57:40.854 INFO:tasks.workunit.client.1.smithi119.stdout:2/332: write d6/d9/d52/d53/d55/d58/f68 [367052,59352] 0 2023-12-17T11:57:40.854 INFO:tasks.workunit.client.0.smithi002.stdout:4/331: creat d0/d10/d14/d27/d57/f6d x:0 0 0 2023-12-17T11:57:40.855 INFO:tasks.workunit.client.0.smithi002.stdout:6/317: mkdir d0/d1/d21/d56/d60 0 2023-12-17T11:57:40.855 INFO:tasks.workunit.client.0.smithi002.stdout:6/318: read - d0/d1/dc/d10/f46 zero size 2023-12-17T11:57:40.856 INFO:tasks.workunit.client.1.smithi119.stdout:4/340: creat dd/d15/d16/d5a/f70 x:0 0 0 2023-12-17T11:57:40.857 INFO:tasks.workunit.client.0.smithi002.stdout:4/332: getdents d0/d10/d21/d33 0 2023-12-17T11:57:40.860 INFO:tasks.workunit.client.0.smithi002.stdout:6/319: rename d0/d1/l45 to d0/l61 0 2023-12-17T11:57:40.863 INFO:tasks.workunit.client.0.smithi002.stdout:5/293: dwrite dc/d1a/f22 [4194304,4194304] 0 2023-12-17T11:57:40.863 INFO:tasks.workunit.client.0.smithi002.stdout:4/333: mknod d0/d3e/d56/d65/c6e 0 2023-12-17T11:57:40.864 INFO:tasks.workunit.client.0.smithi002.stdout:2/347: dwrite d3/d4/d7/d14/d1b/f26 [0,4194304] 0 2023-12-17T11:57:40.866 INFO:tasks.workunit.client.0.smithi002.stdout:9/365: dread dc/d1d/f78 [0,4194304] 0 2023-12-17T11:57:40.871 INFO:tasks.workunit.client.0.smithi002.stdout:6/320: unlink d0/d1/dc/d17/d40/c51 0 2023-12-17T11:57:40.873 INFO:tasks.workunit.client.0.smithi002.stdout:9/366: write dc/d42/d4f/d59/f4e [296991,67248] 0 2023-12-17T11:57:40.873 INFO:tasks.workunit.client.0.smithi002.stdout:9/367: write dc/f14 [747580,109661] 0 2023-12-17T11:57:40.873 INFO:tasks.workunit.client.0.smithi002.stdout:5/294: rename dc/d17/d1c/l28 to dc/d1b/d2d/d5b/l5c 0 2023-12-17T11:57:40.874 INFO:tasks.workunit.client.1.smithi119.stdout:2/333: rename d6/d9/d52/d53/d55/d58/c6a to d6/d9/d52/d5a/c76 0 2023-12-17T11:57:40.875 INFO:tasks.workunit.client.1.smithi119.stdout:5/377: rmdir d1/d25/d39/d71 39 2023-12-17T11:57:40.877 INFO:tasks.workunit.client.1.smithi119.stdout:4/341: read f4 [4618954,111740] 0 2023-12-17T11:57:40.878 INFO:tasks.workunit.client.0.smithi002.stdout:9/368: mkdir dc/d1d/d23/d83 0 2023-12-17T11:57:40.881 INFO:tasks.workunit.client.0.smithi002.stdout:5/295: mknod dc/d1b/c5d 0 2023-12-17T11:57:40.885 INFO:tasks.workunit.client.1.smithi119.stdout:4/342: truncate dd/d15/f2e 2978159 0 2023-12-17T11:57:40.885 INFO:tasks.workunit.client.1.smithi119.stdout:4/343: chown lc 54657629 1 2023-12-17T11:57:40.885 INFO:tasks.workunit.client.1.smithi119.stdout:4/344: chown dd/d11/d26/f66 20762 1 2023-12-17T11:57:40.885 INFO:tasks.workunit.client.1.smithi119.stdout:4/345: creat dd/f71 x:0 0 0 2023-12-17T11:57:40.886 INFO:tasks.workunit.client.0.smithi002.stdout:9/369: mkdir dc/d1d/d23/d52/d84 0 2023-12-17T11:57:40.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/370: rename dc/d1d/d23/d52/d84 to dc/d1d/d25/d85 0 2023-12-17T11:57:40.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/348: write d3/d4/d7/d14/d42/f47 [2575436,24811] 0 2023-12-17T11:57:40.893 INFO:tasks.workunit.client.0.smithi002.stdout:9/371: creat dc/d1d/d23/d76/f86 x:0 0 0 2023-12-17T11:57:40.896 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:40 smithi119 ceph-mon[117414]: pgmap v23: 65 pgs: 65 active+clean; 947 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 82 MiB/s rd, 119 MiB/s wr, 587 op/s 2023-12-17T11:57:40.898 INFO:tasks.workunit.client.1.smithi119.stdout:1/261: sync 2023-12-17T11:57:40.900 INFO:tasks.workunit.client.1.smithi119.stdout:1/262: creat d3/db/d17/f57 x:0 0 0 2023-12-17T11:57:40.901 INFO:tasks.workunit.client.0.smithi002.stdout:0/278: write d0/d6/d26/f35 [2490689,122543] 0 2023-12-17T11:57:40.901 INFO:tasks.workunit.client.1.smithi119.stdout:2/334: dread d6/f21 [0,4194304] 0 2023-12-17T11:57:40.901 INFO:tasks.workunit.client.1.smithi119.stdout:2/335: stat d6/d9/d13/d34/f43 0 2023-12-17T11:57:40.902 INFO:tasks.workunit.client.1.smithi119.stdout:1/263: rename d3/db/d17/d24/d20/d3a/l54 to d3/db/d26/l58 0 2023-12-17T11:57:40.910 INFO:tasks.workunit.client.0.smithi002.stdout:2/349: creat d3/d4/d7/d14/d2e/f7e x:0 0 0 2023-12-17T11:57:40.910 INFO:tasks.workunit.client.0.smithi002.stdout:3/377: write f6 [994831,10535] 0 2023-12-17T11:57:40.910 INFO:tasks.workunit.client.0.smithi002.stdout:3/378: stat l2 0 2023-12-17T11:57:40.910 INFO:tasks.workunit.client.0.smithi002.stdout:3/379: truncate d9/d15/f16 1733198 0 2023-12-17T11:57:40.911 INFO:tasks.workunit.client.0.smithi002.stdout:9/372: rmdir dc/d32/d81 0 2023-12-17T11:57:40.911 INFO:tasks.workunit.client.0.smithi002.stdout:9/373: fsync dc/d32/f51 0 2023-12-17T11:57:40.911 INFO:tasks.workunit.client.0.smithi002.stdout:9/374: dread - dc/d1d/d23/d76/f86 zero size 2023-12-17T11:57:40.913 INFO:tasks.workunit.client.0.smithi002.stdout:2/350: mknod d3/c7f 0 2023-12-17T11:57:40.914 INFO:tasks.workunit.client.0.smithi002.stdout:8/357: dwrite d3/d7/f37 [0,4194304] 0 2023-12-17T11:57:40.915 INFO:tasks.workunit.client.0.smithi002.stdout:0/279: creat d0/d33/f5b x:0 0 0 2023-12-17T11:57:40.917 INFO:tasks.workunit.client.0.smithi002.stdout:0/280: getdents d0/d6/d26/d14/d19 0 2023-12-17T11:57:40.919 INFO:tasks.workunit.client.0.smithi002.stdout:8/358: rename d3/d8/d55 to d3/d7/d6e/d7f 0 2023-12-17T11:57:40.922 INFO:tasks.workunit.client.1.smithi119.stdout:1/264: write d3/f4 [1023976,21300] 0 2023-12-17T11:57:40.922 INFO:tasks.workunit.client.1.smithi119.stdout:2/336: write d6/d9/d13/d1d/f37 [2897332,14950] 0 2023-12-17T11:57:40.923 INFO:tasks.workunit.client.0.smithi002.stdout:0/281: rename d0/d6/d26/d14/d19/f21 to d0/d33/d57/f5c 0 2023-12-17T11:57:40.924 INFO:tasks.workunit.client.0.smithi002.stdout:1/419: dwrite d3/d6/d16/d28/f58 [0,4194304] 0 2023-12-17T11:57:40.925 INFO:tasks.workunit.client.0.smithi002.stdout:1/420: fdatasync d3/d6/f84 0 2023-12-17T11:57:40.926 INFO:tasks.workunit.client.1.smithi119.stdout:2/337: creat d6/d2b/d4b/f77 x:0 0 0 2023-12-17T11:57:40.927 INFO:tasks.workunit.client.0.smithi002.stdout:7/355: dwrite d6/d17/dc/d13/d21/d2e/f5a [0,4194304] 0 2023-12-17T11:57:40.927 INFO:tasks.workunit.client.0.smithi002.stdout:7/356: truncate d6/f3b 573228 0 2023-12-17T11:57:40.927 INFO:tasks.workunit.client.0.smithi002.stdout:7/357: write d6/d17/f1a [3386240,71565] 0 2023-12-17T11:57:40.940 INFO:tasks.workunit.client.1.smithi119.stdout:2/338: write f5 [137058,61005] 0 2023-12-17T11:57:40.941 INFO:tasks.workunit.client.1.smithi119.stdout:2/339: fdatasync d6/d2b/d3f/f6d 0 2023-12-17T11:57:40.941 INFO:tasks.workunit.client.1.smithi119.stdout:2/340: write d6/d9/d13/d34/d70/f71 [1442075,39734] 0 2023-12-17T11:57:40.941 INFO:tasks.workunit.client.1.smithi119.stdout:2/341: fdatasync d6/d9/d13/d1d/f2d 0 2023-12-17T11:57:40.941 INFO:tasks.workunit.client.0.smithi002.stdout:7/358: mknod d6/d17/dc/d13/d21/d2e/d4a/c68 0 2023-12-17T11:57:40.942 INFO:tasks.workunit.client.0.smithi002.stdout:7/359: symlink d6/d17/dc/d13/d37/d4f/l69 0 2023-12-17T11:57:40.943 INFO:tasks.workunit.client.1.smithi119.stdout:2/342: symlink d6/d9/d52/d5a/l78 0 2023-12-17T11:57:40.944 INFO:tasks.workunit.client.1.smithi119.stdout:2/343: chown d6/l12 2015 1 2023-12-17T11:57:40.949 INFO:tasks.workunit.client.0.smithi002.stdout:9/375: read dc/d32/f7a [2683748,76927] 0 2023-12-17T11:57:40.949 INFO:tasks.workunit.client.1.smithi119.stdout:2/344: creat d6/d2b/d3f/d5c/f79 x:0 0 0 2023-12-17T11:57:40.949 INFO:tasks.workunit.client.1.smithi119.stdout:2/345: write d6/d9/d13/d34/f43 [937513,35056] 0 2023-12-17T11:57:40.949 INFO:tasks.workunit.client.1.smithi119.stdout:2/346: write d6/d9/d13/d1d/f24 [680141,106929] 0 2023-12-17T11:57:40.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/360: link d6/d17/dc/d13/d21/c22 d6/d17/dc/d13/c6a 0 2023-12-17T11:57:40.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/361: chown d6/d17/dc/d13/c6a 2857 1 2023-12-17T11:57:40.950 INFO:tasks.workunit.client.0.smithi002.stdout:7/362: read - d6/d17/dc/d67/f5d zero size 2023-12-17T11:57:40.951 INFO:tasks.workunit.client.1.smithi119.stdout:2/347: rmdir d6/d9/d13/d34 39 2023-12-17T11:57:40.953 INFO:tasks.workunit.client.0.smithi002.stdout:0/282: dread d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:40.955 INFO:tasks.workunit.client.1.smithi119.stdout:2/348: symlink d6/d2b/d3f/d5c/l7a 0 2023-12-17T11:57:40.955 INFO:tasks.workunit.client.1.smithi119.stdout:2/349: fdatasync d6/d9/d13/f4d 0 2023-12-17T11:57:40.957 INFO:tasks.workunit.client.1.smithi119.stdout:4/346: dwrite dd/f4a [0,4194304] 0 2023-12-17T11:57:40.962 INFO:tasks.workunit.client.1.smithi119.stdout:2/350: mknod d6/d9/d52/c7b 0 2023-12-17T11:57:40.975 INFO:tasks.workunit.client.0.smithi002.stdout:7/363: mknod d6/d17/dc/d13/d37/c6b 0 2023-12-17T11:57:40.975 INFO:tasks.workunit.client.0.smithi002.stdout:9/376: symlink dc/d1d/d25/l87 0 2023-12-17T11:57:40.975 INFO:tasks.workunit.client.0.smithi002.stdout:9/377: read fb [151952,35228] 0 2023-12-17T11:57:40.980 INFO:tasks.workunit.client.0.smithi002.stdout:7/364: mkdir d6/d17/dc/d6c 0 2023-12-17T11:57:40.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/378: rename dc/d38/c45 to dc/d42/d4f/d59/d47/c88 0 2023-12-17T11:57:40.980 INFO:tasks.workunit.client.0.smithi002.stdout:7/365: fdatasync d6/d17/dc/d67/f5d 0 2023-12-17T11:57:40.981 INFO:tasks.workunit.client.1.smithi119.stdout:4/347: dread f8 [0,4194304] 0 2023-12-17T11:57:40.981 INFO:tasks.workunit.client.0.smithi002.stdout:7/366: write d6/f1c [4712680,120943] 0 2023-12-17T11:57:40.983 INFO:tasks.workunit.client.1.smithi119.stdout:4/348: symlink dd/d4b/d6a/l72 0 2023-12-17T11:57:40.984 INFO:tasks.workunit.client.1.smithi119.stdout:4/349: mknod dd/c73 0 2023-12-17T11:57:40.986 INFO:tasks.workunit.client.1.smithi119.stdout:2/351: dread d6/d9/d13/d34/f64 [0,4194304] 0 2023-12-17T11:57:40.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/379: unlink dc/f11 0 2023-12-17T11:57:40.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/380: fdatasync dc/d42/f4a 0 2023-12-17T11:57:40.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/381: write dc/d42/d4f/d59/f33 [4407386,56013] 0 2023-12-17T11:57:40.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/382: fdatasync dc/f15 0 2023-12-17T11:57:40.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/383: chown dc/d1d/f78 1 1 2023-12-17T11:57:40.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/384: readlink dc/d1d/d25/l87 0 2023-12-17T11:57:40.988 INFO:tasks.workunit.client.0.smithi002.stdout:7/367: getdents d6/d17 0 2023-12-17T11:57:40.988 INFO:tasks.workunit.client.0.smithi002.stdout:7/368: chown d6/d17/dc/d13/f57 1858212626 1 2023-12-17T11:57:40.989 INFO:tasks.workunit.client.0.smithi002.stdout:7/369: dread - d6/d17/f65 zero size 2023-12-17T11:57:40.989 INFO:tasks.workunit.client.0.smithi002.stdout:7/370: fsync d6/d17/dc/f51 0 2023-12-17T11:57:40.989 INFO:tasks.workunit.client.0.smithi002.stdout:7/371: fsync d6/d17/dc/d13/d37/d4f/f63 0 2023-12-17T11:57:40.989 INFO:tasks.workunit.client.0.smithi002.stdout:3/380: dwrite d9/d15/f22 [0,4194304] 0 2023-12-17T11:57:40.989 INFO:tasks.workunit.client.0.smithi002.stdout:1/421: dwrite d3/d6/d16/f47 [4194304,4194304] 0 2023-12-17T11:57:40.991 INFO:tasks.workunit.client.1.smithi119.stdout:4/350: unlink dd/d11/d26/f52 0 2023-12-17T11:57:40.991 INFO:tasks.workunit.client.1.smithi119.stdout:4/351: chown lc 59304 1 2023-12-17T11:57:40.991 INFO:tasks.workunit.client.1.smithi119.stdout:4/352: chown la 6418192 1 2023-12-17T11:57:40.991 INFO:tasks.workunit.client.1.smithi119.stdout:4/353: creat dd/d11/f74 x:0 0 0 2023-12-17T11:57:40.992 INFO:tasks.workunit.client.0.smithi002.stdout:8/359: dwrite d3/d7/f63 [0,4194304] 0 2023-12-17T11:57:40.992 INFO:tasks.workunit.client.0.smithi002.stdout:8/360: readlink d3/d7/d1a/l48 0 2023-12-17T11:57:40.992 INFO:tasks.workunit.client.0.smithi002.stdout:8/361: fsync d3/f40 0 2023-12-17T11:57:40.993 INFO:tasks.workunit.client.0.smithi002.stdout:9/385: creat dc/d1d/d23/d52/f89 x:0 0 0 2023-12-17T11:57:40.993 INFO:tasks.workunit.client.0.smithi002.stdout:9/386: chown dc/d42 1575 1 2023-12-17T11:57:40.994 INFO:tasks.workunit.client.1.smithi119.stdout:2/352: rename d6/l26 to d6/d2b/d3f/d5b/l7c 0 2023-12-17T11:57:40.994 INFO:tasks.workunit.client.0.smithi002.stdout:6/321: dwrite d0/d1/dc/f8 [4194304,4194304] 0 2023-12-17T11:57:40.995 INFO:tasks.workunit.client.1.smithi119.stdout:1/265: dwrite d3/db/d2a/f34 [0,4194304] 0 2023-12-17T11:57:40.995 INFO:tasks.workunit.client.0.smithi002.stdout:5/296: dwrite fa [0,4194304] 0 2023-12-17T11:57:40.995 INFO:tasks.workunit.client.0.smithi002.stdout:5/297: dread - dc/d1a/f48 zero size 2023-12-17T11:57:40.997 INFO:tasks.workunit.client.1.smithi119.stdout:1/266: read d3/f12 [737487,55265] 0 2023-12-17T11:57:40.998 INFO:tasks.workunit.client.1.smithi119.stdout:1/267: read d3/db/d26/f39 [139655,101135] 0 2023-12-17T11:57:40.999 INFO:tasks.workunit.client.0.smithi002.stdout:7/372: link d6/f3b d6/d17/dc/d13/d37/d4f/f6d 0 2023-12-17T11:57:41.001 INFO:tasks.workunit.client.0.smithi002.stdout:0/283: dwrite d0/d6/fb [0,4194304] 0 2023-12-17T11:57:41.003 INFO:tasks.workunit.client.0.smithi002.stdout:3/381: link d9/f14 d9/d1b/f7b 0 2023-12-17T11:57:41.005 INFO:tasks.workunit.client.0.smithi002.stdout:1/422: truncate d3/d6/fe 637678 0 2023-12-17T11:57:41.011 INFO:tasks.workunit.client.0.smithi002.stdout:9/387: unlink dc/d1d/f67 0 2023-12-17T11:57:41.011 INFO:tasks.workunit.client.0.smithi002.stdout:9/388: truncate dc/d1d/f78 1678325 0 2023-12-17T11:57:41.013 INFO:tasks.workunit.client.1.smithi119.stdout:2/353: creat d6/d9/d52/d53/d55/f7d x:0 0 0 2023-12-17T11:57:41.014 INFO:tasks.workunit.client.1.smithi119.stdout:2/354: dread - d6/d9/d52/f72 zero size 2023-12-17T11:57:41.016 INFO:tasks.workunit.client.1.smithi119.stdout:1/268: truncate d3/db/d17/d24/f2e 2463659 0 2023-12-17T11:57:41.016 INFO:tasks.workunit.client.1.smithi119.stdout:1/269: dread - d3/db/f4d zero size 2023-12-17T11:57:41.019 INFO:tasks.workunit.client.0.smithi002.stdout:0/284: write d0/d33/d57/f5c [611561,26418] 0 2023-12-17T11:57:41.021 INFO:tasks.workunit.client.0.smithi002.stdout:3/382: write d9/d1b/f28 [4740583,2190] 0 2023-12-17T11:57:41.021 INFO:tasks.workunit.client.0.smithi002.stdout:5/298: rename dc/d2b/c4d to dc/d1b/d2d/d5b/c5e 0 2023-12-17T11:57:41.021 INFO:tasks.workunit.client.0.smithi002.stdout:6/322: creat d0/d1/d21/d56/d60/f62 x:0 0 0 2023-12-17T11:57:41.021 INFO:tasks.workunit.client.0.smithi002.stdout:6/323: write d0/d1/d21/f38 [4441734,15361] 0 2023-12-17T11:57:41.037 INFO:tasks.workunit.client.0.smithi002.stdout:5/299: dread dc/f3e [0,4194304] 0 2023-12-17T11:57:41.043 INFO:tasks.workunit.client.1.smithi119.stdout:2/355: creat d6/d2b/d4b/d5d/f7e x:0 0 0 2023-12-17T11:57:41.044 INFO:tasks.workunit.client.1.smithi119.stdout:1/270: mknod d3/db/d17/d24/c59 0 2023-12-17T11:57:41.044 INFO:tasks.workunit.client.1.smithi119.stdout:1/271: write d3/db/f2b [139993,11840] 0 2023-12-17T11:57:41.046 INFO:tasks.workunit.client.1.smithi119.stdout:2/356: mkdir d6/d2b/d3f/d5b/d7f 0 2023-12-17T11:57:41.046 INFO:tasks.workunit.client.1.smithi119.stdout:2/357: write d6/d9/f2a [4669652,89733] 0 2023-12-17T11:57:41.048 INFO:tasks.workunit.client.1.smithi119.stdout:1/272: rename d3/db/d2a/f4e to d3/db/d17/d24/d20/d40/f5a 0 2023-12-17T11:57:41.059 INFO:tasks.workunit.client.1.smithi119.stdout:1/273: rmdir d3/db/d17/d24/d20/d3a 0 2023-12-17T11:57:41.059 INFO:tasks.workunit.client.1.smithi119.stdout:1/274: write d3/db/d26/f21 [2129107,15719] 0 2023-12-17T11:57:41.063 INFO:tasks.workunit.client.0.smithi002.stdout:1/423: creat d3/d6/d9/d30/d87/f89 x:0 0 0 2023-12-17T11:57:41.066 INFO:tasks.workunit.client.0.smithi002.stdout:9/389: symlink dc/d1d/d25/d85/l8a 0 2023-12-17T11:57:41.066 INFO:tasks.workunit.client.0.smithi002.stdout:9/390: chown dc/d1d/d25/d85/l8a 521286119 1 2023-12-17T11:57:41.066 INFO:tasks.workunit.client.0.smithi002.stdout:9/391: write dc/d1d/d23/f6f [1119300,36884] 0 2023-12-17T11:57:41.071 INFO:tasks.workunit.client.0.smithi002.stdout:6/324: link d0/d1/c18 d0/d1/d21/d56/c63 0 2023-12-17T11:57:41.071 INFO:tasks.workunit.client.0.smithi002.stdout:6/325: chown d0/d1/dc/d17/d4c/c53 0 1 2023-12-17T11:57:41.071 INFO:tasks.workunit.client.0.smithi002.stdout:6/326: chown d0/d1/dc/d10/c1b 4245 1 2023-12-17T11:57:41.072 INFO:tasks.workunit.client.0.smithi002.stdout:0/285: dwrite d0/d6/d26/f2d [4194304,4194304] 0 2023-12-17T11:57:41.072 INFO:tasks.workunit.client.0.smithi002.stdout:0/286: readlink d0/d6/la 0 2023-12-17T11:57:41.072 INFO:tasks.workunit.client.0.smithi002.stdout:5/300: creat dc/d1b/d5a/f5f x:0 0 0 2023-12-17T11:57:41.072 INFO:tasks.workunit.client.0.smithi002.stdout:5/301: chown dc/d17/f55 33 1 2023-12-17T11:57:41.073 INFO:tasks.workunit.client.0.smithi002.stdout:1/424: symlink d3/d6/d9/d30/d87/l8a 0 2023-12-17T11:57:41.074 INFO:tasks.workunit.client.0.smithi002.stdout:9/392: dread dc/d32/f51 [0,4194304] 0 2023-12-17T11:57:41.086 INFO:tasks.workunit.client.0.smithi002.stdout:0/287: creat d0/d6/d26/d14/f5d x:0 0 0 2023-12-17T11:57:41.088 INFO:tasks.workunit.client.0.smithi002.stdout:5/302: rename dc/d17/d2f/f43 to dc/d17/d2f/f60 0 2023-12-17T11:57:41.088 INFO:tasks.workunit.client.0.smithi002.stdout:5/303: fsync dc/d17/d2f/f3a 0 2023-12-17T11:57:41.089 INFO:tasks.workunit.client.0.smithi002.stdout:3/383: rename d9/d15/d31 to d9/d1b/d35/d41/d59/d7c 0 2023-12-17T11:57:41.094 INFO:tasks.workunit.client.0.smithi002.stdout:4/334: sync 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.0.smithi002.stdout:2/351: sync 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.0.smithi002.stdout:4/335: chown d0/d3e/d56 810091 1 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.0.smithi002.stdout:2/352: chown d3/d4/d7/d14/d34/f46 391 1 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.0.smithi002.stdout:5/304: mkdir dc/d1a/d61 0 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.0.smithi002.stdout:5/305: fdatasync dc/d1b/d5a/f5f 0 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.0.smithi002.stdout:0/288: truncate d0/d6/fe 4517382 0 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.1.smithi119.stdout:1/275: rmdir d3/db/d17/d24/d20 39 2023-12-17T11:57:41.095 INFO:tasks.workunit.client.1.smithi119.stdout:1/276: stat d3/db/d26/c23 0 2023-12-17T11:57:41.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/306: mknod dc/d17/d1c/c62 0 2023-12-17T11:57:41.099 INFO:tasks.workunit.client.0.smithi002.stdout:0/289: rename d0/d33/d57/f5c to d0/d6/f5e 0 2023-12-17T11:57:41.102 INFO:tasks.workunit.client.0.smithi002.stdout:5/307: link dc/f18 dc/d1b/f63 0 2023-12-17T11:57:41.102 INFO:tasks.workunit.client.0.smithi002.stdout:0/290: truncate d0/d15/f23 229401 0 2023-12-17T11:57:41.102 INFO:tasks.workunit.client.0.smithi002.stdout:4/336: dread d0/f8 [0,4194304] 0 2023-12-17T11:57:41.103 INFO:tasks.workunit.client.0.smithi002.stdout:5/308: symlink dc/d17/d1c/l64 0 2023-12-17T11:57:41.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/384: dread d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:41.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/385: write d9/d24/f6d [1222420,50683] 0 2023-12-17T11:57:41.104 INFO:tasks.workunit.client.0.smithi002.stdout:3/386: chown d9/d24 1017 1 2023-12-17T11:57:41.107 INFO:tasks.workunit.client.0.smithi002.stdout:4/337: creat d0/f6f x:0 0 0 2023-12-17T11:57:41.107 INFO:tasks.workunit.client.0.smithi002.stdout:4/338: creat d0/d10/d14/f70 x:0 0 0 2023-12-17T11:57:41.107 INFO:tasks.workunit.client.0.smithi002.stdout:4/339: dread - d0/d10/d14/f70 zero size 2023-12-17T11:57:41.107 INFO:tasks.workunit.client.0.smithi002.stdout:4/340: fsync d0/d10/f30 0 2023-12-17T11:57:41.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/309: creat dc/d2b/f65 x:0 0 0 2023-12-17T11:57:41.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/310: write dc/d2b/f36 [719402,30092] 0 2023-12-17T11:57:41.108 INFO:tasks.workunit.client.0.smithi002.stdout:5/311: dread - dc/d1a/f46 zero size 2023-12-17T11:57:41.109 INFO:tasks.workunit.client.0.smithi002.stdout:3/387: creat d9/d1b/d4f/f7d x:0 0 0 2023-12-17T11:57:41.110 INFO:tasks.workunit.client.1.smithi119.stdout:2/358: dwrite d6/d9/f2a [0,4194304] 0 2023-12-17T11:57:41.112 INFO:tasks.workunit.client.0.smithi002.stdout:2/353: dread d3/d4/d7/d14/d34/f4b [0,4194304] 0 2023-12-17T11:57:41.113 INFO:tasks.workunit.client.1.smithi119.stdout:2/359: rename d6/d9/d13/d1d/l28 to d6/d2b/l80 0 2023-12-17T11:57:41.115 INFO:tasks.workunit.client.0.smithi002.stdout:6/327: dwrite d0/d1/dc/d17/f42 [0,4194304] 0 2023-12-17T11:57:41.116 INFO:tasks.workunit.client.0.smithi002.stdout:0/291: rmdir d0/d6/d26/d14/d19/d4c 39 2023-12-17T11:57:41.116 INFO:tasks.workunit.client.0.smithi002.stdout:4/341: creat d0/d5a/f71 x:0 0 0 2023-12-17T11:57:41.116 INFO:tasks.workunit.client.0.smithi002.stdout:5/312: symlink dc/d1b/d2d/d5b/l66 0 2023-12-17T11:57:41.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/342: creat d0/d3e/d56/f72 x:0 0 0 2023-12-17T11:57:41.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/343: chown d0/d3e/d47/l6a 120879040 1 2023-12-17T11:57:41.118 INFO:tasks.workunit.client.0.smithi002.stdout:5/313: symlink dc/d17/d1c/l67 0 2023-12-17T11:57:41.123 INFO:tasks.workunit.client.0.smithi002.stdout:4/344: symlink d0/d3e/l73 0 2023-12-17T11:57:41.123 INFO:tasks.workunit.client.0.smithi002.stdout:4/345: chown d0/d10/d14/l3b 4189421 1 2023-12-17T11:57:41.123 INFO:tasks.workunit.client.0.smithi002.stdout:4/346: chown d0/d3e/d56/d65 4 1 2023-12-17T11:57:41.125 INFO:tasks.workunit.client.1.smithi119.stdout:2/360: dread d6/d9/f2a [4194304,4194304] 0 2023-12-17T11:57:41.127 INFO:tasks.workunit.client.0.smithi002.stdout:5/314: mkdir dc/d1b/d5a/d68 0 2023-12-17T11:57:41.127 INFO:tasks.workunit.client.0.smithi002.stdout:5/315: dread - dc/d1a/f46 zero size 2023-12-17T11:57:41.128 INFO:tasks.workunit.client.1.smithi119.stdout:2/361: mkdir d6/d2b/d4b/d81 0 2023-12-17T11:57:41.129 INFO:tasks.workunit.client.1.smithi119.stdout:2/362: readlink d6/d2b/d3f/d5c/l6c 0 2023-12-17T11:57:41.133 INFO:tasks.workunit.client.0.smithi002.stdout:4/347: creat d0/d3e/f74 x:0 0 0 2023-12-17T11:57:41.133 INFO:tasks.workunit.client.0.smithi002.stdout:4/348: dread - d0/d10/f15 zero size 2023-12-17T11:57:41.134 INFO:tasks.workunit.client.0.smithi002.stdout:0/292: write d0/d6/d26/f3b [2776543,87916] 0 2023-12-17T11:57:41.135 INFO:tasks.workunit.client.0.smithi002.stdout:5/316: creat dc/d17/d1c/f69 x:0 0 0 2023-12-17T11:57:41.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/317: rename dc/c15 to dc/d1b/d2d/d5b/c6a 0 2023-12-17T11:57:41.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/318: truncate dc/d1a/f46 482245 0 2023-12-17T11:57:41.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/319: read dc/f3e [3970695,7886] 0 2023-12-17T11:57:41.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/320: truncate dc/d1a/d47/f49 346212 0 2023-12-17T11:57:41.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/321: chown dc/d1b/d2d/c45 9658049 1 2023-12-17T11:57:41.141 INFO:tasks.workunit.client.0.smithi002.stdout:0/293: rmdir d0/d33/d51 0 2023-12-17T11:57:41.151 INFO:tasks.workunit.client.0.smithi002.stdout:2/354: write d3/d4/d7/d14/d2e/d37/f5a [2074616,22549] 0 2023-12-17T11:57:41.152 INFO:tasks.workunit.client.0.smithi002.stdout:5/322: dread dc/d1a/d47/f49 [0,4194304] 0 2023-12-17T11:57:41.154 INFO:tasks.workunit.client.0.smithi002.stdout:5/323: mknod dc/d1a/d47/c6b 0 2023-12-17T11:57:41.156 INFO:tasks.workunit.client.0.smithi002.stdout:2/355: unlink d3/d4/d43/l6f 0 2023-12-17T11:57:41.157 INFO:tasks.workunit.client.0.smithi002.stdout:0/294: dread d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:41.159 INFO:tasks.workunit.client.0.smithi002.stdout:2/356: symlink d3/d4/l80 0 2023-12-17T11:57:41.160 INFO:tasks.workunit.client.1.smithi119.stdout:1/277: dwrite d3/db/d17/d24/d20/f2d [0,4194304] 0 2023-12-17T11:57:41.164 INFO:tasks.workunit.client.1.smithi119.stdout:1/278: rename d3/db/d26/f28 to d3/db/d17/d24/d20/d40/f5b 0 2023-12-17T11:57:41.164 INFO:tasks.workunit.client.0.smithi002.stdout:9/393: dwrite dc/d42/d4f/d59/d47/f48 [0,4194304] 0 2023-12-17T11:57:41.165 INFO:tasks.workunit.client.0.smithi002.stdout:5/324: dread dc/d1a/d47/f49 [0,4194304] 0 2023-12-17T11:57:41.166 INFO:tasks.workunit.client.1.smithi119.stdout:1/279: truncate d3/f12 817741 0 2023-12-17T11:57:41.166 INFO:tasks.workunit.client.1.smithi119.stdout:1/280: readlink d3/db/d17/d24/d20/l49 0 2023-12-17T11:57:41.166 INFO:tasks.workunit.client.1.smithi119.stdout:1/281: readlink d3/db/d17/d24/l10 0 2023-12-17T11:57:41.168 INFO:tasks.workunit.client.0.smithi002.stdout:0/295: rmdir d0/d6 39 2023-12-17T11:57:41.169 INFO:tasks.workunit.client.0.smithi002.stdout:0/296: write d0/d6/d26/d25/f45 [4354697,78990] 0 2023-12-17T11:57:41.169 INFO:tasks.workunit.client.0.smithi002.stdout:0/297: chown d0/d6/d26/f3b 12 1 2023-12-17T11:57:41.169 INFO:tasks.workunit.client.0.smithi002.stdout:0/298: fsync d0/d6/d26/d14/d19/d2f/f4e 0 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:9/371: sync 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:9/372: chown d12/l1f 22950758 1 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:3/346: sync 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:3/347: fdatasync d9/d11/f5f 0 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:3/348: chown d9/f19 511540539 1 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:3/349: stat d9/d1c/c75 0 2023-12-17T11:57:41.174 INFO:tasks.workunit.client.1.smithi119.stdout:3/350: chown d9/d35/f48 177129 1 2023-12-17T11:57:41.175 INFO:tasks.workunit.client.0.smithi002.stdout:3/388: dread d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:41.175 INFO:tasks.workunit.client.0.smithi002.stdout:3/389: write f3 [3694272,53203] 0 2023-12-17T11:57:41.176 INFO:tasks.workunit.client.0.smithi002.stdout:6/328: dwrite d0/d1/dc/d17/f43 [0,4194304] 0 2023-12-17T11:57:41.181 INFO:tasks.workunit.client.1.smithi119.stdout:2/363: dwrite d6/d9/d13/f4d [0,4194304] 0 2023-12-17T11:57:41.181 INFO:tasks.workunit.client.1.smithi119.stdout:3/351: mkdir d9/d11/d87 0 2023-12-17T11:57:41.184 INFO:tasks.workunit.client.1.smithi119.stdout:2/364: creat d6/d2b/d4b/d81/f82 x:0 0 0 2023-12-17T11:57:41.187 INFO:tasks.workunit.client.1.smithi119.stdout:3/352: rename d9/da/df/l81 to d9/d11/d87/l88 0 2023-12-17T11:57:41.187 INFO:tasks.workunit.client.1.smithi119.stdout:3/353: dread - d9/d11/d1e/d55/f7e zero size 2023-12-17T11:57:41.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/325: mkdir dc/d2b/d6c 0 2023-12-17T11:57:41.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/326: chown dc/d2b 163439 1 2023-12-17T11:57:41.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/327: dread - dc/d17/d1c/f69 zero size 2023-12-17T11:57:41.189 INFO:tasks.workunit.client.1.smithi119.stdout:1/282: dread d3/db/d26/f1d [4194304,4194304] 0 2023-12-17T11:57:41.191 INFO:tasks.workunit.client.0.smithi002.stdout:0/299: mknod d0/d6/d26/d14/d19/c5f 0 2023-12-17T11:57:41.191 INFO:tasks.workunit.client.0.smithi002.stdout:0/300: read - d0/d6/d26/d14/d19/d2f/f4e zero size 2023-12-17T11:57:41.192 INFO:tasks.workunit.client.0.smithi002.stdout:6/329: dread d0/f1a [0,4194304] 0 2023-12-17T11:57:41.193 INFO:tasks.workunit.client.1.smithi119.stdout:3/354: creat d9/da/df/d67/f89 x:0 0 0 2023-12-17T11:57:41.195 INFO:tasks.workunit.client.0.smithi002.stdout:4/349: dwrite d0/d10/f39 [0,4194304] 0 2023-12-17T11:57:41.196 INFO:tasks.workunit.client.0.smithi002.stdout:3/390: mkdir d9/d1b/d35/d41/d59/d65/d7e 0 2023-12-17T11:57:41.196 INFO:tasks.workunit.client.0.smithi002.stdout:3/391: write d9/d24/f25 [2058117,101104] 0 2023-12-17T11:57:41.196 INFO:tasks.workunit.client.1.smithi119.stdout:3/355: symlink d9/d11/d1e/d55/d77/l8a 0 2023-12-17T11:57:41.198 INFO:tasks.workunit.client.0.smithi002.stdout:0/301: creat d0/d6/d26/d14/d19/d2f/f60 x:0 0 0 2023-12-17T11:57:41.199 INFO:tasks.workunit.client.0.smithi002.stdout:6/330: dread d0/f3a [0,4194304] 0 2023-12-17T11:57:41.199 INFO:tasks.workunit.client.0.smithi002.stdout:6/331: fdatasync d0/d1/d28/f3d 0 2023-12-17T11:57:41.202 INFO:tasks.workunit.client.1.smithi119.stdout:3/356: symlink d9/d11/d1e/d55/d77/l8b 0 2023-12-17T11:57:41.203 INFO:tasks.workunit.client.1.smithi119.stdout:9/373: dread d12/d1d/f5d [0,4194304] 0 2023-12-17T11:57:41.203 INFO:tasks.workunit.client.1.smithi119.stdout:9/374: chown d12/d1d/d28/f3a 106 1 2023-12-17T11:57:41.203 INFO:tasks.workunit.client.1.smithi119.stdout:9/375: write d12/d65/f6a [719378,88130] 0 2023-12-17T11:57:41.206 INFO:tasks.workunit.client.0.smithi002.stdout:8/362: sync 2023-12-17T11:57:41.206 INFO:tasks.workunit.client.0.smithi002.stdout:8/363: fsync d3/d7/d18/d3f/d49/f4e 0 2023-12-17T11:57:41.206 INFO:tasks.workunit.client.0.smithi002.stdout:8/364: write d3/d8/d28/d31/d5a/f7a [1015436,20371] 0 2023-12-17T11:57:41.207 INFO:tasks.workunit.client.0.smithi002.stdout:4/350: truncate d0/fd 1832068 0 2023-12-17T11:57:41.209 INFO:tasks.workunit.client.0.smithi002.stdout:0/302: mkdir d0/d6/d26/d14/d19/d61 0 2023-12-17T11:57:41.210 INFO:tasks.workunit.client.1.smithi119.stdout:2/365: rmdir d6/d9/d52 39 2023-12-17T11:57:41.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/392: dread d9/d15/f66 [0,4194304] 0 2023-12-17T11:57:41.213 INFO:tasks.workunit.client.0.smithi002.stdout:2/357: dwrite d3/d4/f5 [4194304,4194304] 0 2023-12-17T11:57:41.214 INFO:tasks.workunit.client.0.smithi002.stdout:4/351: mknod d0/d10/d21/d33/c75 0 2023-12-17T11:57:41.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/352: dread - d0/d10/d14/f60 zero size 2023-12-17T11:57:41.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/353: dread - d0/d10/d14/f60 zero size 2023-12-17T11:57:41.215 INFO:tasks.workunit.client.1.smithi119.stdout:9/376: mkdir d12/d1d/d28/d4d/d73 0 2023-12-17T11:57:41.215 INFO:tasks.workunit.client.1.smithi119.stdout:9/377: chown d12/d1d/d28/c30 209748 1 2023-12-17T11:57:41.215 INFO:tasks.workunit.client.1.smithi119.stdout:9/378: write d12/d1d/d49/f57 [2033985,90034] 0 2023-12-17T11:57:41.215 INFO:tasks.workunit.client.1.smithi119.stdout:1/283: dread d3/fa [0,4194304] 0 2023-12-17T11:57:41.216 INFO:tasks.workunit.client.0.smithi002.stdout:8/365: rmdir d3/d7/d18/d3f/d49/d6d 0 2023-12-17T11:57:41.217 INFO:tasks.workunit.client.0.smithi002.stdout:8/366: chown d3/d7/d18/c19 71192 1 2023-12-17T11:57:41.217 INFO:tasks.workunit.client.0.smithi002.stdout:8/367: fdatasync d3/d8/da/dd/f66 0 2023-12-17T11:57:41.219 INFO:tasks.workunit.client.0.smithi002.stdout:0/303: rename d0/d6/d26/d14/d19/d4c to d0/d6/d26/d14/d19/d37/d62 0 2023-12-17T11:57:41.220 INFO:tasks.workunit.client.0.smithi002.stdout:5/328: dread dc/d2b/f36 [0,4194304] 0 2023-12-17T11:57:41.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/394: dwrite dc/d42/d4f/d59/f4e [0,4194304] 0 2023-12-17T11:57:41.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/332: getdents d0/d1/d21 0 2023-12-17T11:57:41.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/333: readlink d0/d1/l1c 0 2023-12-17T11:57:41.226 INFO:tasks.workunit.client.1.smithi119.stdout:9/379: truncate d12/f23 228250 0 2023-12-17T11:57:41.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/368: dread d3/d7/f27 [0,4194304] 0 2023-12-17T11:57:41.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/369: fsync d3/d7/f58 0 2023-12-17T11:57:41.228 INFO:tasks.workunit.client.0.smithi002.stdout:8/370: truncate d3/d7/d6e/f77 107172 0 2023-12-17T11:57:41.229 INFO:tasks.workunit.client.1.smithi119.stdout:1/284: creat d3/d44/f5c x:0 0 0 2023-12-17T11:57:41.229 INFO:tasks.workunit.client.1.smithi119.stdout:3/357: dread d9/da/df/f17 [0,4194304] 0 2023-12-17T11:57:41.230 INFO:tasks.workunit.client.1.smithi119.stdout:8/276: sync 2023-12-17T11:57:41.230 INFO:tasks.workunit.client.1.smithi119.stdout:7/355: sync 2023-12-17T11:57:41.230 INFO:tasks.workunit.client.1.smithi119.stdout:7/356: chown d2/d40/l60 0 1 2023-12-17T11:57:41.232 INFO:tasks.workunit.client.0.smithi002.stdout:5/329: rename dc/l11 to dc/d1a/d61/l6d 0 2023-12-17T11:57:41.232 INFO:tasks.workunit.client.0.smithi002.stdout:5/330: readlink dc/d2b/l42 0 2023-12-17T11:57:41.232 INFO:tasks.workunit.client.0.smithi002.stdout:7/373: sync 2023-12-17T11:57:41.232 INFO:tasks.workunit.client.0.smithi002.stdout:1/425: sync 2023-12-17T11:57:41.232 INFO:tasks.workunit.client.1.smithi119.stdout:2/366: dread d6/f11 [0,4194304] 0 2023-12-17T11:57:41.233 INFO:tasks.workunit.client.0.smithi002.stdout:4/354: rmdir d0/d10/d14/d4e 39 2023-12-17T11:57:41.233 INFO:tasks.workunit.client.0.smithi002.stdout:4/355: creat d0/d5a/f76 x:0 0 0 2023-12-17T11:57:41.234 INFO:tasks.workunit.client.1.smithi119.stdout:1/285: link d3/db/d17/d24/l10 d3/db/d26/d19/d3f/l5d 0 2023-12-17T11:57:41.236 INFO:tasks.workunit.client.0.smithi002.stdout:4/356: write d0/d10/d21/f42 [2270799,27702] 0 2023-12-17T11:57:41.236 INFO:tasks.workunit.client.0.smithi002.stdout:6/334: symlink d0/d1/dc/d17/d4c/l64 0 2023-12-17T11:57:41.237 INFO:tasks.workunit.client.1.smithi119.stdout:3/358: mkdir d9/d44/d8c 0 2023-12-17T11:57:41.243 INFO:tasks.workunit.client.0.smithi002.stdout:5/331: truncate dc/d17/d1c/f20 3116133 0 2023-12-17T11:57:41.244 INFO:tasks.workunit.client.1.smithi119.stdout:8/277: creat d7/da/d11/f59 x:0 0 0 2023-12-17T11:57:41.245 INFO:tasks.workunit.client.1.smithi119.stdout:8/278: chown d7/da/d1a 368 1 2023-12-17T11:57:41.245 INFO:tasks.workunit.client.1.smithi119.stdout:0/250: sync 2023-12-17T11:57:41.245 INFO:tasks.workunit.client.1.smithi119.stdout:5/378: sync 2023-12-17T11:57:41.245 INFO:tasks.workunit.client.1.smithi119.stdout:6/300: sync 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:9/380: dread d12/f19 [0,4194304] 0 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:9/381: fdatasync fe 0 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:4/354: sync 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:4/355: fdatasync f4 0 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:4/356: write dd/d11/d26/f66 [95974,55491] 0 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:4/357: write dd/f28 [2187214,87763] 0 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:4/358: dread - dd/d15/d16/d20/d42/f67 zero size 2023-12-17T11:57:41.246 INFO:tasks.workunit.client.1.smithi119.stdout:1/286: mkdir d3/db/d26/d5e 0 2023-12-17T11:57:41.249 INFO:tasks.workunit.client.0.smithi002.stdout:1/426: symlink d3/d2f/l8b 0 2023-12-17T11:57:41.249 INFO:tasks.workunit.client.0.smithi002.stdout:1/427: fsync d3/d6/d9/d30/f56 0 2023-12-17T11:57:41.249 INFO:tasks.workunit.client.0.smithi002.stdout:1/428: write d3/d6/d9/d30/f56 [958615,17997] 0 2023-12-17T11:57:41.250 INFO:tasks.workunit.client.1.smithi119.stdout:7/357: dread d2/d4e/f37 [0,4194304] 0 2023-12-17T11:57:41.260 INFO:tasks.workunit.client.0.smithi002.stdout:7/374: mkdir d6/d17/dc/d13/d21/d6e 0 2023-12-17T11:57:41.261 INFO:tasks.workunit.client.1.smithi119.stdout:9/382: rename d12/f35 to d12/d1d/d28/d4d/d73/f74 0 2023-12-17T11:57:41.264 INFO:tasks.workunit.client.1.smithi119.stdout:4/359: symlink dd/l75 0 2023-12-17T11:57:41.264 INFO:tasks.workunit.client.1.smithi119.stdout:4/360: fdatasync dd/d4b/f54 0 2023-12-17T11:57:41.264 INFO:tasks.workunit.client.1.smithi119.stdout:4/361: readlink dd/d15/l64 0 2023-12-17T11:57:41.266 INFO:tasks.workunit.client.0.smithi002.stdout:6/335: mkdir d0/d1/dc/d17/d3c/d65 0 2023-12-17T11:57:41.268 INFO:tasks.workunit.client.1.smithi119.stdout:7/358: rename d2/d4/d3e to d2/d4/d70 0 2023-12-17T11:57:41.269 INFO:tasks.workunit.client.0.smithi002.stdout:5/332: rename f4 to dc/d1b/f6e 0 2023-12-17T11:57:41.269 INFO:tasks.workunit.client.0.smithi002.stdout:5/333: fdatasync dc/f18 0 2023-12-17T11:57:41.269 INFO:tasks.workunit.client.0.smithi002.stdout:5/334: chown dc/f3e 212060 1 2023-12-17T11:57:41.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/371: dread d3/d7/d18/d3f/d49/f4b [0,4194304] 0 2023-12-17T11:57:41.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/372: truncate d3/d7/d6e/f77 1099988 0 2023-12-17T11:57:41.270 INFO:tasks.workunit.client.1.smithi119.stdout:1/287: dread d3/db/f2b [0,4194304] 0 2023-12-17T11:57:41.270 INFO:tasks.workunit.client.1.smithi119.stdout:6/301: dread d2/f9 [0,4194304] 0 2023-12-17T11:57:41.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/375: creat d6/d17/dc/d6c/f6f x:0 0 0 2023-12-17T11:57:41.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/376: dread - d6/d17/dc/d67/f5d zero size 2023-12-17T11:57:41.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/377: chown d6/d17/dc/d13/d3e/l4e 1 1 2023-12-17T11:57:41.273 INFO:tasks.workunit.client.0.smithi002.stdout:6/336: truncate d0/d1/dc/d17/d3c/f47 2633606 0 2023-12-17T11:57:41.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/335: mkdir dc/d1a/d53/d6f 0 2023-12-17T11:57:41.278 INFO:tasks.workunit.client.0.smithi002.stdout:2/358: dwrite d3/d50/f53 [0,4194304] 0 2023-12-17T11:57:41.278 INFO:tasks.workunit.client.0.smithi002.stdout:2/359: read - d3/d4/d7/d14/d34/f5e zero size 2023-12-17T11:57:41.279 INFO:tasks.workunit.client.1.smithi119.stdout:1/288: rename d3/db/d17/f45 to d3/db/f5f 0 2023-12-17T11:57:41.279 INFO:tasks.workunit.client.1.smithi119.stdout:1/289: write d3/db/d26/d19/d3f/f4a [1333989,46499] 0 2023-12-17T11:57:41.283 INFO:tasks.workunit.client.0.smithi002.stdout:1/429: rename d3/d6/d16/f46 to d3/d6/d9/d37/d39/f8c 0 2023-12-17T11:57:41.287 INFO:tasks.workunit.client.0.smithi002.stdout:7/378: creat d6/d17/dc/d13/d37/d4c/f70 x:0 0 0 2023-12-17T11:57:41.287 INFO:tasks.workunit.client.0.smithi002.stdout:7/379: chown d6/d17/dc/d13/d3e 122418 1 2023-12-17T11:57:41.290 INFO:tasks.workunit.client.1.smithi119.stdout:9/383: unlink d12/d1d/d28/d46/d50/l68 0 2023-12-17T11:57:41.290 INFO:tasks.workunit.client.1.smithi119.stdout:6/302: unlink d2/df/c15 0 2023-12-17T11:57:41.290 INFO:tasks.workunit.client.1.smithi119.stdout:1/290: truncate d3/fa 3534023 0 2023-12-17T11:57:41.290 INFO:tasks.workunit.client.0.smithi002.stdout:6/337: mknod d0/d1/d21/c66 0 2023-12-17T11:57:41.292 INFO:tasks.workunit.client.0.smithi002.stdout:1/430: symlink d3/d6/l8d 0 2023-12-17T11:57:41.294 INFO:tasks.workunit.client.1.smithi119.stdout:2/367: dwrite d6/d9/d52/d5a/f65 [0,4194304] 0 2023-12-17T11:57:41.298 INFO:tasks.workunit.client.1.smithi119.stdout:9/384: symlink d12/d1d/d28/d4d/l75 0 2023-12-17T11:57:41.304 INFO:tasks.workunit.client.1.smithi119.stdout:1/291: creat d3/db/d17/d24/d20/d40/f60 x:0 0 0 2023-12-17T11:57:41.304 INFO:tasks.workunit.client.1.smithi119.stdout:1/292: truncate d3/db/d26/f43 212885 0 2023-12-17T11:57:41.308 INFO:tasks.workunit.client.1.smithi119.stdout:2/368: creat d6/d2b/d3f/f83 x:0 0 0 2023-12-17T11:57:41.309 INFO:tasks.workunit.client.1.smithi119.stdout:9/385: symlink d12/d1d/d40/l76 0 2023-12-17T11:57:41.310 INFO:tasks.workunit.client.1.smithi119.stdout:2/369: read d6/d9/d13/f32 [279599,114742] 0 2023-12-17T11:57:41.311 INFO:tasks.workunit.client.0.smithi002.stdout:6/338: mkdir d0/d1/dc/d17/d67 0 2023-12-17T11:57:41.311 INFO:tasks.workunit.client.0.smithi002.stdout:8/373: rename d3/f25 to d3/d8/d28/d31/d5a/f80 0 2023-12-17T11:57:41.311 INFO:tasks.workunit.client.1.smithi119.stdout:6/303: getdents d2/d41 0 2023-12-17T11:57:41.311 INFO:tasks.workunit.client.1.smithi119.stdout:6/304: write d2/df/d17/f2f [4742558,86660] 0 2023-12-17T11:57:41.313 INFO:tasks.workunit.client.1.smithi119.stdout:1/293: link d3/db/d17/d24/d20/d40/f60 d3/f61 0 2023-12-17T11:57:41.318 INFO:tasks.workunit.client.1.smithi119.stdout:3/359: dwrite d9/d11/d1e/d55/f66 [0,4194304] 0 2023-12-17T11:57:41.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/304: dwrite d0/d15/f27 [0,4194304] 0 2023-12-17T11:57:41.318 INFO:tasks.workunit.client.0.smithi002.stdout:0/305: stat d0/c5 0 2023-12-17T11:57:41.319 INFO:tasks.workunit.client.0.smithi002.stdout:0/306: write d0/d6/d26/d14/f53 [243397,96370] 0 2023-12-17T11:57:41.320 INFO:tasks.workunit.client.1.smithi119.stdout:9/386: link d12/d1d/d28/d4d/f5e d12/d1d/d49/f77 0 2023-12-17T11:57:41.322 INFO:tasks.workunit.client.1.smithi119.stdout:2/370: unlink d6/d9/d13/c25 0 2023-12-17T11:57:41.325 INFO:tasks.workunit.client.1.smithi119.stdout:1/294: rename d3/db/d26/f43 to d3/db/f62 0 2023-12-17T11:57:41.325 INFO:tasks.workunit.client.1.smithi119.stdout:1/295: creat d3/db/d17/f63 x:0 0 0 2023-12-17T11:57:41.326 INFO:tasks.workunit.client.0.smithi002.stdout:3/393: dwrite d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:41.327 INFO:tasks.workunit.client.0.smithi002.stdout:3/394: readlink d9/d1b/d35/d41/d59/l5a 0 2023-12-17T11:57:41.327 INFO:tasks.workunit.client.0.smithi002.stdout:9/395: dwrite dc/f1b [0,4194304] 0 2023-12-17T11:57:41.331 INFO:tasks.workunit.client.0.smithi002.stdout:8/374: creat d3/d7/d18/d74/d7b/f81 x:0 0 0 2023-12-17T11:57:41.332 INFO:tasks.workunit.client.1.smithi119.stdout:2/371: write d6/d9/f20 [1099972,51390] 0 2023-12-17T11:57:41.333 INFO:tasks.workunit.client.1.smithi119.stdout:3/360: truncate d9/d35/f5e 1594185 0 2023-12-17T11:57:41.340 INFO:tasks.workunit.client.1.smithi119.stdout:8/279: dwrite d7/f35 [0,4194304] 0 2023-12-17T11:57:41.341 INFO:tasks.workunit.client.1.smithi119.stdout:9/387: mkdir d12/d1d/d28/d4d/d73/d78 0 2023-12-17T11:57:41.343 INFO:tasks.workunit.client.1.smithi119.stdout:1/296: mkdir d3/db/d26/d19/d3f/d64 0 2023-12-17T11:57:41.345 INFO:tasks.workunit.client.1.smithi119.stdout:9/388: write d12/d1d/f27 [4591100,27886] 0 2023-12-17T11:57:41.356 INFO:tasks.workunit.client.1.smithi119.stdout:2/372: read d6/f45 [3208547,99469] 0 2023-12-17T11:57:41.357 INFO:tasks.workunit.client.1.smithi119.stdout:2/373: dread - d6/d2b/d4b/f77 zero size 2023-12-17T11:57:41.357 INFO:tasks.workunit.client.1.smithi119.stdout:2/374: readlink d6/d9/l1e 0 2023-12-17T11:57:41.357 INFO:tasks.workunit.client.0.smithi002.stdout:8/375: creat d3/d7/d18/d74/f82 x:0 0 0 2023-12-17T11:57:41.357 INFO:tasks.workunit.client.0.smithi002.stdout:8/376: fsync d3/d8/da/dd/f6c 0 2023-12-17T11:57:41.358 INFO:tasks.workunit.client.0.smithi002.stdout:8/377: read d3/d7/d6e/d7f/f3a [2720307,87520] 0 2023-12-17T11:57:41.358 INFO:tasks.workunit.client.0.smithi002.stdout:8/378: stat d3/d7/f5d 0 2023-12-17T11:57:41.359 INFO:tasks.workunit.client.1.smithi119.stdout:7/359: dwrite d2/d4/f16 [0,4194304] 0 2023-12-17T11:57:41.359 INFO:tasks.workunit.client.1.smithi119.stdout:7/360: fdatasync d2/d40/f6d 0 2023-12-17T11:57:41.361 INFO:tasks.workunit.client.1.smithi119.stdout:1/297: rename d3/db/d17/d24/f48 to d3/f65 0 2023-12-17T11:57:41.361 INFO:tasks.workunit.client.1.smithi119.stdout:1/298: chown d3/db/d17/d24/d20/d40/f41 16 1 2023-12-17T11:57:41.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/379: symlink d3/d8/da/dd/l83 0 2023-12-17T11:57:41.372 INFO:tasks.workunit.client.1.smithi119.stdout:2/375: symlink d6/d9/d52/d5a/l84 0 2023-12-17T11:57:41.372 INFO:tasks.workunit.client.1.smithi119.stdout:2/376: creat d6/d9/d13/d34/d70/f85 x:0 0 0 2023-12-17T11:57:41.373 INFO:tasks.workunit.client.1.smithi119.stdout:9/389: dread d12/d1d/d28/d46/f4e [0,4194304] 0 2023-12-17T11:57:41.373 INFO:tasks.workunit.client.1.smithi119.stdout:9/390: fsync d12/d1d/f5d 0 2023-12-17T11:57:41.375 INFO:tasks.workunit.client.0.smithi002.stdout:4/357: dwrite d0/d10/d21/f49 [4194304,4194304] 0 2023-12-17T11:57:41.376 INFO:tasks.workunit.client.0.smithi002.stdout:4/358: stat d0/d10/f4b 0 2023-12-17T11:57:41.376 INFO:tasks.workunit.client.0.smithi002.stdout:1/431: rename d3/d5c/d66 to d3/d6/d16/d61/d8e 0 2023-12-17T11:57:41.376 INFO:tasks.workunit.client.1.smithi119.stdout:5/379: dwrite d1/f35 [0,4194304] 0 2023-12-17T11:57:41.376 INFO:tasks.workunit.client.1.smithi119.stdout:3/361: write d9/da/df/f32 [2289822,44710] 0 2023-12-17T11:57:41.382 INFO:tasks.workunit.client.1.smithi119.stdout:7/361: write d2/d4/d70/d57/d56/f59 [4192026,6673] 0 2023-12-17T11:57:41.382 INFO:tasks.workunit.client.1.smithi119.stdout:7/362: write d2/d4e/f37 [5417315,62540] 0 2023-12-17T11:57:41.382 INFO:tasks.workunit.client.1.smithi119.stdout:7/363: chown d2/d4/d11/d2c/d55/d67 1743211 1 2023-12-17T11:57:41.386 INFO:tasks.workunit.client.0.smithi002.stdout:1/432: mkdir d3/d6/d9/d37/d39/d43/d8f 0 2023-12-17T11:57:41.386 INFO:tasks.workunit.client.0.smithi002.stdout:6/339: rename d0/d1/dc/d17/f26 to d0/d1/dc/d17/d3c/d65/f68 0 2023-12-17T11:57:41.386 INFO:tasks.workunit.client.0.smithi002.stdout:6/340: write d0/d1/dc/d17/d3c/f47 [3180163,20792] 0 2023-12-17T11:57:41.387 INFO:tasks.workunit.client.1.smithi119.stdout:2/377: mkdir d6/d9/d86 0 2023-12-17T11:57:41.388 INFO:tasks.workunit.client.1.smithi119.stdout:0/251: dwrite d2/d16/d12/f32 [0,4194304] 0 2023-12-17T11:57:41.390 INFO:tasks.workunit.client.1.smithi119.stdout:5/380: mkdir d1/d70/d6b/d77 0 2023-12-17T11:57:41.393 INFO:tasks.workunit.client.0.smithi002.stdout:5/336: dwrite fa [4194304,4194304] 0 2023-12-17T11:57:41.394 INFO:tasks.workunit.client.1.smithi119.stdout:4/362: dwrite dd/d15/d16/d3d/f4c [0,4194304] 0 2023-12-17T11:57:41.396 INFO:tasks.workunit.client.0.smithi002.stdout:3/395: rename l2 to d9/d1b/d35/d41/d59/d7c/l7f 0 2023-12-17T11:57:41.397 INFO:tasks.workunit.client.0.smithi002.stdout:3/396: write d9/d40/f6e [46386,54507] 0 2023-12-17T11:57:41.397 INFO:tasks.workunit.client.1.smithi119.stdout:0/252: rename d2/d16/d12/d2e to d2/d16/d12/d2e/d47 22 2023-12-17T11:57:41.398 INFO:tasks.workunit.client.1.smithi119.stdout:2/378: rename d6/d9/d13/d34/d70/f85 to d6/d2b/f87 0 2023-12-17T11:57:41.398 INFO:tasks.workunit.client.1.smithi119.stdout:2/379: write d6/f40 [4296994,71879] 0 2023-12-17T11:57:41.398 INFO:tasks.workunit.client.1.smithi119.stdout:3/362: dread d9/d11/d1e/d55/d65/f7a [0,4194304] 0 2023-12-17T11:57:41.400 INFO:tasks.workunit.client.0.smithi002.stdout:6/341: mknod d0/d1/dc/c69 0 2023-12-17T11:57:41.401 INFO:tasks.workunit.client.1.smithi119.stdout:7/364: rmdir d2/d4/d11/d2c/d55 39 2023-12-17T11:57:41.401 INFO:tasks.workunit.client.1.smithi119.stdout:5/381: unlink d1/d25/c42 0 2023-12-17T11:57:41.403 INFO:tasks.workunit.client.1.smithi119.stdout:0/253: link d2/d16/d12/d2e/d44/c2c d2/d3/c48 0 2023-12-17T11:57:41.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/396: dwrite dc/d1d/d23/f46 [0,4194304] 0 2023-12-17T11:57:41.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/397: write dc/f15 [2326224,87155] 0 2023-12-17T11:57:41.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/398: truncate dc/d38/f5b 870167 0 2023-12-17T11:57:41.406 INFO:tasks.workunit.client.1.smithi119.stdout:2/380: unlink d6/d9/d13/d34/f43 0 2023-12-17T11:57:41.409 INFO:tasks.workunit.client.0.smithi002.stdout:1/433: rename d3/d6/d9/d37/f51 to d3/d6/d9/f90 0 2023-12-17T11:57:41.413 INFO:tasks.workunit.client.0.smithi002.stdout:6/342: mknod d0/c6a 0 2023-12-17T11:57:41.413 INFO:tasks.workunit.client.0.smithi002.stdout:7/380: dwrite d6/d17/dc/d13/d37/d4f/f63 [0,4194304] 0 2023-12-17T11:57:41.416 INFO:tasks.workunit.client.0.smithi002.stdout:4/359: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:41.420 INFO:tasks.workunit.client.1.smithi119.stdout:3/363: mkdir d9/d44/d8d 0 2023-12-17T11:57:41.420 INFO:tasks.workunit.client.1.smithi119.stdout:4/363: getdents dd/d15/d16/d5a 0 2023-12-17T11:57:41.420 INFO:tasks.workunit.client.1.smithi119.stdout:7/365: dread d2/d4e/f4a [0,4194304] 0 2023-12-17T11:57:41.420 INFO:tasks.workunit.client.1.smithi119.stdout:2/381: mkdir d6/d9/d13/d34/d88 0 2023-12-17T11:57:41.428 INFO:tasks.workunit.client.0.smithi002.stdout:2/360: dwrite d3/d4/d7/d14/d34/f5e [0,4194304] 0 2023-12-17T11:57:41.428 INFO:tasks.workunit.client.1.smithi119.stdout:7/366: mkdir d2/d4e/d71 0 2023-12-17T11:57:41.431 INFO:tasks.workunit.client.1.smithi119.stdout:9/391: write d12/d1d/f5d [41756,89724] 0 2023-12-17T11:57:41.433 INFO:tasks.workunit.client.0.smithi002.stdout:0/307: dwrite d0/d6/d26/d25/f31 [0,4194304] 0 2023-12-17T11:57:41.434 INFO:tasks.workunit.client.1.smithi119.stdout:8/280: dwrite d7/f16 [0,4194304] 0 2023-12-17T11:57:41.436 INFO:tasks.workunit.client.1.smithi119.stdout:2/382: rmdir d6/d2b/d3f/d5b/d7f 0 2023-12-17T11:57:41.442 INFO:tasks.workunit.client.1.smithi119.stdout:3/364: rename f6 to d9/d11/d1e/f8e 0 2023-12-17T11:57:41.443 INFO:tasks.workunit.client.1.smithi119.stdout:3/365: truncate d9/d11/d1e/d55/f7e 528753 0 2023-12-17T11:57:41.449 INFO:tasks.workunit.client.1.smithi119.stdout:9/392: mkdir d12/d1d/d79 0 2023-12-17T11:57:41.449 INFO:tasks.workunit.client.1.smithi119.stdout:9/393: read - d12/d1d/d28/d46/f59 zero size 2023-12-17T11:57:41.449 INFO:tasks.workunit.client.1.smithi119.stdout:9/394: creat d12/d1d/d28/d4d/f7a x:0 0 0 2023-12-17T11:57:41.450 INFO:tasks.workunit.client.1.smithi119.stdout:2/383: link d6/l12 d6/d2b/l89 0 2023-12-17T11:57:41.454 INFO:tasks.workunit.client.1.smithi119.stdout:2/384: chown d6/d9/d52 974641 1 2023-12-17T11:57:41.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/367: write d2/d4/d11/d3c/f4d [2035119,89066] 0 2023-12-17T11:57:41.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/368: dread - d2/d4/d70/f64 zero size 2023-12-17T11:57:41.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/369: write d2/f19 [4247076,119917] 0 2023-12-17T11:57:41.459 INFO:tasks.workunit.client.1.smithi119.stdout:7/370: read d2/d4/d11/f43 [409742,72283] 0 2023-12-17T11:57:41.460 INFO:tasks.workunit.client.1.smithi119.stdout:3/366: mknod d9/d35/c8f 0 2023-12-17T11:57:41.460 INFO:tasks.workunit.client.1.smithi119.stdout:3/367: chown d9/da 31 1 2023-12-17T11:57:41.462 INFO:tasks.workunit.client.1.smithi119.stdout:5/382: dwrite d1/d25/d39/f5c [0,4194304] 0 2023-12-17T11:57:41.464 INFO:tasks.workunit.client.0.smithi002.stdout:6/343: write d0/d1/f23 [4067108,25122] 0 2023-12-17T11:57:41.464 INFO:tasks.workunit.client.1.smithi119.stdout:8/281: rename d7/f55 to d7/da/d11/d26/d2c/f5a 0 2023-12-17T11:57:41.469 INFO:tasks.workunit.client.1.smithi119.stdout:0/254: dwrite d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:41.469 INFO:tasks.workunit.client.1.smithi119.stdout:0/255: truncate d2/d16/d12/d1f/f20 5049324 0 2023-12-17T11:57:41.471 INFO:tasks.workunit.client.0.smithi002.stdout:9/399: symlink dc/d1d/d7c/l8b 0 2023-12-17T11:57:41.471 INFO:tasks.workunit.client.0.smithi002.stdout:9/400: creat dc/d42/f8c x:0 0 0 2023-12-17T11:57:41.472 INFO:tasks.workunit.client.1.smithi119.stdout:9/395: symlink d12/d65/l7b 0 2023-12-17T11:57:41.477 INFO:tasks.workunit.client.0.smithi002.stdout:7/381: dwrite d6/d17/dc/d13/d37/d4c/f35 [0,4194304] 0 2023-12-17T11:57:41.478 INFO:tasks.workunit.client.0.smithi002.stdout:3/397: dread d9/d1b/d35/d41/d59/f5c [0,4194304] 0 2023-12-17T11:57:41.480 INFO:tasks.workunit.client.0.smithi002.stdout:7/382: write d6/d17/dc/d13/d37/f3c [4568608,77411] 0 2023-12-17T11:57:41.483 INFO:tasks.workunit.client.0.smithi002.stdout:4/360: dwrite d0/d3e/d56/f72 [0,4194304] 0 2023-12-17T11:57:41.483 INFO:tasks.workunit.client.0.smithi002.stdout:4/361: chown d0/d10/d21/d33/c3f 180390465 1 2023-12-17T11:57:41.485 INFO:tasks.workunit.client.0.smithi002.stdout:5/337: dwrite dc/d17/f26 [0,4194304] 0 2023-12-17T11:57:41.486 INFO:tasks.workunit.client.0.smithi002.stdout:2/361: symlink d3/d4/l81 0 2023-12-17T11:57:41.486 INFO:tasks.workunit.client.0.smithi002.stdout:2/362: creat d3/d4/d7/d14/f82 x:0 0 0 2023-12-17T11:57:41.491 INFO:tasks.workunit.client.1.smithi119.stdout:7/371: dread d2/d4b/f52 [0,4194304] 0 2023-12-17T11:57:41.491 INFO:tasks.workunit.client.1.smithi119.stdout:7/372: stat d2/d4/d70/f45 0 2023-12-17T11:57:41.492 INFO:tasks.workunit.client.0.smithi002.stdout:0/308: mknod d0/d6/d26/d14/d19/d2f/c63 0 2023-12-17T11:57:41.492 INFO:tasks.workunit.client.0.smithi002.stdout:0/309: stat d0/d33/f5b 0 2023-12-17T11:57:41.497 INFO:tasks.workunit.client.1.smithi119.stdout:7/373: read d2/d4/d1f/f4c [180823,13831] 0 2023-12-17T11:57:41.497 INFO:tasks.workunit.client.1.smithi119.stdout:3/368: rename d9/da/df/d41/d74 to d9/da/df/d41/d33/d3a/d90 0 2023-12-17T11:57:41.497 INFO:tasks.workunit.client.1.smithi119.stdout:3/369: creat d9/da/f91 x:0 0 0 2023-12-17T11:57:41.499 INFO:tasks.workunit.client.1.smithi119.stdout:8/282: truncate d7/d18/f4e 478899 0 2023-12-17T11:57:41.500 INFO:tasks.workunit.client.1.smithi119.stdout:8/283: chown d7/f16 4180037 1 2023-12-17T11:57:41.500 INFO:tasks.workunit.client.1.smithi119.stdout:8/284: dread - d7/da/d11/d26/f58 zero size 2023-12-17T11:57:41.500 INFO:tasks.workunit.client.1.smithi119.stdout:8/285: creat d7/d18/f5b x:0 0 0 2023-12-17T11:57:41.501 INFO:tasks.workunit.client.1.smithi119.stdout:5/383: rmdir d1/d36/d65 0 2023-12-17T11:57:41.501 INFO:tasks.workunit.client.1.smithi119.stdout:5/384: creat d1/d44/d52/f78 x:0 0 0 2023-12-17T11:57:41.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/344: rename d0/d1/dc/c30 to d0/d1/d5b/c6b 0 2023-12-17T11:57:41.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/345: fdatasync d0/f1a 0 2023-12-17T11:57:41.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/346: getdents d0/d1/dc/d17/d67 0 2023-12-17T11:57:41.506 INFO:tasks.workunit.client.1.smithi119.stdout:0/256: mknod d2/d16/d12/d2e/c49 0 2023-12-17T11:57:41.506 INFO:tasks.workunit.client.1.smithi119.stdout:0/257: fsync d2/f4 0 2023-12-17T11:57:41.507 INFO:tasks.workunit.client.1.smithi119.stdout:2/385: dwrite d6/d9/d52/f72 [0,4194304] 0 2023-12-17T11:57:41.509 INFO:tasks.workunit.client.1.smithi119.stdout:9/396: dread d12/d1d/d49/f56 [0,4194304] 0 2023-12-17T11:57:41.509 INFO:tasks.workunit.client.0.smithi002.stdout:9/401: mknod dc/d1d/d23/d83/c8d 0 2023-12-17T11:57:41.511 INFO:tasks.workunit.client.1.smithi119.stdout:7/374: truncate d2/f35 920801 0 2023-12-17T11:57:41.511 INFO:tasks.workunit.client.1.smithi119.stdout:7/375: write d2/d4/d11/f2d [8249356,25455] 0 2023-12-17T11:57:41.515 INFO:tasks.workunit.client.0.smithi002.stdout:3/398: getdents d9/d1b/d35/d41/d59/d7c 0 2023-12-17T11:57:41.515 INFO:tasks.workunit.client.0.smithi002.stdout:3/399: dread - d9/d1b/d4f/f7d zero size 2023-12-17T11:57:41.515 INFO:tasks.workunit.client.0.smithi002.stdout:3/400: dread - d9/d1b/d4f/f7d zero size 2023-12-17T11:57:41.516 INFO:tasks.workunit.client.1.smithi119.stdout:3/370: truncate f3 158164 0 2023-12-17T11:57:41.520 INFO:tasks.workunit.client.1.smithi119.stdout:8/286: symlink d7/da/d11/d26/d49/l5c 0 2023-12-17T11:57:41.521 INFO:tasks.workunit.client.0.smithi002.stdout:4/362: unlink d0/d10/d14/l3b 0 2023-12-17T11:57:41.521 INFO:tasks.workunit.client.0.smithi002.stdout:4/363: write d0/d3e/f74 [312172,89362] 0 2023-12-17T11:57:41.522 INFO:tasks.workunit.client.0.smithi002.stdout:4/364: creat d0/d3e/d56/f77 x:0 0 0 2023-12-17T11:57:41.524 INFO:tasks.workunit.client.1.smithi119.stdout:5/385: creat d1/d25/f79 x:0 0 0 2023-12-17T11:57:41.524 INFO:tasks.workunit.client.1.smithi119.stdout:5/386: stat d1/d25/l61 0 2023-12-17T11:57:41.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/258: write d2/d16/d12/d2e/d44/f26 [7137580,1501] 0 2023-12-17T11:57:41.535 INFO:tasks.workunit.client.1.smithi119.stdout:7/376: dread d2/d4/d11/f21 [0,4194304] 0 2023-12-17T11:57:41.537 INFO:tasks.workunit.client.0.smithi002.stdout:7/383: dwrite d6/d17/dc/d13/d37/f3c [4194304,4194304] 0 2023-12-17T11:57:41.539 INFO:tasks.workunit.client.1.smithi119.stdout:9/397: unlink d12/l22 0 2023-12-17T11:57:41.539 INFO:tasks.workunit.client.1.smithi119.stdout:9/398: chown d12/d1d/d28/d46/d6e/f6f 239070 1 2023-12-17T11:57:41.539 INFO:tasks.workunit.client.1.smithi119.stdout:9/399: creat d12/d1d/d40/f7c x:0 0 0 2023-12-17T11:57:41.539 INFO:tasks.workunit.client.1.smithi119.stdout:9/400: creat d12/d65/f7d x:0 0 0 2023-12-17T11:57:41.540 INFO:tasks.workunit.client.0.smithi002.stdout:5/338: symlink dc/d1b/d5a/l70 0 2023-12-17T11:57:41.540 INFO:tasks.workunit.client.0.smithi002.stdout:5/339: creat dc/d1b/d5a/f71 x:0 0 0 2023-12-17T11:57:41.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/371: mkdir d9/d11/d92 0 2023-12-17T11:57:41.544 INFO:tasks.workunit.client.0.smithi002.stdout:2/363: dwrite d3/d4/fd [0,4194304] 0 2023-12-17T11:57:41.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/372: creat d9/da/df/d41/d33/d5a/f93 x:0 0 0 2023-12-17T11:57:41.546 INFO:tasks.workunit.client.0.smithi002.stdout:0/310: mkdir d0/d33/d57/d64 0 2023-12-17T11:57:41.551 INFO:tasks.workunit.client.1.smithi119.stdout:5/387: mknod d1/d44/d52/c7a 0 2023-12-17T11:57:41.551 INFO:tasks.workunit.client.1.smithi119.stdout:5/388: chown d1/d25/d39/d71 12446 1 2023-12-17T11:57:41.551 INFO:tasks.workunit.client.1.smithi119.stdout:5/389: fdatasync d1/fa 0 2023-12-17T11:57:41.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/347: mkdir d0/d1/dc/d17/d67/d6c 0 2023-12-17T11:57:41.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/348: truncate d0/d1/dc/f54 635650 0 2023-12-17T11:57:41.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/349: chown d0/d1/dc/lb 98155 1 2023-12-17T11:57:41.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/350: chown d0/d1/dc/d17/d4c/f55 17399911 1 2023-12-17T11:57:41.559 INFO:tasks.workunit.client.0.smithi002.stdout:9/402: symlink dc/d1d/d25/d85/l8e 0 2023-12-17T11:57:41.559 INFO:tasks.workunit.client.0.smithi002.stdout:9/403: stat dc/d42/d4f/d59/d49/d72 0 2023-12-17T11:57:41.560 INFO:tasks.workunit.client.1.smithi119.stdout:0/259: creat d2/d16/d35/d39/f4a x:0 0 0 2023-12-17T11:57:41.561 INFO:tasks.workunit.client.0.smithi002.stdout:4/365: dwrite d0/d10/d14/f60 [0,4194304] 0 2023-12-17T11:57:41.561 INFO:tasks.workunit.client.0.smithi002.stdout:4/366: chown d0/d3e/d56 2182 1 2023-12-17T11:57:41.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/351: dread d0/d1/dc/d10/f52 [0,4194304] 0 2023-12-17T11:57:41.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/352: write d0/d1/dc/d17/d40/f4f [1286542,44315] 0 2023-12-17T11:57:41.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/353: write d0/d1/dc/d10/f46 [392307,3077] 0 2023-12-17T11:57:41.564 INFO:tasks.workunit.client.0.smithi002.stdout:6/354: readlink d0/la 0 2023-12-17T11:57:41.564 INFO:tasks.workunit.client.0.smithi002.stdout:3/401: mknod d9/d15/d52/d79/c80 0 2023-12-17T11:57:41.568 INFO:tasks.workunit.client.0.smithi002.stdout:5/340: rename dc/d1b/d2d/d5b/c6a to dc/d17/c72 0 2023-12-17T11:57:41.568 INFO:tasks.workunit.client.0.smithi002.stdout:5/341: readlink dc/d1b/l29 0 2023-12-17T11:57:41.570 INFO:tasks.workunit.client.0.smithi002.stdout:9/404: dread dc/f14 [0,4194304] 0 2023-12-17T11:57:41.570 INFO:tasks.workunit.client.0.smithi002.stdout:2/364: getdents d3/d4/d7/d14/d42 0 2023-12-17T11:57:41.572 INFO:tasks.workunit.client.0.smithi002.stdout:1/434: sync 2023-12-17T11:57:41.572 INFO:tasks.workunit.client.0.smithi002.stdout:8/380: sync 2023-12-17T11:57:41.572 INFO:tasks.workunit.client.0.smithi002.stdout:8/381: write d3/d7/d18/d3f/d49/f4e [967508,114198] 0 2023-12-17T11:57:41.573 INFO:tasks.workunit.client.1.smithi119.stdout:7/377: creat d2/d4/d11/d2c/d68/d6a/f72 x:0 0 0 2023-12-17T11:57:41.574 INFO:tasks.workunit.client.0.smithi002.stdout:7/384: dwrite d6/f3b [0,4194304] 0 2023-12-17T11:57:41.581 INFO:tasks.workunit.client.0.smithi002.stdout:3/402: truncate d9/d1b/d35/d41/d59/d65/f69 2004490 0 2023-12-17T11:57:41.584 INFO:tasks.workunit.client.0.smithi002.stdout:4/367: dread d0/ff [0,4194304] 0 2023-12-17T11:57:41.585 INFO:tasks.workunit.client.0.smithi002.stdout:8/382: mknod d3/d7/d6e/d7f/d65/c84 0 2023-12-17T11:57:41.585 INFO:tasks.workunit.client.0.smithi002.stdout:8/383: chown d3/d8/d28/d31/d5a 97810 1 2023-12-17T11:57:41.585 INFO:tasks.workunit.client.0.smithi002.stdout:8/384: readlink d3/d7/d1a/l48 0 2023-12-17T11:57:41.590 INFO:tasks.workunit.client.0.smithi002.stdout:6/355: mkdir d0/d1/d6d 0 2023-12-17T11:57:41.592 INFO:tasks.workunit.client.1.smithi119.stdout:0/260: mknod d2/d3/d5/dc/c4b 0 2023-12-17T11:57:41.593 INFO:tasks.workunit.client.1.smithi119.stdout:9/401: unlink d12/d1d/d28/c30 0 2023-12-17T11:57:41.594 INFO:tasks.workunit.client.1.smithi119.stdout:8/287: unlink d7/d18/d15/f39 0 2023-12-17T11:57:41.594 INFO:tasks.workunit.client.1.smithi119.stdout:8/288: write d7/d18/f4f [1009422,85504] 0 2023-12-17T11:57:41.595 INFO:tasks.workunit.client.0.smithi002.stdout:5/342: dread f8 [8388608,4194304] 0 2023-12-17T11:57:41.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/368: mkdir d0/d3e/d56/d65/d78 0 2023-12-17T11:57:41.597 INFO:tasks.workunit.client.1.smithi119.stdout:2/386: rename d6/d9/d13/d34/d70/f71 to d6/f8a 0 2023-12-17T11:57:41.599 INFO:tasks.workunit.client.1.smithi119.stdout:7/378: symlink d2/d5b/l73 0 2023-12-17T11:57:41.600 INFO:tasks.workunit.client.0.smithi002.stdout:2/365: dread d3/d50/f53 [0,4194304] 0 2023-12-17T11:57:41.600 INFO:tasks.workunit.client.0.smithi002.stdout:8/385: link d3/d7/f73 d3/d7/d6e/d7f/d65/f85 0 2023-12-17T11:57:41.601 INFO:tasks.workunit.client.0.smithi002.stdout:8/386: write d3/d8/d28/d31/f3e [2834721,15216] 0 2023-12-17T11:57:41.601 INFO:tasks.workunit.client.1.smithi119.stdout:0/261: mknod d2/d16/d12/d1f/c4c 0 2023-12-17T11:57:41.602 INFO:tasks.workunit.client.0.smithi002.stdout:3/403: read d9/d15/f22 [138148,21822] 0 2023-12-17T11:57:41.603 INFO:tasks.workunit.client.0.smithi002.stdout:6/356: unlink d0/d1/f23 0 2023-12-17T11:57:41.604 INFO:tasks.workunit.client.1.smithi119.stdout:9/402: symlink d12/d1d/d28/l7e 0 2023-12-17T11:57:41.604 INFO:tasks.workunit.client.0.smithi002.stdout:6/357: creat d0/d1/d21/d56/d60/f6e x:0 0 0 2023-12-17T11:57:41.605 INFO:tasks.workunit.client.0.smithi002.stdout:6/358: chown d0/c7 181252 1 2023-12-17T11:57:41.605 INFO:tasks.workunit.client.0.smithi002.stdout:6/359: stat d0/d1/dc/d17/d4c/l4d 0 2023-12-17T11:57:41.605 INFO:tasks.workunit.client.0.smithi002.stdout:0/311: dwrite d0/d6/d26/d14/d19/d2b/f42 [0,4194304] 0 2023-12-17T11:57:41.606 INFO:tasks.workunit.client.0.smithi002.stdout:5/343: symlink dc/d1a/d47/l73 0 2023-12-17T11:57:41.608 INFO:tasks.workunit.client.1.smithi119.stdout:8/289: read d7/d18/f4e [72964,68812] 0 2023-12-17T11:57:41.609 INFO:tasks.workunit.client.1.smithi119.stdout:3/373: rename d9/da/f28 to d9/da/df/d41/d33/d3a/d90/f94 0 2023-12-17T11:57:41.609 INFO:tasks.workunit.client.1.smithi119.stdout:3/374: creat d9/f95 x:0 0 0 2023-12-17T11:57:41.609 INFO:tasks.workunit.client.1.smithi119.stdout:3/375: fdatasync d9/d44/f86 0 2023-12-17T11:57:41.609 INFO:tasks.workunit.client.1.smithi119.stdout:3/376: creat d9/da/df/d41/d33/d5a/f96 x:0 0 0 2023-12-17T11:57:41.610 INFO:tasks.workunit.client.1.smithi119.stdout:3/377: dread - d9/da/df/f52 zero size 2023-12-17T11:57:41.612 INFO:tasks.workunit.client.0.smithi002.stdout:4/369: rmdir d0/d10/d14/d4e 39 2023-12-17T11:57:41.613 INFO:tasks.workunit.client.1.smithi119.stdout:2/387: dread - d6/d2b/d3f/d5c/f79 zero size 2023-12-17T11:57:41.616 INFO:tasks.workunit.client.1.smithi119.stdout:9/403: symlink d12/d1d/d28/d4d/l7f 0 2023-12-17T11:57:41.619 INFO:tasks.workunit.client.0.smithi002.stdout:2/366: dread d3/d4/d7/d14/d34/f5e [0,4194304] 0 2023-12-17T11:57:41.619 INFO:tasks.workunit.client.0.smithi002.stdout:2/367: stat d3/d4/d7/f1a 0 2023-12-17T11:57:41.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/387: dread d3/d7/d6e/d7f/f3a [0,4194304] 0 2023-12-17T11:57:41.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/388: creat d3/d7/d18/d3f/f86 x:0 0 0 2023-12-17T11:57:41.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/389: write d3/d8/da/dd/f5f [426799,29154] 0 2023-12-17T11:57:41.622 INFO:tasks.workunit.client.1.smithi119.stdout:2/388: link d6/d2b/l66 d6/d9/d13/d34/d88/l8b 0 2023-12-17T11:57:41.622 INFO:tasks.workunit.client.1.smithi119.stdout:2/389: getdents d6/d9/d86 0 2023-12-17T11:57:41.625 INFO:tasks.workunit.client.1.smithi119.stdout:9/404: rename d12/d1d/f3c to d12/d1d/d79/f80 0 2023-12-17T11:57:41.632 INFO:tasks.workunit.client.1.smithi119.stdout:9/405: symlink d12/d1d/d28/d4d/d73/d78/l81 0 2023-12-17T11:57:41.632 INFO:tasks.workunit.client.1.smithi119.stdout:9/406: chown d12/d1d/d40 125 1 2023-12-17T11:57:41.633 INFO:tasks.workunit.client.1.smithi119.stdout:2/390: rmdir d6/d2b/d4b/d81 39 2023-12-17T11:57:41.634 INFO:tasks.workunit.client.1.smithi119.stdout:9/407: write fe [4439584,25318] 0 2023-12-17T11:57:41.634 INFO:tasks.workunit.client.1.smithi119.stdout:9/408: write d12/d1d/d49/f5b [410046,60462] 0 2023-12-17T11:57:41.634 INFO:tasks.workunit.client.1.smithi119.stdout:9/409: creat d12/f82 x:0 0 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:6/360: symlink d0/d1/d6d/l6f 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:6/361: chown d0/d1/d21/d56/c63 641856844 1 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:6/362: fsync d0/d1/d21/f38 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:0/312: mknod d0/d33/d57/d64/c65 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:0/313: readlink d0/d15/l58 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:0/314: fsync d0/d15/f54 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:0/315: readlink d0/d6/d26/d14/d19/d2f/l4b 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/344: symlink dc/d1b/d2d/d5b/l74 0 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/345: chown dc/d17/f2c 0 1 2023-12-17T11:57:41.636 INFO:tasks.workunit.client.0.smithi002.stdout:2/368: mkdir d3/d4/d17/d19/d4d/d72/d83 0 2023-12-17T11:57:41.640 INFO:tasks.workunit.client.0.smithi002.stdout:0/316: mknod d0/d6/d26/d14/d19/d2f/c66 0 2023-12-17T11:57:41.642 INFO:tasks.workunit.client.0.smithi002.stdout:5/346: mkdir dc/d1b/d75 0 2023-12-17T11:57:41.642 INFO:tasks.workunit.client.0.smithi002.stdout:5/347: readlink dc/d1a/l41 0 2023-12-17T11:57:41.643 INFO:tasks.workunit.client.0.smithi002.stdout:2/369: link d3/d4/d7/d14/d1b/c33 d3/d4/d7/d14/d2e/d37/c84 0 2023-12-17T11:57:41.644 INFO:tasks.workunit.client.0.smithi002.stdout:2/370: creat d3/d4/d7/d14/d2e/d37/f85 x:0 0 0 2023-12-17T11:57:41.644 INFO:tasks.workunit.client.0.smithi002.stdout:5/348: creat dc/d1a/d47/f76 x:0 0 0 2023-12-17T11:57:41.650 INFO:tasks.workunit.client.1.smithi119.stdout:4/364: sync 2023-12-17T11:57:41.650 INFO:tasks.workunit.client.1.smithi119.stdout:4/365: chown dd/d11/c34 4088641 1 2023-12-17T11:57:41.650 INFO:tasks.workunit.client.1.smithi119.stdout:1/299: sync 2023-12-17T11:57:41.650 INFO:tasks.workunit.client.1.smithi119.stdout:1/300: fsync d3/db/f62 0 2023-12-17T11:57:41.651 INFO:tasks.workunit.client.1.smithi119.stdout:4/366: write dd/d15/d16/f1a [1663296,69940] 0 2023-12-17T11:57:41.651 INFO:tasks.workunit.client.1.smithi119.stdout:4/367: fsync dd/d15/d16/d20/d42/f67 0 2023-12-17T11:57:41.651 INFO:tasks.workunit.client.1.smithi119.stdout:1/301: write d3/db/d17/d24/f53 [7264,101117] 0 2023-12-17T11:57:41.654 INFO:tasks.workunit.client.1.smithi119.stdout:6/305: sync 2023-12-17T11:57:41.657 INFO:tasks.workunit.client.0.smithi002.stdout:2/371: rename d3/d4/d7/d14/d1b/f40 to d3/d4/d7/f86 0 2023-12-17T11:57:41.657 INFO:tasks.workunit.client.0.smithi002.stdout:2/372: stat d3/d4/d43 0 2023-12-17T11:57:41.657 INFO:tasks.workunit.client.0.smithi002.stdout:5/349: symlink dc/d2b/d6c/l77 0 2023-12-17T11:57:41.659 INFO:tasks.workunit.client.1.smithi119.stdout:4/368: symlink dd/d15/d16/d3d/l76 0 2023-12-17T11:57:41.662 INFO:tasks.workunit.client.1.smithi119.stdout:1/302: rename d3/db/d17/f57 to d3/db/d2a/f66 0 2023-12-17T11:57:41.662 INFO:tasks.workunit.client.0.smithi002.stdout:3/404: dread d9/f13 [0,4194304] 0 2023-12-17T11:57:41.662 INFO:tasks.workunit.client.1.smithi119.stdout:2/391: write d6/d9/f2a [838168,3636] 0 2023-12-17T11:57:41.662 INFO:tasks.workunit.client.1.smithi119.stdout:2/392: fsync d6/d2b/d3f/d5c/f79 0 2023-12-17T11:57:41.663 INFO:tasks.workunit.client.1.smithi119.stdout:0/262: dwrite d2/d16/d12/f1c [0,4194304] 0 2023-12-17T11:57:41.663 INFO:tasks.workunit.client.1.smithi119.stdout:0/263: fdatasync d2/d16/d12/f25 0 2023-12-17T11:57:41.665 INFO:tasks.workunit.client.1.smithi119.stdout:3/378: dwrite d9/d11/d1e/d55/f7e [0,4194304] 0 2023-12-17T11:57:41.667 INFO:tasks.workunit.client.0.smithi002.stdout:9/405: dwrite dc/f1b [0,4194304] 0 2023-12-17T11:57:41.667 INFO:tasks.workunit.client.0.smithi002.stdout:9/406: write dc/d1d/d23/f73 [4446119,25614] 0 2023-12-17T11:57:41.668 INFO:tasks.workunit.client.0.smithi002.stdout:9/407: creat dc/d1d/d23/d52/f8f x:0 0 0 2023-12-17T11:57:41.668 INFO:tasks.workunit.client.0.smithi002.stdout:9/408: readlink dc/l7d 0 2023-12-17T11:57:41.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/363: dread d0/d1/dc/d10/f37 [8388608,4194304] 0 2023-12-17T11:57:41.669 INFO:tasks.workunit.client.0.smithi002.stdout:7/385: dwrite d6/d17/dc/d13/d37/d4f/f63 [0,4194304] 0 2023-12-17T11:57:41.669 INFO:tasks.workunit.client.0.smithi002.stdout:5/350: mknod dc/d1a/d47/c78 0 2023-12-17T11:57:41.670 INFO:tasks.workunit.client.1.smithi119.stdout:6/306: symlink d2/l5b 0 2023-12-17T11:57:41.670 INFO:tasks.workunit.client.1.smithi119.stdout:6/307: write d2/f4 [2259884,66262] 0 2023-12-17T11:57:41.670 INFO:tasks.workunit.client.1.smithi119.stdout:6/308: chown d2/df/d17/f2f 12469915 1 2023-12-17T11:57:41.670 INFO:tasks.workunit.client.1.smithi119.stdout:6/309: truncate d2/df/f31 368072 0 2023-12-17T11:57:41.674 INFO:tasks.workunit.client.0.smithi002.stdout:3/405: link d9/f45 d9/d24/f81 0 2023-12-17T11:57:41.677 INFO:tasks.workunit.client.1.smithi119.stdout:4/369: creat dd/d15/d16/d3d/f77 x:0 0 0 2023-12-17T11:57:41.680 INFO:tasks.workunit.client.1.smithi119.stdout:1/303: mknod d3/db/d26/d5e/c67 0 2023-12-17T11:57:41.681 INFO:tasks.workunit.client.1.smithi119.stdout:6/310: read d2/f26 [1856891,71429] 0 2023-12-17T11:57:41.681 INFO:tasks.workunit.client.0.smithi002.stdout:4/370: dwrite d0/d10/d21/f48 [0,4194304] 0 2023-12-17T11:57:41.683 INFO:tasks.workunit.client.1.smithi119.stdout:7/379: write d2/f26 [36935,10841] 0 2023-12-17T11:57:41.686 INFO:tasks.workunit.client.1.smithi119.stdout:2/393: mknod d6/d9/d13/d34/d70/c8c 0 2023-12-17T11:57:41.689 INFO:tasks.workunit.client.1.smithi119.stdout:0/264: getdents d2/d16/d12/d1f 0 2023-12-17T11:57:41.689 INFO:tasks.workunit.client.1.smithi119.stdout:0/265: readlink d2/d3/d5/dc/l36 0 2023-12-17T11:57:41.690 INFO:tasks.workunit.client.1.smithi119.stdout:0/266: read d2/d16/f17 [605636,114974] 0 2023-12-17T11:57:41.690 INFO:tasks.workunit.client.1.smithi119.stdout:9/410: dwrite d12/d1d/d28/f3d [4194304,4194304] 0 2023-12-17T11:57:41.696 INFO:tasks.workunit.client.1.smithi119.stdout:3/379: getdents d9/da/df/d41/d33/d3a/d90 0 2023-12-17T11:57:41.697 INFO:tasks.workunit.client.1.smithi119.stdout:3/380: chown d9/da/df/d41/d33/d3a/d90 2029717 1 2023-12-17T11:57:41.698 INFO:tasks.workunit.client.1.smithi119.stdout:8/290: dwrite d7/da/d1a/f1c [0,4194304] 0 2023-12-17T11:57:41.699 INFO:tasks.workunit.client.0.smithi002.stdout:9/409: truncate dc/d1d/d23/f6f 432902 0 2023-12-17T11:57:41.701 INFO:tasks.workunit.client.0.smithi002.stdout:0/317: dwrite d0/d15/f54 [0,4194304] 0 2023-12-17T11:57:41.704 INFO:tasks.workunit.client.0.smithi002.stdout:0/318: creat d0/d15/f67 x:0 0 0 2023-12-17T11:57:41.704 INFO:tasks.workunit.client.0.smithi002.stdout:0/319: write d0/d33/f5b [770623,102582] 0 2023-12-17T11:57:41.704 INFO:tasks.workunit.client.0.smithi002.stdout:7/386: mknod d6/d17/dc/d13/d37/c71 0 2023-12-17T11:57:41.708 INFO:tasks.workunit.client.0.smithi002.stdout:6/364: write d0/d1/d21/f2d [789539,89826] 0 2023-12-17T11:57:41.709 INFO:tasks.workunit.client.1.smithi119.stdout:9/411: dread d12/f48 [0,4194304] 0 2023-12-17T11:57:41.709 INFO:tasks.workunit.client.1.smithi119.stdout:9/412: stat d12/d1d/d28/d4d/f7a 0 2023-12-17T11:57:41.710 INFO:tasks.workunit.client.0.smithi002.stdout:8/390: dwrite d3/d8/d28/d31/f3e [0,4194304] 0 2023-12-17T11:57:41.711 INFO:tasks.workunit.client.1.smithi119.stdout:6/311: creat d2/d2b/d43/f5c x:0 0 0 2023-12-17T11:57:41.712 INFO:tasks.workunit.client.1.smithi119.stdout:1/304: dread d3/fa [0,4194304] 0 2023-12-17T11:57:41.714 INFO:tasks.workunit.client.1.smithi119.stdout:7/380: getdents d2/d4/d1f 0 2023-12-17T11:57:41.715 INFO:tasks.workunit.client.0.smithi002.stdout:3/406: mkdir d9/d15/d71/d82 0 2023-12-17T11:57:41.718 INFO:tasks.workunit.client.0.smithi002.stdout:0/320: dread d0/f2e [0,4194304] 0 2023-12-17T11:57:41.719 INFO:tasks.workunit.client.1.smithi119.stdout:2/394: mknod d6/d9/d52/d53/d55/d58/d6b/c8d 0 2023-12-17T11:57:41.719 INFO:tasks.workunit.client.1.smithi119.stdout:2/395: creat d6/d9/f8e x:0 0 0 2023-12-17T11:57:41.719 INFO:tasks.workunit.client.1.smithi119.stdout:2/396: chown d6/d9/d13/d34 6873 1 2023-12-17T11:57:41.721 INFO:tasks.workunit.client.0.smithi002.stdout:2/373: rmdir d3/d4/d7/d14/d2e 39 2023-12-17T11:57:41.723 INFO:tasks.workunit.client.0.smithi002.stdout:4/371: creat d0/d10/d14/d27/f79 x:0 0 0 2023-12-17T11:57:41.725 INFO:tasks.workunit.client.0.smithi002.stdout:5/351: dwrite dc/f18 [0,4194304] 0 2023-12-17T11:57:41.725 INFO:tasks.workunit.client.1.smithi119.stdout:8/291: dread d7/da/f41 [0,4194304] 0 2023-12-17T11:57:41.726 INFO:tasks.workunit.client.0.smithi002.stdout:5/352: chown dc/l23 17581500 1 2023-12-17T11:57:41.726 INFO:tasks.workunit.client.0.smithi002.stdout:5/353: dread - dc/d1b/d2d/f56 zero size 2023-12-17T11:57:41.729 INFO:tasks.workunit.client.1.smithi119.stdout:0/267: rename d2/d3/l43 to d2/d16/d12/d2e/l4d 0 2023-12-17T11:57:41.731 INFO:tasks.workunit.client.0.smithi002.stdout:7/387: rename d6/d17/dc/d13/d21/f3f to d6/f72 0 2023-12-17T11:57:41.733 INFO:tasks.workunit.client.0.smithi002.stdout:6/365: getdents d0/d1/d5b 0 2023-12-17T11:57:41.733 INFO:tasks.workunit.client.0.smithi002.stdout:6/366: readlink d0/d1/d6d/l6f 0 2023-12-17T11:57:41.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/321: mknod d0/d6/d26/d14/d19/d37/d62/c68 0 2023-12-17T11:57:41.736 INFO:tasks.workunit.client.0.smithi002.stdout:0/322: write d0/d6/d26/d14/d19/d37/f39 [4609826,114033] 0 2023-12-17T11:57:41.743 INFO:tasks.workunit.client.0.smithi002.stdout:6/367: unlink d0/c35 0 2023-12-17T11:57:41.751 INFO:tasks.workunit.client.1.smithi119.stdout:4/370: rmdir dd/d4b 39 2023-12-17T11:57:41.755 INFO:tasks.workunit.client.1.smithi119.stdout:6/312: creat d2/df/f5d x:0 0 0 2023-12-17T11:57:41.755 INFO:tasks.workunit.client.0.smithi002.stdout:6/368: link d0/d1/dc/d10/c5e d0/d1/d21/c70 0 2023-12-17T11:57:41.756 INFO:tasks.workunit.client.1.smithi119.stdout:1/305: symlink d3/db/l68 0 2023-12-17T11:57:41.756 INFO:tasks.workunit.client.1.smithi119.stdout:1/306: write d3/db/d17/f63 [129787,75650] 0 2023-12-17T11:57:41.758 INFO:tasks.workunit.client.1.smithi119.stdout:7/381: creat d2/f74 x:0 0 0 2023-12-17T11:57:41.762 INFO:tasks.workunit.client.0.smithi002.stdout:9/410: dwrite dc/f13 [0,4194304] 0 2023-12-17T11:57:41.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/381: rename d9/d11/d87/l88 to d9/d35/l97 0 2023-12-17T11:57:41.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/382: write d9/da/df/d41/d33/d5a/f96 [114710,14086] 0 2023-12-17T11:57:41.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/383: write d9/d11/f76 [543589,25003] 0 2023-12-17T11:57:41.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/384: dread - d9/da/f91 zero size 2023-12-17T11:57:41.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/385: read f4 [1195079,42623] 0 2023-12-17T11:57:41.772 INFO:tasks.workunit.client.1.smithi119.stdout:4/371: mkdir dd/d15/d16/d20/d42/d78 0 2023-12-17T11:57:41.775 INFO:tasks.workunit.client.1.smithi119.stdout:1/307: mknod d3/db/c69 0 2023-12-17T11:57:41.775 INFO:tasks.workunit.client.1.smithi119.stdout:1/308: write d3/db/d17/f63 [885908,8160] 0 2023-12-17T11:57:41.776 INFO:tasks.workunit.client.1.smithi119.stdout:1/309: write d3/db/d17/d24/f1a [1088944,106200] 0 2023-12-17T11:57:41.786 INFO:tasks.workunit.client.0.smithi002.stdout:3/407: dwrite d9/d1b/d35/d41/d43/f46 [4194304,4194304] 0 2023-12-17T11:57:41.787 INFO:tasks.workunit.client.0.smithi002.stdout:4/372: dread d0/d10/d21/f49 [4194304,4194304] 0 2023-12-17T11:57:41.791 INFO:tasks.workunit.client.1.smithi119.stdout:5/390: sync 2023-12-17T11:57:41.792 INFO:tasks.workunit.client.1.smithi119.stdout:2/397: dwrite d6/d2b/d3f/f83 [0,4194304] 0 2023-12-17T11:57:41.797 INFO:tasks.workunit.client.0.smithi002.stdout:3/408: dread d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:41.797 INFO:tasks.workunit.client.0.smithi002.stdout:3/409: write d9/d24/f51 [254263,60292] 0 2023-12-17T11:57:41.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/391: dwrite d3/d7/d18/d3f/d49/f4e [0,4194304] 0 2023-12-17T11:57:41.803 INFO:tasks.workunit.client.0.smithi002.stdout:5/354: dwrite fa [0,4194304] 0 2023-12-17T11:57:41.804 INFO:tasks.workunit.client.1.smithi119.stdout:9/413: rmdir d12 39 2023-12-17T11:57:41.804 INFO:tasks.workunit.client.1.smithi119.stdout:9/414: chown d12/d1d/d28/d4d/f6c 172442 1 2023-12-17T11:57:41.804 INFO:tasks.workunit.client.1.smithi119.stdout:9/415: fsync d12/d65/f6a 0 2023-12-17T11:57:41.804 INFO:tasks.workunit.client.1.smithi119.stdout:2/398: dread d6/d9/d52/d53/d55/f41 [0,4194304] 0 2023-12-17T11:57:41.808 INFO:tasks.workunit.client.0.smithi002.stdout:4/373: dread d0/d10/f4b [0,4194304] 0 2023-12-17T11:57:41.813 INFO:tasks.workunit.client.1.smithi119.stdout:5/391: read d1/f51 [3592415,92423] 0 2023-12-17T11:57:41.813 INFO:tasks.workunit.client.1.smithi119.stdout:5/392: dread - d1/d25/f79 zero size 2023-12-17T11:57:41.814 INFO:tasks.workunit.client.1.smithi119.stdout:8/292: unlink d7/d18/l47 0 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.1.smithi119.stdout:0/268: rename d2/d3/f3e to d2/d16/d12/d1f/f4e 0 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.1.smithi119.stdout:3/386: mkdir d9/d11/d1e/d55/d65/d84/d98 0 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.1.smithi119.stdout:0/269: chown d2 379 1 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.1.smithi119.stdout:3/387: fdatasync d9/da/f54 0 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.1.smithi119.stdout:0/270: read - d2/d3/f3d zero size 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.1.smithi119.stdout:0/271: readlink d2/d16/d12/d2e/l4d 0 2023-12-17T11:57:41.818 INFO:tasks.workunit.client.0.smithi002.stdout:6/369: dread d0/d1/dc/d17/f2e [0,4194304] 0 2023-12-17T11:57:41.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/392: symlink d3/d8/d28/d31/d5a/l87 0 2023-12-17T11:57:41.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/393: fsync d3/d8/d28/d31/d5a/f7a 0 2023-12-17T11:57:41.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/394: creat d3/d8/da/f88 x:0 0 0 2023-12-17T11:57:41.822 INFO:tasks.workunit.client.0.smithi002.stdout:8/395: creat d3/d8/d28/d31/d5a/d7c/f89 x:0 0 0 2023-12-17T11:57:41.822 INFO:tasks.workunit.client.0.smithi002.stdout:8/396: dread - d3/d8/da/f88 zero size 2023-12-17T11:57:41.822 INFO:tasks.workunit.client.0.smithi002.stdout:8/397: creat d3/d8/da/f8a x:0 0 0 2023-12-17T11:57:41.823 INFO:tasks.workunit.client.1.smithi119.stdout:3/388: write d9/da/df/d41/d33/d3a/d90/f7c [904144,118644] 0 2023-12-17T11:57:41.824 INFO:tasks.workunit.client.1.smithi119.stdout:3/389: chown d9/d35/f5e 20 1 2023-12-17T11:57:41.824 INFO:tasks.workunit.client.1.smithi119.stdout:6/313: rmdir d2/df 39 2023-12-17T11:57:41.831 INFO:tasks.workunit.client.0.smithi002.stdout:6/370: getdents d0/d1 0 2023-12-17T11:57:41.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/411: dread f0 [0,4194304] 0 2023-12-17T11:57:41.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/412: chown dc/d1d/d23/d52 166322086 1 2023-12-17T11:57:41.832 INFO:tasks.workunit.client.0.smithi002.stdout:5/355: write dc/d1b/f63 [2227651,78750] 0 2023-12-17T11:57:41.832 INFO:tasks.workunit.client.1.smithi119.stdout:5/393: getdents d1/d25/d39/d71 0 2023-12-17T11:57:41.833 INFO:tasks.workunit.client.1.smithi119.stdout:5/394: fdatasync d1/d36/d3a/f4b 0 2023-12-17T11:57:41.833 INFO:tasks.workunit.client.1.smithi119.stdout:5/395: write d1/f17 [8550106,70153] 0 2023-12-17T11:57:41.833 INFO:tasks.workunit.client.1.smithi119.stdout:5/396: dread - d1/d25/f79 zero size 2023-12-17T11:57:41.833 INFO:tasks.workunit.client.1.smithi119.stdout:7/382: dwrite d2/d4e/f30 [0,4194304] 0 2023-12-17T11:57:41.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/371: creat d0/f71 x:0 0 0 2023-12-17T11:57:41.839 INFO:tasks.workunit.client.0.smithi002.stdout:9/413: rename dc/d42/d4f/d59/d47/d63 to dc/d1d/d7c/d90 0 2023-12-17T11:57:41.842 INFO:tasks.workunit.client.0.smithi002.stdout:9/414: mkdir dc/d1d/d23/d83/d91 0 2023-12-17T11:57:41.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/323: dwrite d0/d6/d26/d25/f46 [0,4194304] 0 2023-12-17T11:57:41.845 INFO:tasks.workunit.client.1.smithi119.stdout:4/372: rmdir dd/d15/d16/d20/d42 39 2023-12-17T11:57:41.845 INFO:tasks.workunit.client.1.smithi119.stdout:8/293: mknod d7/da/d11/d26/d2c/c5d 0 2023-12-17T11:57:41.845 INFO:tasks.workunit.client.1.smithi119.stdout:5/397: mknod d1/d70/d6b/d77/c7b 0 2023-12-17T11:57:41.847 INFO:tasks.workunit.client.0.smithi002.stdout:5/356: dread dc/d1a/d47/f49 [0,4194304] 0 2023-12-17T11:57:41.849 INFO:tasks.workunit.client.1.smithi119.stdout:3/390: dread d9/d11/d1e/d55/f7e [0,4194304] 0 2023-12-17T11:57:41.850 INFO:tasks.workunit.client.0.smithi002.stdout:4/374: write d0/d10/f4b [2086845,101908] 0 2023-12-17T11:57:41.850 INFO:tasks.workunit.client.0.smithi002.stdout:9/415: unlink dc/c56 0 2023-12-17T11:57:41.851 INFO:tasks.workunit.client.0.smithi002.stdout:9/416: write dc/d1d/d23/d76/f86 [152495,13173] 0 2023-12-17T11:57:41.852 INFO:tasks.workunit.client.1.smithi119.stdout:9/416: dwrite d12/f17 [0,4194304] 0 2023-12-17T11:57:41.852 INFO:tasks.workunit.client.1.smithi119.stdout:1/310: dread d3/db/d17/d24/f53 [0,4194304] 0 2023-12-17T11:57:41.852 INFO:tasks.workunit.client.1.smithi119.stdout:9/417: chown d12/d1d/c39 16566775 1 2023-12-17T11:57:41.852 INFO:tasks.workunit.client.1.smithi119.stdout:9/418: stat d12/f23 0 2023-12-17T11:57:41.853 INFO:tasks.workunit.client.1.smithi119.stdout:8/294: creat d7/da/d11/d26/d49/f5e x:0 0 0 2023-12-17T11:57:41.859 INFO:tasks.workunit.client.0.smithi002.stdout:0/324: write d0/d15/f54 [2184805,72628] 0 2023-12-17T11:57:41.862 INFO:tasks.workunit.client.1.smithi119.stdout:2/399: dread d6/f33 [0,4194304] 0 2023-12-17T11:57:41.862 INFO:tasks.workunit.client.1.smithi119.stdout:2/400: write f5 [2592234,115962] 0 2023-12-17T11:57:41.862 INFO:tasks.workunit.client.1.smithi119.stdout:2/401: chown f5 4 1 2023-12-17T11:57:41.862 INFO:tasks.workunit.client.1.smithi119.stdout:5/398: creat d1/d70/d6b/f7c x:0 0 0 2023-12-17T11:57:41.862 INFO:tasks.workunit.client.1.smithi119.stdout:5/399: chown d1/l75 222 1 2023-12-17T11:57:41.863 INFO:tasks.workunit.client.1.smithi119.stdout:3/391: link d9/da/f83 d9/d11/d1e/d55/d65/f99 0 2023-12-17T11:57:41.863 INFO:tasks.workunit.client.0.smithi002.stdout:1/435: sync 2023-12-17T11:57:41.865 INFO:tasks.workunit.client.1.smithi119.stdout:4/373: dread dd/f38 [0,4194304] 0 2023-12-17T11:57:41.880 INFO:tasks.workunit.client.1.smithi119.stdout:0/272: dwrite d2/d16/f17 [0,4194304] 0 2023-12-17T11:57:41.880 INFO:tasks.workunit.client.1.smithi119.stdout:0/273: truncate d2/d3/f14 8671980 0 2023-12-17T11:57:41.880 INFO:tasks.workunit.client.1.smithi119.stdout:0/274: readlink d2/d16/d12/d1f/d24/l2f 0 2023-12-17T11:57:41.882 INFO:tasks.workunit.client.1.smithi119.stdout:7/383: dread d2/d40/f6d [0,4194304] 0 2023-12-17T11:57:41.890 INFO:tasks.workunit.client.1.smithi119.stdout:4/374: write dd/f1d [3565293,83723] 0 2023-12-17T11:57:41.892 INFO:tasks.workunit.client.1.smithi119.stdout:4/375: fdatasync dd/d15/d16/f45 0 2023-12-17T11:57:41.892 INFO:tasks.workunit.client.1.smithi119.stdout:6/314: dwrite d2/df/d17/f50 [0,4194304] 0 2023-12-17T11:57:41.892 INFO:tasks.workunit.client.1.smithi119.stdout:6/315: stat d2/f26 0 2023-12-17T11:57:41.895 INFO:tasks.workunit.client.0.smithi002.stdout:5/357: dwrite dc/d2b/f65 [0,4194304] 0 2023-12-17T11:57:41.896 INFO:tasks.workunit.client.0.smithi002.stdout:3/410: dwrite d9/d15/f66 [0,4194304] 0 2023-12-17T11:57:41.901 INFO:tasks.workunit.client.1.smithi119.stdout:0/275: dread d2/d16/d12/f32 [0,4194304] 0 2023-12-17T11:57:41.903 INFO:tasks.workunit.client.0.smithi002.stdout:4/375: dwrite d0/d3e/d56/f77 [0,4194304] 0 2023-12-17T11:57:41.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:41 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:41.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:41 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:41.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:41 smithi119 ceph-mon[117414]: Reconfiguring grafana.smithi002 (dependencies changed)... 2023-12-17T11:57:41.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:41 smithi119 ceph-mon[117414]: Reconfiguring daemon grafana.smithi002 on smithi002 2023-12-17T11:57:41.919 INFO:tasks.workunit.client.1.smithi119.stdout:1/311: creat d3/db/d26/d5e/f6a x:0 0 0 2023-12-17T11:57:41.922 INFO:tasks.workunit.client.1.smithi119.stdout:9/419: symlink d12/d1d/d28/l83 0 2023-12-17T11:57:41.923 INFO:tasks.workunit.client.0.smithi002.stdout:1/436: mkdir d3/d2f/d4d/d91 0 2023-12-17T11:57:41.925 INFO:tasks.workunit.client.0.smithi002.stdout:0/325: dwrite d0/d15/f32 [4194304,4194304] 0 2023-12-17T11:57:41.929 INFO:tasks.workunit.client.1.smithi119.stdout:4/376: dread dd/f4a [0,4194304] 0 2023-12-17T11:57:41.932 INFO:tasks.workunit.client.0.smithi002.stdout:9/417: dwrite dc/d1d/d23/f7f [0,4194304] 0 2023-12-17T11:57:41.933 INFO:tasks.workunit.client.0.smithi002.stdout:9/418: write dc/d42/d4f/d59/f33 [4755720,118888] 0 2023-12-17T11:57:41.947 INFO:tasks.workunit.client.1.smithi119.stdout:3/392: mknod d9/da/df/d41/d33/d3a/c9a 0 2023-12-17T11:57:41.950 INFO:tasks.workunit.client.1.smithi119.stdout:7/384: mkdir d2/d4/d11/d3c/d75 0 2023-12-17T11:57:41.950 INFO:tasks.workunit.client.1.smithi119.stdout:7/385: creat d2/f76 x:0 0 0 2023-12-17T11:57:41.950 INFO:tasks.workunit.client.1.smithi119.stdout:7/386: chown d2/d4/d11/d2c/d55 29188 1 2023-12-17T11:57:41.951 INFO:tasks.workunit.client.1.smithi119.stdout:7/387: readlink d2/d5b/l73 0 2023-12-17T11:57:41.951 INFO:tasks.workunit.client.1.smithi119.stdout:7/388: fsync d2/d40/f6b 0 2023-12-17T11:57:41.959 INFO:tasks.workunit.client.1.smithi119.stdout:6/316: mkdir d2/d2b/d43/d5e 0 2023-12-17T11:57:41.965 INFO:tasks.workunit.client.1.smithi119.stdout:0/276: dwrite d2/f4 [4194304,4194304] 0 2023-12-17T11:57:41.965 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:41 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:41.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:41 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:41.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:41 smithi002 ceph-mon[107131]: Reconfiguring grafana.smithi002 (dependencies changed)... 2023-12-17T11:57:41.966 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:41 smithi002 ceph-mon[107131]: Reconfiguring daemon grafana.smithi002 on smithi002 2023-12-17T11:57:41.980 INFO:tasks.workunit.client.0.smithi002.stdout:5/358: dwrite dc/f3e [0,4194304] 0 2023-12-17T11:57:41.980 INFO:tasks.workunit.client.1.smithi119.stdout:8/295: dwrite d7/d18/f3d [0,4194304] 0 2023-12-17T11:57:41.985 INFO:tasks.workunit.client.1.smithi119.stdout:2/402: dwrite d6/d9/d13/d1d/f50 [0,4194304] 0 2023-12-17T11:57:41.985 INFO:tasks.workunit.client.0.smithi002.stdout:3/411: dwrite d9/f45 [0,4194304] 0 2023-12-17T11:57:41.985 INFO:tasks.workunit.client.0.smithi002.stdout:3/412: write d9/d1b/f7b [1605369,9911] 0 2023-12-17T11:57:41.994 INFO:tasks.workunit.client.0.smithi002.stdout:3/413: dread d9/d1b/d35/d41/d59/d65/f74 [0,4194304] 0 2023-12-17T11:57:41.994 INFO:tasks.workunit.client.0.smithi002.stdout:3/414: write d9/f1d [1571676,87217] 0 2023-12-17T11:57:41.996 INFO:tasks.workunit.client.1.smithi119.stdout:1/312: symlink d3/db/d26/d19/d3f/d64/l6b 0 2023-12-17T11:57:42.001 INFO:tasks.workunit.client.1.smithi119.stdout:4/377: dwrite dd/d15/d16/f1a [4194304,4194304] 0 2023-12-17T11:57:42.005 INFO:tasks.workunit.client.1.smithi119.stdout:9/420: mknod d12/d1d/d28/d46/d50/c84 0 2023-12-17T11:57:42.008 INFO:tasks.workunit.client.0.smithi002.stdout:3/415: dread d9/d15/f66 [0,4194304] 0 2023-12-17T11:57:42.018 INFO:tasks.workunit.client.1.smithi119.stdout:7/389: mkdir d2/d4/d11/d2c/d68/d77 0 2023-12-17T11:57:42.024 INFO:tasks.workunit.client.1.smithi119.stdout:6/317: creat d2/df/d17/f5f x:0 0 0 2023-12-17T11:57:42.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/416: read d9/d1b/f28 [2697236,46912] 0 2023-12-17T11:57:42.027 INFO:tasks.workunit.client.0.smithi002.stdout:3/417: write d9/d15/f22 [2934574,116526] 0 2023-12-17T11:57:42.039 INFO:tasks.workunit.client.1.smithi119.stdout:0/277: dwrite d2/d3/f14 [0,4194304] 0 2023-12-17T11:57:42.039 INFO:tasks.workunit.client.1.smithi119.stdout:0/278: write d2/d3/f14 [8524639,20741] 0 2023-12-17T11:57:42.042 INFO:tasks.workunit.client.0.smithi002.stdout:3/418: dread d9/d1b/d35/d41/f42 [0,4194304] 0 2023-12-17T11:57:42.043 INFO:tasks.workunit.client.0.smithi002.stdout:3/419: chown d9/d15/d71/d82 27040439 1 2023-12-17T11:57:42.043 INFO:tasks.workunit.client.1.smithi119.stdout:8/296: truncate d7/da/d11/f13 1055623 0 2023-12-17T11:57:42.061 INFO:tasks.workunit.client.1.smithi119.stdout:2/403: rename d6/d9/d52/c7b to d6/d9/d13/d34/d88/c8f 0 2023-12-17T11:57:42.061 INFO:tasks.workunit.client.1.smithi119.stdout:1/313: mkdir d3/db/d17/d24/d20/d6c 0 2023-12-17T11:57:42.061 INFO:tasks.workunit.client.1.smithi119.stdout:1/314: read d3/db/d26/d19/f2f [320519,23052] 0 2023-12-17T11:57:42.066 INFO:tasks.workunit.client.1.smithi119.stdout:4/378: mknod dd/d4b/c79 0 2023-12-17T11:57:42.066 INFO:tasks.workunit.client.1.smithi119.stdout:9/421: dwrite d12/d65/f7d [0,4194304] 0 2023-12-17T11:57:42.067 INFO:tasks.workunit.client.1.smithi119.stdout:3/393: link d9/d35/f58 d9/f9b 0 2023-12-17T11:57:42.067 INFO:tasks.workunit.client.1.smithi119.stdout:3/394: chown d9/da/df/d41/d33/f62 78377 1 2023-12-17T11:57:42.079 INFO:tasks.workunit.client.1.smithi119.stdout:8/297: creat d7/d18/f5f x:0 0 0 2023-12-17T11:57:42.079 INFO:tasks.workunit.client.1.smithi119.stdout:2/404: dread d6/d9/f60 [0,4194304] 0 2023-12-17T11:57:42.085 INFO:tasks.workunit.client.1.smithi119.stdout:1/315: mkdir d3/db/d17/d24/d20/d40/d6d 0 2023-12-17T11:57:42.100 INFO:tasks.workunit.client.1.smithi119.stdout:9/422: mkdir d12/d1d/d49/d85 0 2023-12-17T11:57:42.106 INFO:tasks.workunit.client.1.smithi119.stdout:3/395: symlink d9/d11/d1e/d55/d65/d84/l9c 0 2023-12-17T11:57:42.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/279: dwrite d2/d16/d12/d1f/f4e [0,4194304] 0 2023-12-17T11:57:42.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/280: chown d2/d3/d5/dc/c4b 311 1 2023-12-17T11:57:42.117 INFO:tasks.workunit.client.1.smithi119.stdout:4/379: dwrite dd/d15/d16/f51 [0,4194304] 0 2023-12-17T11:57:42.117 INFO:tasks.workunit.client.1.smithi119.stdout:4/380: write dd/f71 [176775,9523] 0 2023-12-17T11:57:42.119 INFO:tasks.workunit.client.1.smithi119.stdout:1/316: creat d3/db/d17/d24/d20/d40/d6d/f6e x:0 0 0 2023-12-17T11:57:42.120 INFO:tasks.workunit.client.1.smithi119.stdout:1/317: readlink d3/db/d26/l4c 0 2023-12-17T11:57:42.120 INFO:tasks.workunit.client.1.smithi119.stdout:1/318: dread - d3/f25 zero size 2023-12-17T11:57:42.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/405: dread d6/d9/f2a [0,4194304] 0 2023-12-17T11:57:42.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/406: creat d6/d2b/d4b/d5d/f90 x:0 0 0 2023-12-17T11:57:42.123 INFO:tasks.workunit.client.1.smithi119.stdout:6/318: dwrite d2/df/d17/f37 [0,4194304] 0 2023-12-17T11:57:42.123 INFO:tasks.workunit.client.1.smithi119.stdout:6/319: chown d2/d2b/c35 4076838 1 2023-12-17T11:57:42.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/423: mkdir d12/d1d/d28/d86 0 2023-12-17T11:57:42.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/424: truncate d12/d1d/d49/f77 476291 0 2023-12-17T11:57:42.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/425: chown d12/d1d/d79 74 1 2023-12-17T11:57:42.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/426: chown d12/d1d/f27 225 1 2023-12-17T11:57:42.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/427: chown ld 352 1 2023-12-17T11:57:42.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/428: write d12/d1d/d49/f5b [770174,49863] 0 2023-12-17T11:57:42.131 INFO:tasks.workunit.client.1.smithi119.stdout:9/429: chown d12/d1d/d28/d4d/l75 1774772 1 2023-12-17T11:57:42.136 INFO:tasks.workunit.client.0.smithi002.stdout:1/437: symlink d3/d6/d16/d28/l92 0 2023-12-17T11:57:42.136 INFO:tasks.workunit.client.0.smithi002.stdout:1/438: write d3/d6/d9/d30/f41 [1615026,36886] 0 2023-12-17T11:57:42.136 INFO:tasks.workunit.client.0.smithi002.stdout:1/439: chown d3/l20 1103457 1 2023-12-17T11:57:42.136 INFO:tasks.workunit.client.0.smithi002.stdout:1/440: chown d3/d6/d9/f38 10024 1 2023-12-17T11:57:42.136 INFO:tasks.workunit.client.0.smithi002.stdout:1/441: creat d3/d6/d16/d61/f93 x:0 0 0 2023-12-17T11:57:42.137 INFO:tasks.workunit.client.1.smithi119.stdout:3/396: unlink d9/d35/c8f 0 2023-12-17T11:57:42.137 INFO:tasks.workunit.client.1.smithi119.stdout:3/397: read - d9/f85 zero size 2023-12-17T11:57:42.137 INFO:tasks.workunit.client.1.smithi119.stdout:3/398: chown d9/d35/f6a 1814950 1 2023-12-17T11:57:42.137 INFO:tasks.workunit.client.1.smithi119.stdout:3/399: write d9/da/df/d41/d33/d5a/f93 [446343,71895] 0 2023-12-17T11:57:42.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/442: dread d3/d6/d9/d37/d39/d43/d4a/f77 [0,4194304] 0 2023-12-17T11:57:42.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/443: chown d3/d6/d9/f38 4528 1 2023-12-17T11:57:42.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/444: chown d3/d6/d9/d30/l1d 1883 1 2023-12-17T11:57:42.142 INFO:tasks.workunit.client.0.smithi002.stdout:1/445: write d3/d2f/f79 [311215,40675] 0 2023-12-17T11:57:42.143 INFO:tasks.workunit.client.0.smithi002.stdout:0/326: truncate d0/f48 3352519 0 2023-12-17T11:57:42.144 INFO:tasks.workunit.client.1.smithi119.stdout:0/281: creat d2/d3/d5/f4f x:0 0 0 2023-12-17T11:57:42.149 INFO:tasks.workunit.client.1.smithi119.stdout:5/400: mknod d1/d36/c7d 0 2023-12-17T11:57:42.151 INFO:tasks.workunit.client.1.smithi119.stdout:4/381: link dd/d15/d16/c57 dd/d15/d16/c7a 0 2023-12-17T11:57:42.155 INFO:tasks.workunit.client.1.smithi119.stdout:8/298: mkdir d7/da/d11/d60 0 2023-12-17T11:57:42.155 INFO:tasks.workunit.client.1.smithi119.stdout:8/299: creat d7/d12/d23/f61 x:0 0 0 2023-12-17T11:57:42.155 INFO:tasks.workunit.client.1.smithi119.stdout:8/300: stat d7/fb 0 2023-12-17T11:57:42.159 INFO:tasks.workunit.client.1.smithi119.stdout:1/319: rename d3/db/f4d to d3/db/d17/d24/d20/f6f 0 2023-12-17T11:57:42.161 INFO:tasks.workunit.client.1.smithi119.stdout:0/282: write d2/d3/f14 [6648744,30143] 0 2023-12-17T11:57:42.161 INFO:tasks.workunit.client.1.smithi119.stdout:0/283: chown d2/d16/d12/d2e/d44/f26 2614897 1 2023-12-17T11:57:42.166 INFO:tasks.workunit.client.1.smithi119.stdout:2/407: symlink d6/d2b/d3f/l91 0 2023-12-17T11:57:42.166 INFO:tasks.workunit.client.1.smithi119.stdout:2/408: stat d6/d2b/d3f 0 2023-12-17T11:57:42.167 INFO:tasks.workunit.client.0.smithi002.stdout:5/359: symlink dc/d17/l79 0 2023-12-17T11:57:42.176 INFO:tasks.workunit.client.1.smithi119.stdout:6/320: symlink d2/d2b/d43/d5e/l60 0 2023-12-17T11:57:42.176 INFO:tasks.workunit.client.1.smithi119.stdout:6/321: dread - d2/d2b/f52 zero size 2023-12-17T11:57:42.176 INFO:tasks.workunit.client.1.smithi119.stdout:6/322: chown d2/df/f1f 5 1 2023-12-17T11:57:42.180 INFO:tasks.workunit.client.1.smithi119.stdout:9/430: getdents d12/d65 0 2023-12-17T11:57:42.180 INFO:tasks.workunit.client.1.smithi119.stdout:9/431: chown d12/l16 95793585 1 2023-12-17T11:57:42.181 INFO:tasks.workunit.client.1.smithi119.stdout:5/401: creat d1/d25/f7e x:0 0 0 2023-12-17T11:57:42.188 INFO:tasks.workunit.client.1.smithi119.stdout:1/320: creat d3/db/d26/d19/f70 x:0 0 0 2023-12-17T11:57:42.189 INFO:tasks.workunit.client.1.smithi119.stdout:0/284: unlink d2/d16/l33 0 2023-12-17T11:57:42.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/285: chown d2/d16/d12/f1a 59449875 1 2023-12-17T11:57:42.190 INFO:tasks.workunit.client.1.smithi119.stdout:4/382: dread dd/d15/d16/f1a [0,4194304] 0 2023-12-17T11:57:42.192 INFO:tasks.workunit.client.0.smithi002.stdout:1/446: mkdir d3/d6/d9/d37/d39/d94 0 2023-12-17T11:57:42.194 INFO:tasks.workunit.client.1.smithi119.stdout:2/409: creat d6/d9/d52/d53/d55/d58/f92 x:0 0 0 2023-12-17T11:57:42.194 INFO:tasks.workunit.client.1.smithi119.stdout:2/410: chown d6/d2b/d3f/d5c/l62 1710300290 1 2023-12-17T11:57:42.194 INFO:tasks.workunit.client.1.smithi119.stdout:2/411: dread - d6/d2b/d3f/f6d zero size 2023-12-17T11:57:42.194 INFO:tasks.workunit.client.1.smithi119.stdout:2/412: readlink d6/d2b/d3f/d5b/l7c 0 2023-12-17T11:57:42.195 INFO:tasks.workunit.client.0.smithi002.stdout:0/327: mknod d0/d6/d26/d14/d19/c69 0 2023-12-17T11:57:42.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/323: mkdir d2/d61 0 2023-12-17T11:57:42.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/324: creat d2/d2b/d43/f62 x:0 0 0 2023-12-17T11:57:42.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/419: getdents dc/d42/d4f 0 2023-12-17T11:57:42.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/420: fsync dc/d1d/d25/f65 0 2023-12-17T11:57:42.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/421: fsync f1 0 2023-12-17T11:57:42.201 INFO:tasks.workunit.client.1.smithi119.stdout:5/402: symlink d1/d36/l7f 0 2023-12-17T11:57:42.203 INFO:tasks.workunit.client.0.smithi002.stdout:5/360: creat dc/d17/d2f/f7a x:0 0 0 2023-12-17T11:57:42.203 INFO:tasks.workunit.client.1.smithi119.stdout:8/301: dwrite d7/d18/f5f [0,4194304] 0 2023-12-17T11:57:42.203 INFO:tasks.workunit.client.1.smithi119.stdout:8/302: write d7/da/d11/d26/d2c/f5a [265387,58074] 0 2023-12-17T11:57:42.204 INFO:tasks.workunit.client.1.smithi119.stdout:8/303: write d7/da/d11/d26/d49/f5e [632438,32144] 0 2023-12-17T11:57:42.204 INFO:tasks.workunit.client.1.smithi119.stdout:3/400: dwrite d9/d11/d1e/f3e [0,4194304] 0 2023-12-17T11:57:42.211 INFO:tasks.workunit.client.1.smithi119.stdout:3/401: dread d9/d11/d1e/f6f [0,4194304] 0 2023-12-17T11:57:42.211 INFO:tasks.workunit.client.1.smithi119.stdout:3/402: chown d9/d11/d1e/d55/f66 14 1 2023-12-17T11:57:42.211 INFO:tasks.workunit.client.1.smithi119.stdout:3/403: truncate d9/d35/f6a 337415 0 2023-12-17T11:57:42.231 INFO:tasks.workunit.client.0.smithi002.stdout:1/447: mkdir d3/d2f/d4d/d95 0 2023-12-17T11:57:42.231 INFO:tasks.workunit.client.0.smithi002.stdout:1/448: chown d3/d6/d9/d30/f4c 1 1 2023-12-17T11:57:42.231 INFO:tasks.workunit.client.0.smithi002.stdout:1/449: fdatasync d3/d6/d9/d37/f65 0 2023-12-17T11:57:42.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/328: symlink d0/d6/d26/d14/d19/d37/d62/l6a 0 2023-12-17T11:57:42.237 INFO:tasks.workunit.client.0.smithi002.stdout:5/361: stat dc/d1b/d2d/d5b/l5c 0 2023-12-17T11:57:42.240 INFO:tasks.workunit.client.1.smithi119.stdout:1/321: unlink d3/db/d17/d24/d20/f6f 0 2023-12-17T11:57:42.241 INFO:tasks.workunit.client.1.smithi119.stdout:4/383: rename dd/d2a/l40 to dd/d15/d16/d20/d42/l7b 0 2023-12-17T11:57:42.241 INFO:tasks.workunit.client.1.smithi119.stdout:4/384: creat dd/d15/d16/d3d/f7c x:0 0 0 2023-12-17T11:57:42.244 INFO:tasks.workunit.client.0.smithi002.stdout:5/362: symlink dc/d1a/l7b 0 2023-12-17T11:57:42.245 INFO:tasks.workunit.client.1.smithi119.stdout:3/404: dwrite d9/d1c/f49 [0,4194304] 0 2023-12-17T11:57:42.245 INFO:tasks.workunit.client.1.smithi119.stdout:3/405: fsync d9/d11/f76 0 2023-12-17T11:57:42.247 INFO:tasks.workunit.client.1.smithi119.stdout:0/286: dwrite d2/d3/f3d [0,4194304] 0 2023-12-17T11:57:42.247 INFO:tasks.workunit.client.1.smithi119.stdout:6/325: link d2/df/f30 d2/d2b/f63 0 2023-12-17T11:57:42.247 INFO:tasks.workunit.client.1.smithi119.stdout:6/326: write d2/d2b/d43/f62 [356530,79783] 0 2023-12-17T11:57:42.248 INFO:tasks.workunit.client.0.smithi002.stdout:1/450: write d3/f17 [2480134,50838] 0 2023-12-17T11:57:42.253 INFO:tasks.workunit.client.0.smithi002.stdout:1/451: creat d3/d2f/d4d/d95/f96 x:0 0 0 2023-12-17T11:57:42.253 INFO:tasks.workunit.client.0.smithi002.stdout:1/452: fdatasync d3/d6/d9/d30/f54 0 2023-12-17T11:57:42.254 INFO:tasks.workunit.client.0.smithi002.stdout:3/420: write d9/f45 [4302571,90262] 0 2023-12-17T11:57:42.254 INFO:tasks.workunit.client.0.smithi002.stdout:3/421: truncate d9/d1b/d35/d41/d43/d4b/f57 956084 0 2023-12-17T11:57:42.255 INFO:tasks.workunit.client.1.smithi119.stdout:6/327: dread d2/f38 [0,4194304] 0 2023-12-17T11:57:42.255 INFO:tasks.workunit.client.1.smithi119.stdout:6/328: truncate d2/f5a 364386 0 2023-12-17T11:57:42.255 INFO:tasks.workunit.client.1.smithi119.stdout:6/329: readlink d2/df/l18 0 2023-12-17T11:57:42.257 INFO:tasks.workunit.client.0.smithi002.stdout:1/453: mkdir d3/d2f/d74/d97 0 2023-12-17T11:57:42.260 INFO:tasks.workunit.client.0.smithi002.stdout:1/454: mknod d3/d2f/d4d/d95/c98 0 2023-12-17T11:57:42.261 INFO:tasks.workunit.client.1.smithi119.stdout:8/304: dread d7/da/d11/f13 [0,4194304] 0 2023-12-17T11:57:42.263 INFO:tasks.workunit.client.0.smithi002.stdout:9/422: dwrite dc/d38/f5b [0,4194304] 0 2023-12-17T11:57:42.267 INFO:tasks.workunit.client.1.smithi119.stdout:1/322: symlink d3/db/d26/l71 0 2023-12-17T11:57:42.267 INFO:tasks.workunit.client.1.smithi119.stdout:1/323: creat d3/db/d26/d19/d3f/f72 x:0 0 0 2023-12-17T11:57:42.268 INFO:tasks.workunit.client.1.smithi119.stdout:1/324: write d3/db/d26/d19/d3f/f72 [691563,64420] 0 2023-12-17T11:57:42.268 INFO:tasks.workunit.client.1.smithi119.stdout:1/325: write d3/db/f2b [2154604,23665] 0 2023-12-17T11:57:42.268 INFO:tasks.workunit.client.1.smithi119.stdout:1/326: fdatasync d3/f4 0 2023-12-17T11:57:42.268 INFO:tasks.workunit.client.1.smithi119.stdout:1/327: chown d3/db/d26/f55 106454 1 2023-12-17T11:57:42.273 INFO:tasks.workunit.client.0.smithi002.stdout:4/376: mknod d0/d3e/c7a 0 2023-12-17T11:57:42.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/455: symlink d3/d2f/d4d/l99 0 2023-12-17T11:57:42.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/456: fdatasync d3/d6/d16/d61/f86 0 2023-12-17T11:57:42.273 INFO:tasks.workunit.client.0.smithi002.stdout:4/377: creat d0/d10/d14/d27/d57/f7b x:0 0 0 2023-12-17T11:57:42.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/457: dread - d3/d6/d16/d61/d8e/f78 zero size 2023-12-17T11:57:42.273 INFO:tasks.workunit.client.0.smithi002.stdout:1/458: truncate d3/d6/d9/f38 419479 0 2023-12-17T11:57:42.275 INFO:tasks.workunit.client.1.smithi119.stdout:4/385: symlink dd/d11/l7d 0 2023-12-17T11:57:42.275 INFO:tasks.workunit.client.1.smithi119.stdout:4/386: creat dd/d11/d26/f7e x:0 0 0 2023-12-17T11:57:42.275 INFO:tasks.workunit.client.1.smithi119.stdout:2/413: truncate d6/f11 1282990 0 2023-12-17T11:57:42.275 INFO:tasks.workunit.client.1.smithi119.stdout:2/414: dread - d6/d2b/d4b/d81/f82 zero size 2023-12-17T11:57:42.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/423: write dc/d1d/d23/f7f [1011460,106956] 0 2023-12-17T11:57:42.278 INFO:tasks.workunit.client.1.smithi119.stdout:3/406: mkdir d9/d11/d1e/d55/d65/d84/d9d 0 2023-12-17T11:57:42.284 INFO:tasks.workunit.client.0.smithi002.stdout:1/459: rmdir d3/d2f/d74 39 2023-12-17T11:57:42.284 INFO:tasks.workunit.client.1.smithi119.stdout:6/330: fsync d2/d2b/d43/f62 0 2023-12-17T11:57:42.286 INFO:tasks.workunit.client.0.smithi002.stdout:0/329: dwrite d0/f2e [0,4194304] 0 2023-12-17T11:57:42.286 INFO:tasks.workunit.client.0.smithi002.stdout:9/424: creat dc/d42/d4f/f92 x:0 0 0 2023-12-17T11:57:42.287 INFO:tasks.workunit.client.1.smithi119.stdout:0/287: mkdir d2/d16/d12/d1f/d24/d50 0 2023-12-17T11:57:42.290 INFO:tasks.workunit.client.1.smithi119.stdout:5/403: getdents d1/d44/d52 0 2023-12-17T11:57:42.291 INFO:tasks.workunit.client.1.smithi119.stdout:4/387: dread dd/f38 [0,4194304] 0 2023-12-17T11:57:42.292 INFO:tasks.workunit.client.0.smithi002.stdout:1/460: symlink d3/d2f/d4d/d91/l9a 0 2023-12-17T11:57:42.292 INFO:tasks.workunit.client.0.smithi002.stdout:4/378: dread d0/f43 [0,4194304] 0 2023-12-17T11:57:42.293 INFO:tasks.workunit.client.0.smithi002.stdout:5/363: dwrite dc/d17/d2f/f34 [4194304,4194304] 0 2023-12-17T11:57:42.300 INFO:tasks.workunit.client.1.smithi119.stdout:8/305: rename d7/d12/f2b to d7/d12/d1f/d2a/f62 0 2023-12-17T11:57:42.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/422: dwrite d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:42.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/423: truncate d9/d1b/d35/f7a 487444 0 2023-12-17T11:57:42.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/424: stat d9/d1b/d4f/f68 0 2023-12-17T11:57:42.308 INFO:tasks.workunit.client.0.smithi002.stdout:2/374: sync 2023-12-17T11:57:42.308 INFO:tasks.workunit.client.0.smithi002.stdout:5/364: truncate dc/d1a/f46 357866 0 2023-12-17T11:57:42.308 INFO:tasks.workunit.client.0.smithi002.stdout:8/398: sync 2023-12-17T11:57:42.308 INFO:tasks.workunit.client.0.smithi002.stdout:7/388: sync 2023-12-17T11:57:42.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/372: sync 2023-12-17T11:57:42.308 INFO:tasks.workunit.client.1.smithi119.stdout:1/328: rmdir d3/db/d26/d19/d3f/d64 39 2023-12-17T11:57:42.309 INFO:tasks.workunit.client.1.smithi119.stdout:1/329: write d3/db/d2a/f66 [357724,113529] 0 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:1/330: readlink d3/db/d26/l71 0 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:1/331: dread - d3/db/d17/d24/d20/f50 zero size 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:1/332: creat d3/db/d26/d19/d3f/f73 x:0 0 0 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:1/333: dread - d3/db/d26/d19/d3f/f51 zero size 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:1/334: dread - d3/db/d17/f31 zero size 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:1/335: read - d3/f25 zero size 2023-12-17T11:57:42.310 INFO:tasks.workunit.client.1.smithi119.stdout:5/404: read d1/d25/d39/f5c [1405490,62750] 0 2023-12-17T11:57:42.314 INFO:tasks.workunit.client.1.smithi119.stdout:1/336: fdatasync d3/db/d2a/f66 0 2023-12-17T11:57:42.324 INFO:tasks.workunit.client.1.smithi119.stdout:6/331: dwrite d2/d2b/f52 [0,4194304] 0 2023-12-17T11:57:42.324 INFO:tasks.workunit.client.1.smithi119.stdout:6/332: creat d2/df/d17/f64 x:0 0 0 2023-12-17T11:57:42.324 INFO:tasks.workunit.client.0.smithi002.stdout:1/461: write d3/d6/d9/f90 [2293728,97147] 0 2023-12-17T11:57:42.325 INFO:tasks.workunit.client.0.smithi002.stdout:9/425: rename dc/d1d/d23 to dc/d42/d4f/d59/d49/d72/d93 0 2023-12-17T11:57:42.331 INFO:tasks.workunit.client.0.smithi002.stdout:2/375: creat d3/d4/f87 x:0 0 0 2023-12-17T11:57:42.333 INFO:tasks.workunit.client.1.smithi119.stdout:2/415: creat d6/d9/d52/d53/d55/d58/d6b/f93 x:0 0 0 2023-12-17T11:57:42.335 INFO:tasks.workunit.client.0.smithi002.stdout:5/365: mkdir dc/d1a/d7c 0 2023-12-17T11:57:42.340 INFO:tasks.workunit.client.0.smithi002.stdout:6/373: rename d0/d1/d21/c5d to d0/d1/d21/c72 0 2023-12-17T11:57:42.342 INFO:tasks.workunit.client.1.smithi119.stdout:5/405: read d1/d25/f46 [756252,116977] 0 2023-12-17T11:57:42.342 INFO:tasks.workunit.client.1.smithi119.stdout:5/406: getdents d1/d44/d52 0 2023-12-17T11:57:42.342 INFO:tasks.workunit.client.0.smithi002.stdout:8/399: mknod d3/d7/c8b 0 2023-12-17T11:57:42.342 INFO:tasks.workunit.client.0.smithi002.stdout:8/400: read - d3/d7/d6e/d7f/f54 zero size 2023-12-17T11:57:42.343 INFO:tasks.workunit.client.0.smithi002.stdout:8/401: fsync d3/d8/d28/d31/d5a/d7c/f7e 0 2023-12-17T11:57:42.350 INFO:tasks.workunit.client.0.smithi002.stdout:1/462: creat d3/d2f/d74/f9b x:0 0 0 2023-12-17T11:57:42.358 INFO:tasks.workunit.client.0.smithi002.stdout:4/379: rename d0/d10/d14/d4e/f5c to d0/d3e/d56/f7c 0 2023-12-17T11:57:42.359 INFO:tasks.workunit.client.0.smithi002.stdout:8/402: rename d3/d7/d18/d3f to d3/d7/d18/d3f/d8c 22 2023-12-17T11:57:42.361 INFO:tasks.workunit.client.0.smithi002.stdout:1/463: dread d3/d6/d16/d28/f69 [0,4194304] 0 2023-12-17T11:57:42.366 INFO:tasks.workunit.client.0.smithi002.stdout:5/366: symlink dc/d1b/d2d/l7d 0 2023-12-17T11:57:42.367 INFO:tasks.workunit.client.1.smithi119.stdout:4/388: dwrite dd/f41 [0,4194304] 0 2023-12-17T11:57:42.370 INFO:tasks.workunit.client.0.smithi002.stdout:2/376: mknod d3/d4/d7/d14/d2e/d37/d3f/c88 0 2023-12-17T11:57:42.370 INFO:tasks.workunit.client.0.smithi002.stdout:5/367: fdatasync f8 0 2023-12-17T11:57:42.370 INFO:tasks.workunit.client.0.smithi002.stdout:2/377: chown d3/d4/d7/l1c 614786 1 2023-12-17T11:57:42.371 INFO:tasks.workunit.client.0.smithi002.stdout:2/378: chown d3/d4/d7/d14/d1b/l1d 3764969 1 2023-12-17T11:57:42.371 INFO:tasks.workunit.client.0.smithi002.stdout:2/379: fsync d3/d4/d7/d14/d1b/d5b/f63 0 2023-12-17T11:57:42.371 INFO:tasks.workunit.client.0.smithi002.stdout:2/380: truncate d3/d4/d7/d14/d42/f76 591493 0 2023-12-17T11:57:42.371 INFO:tasks.workunit.client.0.smithi002.stdout:2/381: chown d3/d4/d7/f86 9909 1 2023-12-17T11:57:42.373 INFO:tasks.workunit.client.1.smithi119.stdout:6/333: unlink d2/df/l18 0 2023-12-17T11:57:42.373 INFO:tasks.workunit.client.1.smithi119.stdout:0/288: dwrite d2/d16/d12/f1a [0,4194304] 0 2023-12-17T11:57:42.376 INFO:tasks.workunit.client.1.smithi119.stdout:1/337: dwrite d3/db/d17/d24/d20/d40/f5a [0,4194304] 0 2023-12-17T11:57:42.379 INFO:tasks.workunit.client.1.smithi119.stdout:8/306: mknod d7/d18/d15/c63 0 2023-12-17T11:57:42.380 INFO:tasks.workunit.client.1.smithi119.stdout:8/307: chown d7/da/d1a/f1c 3 1 2023-12-17T11:57:42.380 INFO:tasks.workunit.client.1.smithi119.stdout:8/308: fsync d7/d18/d15/f1b 0 2023-12-17T11:57:42.381 INFO:tasks.workunit.client.0.smithi002.stdout:6/374: creat d0/d1/d5b/f73 x:0 0 0 2023-12-17T11:57:42.381 INFO:tasks.workunit.client.0.smithi002.stdout:9/426: rmdir dc/d32 39 2023-12-17T11:57:42.385 INFO:tasks.workunit.client.0.smithi002.stdout:5/368: symlink dc/d1a/d47/l7e 0 2023-12-17T11:57:42.385 INFO:tasks.workunit.client.0.smithi002.stdout:8/403: dread d3/d7/d6e/d7f/f3a [0,4194304] 0 2023-12-17T11:57:42.385 INFO:tasks.workunit.client.0.smithi002.stdout:8/404: chown d3 6920146 1 2023-12-17T11:57:42.385 INFO:tasks.workunit.client.0.smithi002.stdout:8/405: dread - d3/d8/da/dd/f66 zero size 2023-12-17T11:57:42.385 INFO:tasks.workunit.client.0.smithi002.stdout:7/389: dwrite d6/d17/f65 [0,4194304] 0 2023-12-17T11:57:42.385 INFO:tasks.workunit.client.0.smithi002.stdout:6/375: creat d0/d1/dc/d17/d3c/d65/f74 x:0 0 0 2023-12-17T11:57:42.386 INFO:tasks.workunit.client.1.smithi119.stdout:3/407: rmdir d9/d11/d1e 39 2023-12-17T11:57:42.386 INFO:tasks.workunit.client.1.smithi119.stdout:3/408: readlink d9/d11/d1e/d55/d77/l8a 0 2023-12-17T11:57:42.386 INFO:tasks.workunit.client.0.smithi002.stdout:9/427: creat dc/d42/d4f/d59/d49/d72/d93/d76/f94 x:0 0 0 2023-12-17T11:57:42.392 INFO:tasks.workunit.client.0.smithi002.stdout:5/369: symlink dc/d1a/d47/l7f 0 2023-12-17T11:57:42.392 INFO:tasks.workunit.client.0.smithi002.stdout:8/406: link d3/d8/d28/d31/d5a/l87 d3/d7/d6e/l8d 0 2023-12-17T11:57:42.392 INFO:tasks.workunit.client.0.smithi002.stdout:0/330: dwrite d0/f13 [0,4194304] 0 2023-12-17T11:57:42.392 INFO:tasks.workunit.client.0.smithi002.stdout:0/331: write d0/d15/f67 [300121,47911] 0 2023-12-17T11:57:42.393 INFO:tasks.workunit.client.1.smithi119.stdout:0/289: rename d2/d16/d12/d2e/d44/c2c to d2/d16/d12/d1f/d24/d50/c51 0 2023-12-17T11:57:42.394 INFO:tasks.workunit.client.1.smithi119.stdout:2/416: creat d6/d38/f94 x:0 0 0 2023-12-17T11:57:42.396 INFO:tasks.workunit.client.0.smithi002.stdout:3/425: dwrite d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:42.399 INFO:tasks.workunit.client.0.smithi002.stdout:7/390: mknod d6/d17/dc/d6c/c73 0 2023-12-17T11:57:42.402 INFO:tasks.workunit.client.0.smithi002.stdout:6/376: mknod d0/d1/c75 0 2023-12-17T11:57:42.404 INFO:tasks.workunit.client.0.smithi002.stdout:0/332: creat d0/d15/d59/f6b x:0 0 0 2023-12-17T11:57:42.406 INFO:tasks.workunit.client.1.smithi119.stdout:1/338: unlink d3/f25 0 2023-12-17T11:57:42.407 INFO:tasks.workunit.client.1.smithi119.stdout:4/389: getdents dd/d15/d16/d3d 0 2023-12-17T11:57:42.408 INFO:tasks.workunit.client.1.smithi119.stdout:4/390: truncate dd/d15/d16/d3d/f7c 863010 0 2023-12-17T11:57:42.415 INFO:tasks.workunit.client.1.smithi119.stdout:8/309: dread d7/da/f22 [0,4194304] 0 2023-12-17T11:57:42.415 INFO:tasks.workunit.client.1.smithi119.stdout:0/290: creat d2/d3/d5/d3f/f52 x:0 0 0 2023-12-17T11:57:42.417 INFO:tasks.workunit.client.0.smithi002.stdout:3/426: symlink d9/d1b/d35/d41/d59/d65/d7e/l83 0 2023-12-17T11:57:42.418 INFO:tasks.workunit.client.1.smithi119.stdout:2/417: symlink d6/d9/d52/d53/d55/d58/d6b/l95 0 2023-12-17T11:57:42.418 INFO:tasks.workunit.client.1.smithi119.stdout:2/418: chown d6/d2b/d4b 101 1 2023-12-17T11:57:42.418 INFO:tasks.workunit.client.0.smithi002.stdout:7/391: symlink d6/d17/dc/d13/d21/d2e/d4a/d53/l74 0 2023-12-17T11:57:42.420 INFO:tasks.workunit.client.1.smithi119.stdout:3/409: dread d9/da/df/d41/d33/d3a/d90/f94 [0,4194304] 0 2023-12-17T11:57:42.420 INFO:tasks.workunit.client.1.smithi119.stdout:1/339: mknod d3/db/d17/d24/d20/d6c/c74 0 2023-12-17T11:57:42.427 INFO:tasks.workunit.client.1.smithi119.stdout:4/391: truncate dd/d15/d16/f1a 2453969 0 2023-12-17T11:57:42.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/333: link d0/d6/d26/d14/d19/d37/d62/f52 d0/d15/f6c 0 2023-12-17T11:57:42.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/334: write d0/d6/d26/d14/d19/d2b/f5a [840238,2680] 0 2023-12-17T11:57:42.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/335: write d0/d6/d26/f35 [4785942,8607] 0 2023-12-17T11:57:42.429 INFO:tasks.workunit.client.0.smithi002.stdout:0/336: chown d0/d6/d26/d14/d19/c69 155 1 2023-12-17T11:57:42.431 INFO:tasks.workunit.client.1.smithi119.stdout:0/291: truncate d2/d16/d12/f1c 6971764 0 2023-12-17T11:57:42.433 INFO:tasks.workunit.client.1.smithi119.stdout:8/310: mkdir d7/d18/d15/d64 0 2023-12-17T11:57:42.437 INFO:tasks.workunit.client.1.smithi119.stdout:2/419: mkdir d6/d38/d96 0 2023-12-17T11:57:42.437 INFO:tasks.workunit.client.1.smithi119.stdout:2/420: write d6/d9/d13/d1d/f37 [2318557,119236] 0 2023-12-17T11:57:42.442 INFO:tasks.workunit.client.0.smithi002.stdout:4/380: dwrite d0/d10/f40 [4194304,4194304] 0 2023-12-17T11:57:42.442 INFO:tasks.workunit.client.0.smithi002.stdout:4/381: write d0/f6f [470215,89535] 0 2023-12-17T11:57:42.447 INFO:tasks.workunit.client.1.smithi119.stdout:3/410: creat d9/d44/d8c/f9e x:0 0 0 2023-12-17T11:57:42.448 INFO:tasks.workunit.client.1.smithi119.stdout:1/340: creat d3/db/d26/d19/d3f/d64/f75 x:0 0 0 2023-12-17T11:57:42.448 INFO:tasks.workunit.client.1.smithi119.stdout:4/392: dread dd/d11/d26/f66 [0,4194304] 0 2023-12-17T11:57:42.448 INFO:tasks.workunit.client.0.smithi002.stdout:2/382: dwrite d3/d4/d7/f36 [0,4194304] 0 2023-12-17T11:57:42.448 INFO:tasks.workunit.client.0.smithi002.stdout:2/383: creat d3/d4/d17/d19/f89 x:0 0 0 2023-12-17T11:57:42.453 INFO:tasks.workunit.client.1.smithi119.stdout:0/292: creat d2/d16/d12/f53 x:0 0 0 2023-12-17T11:57:42.456 INFO:tasks.workunit.client.1.smithi119.stdout:8/311: mknod d7/d18/d15/c65 0 2023-12-17T11:57:42.456 INFO:tasks.workunit.client.1.smithi119.stdout:8/312: chown d7/d12/l30 1287 1 2023-12-17T11:57:42.465 INFO:tasks.workunit.client.0.smithi002.stdout:3/427: mkdir d9/d24/d6f/d84 0 2023-12-17T11:57:42.465 INFO:tasks.workunit.client.1.smithi119.stdout:4/393: symlink dd/d15/l7f 0 2023-12-17T11:57:42.465 INFO:tasks.workunit.client.1.smithi119.stdout:8/313: creat d7/da/d1a/f66 x:0 0 0 2023-12-17T11:57:42.465 INFO:tasks.workunit.client.1.smithi119.stdout:3/411: write d9/d11/d1e/f37 [1212407,126361] 0 2023-12-17T11:57:42.470 INFO:tasks.workunit.client.1.smithi119.stdout:8/314: mkdir d7/d12/d1f/d67 0 2023-12-17T11:57:42.470 INFO:tasks.workunit.client.1.smithi119.stdout:8/315: chown d7/f16 13 1 2023-12-17T11:57:42.474 INFO:tasks.workunit.client.1.smithi119.stdout:0/293: write d2/d16/d12/f25 [247165,115845] 0 2023-12-17T11:57:42.475 INFO:tasks.workunit.client.1.smithi119.stdout:6/334: dwrite d2/f19 [0,4194304] 0 2023-12-17T11:57:42.476 INFO:tasks.workunit.client.1.smithi119.stdout:6/335: write d2/df/f4b [948372,73249] 0 2023-12-17T11:57:42.477 INFO:tasks.workunit.client.0.smithi002.stdout:4/382: mkdir d0/d10/d14/d27/d57/d7d 0 2023-12-17T11:57:42.477 INFO:tasks.workunit.client.0.smithi002.stdout:4/383: chown d0/d10/f2d 0 1 2023-12-17T11:57:42.482 INFO:tasks.workunit.client.1.smithi119.stdout:3/412: mkdir d9/d11/d1e/d9f 0 2023-12-17T11:57:42.482 INFO:tasks.workunit.client.1.smithi119.stdout:5/407: dwrite d1/d44/d52/f55 [0,4194304] 0 2023-12-17T11:57:42.482 INFO:tasks.workunit.client.1.smithi119.stdout:8/316: truncate d7/da/d11/d26/f32 153049 0 2023-12-17T11:57:42.496 INFO:tasks.workunit.client.1.smithi119.stdout:7/390: sync 2023-12-17T11:57:42.496 INFO:tasks.workunit.client.1.smithi119.stdout:4/394: read f8 [3236582,130484] 0 2023-12-17T11:57:42.496 INFO:tasks.workunit.client.1.smithi119.stdout:7/391: creat d2/d4/d11/d2c/d68/d6a/f78 x:0 0 0 2023-12-17T11:57:42.497 INFO:tasks.workunit.client.0.smithi002.stdout:2/384: mkdir d3/d4/d7/d14/d42/d8a 0 2023-12-17T11:57:42.497 INFO:tasks.workunit.client.0.smithi002.stdout:2/385: chown d3/d4/d7/d14/d34/f5e 4 1 2023-12-17T11:57:42.497 INFO:tasks.workunit.client.0.smithi002.stdout:8/407: dwrite d3/d8/da/f8a [0,4194304] 0 2023-12-17T11:57:42.498 INFO:tasks.workunit.client.0.smithi002.stdout:7/392: dwrite d6/f72 [0,4194304] 0 2023-12-17T11:57:42.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/377: dwrite d0/d1/dc/d17/d40/f4f [0,4194304] 0 2023-12-17T11:57:42.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/378: readlink d0/d1/dc/d10/l33 0 2023-12-17T11:57:42.498 INFO:tasks.workunit.client.0.smithi002.stdout:6/379: dread - d0/d1/d21/d56/d60/f62 zero size 2023-12-17T11:57:42.500 INFO:tasks.workunit.client.0.smithi002.stdout:5/370: dwrite dc/d17/d1c/f20 [0,4194304] 0 2023-12-17T11:57:42.504 INFO:tasks.workunit.client.0.smithi002.stdout:3/428: mkdir d9/d15/d52/d85 0 2023-12-17T11:57:42.512 INFO:tasks.workunit.client.0.smithi002.stdout:0/337: getdents d0/d15/d59 0 2023-12-17T11:57:42.514 INFO:tasks.workunit.client.1.smithi119.stdout:1/341: dwrite d3/db/d17/d24/d20/d40/f41 [0,4194304] 0 2023-12-17T11:57:42.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/384: symlink d0/d3e/d56/d65/l7e 0 2023-12-17T11:57:42.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/408: unlink d3/d8/d28/d31/l53 0 2023-12-17T11:57:42.525 INFO:tasks.workunit.client.0.smithi002.stdout:8/409: write d3/d7/d6e/d7f/d65/f85 [945025,13125] 0 2023-12-17T11:57:42.526 INFO:tasks.workunit.client.1.smithi119.stdout:1/342: dread d3/db/d17/f63 [0,4194304] 0 2023-12-17T11:57:42.529 INFO:tasks.workunit.client.1.smithi119.stdout:3/413: dwrite d9/da/df/f32 [4194304,4194304] 0 2023-12-17T11:57:42.532 INFO:tasks.workunit.client.1.smithi119.stdout:5/408: dwrite d1/fa [0,4194304] 0 2023-12-17T11:57:42.532 INFO:tasks.workunit.client.1.smithi119.stdout:5/409: rename d1 to d1/d44/d52/d80 22 2023-12-17T11:57:42.533 INFO:tasks.workunit.client.1.smithi119.stdout:5/410: chown d1/d36/l7f 178 1 2023-12-17T11:57:42.533 INFO:tasks.workunit.client.1.smithi119.stdout:5/411: chown d1/l18 6 1 2023-12-17T11:57:42.533 INFO:tasks.workunit.client.1.smithi119.stdout:5/412: write d1/d44/f74 [353493,51596] 0 2023-12-17T11:57:42.533 INFO:tasks.workunit.client.1.smithi119.stdout:5/413: creat d1/d36/d57/f81 x:0 0 0 2023-12-17T11:57:42.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/395: creat dd/d2a/d55/f80 x:0 0 0 2023-12-17T11:57:42.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/396: chown dd/d11/d26/f66 107 1 2023-12-17T11:57:42.534 INFO:tasks.workunit.client.1.smithi119.stdout:8/317: symlink d7/da/l68 0 2023-12-17T11:57:42.535 INFO:tasks.workunit.client.0.smithi002.stdout:7/393: mkdir d6/d17/dc/d13/d21/d2e/d4a/d53/d75 0 2023-12-17T11:57:42.536 INFO:tasks.workunit.client.0.smithi002.stdout:2/386: dread d3/d4/d17/d19/f24 [0,4194304] 0 2023-12-17T11:57:42.537 INFO:tasks.workunit.client.0.smithi002.stdout:6/380: creat d0/d1/d21/f76 x:0 0 0 2023-12-17T11:57:42.538 INFO:tasks.workunit.client.0.smithi002.stdout:6/381: chown d0/f1a 35 1 2023-12-17T11:57:42.538 INFO:tasks.workunit.client.1.smithi119.stdout:7/392: creat d2/d4/d11/d2c/d68/d77/f79 x:0 0 0 2023-12-17T11:57:42.542 INFO:tasks.workunit.client.1.smithi119.stdout:0/294: mknod d2/d16/d35/d39/c54 0 2023-12-17T11:57:42.551 INFO:tasks.workunit.client.1.smithi119.stdout:1/343: mkdir d3/db/d17/d24/d20/d40/d76 0 2023-12-17T11:57:42.552 INFO:tasks.workunit.client.1.smithi119.stdout:3/414: dread d9/d44/f86 [0,4194304] 0 2023-12-17T11:57:42.552 INFO:tasks.workunit.client.1.smithi119.stdout:3/415: truncate d9/f50 1039770 0 2023-12-17T11:57:42.553 INFO:tasks.workunit.client.1.smithi119.stdout:3/416: creat d9/da/df/d67/fa0 x:0 0 0 2023-12-17T11:57:42.555 INFO:tasks.workunit.client.1.smithi119.stdout:0/295: dread d2/d3/f14 [4194304,4194304] 0 2023-12-17T11:57:42.557 INFO:tasks.workunit.client.1.smithi119.stdout:6/336: dwrite d2/df/d17/f57 [0,4194304] 0 2023-12-17T11:57:42.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/394: dread d6/d17/dc/d13/f57 [0,4194304] 0 2023-12-17T11:57:42.560 INFO:tasks.workunit.client.1.smithi119.stdout:5/414: mkdir d1/d25/d39/d71/d82 0 2023-12-17T11:57:42.561 INFO:tasks.workunit.client.1.smithi119.stdout:5/415: chown d1/fa 0 1 2023-12-17T11:57:42.561 INFO:tasks.workunit.client.1.smithi119.stdout:5/416: fdatasync d1/f35 0 2023-12-17T11:57:42.561 INFO:tasks.workunit.client.1.smithi119.stdout:5/417: write d1/d25/f79 [443285,96926] 0 2023-12-17T11:57:42.561 INFO:tasks.workunit.client.0.smithi002.stdout:5/371: mkdir dc/d80 0 2023-12-17T11:57:42.562 INFO:tasks.workunit.client.0.smithi002.stdout:5/372: read - dc/f50 zero size 2023-12-17T11:57:42.562 INFO:tasks.workunit.client.1.smithi119.stdout:4/397: mkdir dd/d2a/d55/d81 0 2023-12-17T11:57:42.564 INFO:tasks.workunit.client.0.smithi002.stdout:3/429: unlink d9/d24/c33 0 2023-12-17T11:57:42.566 INFO:tasks.workunit.client.1.smithi119.stdout:8/318: rename d7/d12/d1f to d7/d12/d69 0 2023-12-17T11:57:42.566 INFO:tasks.workunit.client.0.smithi002.stdout:4/385: dwrite d0/d10/f25 [0,4194304] 0 2023-12-17T11:57:42.567 INFO:tasks.workunit.client.0.smithi002.stdout:0/338: mkdir d0/d6/d26/d14/d6d 0 2023-12-17T11:57:42.567 INFO:tasks.workunit.client.1.smithi119.stdout:4/398: dread dd/d15/d16/d3d/f7c [0,4194304] 0 2023-12-17T11:57:42.569 INFO:tasks.workunit.client.1.smithi119.stdout:7/393: unlink d2/c1c 0 2023-12-17T11:57:42.570 INFO:tasks.workunit.client.0.smithi002.stdout:8/410: symlink d3/d7/d6e/d7f/l8e 0 2023-12-17T11:57:42.572 INFO:tasks.workunit.client.1.smithi119.stdout:1/344: symlink d3/db/d26/d19/d3f/d64/l77 0 2023-12-17T11:57:42.572 INFO:tasks.workunit.client.1.smithi119.stdout:1/345: write d3/db/d26/d19/f2f [4297661,6743] 0 2023-12-17T11:57:42.572 INFO:tasks.workunit.client.1.smithi119.stdout:1/346: chown d3 50522 1 2023-12-17T11:57:42.572 INFO:tasks.workunit.client.1.smithi119.stdout:1/347: chown d3/db/d17/d24/l38 2085157364 1 2023-12-17T11:57:42.572 INFO:tasks.workunit.client.1.smithi119.stdout:1/348: creat d3/db/d17/d24/d20/d40/f78 x:0 0 0 2023-12-17T11:57:42.573 INFO:tasks.workunit.client.1.smithi119.stdout:9/432: sync 2023-12-17T11:57:42.573 INFO:tasks.workunit.client.1.smithi119.stdout:9/433: chown d12/d65/f6a 1 1 2023-12-17T11:57:42.573 INFO:tasks.workunit.client.1.smithi119.stdout:9/434: write d12/d1d/f36 [1869737,5295] 0 2023-12-17T11:57:42.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/387: mkdir d3/d4/d8b 0 2023-12-17T11:57:42.574 INFO:tasks.workunit.client.0.smithi002.stdout:6/382: creat d0/d1/dc/d58/f77 x:0 0 0 2023-12-17T11:57:42.575 INFO:tasks.workunit.client.0.smithi002.stdout:6/383: write d0/d1/d21/f76 [26805,65944] 0 2023-12-17T11:57:42.576 INFO:tasks.workunit.client.1.smithi119.stdout:3/417: mkdir d9/da/df/da1 0 2023-12-17T11:57:42.576 INFO:tasks.workunit.client.1.smithi119.stdout:3/418: dread - d9/d44/d8c/f9e zero size 2023-12-17T11:57:42.578 INFO:tasks.workunit.client.1.smithi119.stdout:0/296: truncate d2/f28 5059876 0 2023-12-17T11:57:42.578 INFO:tasks.workunit.client.1.smithi119.stdout:0/297: creat d2/d3/d5/f55 x:0 0 0 2023-12-17T11:57:42.582 INFO:tasks.workunit.client.1.smithi119.stdout:8/319: read d7/d12/d69/d2a/f62 [1833378,79173] 0 2023-12-17T11:57:42.589 INFO:tasks.workunit.client.0.smithi002.stdout:3/430: creat d9/d24/d6f/d84/f86 x:0 0 0 2023-12-17T11:57:42.589 INFO:tasks.workunit.client.1.smithi119.stdout:5/418: dread d1/d25/f79 [0,4194304] 0 2023-12-17T11:57:42.590 INFO:tasks.workunit.client.0.smithi002.stdout:5/373: unlink dc/d1b/l4e 0 2023-12-17T11:57:42.590 INFO:tasks.workunit.client.1.smithi119.stdout:6/337: rename d2/c10 to d2/d2b/d43/d5e/c65 0 2023-12-17T11:57:42.590 INFO:tasks.workunit.client.1.smithi119.stdout:6/338: chown d2/df/c1c 3868 1 2023-12-17T11:57:42.590 INFO:tasks.workunit.client.1.smithi119.stdout:6/339: write d2/f59 [716033,7146] 0 2023-12-17T11:57:42.593 INFO:tasks.workunit.client.0.smithi002.stdout:7/395: creat d6/d17/dc/f76 x:0 0 0 2023-12-17T11:57:42.593 INFO:tasks.workunit.client.0.smithi002.stdout:7/396: write d6/d17/f1a [201511,98558] 0 2023-12-17T11:57:42.593 INFO:tasks.workunit.client.0.smithi002.stdout:4/386: creat d0/d10/d14/d27/d57/d7d/f7f x:0 0 0 2023-12-17T11:57:42.595 INFO:tasks.workunit.client.1.smithi119.stdout:4/399: mkdir dd/d15/d16/d20/d82 0 2023-12-17T11:57:42.595 INFO:tasks.workunit.client.1.smithi119.stdout:4/400: chown dd/d15/d16/c27 44545 1 2023-12-17T11:57:42.596 INFO:tasks.workunit.client.1.smithi119.stdout:0/298: dread d2/d3/f3d [0,4194304] 0 2023-12-17T11:57:42.596 INFO:tasks.workunit.client.1.smithi119.stdout:0/299: fsync d2/d16/d12/d2e/d44/f26 0 2023-12-17T11:57:42.603 INFO:tasks.workunit.client.0.smithi002.stdout:0/339: rename d0/d6/d26/d14/d19/d2f/f4e to d0/d15/d59/f6e 0 2023-12-17T11:57:42.604 INFO:tasks.workunit.client.1.smithi119.stdout:7/394: creat d2/d4/d70/f7a x:0 0 0 2023-12-17T11:57:42.611 INFO:tasks.workunit.client.0.smithi002.stdout:3/431: truncate d9/d1b/f28 420232 0 2023-12-17T11:57:42.617 INFO:tasks.workunit.client.1.smithi119.stdout:1/349: mknod d3/db/d26/d19/d3f/c79 0 2023-12-17T11:57:42.617 INFO:tasks.workunit.client.1.smithi119.stdout:4/401: dread dd/f1d [0,4194304] 0 2023-12-17T11:57:42.620 INFO:tasks.workunit.client.1.smithi119.stdout:9/435: creat d12/d1d/d28/f87 x:0 0 0 2023-12-17T11:57:42.622 INFO:tasks.workunit.client.0.smithi002.stdout:4/387: creat d0/d10/d14/d4e/f80 x:0 0 0 2023-12-17T11:57:42.626 INFO:tasks.workunit.client.1.smithi119.stdout:3/419: symlink d9/da/df/d41/d33/d3a/la2 0 2023-12-17T11:57:42.626 INFO:tasks.workunit.client.0.smithi002.stdout:7/397: getdents d6/d17/dc/d13/d21/d2e 0 2023-12-17T11:57:42.627 INFO:tasks.workunit.client.0.smithi002.stdout:7/398: write d6/d17/dc/d13/d21/d2e/d4a/d53/f5f [615826,128143] 0 2023-12-17T11:57:42.629 INFO:tasks.workunit.client.0.smithi002.stdout:3/432: rmdir d9/d40 39 2023-12-17T11:57:42.630 INFO:tasks.workunit.client.0.smithi002.stdout:3/433: write d9/d1b/d35/d41/d59/d65/f77 [264937,65479] 0 2023-12-17T11:57:42.641 INFO:tasks.workunit.client.1.smithi119.stdout:6/340: unlink d2/f5a 0 2023-12-17T11:57:42.644 INFO:tasks.workunit.client.1.smithi119.stdout:9/436: creat d12/d1d/d28/d4d/d73/f88 x:0 0 0 2023-12-17T11:57:42.645 INFO:tasks.workunit.client.1.smithi119.stdout:3/420: mkdir d9/d11/d87/da3 0 2023-12-17T11:57:42.645 INFO:tasks.workunit.client.1.smithi119.stdout:3/421: chown d9/d11/d87 138 1 2023-12-17T11:57:42.648 INFO:tasks.workunit.client.1.smithi119.stdout:8/320: link d7/d18/f4e d7/da/d11/d26/d2c/f6a 0 2023-12-17T11:57:42.650 INFO:tasks.workunit.client.0.smithi002.stdout:4/388: creat d0/d3e/d56/d65/d78/f81 x:0 0 0 2023-12-17T11:57:42.650 INFO:tasks.workunit.client.0.smithi002.stdout:4/389: truncate d0/d3e/f74 819957 0 2023-12-17T11:57:42.653 INFO:tasks.workunit.client.1.smithi119.stdout:7/395: rmdir d2/d4e 39 2023-12-17T11:57:42.659 INFO:tasks.workunit.client.1.smithi119.stdout:9/437: mkdir d12/d1d/d49/d89 0 2023-12-17T11:57:42.659 INFO:tasks.workunit.client.1.smithi119.stdout:9/438: fdatasync d12/d1d/d49/f52 0 2023-12-17T11:57:42.661 INFO:tasks.workunit.client.1.smithi119.stdout:7/396: symlink d2/d4/l7b 0 2023-12-17T11:57:42.662 INFO:tasks.workunit.client.0.smithi002.stdout:9/428: sync 2023-12-17T11:57:42.662 INFO:tasks.workunit.client.0.smithi002.stdout:1/464: sync 2023-12-17T11:57:42.662 INFO:tasks.workunit.client.1.smithi119.stdout:9/439: getdents d12/d1d/d28/d4d 0 2023-12-17T11:57:42.664 INFO:tasks.workunit.client.1.smithi119.stdout:8/321: link d7/d12/d23/f61 d7/d18/f6b 0 2023-12-17T11:57:42.666 INFO:tasks.workunit.client.1.smithi119.stdout:7/397: creat d2/d4e/d6c/f7c x:0 0 0 2023-12-17T11:57:42.667 INFO:tasks.workunit.client.1.smithi119.stdout:9/440: creat d12/d1d/d28/d86/f8a x:0 0 0 2023-12-17T11:57:42.672 INFO:tasks.workunit.client.1.smithi119.stdout:9/441: unlink d12/f48 0 2023-12-17T11:57:42.672 INFO:tasks.workunit.client.1.smithi119.stdout:9/442: write d12/d1d/f44 [1944423,15678] 0 2023-12-17T11:57:42.673 INFO:tasks.workunit.client.1.smithi119.stdout:9/443: fdatasync d12/d1d/f27 0 2023-12-17T11:57:42.677 INFO:tasks.workunit.client.0.smithi002.stdout:6/384: dwrite d0/d1/dc/d10/f37 [8388608,4194304] 0 2023-12-17T11:57:42.677 INFO:tasks.workunit.client.0.smithi002.stdout:6/385: truncate d0/d1/dc/d17/d40/f5f 217654 0 2023-12-17T11:57:42.681 INFO:tasks.workunit.client.0.smithi002.stdout:5/374: dwrite dc/d1a/f48 [0,4194304] 0 2023-12-17T11:57:42.682 INFO:tasks.workunit.client.0.smithi002.stdout:5/375: write dc/d1a/d47/f4a [514351,83638] 0 2023-12-17T11:57:42.684 INFO:tasks.workunit.client.1.smithi119.stdout:1/350: dwrite d3/db/f62 [0,4194304] 0 2023-12-17T11:57:42.685 INFO:tasks.workunit.client.1.smithi119.stdout:1/351: write d3/db/d2a/f66 [511629,2011] 0 2023-12-17T11:57:42.686 INFO:tasks.workunit.client.1.smithi119.stdout:1/352: write d3/db/d26/d19/d3f/f4a [149932,52296] 0 2023-12-17T11:57:42.705 INFO:tasks.workunit.client.1.smithi119.stdout:5/419: dwrite d1/d36/f3d [0,4194304] 0 2023-12-17T11:57:42.706 INFO:tasks.workunit.client.1.smithi119.stdout:5/420: write d1/d44/f74 [1415250,54065] 0 2023-12-17T11:57:42.707 INFO:tasks.workunit.client.1.smithi119.stdout:5/421: truncate d1/d25/f79 584359 0 2023-12-17T11:57:42.707 INFO:tasks.workunit.client.0.smithi002.stdout:1/465: write d3/d6/d16/f31 [234008,87693] 0 2023-12-17T11:57:42.708 INFO:tasks.workunit.client.0.smithi002.stdout:2/388: dwrite d3/d4/f65 [0,4194304] 0 2023-12-17T11:57:42.708 INFO:tasks.workunit.client.0.smithi002.stdout:2/389: fdatasync d3/d4/d17/d19/f89 0 2023-12-17T11:57:42.709 INFO:tasks.workunit.client.1.smithi119.stdout:1/353: rmdir d3/db/d2a 39 2023-12-17T11:57:42.710 INFO:tasks.workunit.client.1.smithi119.stdout:1/354: write d3/db/d17/d24/d20/d40/d6d/f6e [943367,99295] 0 2023-12-17T11:57:42.710 INFO:tasks.workunit.client.1.smithi119.stdout:1/355: creat d3/db/d26/d5e/f7a x:0 0 0 2023-12-17T11:57:42.710 INFO:tasks.workunit.client.1.smithi119.stdout:1/356: dread - d3/db/d26/d19/d3f/f46 zero size 2023-12-17T11:57:42.714 INFO:tasks.workunit.client.0.smithi002.stdout:7/399: dwrite d6/d17/dc/f51 [4194304,4194304] 0 2023-12-17T11:57:42.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/466: mkdir d3/d6/d9/d30/d9c 0 2023-12-17T11:57:42.718 INFO:tasks.workunit.client.1.smithi119.stdout:3/422: dwrite d9/d35/f6a [0,4194304] 0 2023-12-17T11:57:42.720 INFO:tasks.workunit.client.0.smithi002.stdout:9/429: dwrite dc/d1d/d25/f43 [0,4194304] 0 2023-12-17T11:57:42.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/340: dwrite d0/d6/d26/d14/d19/d2f/f60 [0,4194304] 0 2023-12-17T11:57:42.724 INFO:tasks.workunit.client.0.smithi002.stdout:8/411: dwrite d3/d7/d18/d3f/d49/f4b [0,4194304] 0 2023-12-17T11:57:42.724 INFO:tasks.workunit.client.0.smithi002.stdout:8/412: dread - d3/d8/da/f88 zero size 2023-12-17T11:57:42.731 INFO:tasks.workunit.client.1.smithi119.stdout:5/422: write d1/d25/f68 [1979283,65080] 0 2023-12-17T11:57:42.732 INFO:tasks.workunit.client.0.smithi002.stdout:5/376: dread dc/d1a/d47/f4a [0,4194304] 0 2023-12-17T11:57:42.734 INFO:tasks.workunit.client.0.smithi002.stdout:2/390: mknod d3/d4/d7/d14/d42/c8c 0 2023-12-17T11:57:42.734 INFO:tasks.workunit.client.0.smithi002.stdout:2/391: chown d3/d4/d7/f86 22200843 1 2023-12-17T11:57:42.735 INFO:tasks.workunit.client.0.smithi002.stdout:3/434: dread d9/d1b/f28 [0,4194304] 0 2023-12-17T11:57:42.735 INFO:tasks.workunit.client.0.smithi002.stdout:3/435: chown d9/d1b/d35/d41/d43/d73/l78 885232809 1 2023-12-17T11:57:42.735 INFO:tasks.workunit.client.0.smithi002.stdout:3/436: write d9/f14 [2939778,18554] 0 2023-12-17T11:57:42.736 INFO:tasks.workunit.client.0.smithi002.stdout:4/390: dwrite d0/d3e/f74 [0,4194304] 0 2023-12-17T11:57:42.736 INFO:tasks.workunit.client.0.smithi002.stdout:6/386: dwrite d0/d1/dc/d17/d40/f4e [0,4194304] 0 2023-12-17T11:57:42.736 INFO:tasks.workunit.client.0.smithi002.stdout:6/387: creat d0/d1/d21/d56/f78 x:0 0 0 2023-12-17T11:57:42.736 INFO:tasks.workunit.client.0.smithi002.stdout:6/388: chown d0/f1a 376 1 2023-12-17T11:57:42.739 INFO:tasks.workunit.client.1.smithi119.stdout:8/322: dwrite d7/da/d11/d26/d49/f5e [0,4194304] 0 2023-12-17T11:57:42.739 INFO:tasks.workunit.client.1.smithi119.stdout:8/323: write d7/d12/d69/d2a/f62 [2176724,61861] 0 2023-12-17T11:57:42.743 INFO:tasks.workunit.client.1.smithi119.stdout:1/357: rename d3/db/d17/d24/d20/d40/f60 to d3/db/d26/f7b 0 2023-12-17T11:57:42.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/358: write d3/db/f2b [1456638,103367] 0 2023-12-17T11:57:42.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/359: creat d3/db/d26/d19/d3f/d64/f7c x:0 0 0 2023-12-17T11:57:42.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/360: truncate d3/db/d26/d19/d3f/f4a 2127902 0 2023-12-17T11:57:42.753 INFO:tasks.workunit.client.0.smithi002.stdout:9/430: rename dc/d38/c39 to dc/d42/d4f/d59/d49/c95 0 2023-12-17T11:57:42.755 INFO:tasks.workunit.client.0.smithi002.stdout:0/341: symlink d0/d15/d59/l6f 0 2023-12-17T11:57:42.757 INFO:tasks.workunit.client.1.smithi119.stdout:5/423: dread d1/f1e [0,4194304] 0 2023-12-17T11:57:42.759 INFO:tasks.workunit.client.1.smithi119.stdout:3/423: dwrite d9/d44/d8c/f9e [0,4194304] 0 2023-12-17T11:57:42.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/377: creat dc/d17/f81 x:0 0 0 2023-12-17T11:57:42.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/378: stat dc/d1b/d2d 0 2023-12-17T11:57:42.768 INFO:tasks.workunit.client.0.smithi002.stdout:5/379: chown dc/d1a/d61 71631865 1 2023-12-17T11:57:42.769 INFO:tasks.workunit.client.1.smithi119.stdout:5/424: mkdir d1/d25/d39/d71/d76/d83 0 2023-12-17T11:57:42.771 INFO:tasks.workunit.client.0.smithi002.stdout:2/392: mkdir d3/d4/d17/d19/d8d 0 2023-12-17T11:57:42.773 INFO:tasks.workunit.client.0.smithi002.stdout:0/342: write d0/d6/d26/f24 [1284181,92153] 0 2023-12-17T11:57:42.773 INFO:tasks.workunit.client.1.smithi119.stdout:9/444: truncate d12/d1d/f44 408192 0 2023-12-17T11:57:42.775 INFO:tasks.workunit.client.0.smithi002.stdout:8/413: dwrite d3/d7/d18/d74/d7b/f81 [0,4194304] 0 2023-12-17T11:57:42.775 INFO:tasks.workunit.client.0.smithi002.stdout:8/414: dread - d3/d7/d6e/d7f/f54 zero size 2023-12-17T11:57:42.786 INFO:tasks.workunit.client.1.smithi119.stdout:3/424: mknod d9/ca4 0 2023-12-17T11:57:42.786 INFO:tasks.workunit.client.1.smithi119.stdout:3/425: chown d9/fc 143177 1 2023-12-17T11:57:42.789 INFO:tasks.workunit.client.1.smithi119.stdout:5/425: creat d1/d25/d39/d71/f84 x:0 0 0 2023-12-17T11:57:42.792 INFO:tasks.workunit.client.1.smithi119.stdout:9/445: mkdir d12/d1d/d28/d4d/d73/d78/d8b 0 2023-12-17T11:57:42.792 INFO:tasks.workunit.client.1.smithi119.stdout:9/446: getdents d12/d1d/d28/d4d 0 2023-12-17T11:57:42.801 INFO:tasks.workunit.client.1.smithi119.stdout:8/324: dwrite d7/d18/d15/f1b [0,4194304] 0 2023-12-17T11:57:42.801 INFO:tasks.workunit.client.1.smithi119.stdout:8/325: chown d7/d18/d15 459 1 2023-12-17T11:57:42.803 INFO:tasks.workunit.client.0.smithi002.stdout:4/391: mknod d0/d10/d14/c82 0 2023-12-17T11:57:42.803 INFO:tasks.workunit.client.0.smithi002.stdout:4/392: chown d0/c23 949607 1 2023-12-17T11:57:42.809 INFO:tasks.workunit.client.0.smithi002.stdout:1/467: rmdir d3/d6/d16/d61 39 2023-12-17T11:57:42.812 INFO:tasks.workunit.client.0.smithi002.stdout:1/468: read d3/d6/d16/d28/f69 [585976,25059] 0 2023-12-17T11:57:42.816 INFO:tasks.workunit.client.0.smithi002.stdout:6/389: rename d0/d1/dc/d17/d3c/d65/f74 to d0/d1/dc/d17/f79 0 2023-12-17T11:57:42.817 INFO:tasks.workunit.client.0.smithi002.stdout:6/390: readlink d0/d1/d21/l3b 0 2023-12-17T11:57:42.818 INFO:tasks.workunit.client.1.smithi119.stdout:7/398: dwrite d2/d4/d11/f3d [0,4194304] 0 2023-12-17T11:57:42.820 INFO:tasks.workunit.client.1.smithi119.stdout:8/326: dread d7/da/d11/d26/d2c/f6a [0,4194304] 0 2023-12-17T11:57:42.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/431: symlink dc/d1d/d25/d85/l96 0 2023-12-17T11:57:42.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/432: fdatasync dc/d42/d4f/d59/d49/d72/d93/f73 0 2023-12-17T11:57:42.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/433: fdatasync dc/d32/f34 0 2023-12-17T11:57:42.823 INFO:tasks.workunit.client.1.smithi119.stdout:3/426: mknod d9/d35/ca5 0 2023-12-17T11:57:42.824 INFO:tasks.workunit.client.1.smithi119.stdout:2/421: sync 2023-12-17T11:57:42.827 INFO:tasks.workunit.client.1.smithi119.stdout:5/426: mkdir d1/d70/d85 0 2023-12-17T11:57:42.834 INFO:tasks.workunit.client.1.smithi119.stdout:9/447: dwrite d12/d1d/d49/f77 [0,4194304] 0 2023-12-17T11:57:42.834 INFO:tasks.workunit.client.1.smithi119.stdout:9/448: chown d12/f2c 1153 1 2023-12-17T11:57:42.835 INFO:tasks.workunit.client.0.smithi002.stdout:5/380: mkdir dc/d17/d2f/d82 0 2023-12-17T11:57:42.835 INFO:tasks.workunit.client.0.smithi002.stdout:5/381: dread - dc/d17/d1c/f69 zero size 2023-12-17T11:57:42.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/382: chown dc/d1a/f48 931381 1 2023-12-17T11:57:42.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/383: truncate dc/d1b/d5a/f71 1048552 0 2023-12-17T11:57:42.838 INFO:tasks.workunit.client.0.smithi002.stdout:2/393: link d3/d4/d7/d14/d1b/c1e d3/d4/d17/d19/d4d/c8e 0 2023-12-17T11:57:42.840 INFO:tasks.workunit.client.1.smithi119.stdout:8/327: rename d7/d18/d15/f1b to d7/da/f6c 0 2023-12-17T11:57:42.841 INFO:tasks.workunit.client.1.smithi119.stdout:3/427: mkdir d9/d59/da6 0 2023-12-17T11:57:42.841 INFO:tasks.workunit.client.1.smithi119.stdout:3/428: write d9/da/f2d [9007223,67684] 0 2023-12-17T11:57:42.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/343: symlink d0/d15/l70 0 2023-12-17T11:57:42.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/344: chown d0/d6/d26/d14/d19/d2f 6907 1 2023-12-17T11:57:42.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/345: readlink d0/d6/d26/l4a 0 2023-12-17T11:57:42.843 INFO:tasks.workunit.client.0.smithi002.stdout:0/346: creat d0/d33/f71 x:0 0 0 2023-12-17T11:57:42.844 INFO:tasks.workunit.client.1.smithi119.stdout:5/427: unlink d1/d25/c63 0 2023-12-17T11:57:42.849 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:42 smithi002 ceph-mon[107131]: pgmap v24: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 184 MiB/s rd, 237 MiB/s wr, 752 op/s 2023-12-17T11:57:42.853 INFO:tasks.workunit.client.1.smithi119.stdout:9/449: rmdir d12/d1d 39 2023-12-17T11:57:42.855 INFO:tasks.workunit.client.0.smithi002.stdout:4/393: truncate d0/d10/d21/d33/f37 3073426 0 2023-12-17T11:57:42.857 INFO:tasks.workunit.client.1.smithi119.stdout:4/402: sync 2023-12-17T11:57:42.857 INFO:tasks.workunit.client.1.smithi119.stdout:0/300: sync 2023-12-17T11:57:42.857 INFO:tasks.workunit.client.1.smithi119.stdout:0/301: fsync d2/d16/d12/d1f/f22 0 2023-12-17T11:57:42.860 INFO:tasks.workunit.client.0.smithi002.stdout:1/469: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/c9d 0 2023-12-17T11:57:42.870 INFO:tasks.workunit.client.1.smithi119.stdout:5/428: truncate d1/d25/f68 3405702 0 2023-12-17T11:57:42.872 INFO:tasks.workunit.client.0.smithi002.stdout:9/434: rename dc/l7d to dc/d1d/d7c/l97 0 2023-12-17T11:57:42.874 INFO:tasks.workunit.client.1.smithi119.stdout:9/450: creat d12/d1d/d28/d4d/f8c x:0 0 0 2023-12-17T11:57:42.876 INFO:tasks.workunit.client.1.smithi119.stdout:7/399: dwrite d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:42.880 INFO:tasks.workunit.client.1.smithi119.stdout:8/328: creat d7/d18/d45/f6d x:0 0 0 2023-12-17T11:57:42.880 INFO:tasks.workunit.client.0.smithi002.stdout:9/435: dread dc/d32/f53 [0,4194304] 0 2023-12-17T11:57:42.881 INFO:tasks.workunit.client.0.smithi002.stdout:9/436: creat dc/d42/d4f/f98 x:0 0 0 2023-12-17T11:57:42.881 INFO:tasks.workunit.client.1.smithi119.stdout:4/403: link dd/d15/c39 dd/d15/c83 0 2023-12-17T11:57:42.881 INFO:tasks.workunit.client.1.smithi119.stdout:4/404: chown dd/f71 105 1 2023-12-17T11:57:42.881 INFO:tasks.workunit.client.1.smithi119.stdout:4/405: fdatasync dd/d11/f5e 0 2023-12-17T11:57:42.883 INFO:tasks.workunit.client.1.smithi119.stdout:2/422: dwrite d6/d9/d52/d53/d55/f4c [0,4194304] 0 2023-12-17T11:57:42.884 INFO:tasks.workunit.client.1.smithi119.stdout:2/423: readlink d6/d9/d13/d1d/l3b 0 2023-12-17T11:57:42.884 INFO:tasks.workunit.client.1.smithi119.stdout:2/424: chown d6/d9 3466350 1 2023-12-17T11:57:42.884 INFO:tasks.workunit.client.1.smithi119.stdout:3/429: dwrite d9/da/df/f17 [0,4194304] 0 2023-12-17T11:57:42.886 INFO:tasks.workunit.client.0.smithi002.stdout:5/384: link dc/d17/d1c/f20 dc/f83 0 2023-12-17T11:57:42.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/437: dread dc/d42/f57 [0,4194304] 0 2023-12-17T11:57:42.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/438: write dc/d42/d4f/d59/f6e [339896,23133] 0 2023-12-17T11:57:42.888 INFO:tasks.workunit.client.0.smithi002.stdout:9/439: dread - dc/d32/f77 zero size 2023-12-17T11:57:42.889 INFO:tasks.workunit.client.0.smithi002.stdout:8/415: truncate d3/d7/d18/d3f/d49/f4b 1263353 0 2023-12-17T11:57:42.889 INFO:tasks.workunit.client.0.smithi002.stdout:8/416: readlink d3/d7/l2b 0 2023-12-17T11:57:42.890 INFO:tasks.workunit.client.1.smithi119.stdout:9/451: truncate d12/d1d/d49/f57 77252 0 2023-12-17T11:57:42.890 INFO:tasks.workunit.client.0.smithi002.stdout:6/391: rmdir d0/d1/dc/d17/d4c 39 2023-12-17T11:57:42.891 INFO:tasks.workunit.client.0.smithi002.stdout:6/392: write d0/d1/dc/d17/d40/f5f [1071706,97426] 0 2023-12-17T11:57:42.893 INFO:tasks.workunit.client.1.smithi119.stdout:8/329: truncate d7/d18/d15/f21 2357011 0 2023-12-17T11:57:42.900 INFO:tasks.workunit.client.0.smithi002.stdout:2/394: rename d3/d4/d7/f36 to d3/d50/f8f 0 2023-12-17T11:57:42.901 INFO:tasks.workunit.client.0.smithi002.stdout:1/470: rename d3 to d3/d6/d16/d61/d9e 22 2023-12-17T11:57:42.904 INFO:tasks.workunit.client.0.smithi002.stdout:9/440: truncate dc/d42/d4f/d59/d47/f48 3718985 0 2023-12-17T11:57:42.906 INFO:tasks.workunit.client.1.smithi119.stdout:2/425: write d6/d9/d52/f72 [350072,1768] 0 2023-12-17T11:57:42.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/347: dwrite d0/d6/d26/d14/d19/d2b/f5a [0,4194304] 0 2023-12-17T11:57:42.907 INFO:tasks.workunit.client.0.smithi002.stdout:6/393: symlink d0/d1/d21/d56/d60/l7a 0 2023-12-17T11:57:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:42 smithi119 ceph-mon[117414]: pgmap v24: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 184 MiB/s rd, 237 MiB/s wr, 752 op/s 2023-12-17T11:57:42.910 INFO:tasks.workunit.client.0.smithi002.stdout:2/395: mknod d3/d4/d7/d14/d2e/c90 0 2023-12-17T11:57:42.912 INFO:tasks.workunit.client.0.smithi002.stdout:5/385: rename dc/f50 to dc/d17/f84 0 2023-12-17T11:57:42.918 INFO:tasks.workunit.client.0.smithi002.stdout:9/441: creat dc/d42/d4f/d59/d49/d72/f99 x:0 0 0 2023-12-17T11:57:42.919 INFO:tasks.workunit.client.0.smithi002.stdout:4/394: dwrite d0/d10/f15 [0,4194304] 0 2023-12-17T11:57:42.929 INFO:tasks.workunit.client.1.smithi119.stdout:9/452: unlink d12/d1d/c39 0 2023-12-17T11:57:42.934 INFO:tasks.workunit.client.0.smithi002.stdout:0/348: getdents d0/d6/d26/d14/d19/d37/d62 0 2023-12-17T11:57:42.934 INFO:tasks.workunit.client.1.smithi119.stdout:8/330: mknod d7/c6e 0 2023-12-17T11:57:42.935 INFO:tasks.workunit.client.1.smithi119.stdout:8/331: creat d7/da/d1a/f6f x:0 0 0 2023-12-17T11:57:42.935 INFO:tasks.workunit.client.1.smithi119.stdout:8/332: fdatasync d7/da/d11/f1d 0 2023-12-17T11:57:42.939 INFO:tasks.workunit.client.1.smithi119.stdout:2/426: symlink d6/d38/d96/l97 0 2023-12-17T11:57:42.940 INFO:tasks.workunit.client.1.smithi119.stdout:2/427: creat d6/d2b/d3f/f98 x:0 0 0 2023-12-17T11:57:42.944 INFO:tasks.workunit.client.0.smithi002.stdout:2/396: creat d3/d4/d7/d14/d2e/d37/d3f/f91 x:0 0 0 2023-12-17T11:57:42.947 INFO:tasks.workunit.client.1.smithi119.stdout:0/302: dwrite d2/f4 [4194304,4194304] 0 2023-12-17T11:57:42.947 INFO:tasks.workunit.client.1.smithi119.stdout:0/303: fdatasync d2/d16/d12/f25 0 2023-12-17T11:57:42.949 INFO:tasks.workunit.client.1.smithi119.stdout:5/429: rename d1/d36/d57 to d1/d25/d39/d71/d82/d86 0 2023-12-17T11:57:42.949 INFO:tasks.workunit.client.1.smithi119.stdout:5/430: creat d1/d70/d6b/f87 x:0 0 0 2023-12-17T11:57:42.951 INFO:tasks.workunit.client.0.smithi002.stdout:5/386: truncate dc/d17/d1c/f20 1878633 0 2023-12-17T11:57:42.953 INFO:tasks.workunit.client.0.smithi002.stdout:8/417: dwrite d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:42.954 INFO:tasks.workunit.client.1.smithi119.stdout:7/400: dwrite d2/d4e/f4a [0,4194304] 0 2023-12-17T11:57:42.954 INFO:tasks.workunit.client.1.smithi119.stdout:7/401: truncate d2/f24 5241843 0 2023-12-17T11:57:42.955 INFO:tasks.workunit.client.0.smithi002.stdout:1/471: rename d3/d6/d59 to d3/d6/d16/d9f 0 2023-12-17T11:57:42.955 INFO:tasks.workunit.client.0.smithi002.stdout:0/349: write d0/f13 [3576008,128391] 0 2023-12-17T11:57:42.959 INFO:tasks.workunit.client.1.smithi119.stdout:2/428: creat d6/d9/d13/d34/f99 x:0 0 0 2023-12-17T11:57:42.959 INFO:tasks.workunit.client.1.smithi119.stdout:2/429: chown d6/d9 3764 1 2023-12-17T11:57:42.962 INFO:tasks.workunit.client.1.smithi119.stdout:3/430: rename d9/da/df/f27 to d9/da/fa7 0 2023-12-17T11:57:42.965 INFO:tasks.workunit.client.1.smithi119.stdout:8/333: write d7/d18/f3d [3273180,100931] 0 2023-12-17T11:57:42.968 INFO:tasks.workunit.client.0.smithi002.stdout:4/395: creat d0/f83 x:0 0 0 2023-12-17T11:57:42.969 INFO:tasks.workunit.client.0.smithi002.stdout:9/442: dwrite dc/d1d/d25/f43 [0,4194304] 0 2023-12-17T11:57:42.969 INFO:tasks.workunit.client.0.smithi002.stdout:9/443: stat dc/c1a 0 2023-12-17T11:57:42.970 INFO:tasks.workunit.client.1.smithi119.stdout:5/431: symlink d1/d70/d85/l88 0 2023-12-17T11:57:42.975 INFO:tasks.workunit.client.0.smithi002.stdout:6/394: rmdir d0/d1/d21 39 2023-12-17T11:57:42.976 INFO:tasks.workunit.client.1.smithi119.stdout:4/406: dwrite dd/d11/d2d/f3e [0,4194304] 0 2023-12-17T11:57:42.976 INFO:tasks.workunit.client.1.smithi119.stdout:4/407: write dd/f71 [1223046,112015] 0 2023-12-17T11:57:42.977 INFO:tasks.workunit.client.1.smithi119.stdout:7/402: creat d2/d4/d70/d57/d56/f7d x:0 0 0 2023-12-17T11:57:42.977 INFO:tasks.workunit.client.1.smithi119.stdout:7/403: truncate d2/d4/d1f/f4c 1430114 0 2023-12-17T11:57:42.981 INFO:tasks.workunit.client.1.smithi119.stdout:2/430: readlink d6/l12 0 2023-12-17T11:57:42.982 INFO:tasks.workunit.client.0.smithi002.stdout:6/395: write d0/d1/dc/d17/d40/f5f [397491,112798] 0 2023-12-17T11:57:42.983 INFO:tasks.workunit.client.0.smithi002.stdout:2/397: creat d3/d4/d7/d14/f92 x:0 0 0 2023-12-17T11:57:42.983 INFO:tasks.workunit.client.0.smithi002.stdout:2/398: dread - d3/d4/d17/d19/f89 zero size 2023-12-17T11:57:42.983 INFO:tasks.workunit.client.0.smithi002.stdout:2/399: fdatasync d3/d4/d7/d14/f82 0 2023-12-17T11:57:42.984 INFO:tasks.workunit.client.0.smithi002.stdout:5/387: truncate fa 7053614 0 2023-12-17T11:57:42.986 INFO:tasks.workunit.client.1.smithi119.stdout:6/341: sync 2023-12-17T11:57:42.986 INFO:tasks.workunit.client.1.smithi119.stdout:1/361: sync 2023-12-17T11:57:42.986 INFO:tasks.workunit.client.1.smithi119.stdout:1/362: dread - d3/db/d26/d5e/f7a zero size 2023-12-17T11:57:42.989 INFO:tasks.workunit.client.1.smithi119.stdout:3/431: dread d9/da/fa7 [0,4194304] 0 2023-12-17T11:57:42.990 INFO:tasks.workunit.client.1.smithi119.stdout:7/404: creat d2/d5b/f7e x:0 0 0 2023-12-17T11:57:42.990 INFO:tasks.workunit.client.1.smithi119.stdout:7/405: chown d2/d4/d11/d3c/d75 160123 1 2023-12-17T11:57:42.993 INFO:tasks.workunit.client.1.smithi119.stdout:3/432: unlink f3 0 2023-12-17T11:57:42.993 INFO:tasks.workunit.client.1.smithi119.stdout:3/433: write d9/da/df/f32 [1792611,10700] 0 2023-12-17T11:57:42.994 INFO:tasks.workunit.client.1.smithi119.stdout:1/363: dread d3/db/d17/f63 [0,4194304] 0 2023-12-17T11:57:42.997 INFO:tasks.workunit.client.1.smithi119.stdout:3/434: creat d9/da/df/da1/fa8 x:0 0 0 2023-12-17T11:57:42.999 INFO:tasks.workunit.client.1.smithi119.stdout:1/364: unlink d3/db/d26/d19/d3f/f72 0 2023-12-17T11:57:43.000 INFO:tasks.workunit.client.0.smithi002.stdout:0/350: mknod d0/d15/d59/c72 0 2023-12-17T11:57:43.000 INFO:tasks.workunit.client.0.smithi002.stdout:0/351: fsync d0/d6/d26/d14/d19/d37/f39 0 2023-12-17T11:57:43.000 INFO:tasks.workunit.client.0.smithi002.stdout:0/352: read d0/d6/d26/f35 [119293,5780] 0 2023-12-17T11:57:43.000 INFO:tasks.workunit.client.1.smithi119.stdout:1/365: creat d3/db/d17/f7d x:0 0 0 2023-12-17T11:57:43.001 INFO:tasks.workunit.client.1.smithi119.stdout:6/342: dread d2/df/f55 [0,4194304] 0 2023-12-17T11:57:43.001 INFO:tasks.workunit.client.1.smithi119.stdout:6/343: fdatasync d2/d2b/d43/f62 0 2023-12-17T11:57:43.001 INFO:tasks.workunit.client.1.smithi119.stdout:7/406: rmdir d2/d4b 39 2023-12-17T11:57:43.002 INFO:tasks.workunit.client.0.smithi002.stdout:1/472: symlink d3/d6/d9/la0 0 2023-12-17T11:57:43.004 INFO:tasks.workunit.client.1.smithi119.stdout:6/344: mknod d2/d41/c66 0 2023-12-17T11:57:43.006 INFO:tasks.workunit.client.0.smithi002.stdout:9/444: rename dc/d42/d4f/d59/d49/d72/f99 to dc/d1d/d25/d85/f9a 0 2023-12-17T11:57:43.009 INFO:tasks.workunit.client.1.smithi119.stdout:6/345: creat d2/d61/f67 x:0 0 0 2023-12-17T11:57:43.009 INFO:tasks.workunit.client.1.smithi119.stdout:6/346: read d2/d2b/d43/f58 [2480136,81502] 0 2023-12-17T11:57:43.009 INFO:tasks.workunit.client.1.smithi119.stdout:6/347: chown d2/df/c3e 11 1 2023-12-17T11:57:43.011 INFO:tasks.workunit.client.1.smithi119.stdout:7/407: link d2/d4e/f2b d2/d4/d11/d3c/d75/f7f 0 2023-12-17T11:57:43.011 INFO:tasks.workunit.client.1.smithi119.stdout:1/366: dread d3/db/d26/d19/d3f/f4a [0,4194304] 0 2023-12-17T11:57:43.012 INFO:tasks.workunit.client.0.smithi002.stdout:2/400: symlink d3/d4/l93 0 2023-12-17T11:57:43.012 INFO:tasks.workunit.client.0.smithi002.stdout:2/401: readlink d3/d4/l9 0 2023-12-17T11:57:43.012 INFO:tasks.workunit.client.0.smithi002.stdout:5/388: symlink dc/d2b/l85 0 2023-12-17T11:57:43.012 INFO:tasks.workunit.client.0.smithi002.stdout:5/389: dread - dc/d1b/d2d/f56 zero size 2023-12-17T11:57:43.014 INFO:tasks.workunit.client.1.smithi119.stdout:7/408: symlink d2/d4/d11/d2c/d68/d6a/l80 0 2023-12-17T11:57:43.014 INFO:tasks.workunit.client.1.smithi119.stdout:3/435: dread d9/d44/d8c/f9e [0,4194304] 0 2023-12-17T11:57:43.014 INFO:tasks.workunit.client.1.smithi119.stdout:3/436: creat d9/da/df/da1/fa9 x:0 0 0 2023-12-17T11:57:43.016 INFO:tasks.workunit.client.1.smithi119.stdout:1/367: mkdir d3/db/d17/d24/d20/d40/d6d/d7e 0 2023-12-17T11:57:43.018 INFO:tasks.workunit.client.0.smithi002.stdout:9/445: dread dc/d1d/d25/f65 [0,4194304] 0 2023-12-17T11:57:43.019 INFO:tasks.workunit.client.0.smithi002.stdout:1/473: unlink d3/d6/d9/d37/d39/d43/d4a/c63 0 2023-12-17T11:57:43.024 INFO:tasks.workunit.client.0.smithi002.stdout:6/396: rename d0/d1/d5b/f73 to d0/d1/d28/f7b 0 2023-12-17T11:57:43.027 INFO:tasks.workunit.client.1.smithi119.stdout:3/437: creat d9/d11/d1e/d55/d77/faa x:0 0 0 2023-12-17T11:57:43.027 INFO:tasks.workunit.client.1.smithi119.stdout:3/438: fsync d9/d1c/f7b 0 2023-12-17T11:57:43.027 INFO:tasks.workunit.client.1.smithi119.stdout:3/439: truncate d9/d59/f5d 138058 0 2023-12-17T11:57:43.028 INFO:tasks.workunit.client.0.smithi002.stdout:2/402: mkdir d3/d4/d17/d19/d4d/d72/d83/d94 0 2023-12-17T11:57:43.030 INFO:tasks.workunit.client.0.smithi002.stdout:5/390: dread dc/d2b/f65 [0,4194304] 0 2023-12-17T11:57:43.030 INFO:tasks.workunit.client.1.smithi119.stdout:1/368: creat d3/db/d17/d24/d20/f7f x:0 0 0 2023-12-17T11:57:43.030 INFO:tasks.workunit.client.1.smithi119.stdout:1/369: creat d3/db/d17/d24/d20/d40/f80 x:0 0 0 2023-12-17T11:57:43.031 INFO:tasks.workunit.client.0.smithi002.stdout:0/353: rmdir d0/d33 39 2023-12-17T11:57:43.031 INFO:tasks.workunit.client.0.smithi002.stdout:0/354: fdatasync d0/d6/d26/f3a 0 2023-12-17T11:57:43.034 INFO:tasks.workunit.client.0.smithi002.stdout:1/474: mknod d3/d6/d9/d37/d39/ca1 0 2023-12-17T11:57:43.035 INFO:tasks.workunit.client.1.smithi119.stdout:1/370: rename d3/db/d26/d5e/c67 to d3/db/d26/d19/d3f/d64/c81 0 2023-12-17T11:57:43.037 INFO:tasks.workunit.client.0.smithi002.stdout:6/397: mknod d0/c7c 0 2023-12-17T11:57:43.037 INFO:tasks.workunit.client.0.smithi002.stdout:6/398: chown d0/d1/d6d 1734 1 2023-12-17T11:57:43.037 INFO:tasks.workunit.client.0.smithi002.stdout:6/399: write d0/d1/dc/f34 [722925,7415] 0 2023-12-17T11:57:43.037 INFO:tasks.workunit.client.0.smithi002.stdout:0/355: dread d0/d15/f67 [0,4194304] 0 2023-12-17T11:57:43.040 INFO:tasks.workunit.client.1.smithi119.stdout:1/371: link d3/db/f62 d3/db/d17/d24/d20/d40/d6d/f82 0 2023-12-17T11:57:43.041 INFO:tasks.workunit.client.0.smithi002.stdout:2/403: mknod d3/d4/d17/d19/d8d/c95 0 2023-12-17T11:57:43.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/391: mknod dc/d17/d2f/d82/c86 0 2023-12-17T11:57:43.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/392: truncate dc/d17/f81 264003 0 2023-12-17T11:57:43.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/393: creat dc/d17/f87 x:0 0 0 2023-12-17T11:57:43.041 INFO:tasks.workunit.client.0.smithi002.stdout:9/446: getdents dc/d38 0 2023-12-17T11:57:43.041 INFO:tasks.workunit.client.0.smithi002.stdout:9/447: stat dc/f13 0 2023-12-17T11:57:43.045 INFO:tasks.workunit.client.1.smithi119.stdout:1/372: link d3/db/d17/d24/d20/f2d d3/db/d26/f83 0 2023-12-17T11:57:43.046 INFO:tasks.workunit.client.0.smithi002.stdout:1/475: creat d3/d6/fa2 x:0 0 0 2023-12-17T11:57:43.049 INFO:tasks.workunit.client.0.smithi002.stdout:2/404: mknod d3/d4/d17/d19/c96 0 2023-12-17T11:57:43.050 INFO:tasks.workunit.client.1.smithi119.stdout:1/373: rmdir d3/d44 39 2023-12-17T11:57:43.050 INFO:tasks.workunit.client.1.smithi119.stdout:1/374: write d3/db/d26/d19/d3f/d64/f75 [277591,49232] 0 2023-12-17T11:57:43.050 INFO:tasks.workunit.client.1.smithi119.stdout:1/375: write d3/db/d17/f30 [123112,26818] 0 2023-12-17T11:57:43.053 INFO:tasks.workunit.client.0.smithi002.stdout:9/448: creat dc/d42/d4f/d59/d49/d72/d93/d83/f9b x:0 0 0 2023-12-17T11:57:43.054 INFO:tasks.workunit.client.1.smithi119.stdout:1/376: mkdir d3/db/d17/d24/d20/d40/d76/d84 0 2023-12-17T11:57:43.055 INFO:tasks.workunit.client.0.smithi002.stdout:0/356: getdents d0/d6/d26/d14/d19/d2f 0 2023-12-17T11:57:43.056 INFO:tasks.workunit.client.0.smithi002.stdout:2/405: rename d3/d4/d7/d14/d2e/d37/d3f/f6e to d3/d4/d7/d14/d1b/d5b/f97 0 2023-12-17T11:57:43.057 INFO:tasks.workunit.client.1.smithi119.stdout:1/377: symlink d3/db/d17/l85 0 2023-12-17T11:57:43.058 INFO:tasks.workunit.client.0.smithi002.stdout:9/449: symlink dc/d42/d4f/d59/d49/d72/d93/d52/l9c 0 2023-12-17T11:57:43.058 INFO:tasks.workunit.client.0.smithi002.stdout:0/357: truncate d0/f44 3945431 0 2023-12-17T11:57:43.059 INFO:tasks.workunit.client.0.smithi002.stdout:2/406: symlink d3/d4/d7/d14/d1b/d5b/l98 0 2023-12-17T11:57:43.060 INFO:tasks.workunit.client.0.smithi002.stdout:9/450: rmdir dc/d1d 39 2023-12-17T11:57:43.060 INFO:tasks.workunit.client.0.smithi002.stdout:9/451: write dc/d32/f77 [620882,116669] 0 2023-12-17T11:57:43.060 INFO:tasks.workunit.client.0.smithi002.stdout:9/452: creat dc/d42/d4f/d59/d47/d4b/f9d x:0 0 0 2023-12-17T11:57:43.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/407: symlink d3/d4/d17/d19/d4d/l99 0 2023-12-17T11:57:43.064 INFO:tasks.workunit.client.0.smithi002.stdout:1/476: dread d3/d6/d9/f3c [0,4194304] 0 2023-12-17T11:57:43.065 INFO:tasks.workunit.client.0.smithi002.stdout:2/408: symlink d3/d4/d17/d19/d4d/d72/d83/d94/l9a 0 2023-12-17T11:57:43.065 INFO:tasks.workunit.client.0.smithi002.stdout:2/409: readlink d3/d4/d7/d14/d1b/d5b/l71 0 2023-12-17T11:57:43.065 INFO:tasks.workunit.client.0.smithi002.stdout:1/477: creat d3/d6/d9/d30/d9c/fa3 x:0 0 0 2023-12-17T11:57:43.067 INFO:tasks.workunit.client.0.smithi002.stdout:2/410: mkdir d3/d4/d7/d14/d9b 0 2023-12-17T11:57:43.067 INFO:tasks.workunit.client.0.smithi002.stdout:2/411: read d3/d4/d17/d19/f24 [2352193,2950] 0 2023-12-17T11:57:43.067 INFO:tasks.workunit.client.0.smithi002.stdout:2/412: readlink d3/d4/d7/d14/d1b/d5b/l5f 0 2023-12-17T11:57:43.067 INFO:tasks.workunit.client.0.smithi002.stdout:1/478: creat d3/d6/d9/d37/d39/d43/fa4 x:0 0 0 2023-12-17T11:57:43.067 INFO:tasks.workunit.client.0.smithi002.stdout:1/479: write d3/f83 [4299029,5417] 0 2023-12-17T11:57:43.070 INFO:tasks.workunit.client.0.smithi002.stdout:2/413: creat d3/d4/d17/d19/d4d/d72/d83/d94/f9c x:0 0 0 2023-12-17T11:57:43.071 INFO:tasks.workunit.client.0.smithi002.stdout:2/414: fdatasync d3/d4/fd 0 2023-12-17T11:57:43.071 INFO:tasks.workunit.client.0.smithi002.stdout:2/415: write d3/d4/d7/d14/f82 [327313,110262] 0 2023-12-17T11:57:43.073 INFO:tasks.workunit.client.0.smithi002.stdout:2/416: link d3/d4/d7/d14/d2e/d37/c84 d3/d4/d7/d14/d1b/d5b/c9d 0 2023-12-17T11:57:43.075 INFO:tasks.workunit.client.0.smithi002.stdout:2/417: rename d3/d4/d7/d14/c2d to d3/d56/c9e 0 2023-12-17T11:57:43.098 INFO:tasks.workunit.client.1.smithi119.stdout:8/334: dread d7/da/d11/d26/d2c/f5a [0,4194304] 0 2023-12-17T11:57:43.104 INFO:tasks.workunit.client.0.smithi002.stdout:1/480: dread d3/d2f/d4d/f5e [0,4194304] 0 2023-12-17T11:57:43.105 INFO:tasks.workunit.client.1.smithi119.stdout:9/453: dwrite d12/d1d/d28/d46/d50/f62 [4194304,4194304] 0 2023-12-17T11:57:43.106 INFO:tasks.workunit.client.1.smithi119.stdout:9/454: dread - d12/d1d/d28/d46/f66 zero size 2023-12-17T11:57:43.107 INFO:tasks.workunit.client.1.smithi119.stdout:2/431: dread d6/d9/d13/f32 [0,4194304] 0 2023-12-17T11:57:43.109 INFO:tasks.workunit.client.0.smithi002.stdout:1/481: rename d3/d6/d9/d37/f53 to d3/d6/d9/d37/d39/d43/d4a/fa5 0 2023-12-17T11:57:43.111 INFO:tasks.workunit.client.1.smithi119.stdout:9/455: rename d12/l63 to d12/d1d/d49/l8d 0 2023-12-17T11:57:43.112 INFO:tasks.workunit.client.0.smithi002.stdout:0/358: write d0/d15/f27 [2562188,45911] 0 2023-12-17T11:57:43.112 INFO:tasks.workunit.client.0.smithi002.stdout:0/359: read - d0/d6/d26/d14/f5d zero size 2023-12-17T11:57:43.112 INFO:tasks.workunit.client.0.smithi002.stdout:0/360: chown d0/d6/d26/d14/d19/c69 1479958 1 2023-12-17T11:57:43.112 INFO:tasks.workunit.client.0.smithi002.stdout:0/361: write d0/d6/d26/d14/d19/d2b/f30 [1025308,69983] 0 2023-12-17T11:57:43.113 INFO:tasks.workunit.client.0.smithi002.stdout:1/482: creat d3/d6/d9/d37/d39/fa6 x:0 0 0 2023-12-17T11:57:43.113 INFO:tasks.workunit.client.0.smithi002.stdout:1/483: chown d3/d6/d9/d37/d39/c3f 27960264 1 2023-12-17T11:57:43.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/362: creat d0/d6/d26/d14/d19/d61/f73 x:0 0 0 2023-12-17T11:57:43.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/363: chown d0/d6/c1d 5129 1 2023-12-17T11:57:43.115 INFO:tasks.workunit.client.0.smithi002.stdout:0/364: write d0/d15/f27 [3391185,53936] 0 2023-12-17T11:57:43.116 INFO:tasks.workunit.client.1.smithi119.stdout:7/409: dwrite d2/f3 [0,4194304] 0 2023-12-17T11:57:43.117 INFO:tasks.workunit.client.0.smithi002.stdout:1/484: mknod d3/d2f/d4d/d91/ca7 0 2023-12-17T11:57:43.121 INFO:tasks.workunit.client.0.smithi002.stdout:5/394: dwrite fb [0,4194304] 0 2023-12-17T11:57:43.121 INFO:tasks.workunit.client.0.smithi002.stdout:5/395: chown dc/d1b/d75 101987386 1 2023-12-17T11:57:43.121 INFO:tasks.workunit.client.0.smithi002.stdout:5/396: readlink dc/d17/d1c/l67 0 2023-12-17T11:57:43.122 INFO:tasks.workunit.client.0.smithi002.stdout:9/453: dwrite dc/d42/d4f/d59/f6e [0,4194304] 0 2023-12-17T11:57:43.124 INFO:tasks.workunit.client.0.smithi002.stdout:0/365: mknod d0/d6/d26/c74 0 2023-12-17T11:57:43.125 INFO:tasks.workunit.client.0.smithi002.stdout:4/396: dread d0/d10/d21/f42 [4194304,4194304] 0 2023-12-17T11:57:43.125 INFO:tasks.workunit.client.0.smithi002.stdout:6/400: dwrite d0/d1/dc/d17/f1e [0,4194304] 0 2023-12-17T11:57:43.129 INFO:tasks.workunit.client.1.smithi119.stdout:3/440: fsync d9/da/fa7 0 2023-12-17T11:57:43.129 INFO:tasks.workunit.client.1.smithi119.stdout:3/441: fdatasync d9/d11/f5f 0 2023-12-17T11:57:43.132 INFO:tasks.workunit.client.1.smithi119.stdout:9/456: creat d12/d1d/f8e x:0 0 0 2023-12-17T11:57:43.132 INFO:tasks.workunit.client.1.smithi119.stdout:6/348: dwrite d2/d2b/f4c [0,4194304] 0 2023-12-17T11:57:43.132 INFO:tasks.workunit.client.1.smithi119.stdout:6/349: fsync d2/f4 0 2023-12-17T11:57:43.132 INFO:tasks.workunit.client.0.smithi002.stdout:9/454: mkdir dc/d42/d4f/d9e 0 2023-12-17T11:57:43.133 INFO:tasks.workunit.client.0.smithi002.stdout:9/455: write dc/d42/d4f/d59/d47/f5c [383843,66593] 0 2023-12-17T11:57:43.133 INFO:tasks.workunit.client.0.smithi002.stdout:9/456: chown dc/d42/d4f/d59/f33 85722 1 2023-12-17T11:57:43.135 INFO:tasks.workunit.client.1.smithi119.stdout:6/350: write d2/d2b/d43/f4a [8287,3287] 0 2023-12-17T11:57:43.135 INFO:tasks.workunit.client.1.smithi119.stdout:6/351: read - d2/d61/f67 zero size 2023-12-17T11:57:43.141 INFO:tasks.workunit.client.0.smithi002.stdout:5/397: dread dc/d17/d1c/f20 [0,4194304] 0 2023-12-17T11:57:43.142 INFO:tasks.workunit.client.1.smithi119.stdout:0/304: dwrite d2/d3/d5/f4f [0,4194304] 0 2023-12-17T11:57:43.145 INFO:tasks.workunit.client.1.smithi119.stdout:7/410: symlink d2/d4/d11/d2c/l81 0 2023-12-17T11:57:43.151 INFO:tasks.workunit.client.0.smithi002.stdout:9/457: mknod dc/c9f 0 2023-12-17T11:57:43.156 INFO:tasks.workunit.client.0.smithi002.stdout:3/437: sync 2023-12-17T11:57:43.156 INFO:tasks.workunit.client.0.smithi002.stdout:7/400: sync 2023-12-17T11:57:43.156 INFO:tasks.workunit.client.0.smithi002.stdout:3/438: fdatasync d9/d1b/d35/d41/d43/f50 0 2023-12-17T11:57:43.157 INFO:tasks.workunit.client.1.smithi119.stdout:6/352: creat d2/d41/f68 x:0 0 0 2023-12-17T11:57:43.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/398: creat dc/d1b/d75/f88 x:0 0 0 2023-12-17T11:57:43.163 INFO:tasks.workunit.client.1.smithi119.stdout:7/411: dread d2/f35 [0,4194304] 0 2023-12-17T11:57:43.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/366: dread d0/d6/d26/d25/f46 [0,4194304] 0 2023-12-17T11:57:43.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/439: creat d9/d1b/d35/d41/d59/d65/f87 x:0 0 0 2023-12-17T11:57:43.173 INFO:tasks.workunit.client.0.smithi002.stdout:3/440: chown d9/d1b/d35/d41/d59/d65/f77 1338605 1 2023-12-17T11:57:43.185 INFO:tasks.workunit.client.1.smithi119.stdout:8/335: dwrite d7/d18/f3d [0,4194304] 0 2023-12-17T11:57:43.191 INFO:tasks.workunit.client.1.smithi119.stdout:6/353: rename d2/df/f31 to d2/d2b/d43/d5e/f69 0 2023-12-17T11:57:43.192 INFO:tasks.workunit.client.0.smithi002.stdout:5/399: mknod dc/d1b/d5a/d68/c89 0 2023-12-17T11:57:43.199 INFO:tasks.workunit.client.0.smithi002.stdout:2/418: dwrite d3/d4/d17/d19/d4d/d72/d77/f7a [0,4194304] 0 2023-12-17T11:57:43.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/401: dread d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:43.200 INFO:tasks.workunit.client.0.smithi002.stdout:7/402: write d6/d17/dc/d6c/f6f [962393,116683] 0 2023-12-17T11:57:43.200 INFO:tasks.workunit.client.0.smithi002.stdout:7/403: write d6/f1c [863692,29282] 0 2023-12-17T11:57:43.203 INFO:tasks.workunit.client.1.smithi119.stdout:3/442: dread d9/da/f2d [4194304,4194304] 0 2023-12-17T11:57:43.203 INFO:tasks.workunit.client.1.smithi119.stdout:3/443: chown d9/da/df 3720197 1 2023-12-17T11:57:43.204 INFO:tasks.workunit.client.0.smithi002.stdout:1/485: dwrite d3/d6/d9/d30/f56 [0,4194304] 0 2023-12-17T11:57:43.205 INFO:tasks.workunit.client.0.smithi002.stdout:4/397: dwrite d0/d10/f39 [4194304,4194304] 0 2023-12-17T11:57:43.210 INFO:tasks.workunit.client.1.smithi119.stdout:6/354: mknod d2/d61/c6a 0 2023-12-17T11:57:43.215 INFO:tasks.workunit.client.1.smithi119.stdout:6/355: symlink d2/d2b/l6b 0 2023-12-17T11:57:43.215 INFO:tasks.workunit.client.1.smithi119.stdout:6/356: write d2/f4 [3494863,38571] 0 2023-12-17T11:57:43.216 INFO:tasks.workunit.client.0.smithi002.stdout:0/367: link d0/d6/c16 d0/c75 0 2023-12-17T11:57:43.217 INFO:tasks.workunit.client.0.smithi002.stdout:0/368: chown d0/d6/d26/d25/f45 46363 1 2023-12-17T11:57:43.218 INFO:tasks.workunit.client.0.smithi002.stdout:7/404: dread d6/d17/f61 [0,4194304] 0 2023-12-17T11:57:43.218 INFO:tasks.workunit.client.1.smithi119.stdout:6/357: mknod d2/d2b/d43/c6c 0 2023-12-17T11:57:43.219 INFO:tasks.workunit.client.0.smithi002.stdout:0/369: write d0/d15/f67 [288552,110769] 0 2023-12-17T11:57:43.222 INFO:tasks.workunit.client.0.smithi002.stdout:3/441: mkdir d9/d1b/d4f/d88 0 2023-12-17T11:57:43.222 INFO:tasks.workunit.client.1.smithi119.stdout:3/444: write d9/d11/d1e/f3e [409764,786] 0 2023-12-17T11:57:43.222 INFO:tasks.workunit.client.1.smithi119.stdout:3/445: stat d9/da/df/d41/d33/f62 0 2023-12-17T11:57:43.224 INFO:tasks.workunit.client.0.smithi002.stdout:5/400: rmdir dc 39 2023-12-17T11:57:43.227 INFO:tasks.workunit.client.1.smithi119.stdout:9/457: dwrite d12/d1d/f27 [0,4194304] 0 2023-12-17T11:57:43.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/446: symlink d9/d11/d1e/d55/d65/d84/lab 0 2023-12-17T11:57:43.235 INFO:tasks.workunit.client.1.smithi119.stdout:3/447: write d9/d11/f76 [155720,91094] 0 2023-12-17T11:57:43.236 INFO:tasks.workunit.client.1.smithi119.stdout:9/458: mkdir d12/d1d/d28/d86/d8f 0 2023-12-17T11:57:43.238 INFO:tasks.workunit.client.1.smithi119.stdout:2/432: dwrite d6/f73 [0,4194304] 0 2023-12-17T11:57:43.239 INFO:tasks.workunit.client.1.smithi119.stdout:0/305: dwrite d2/d16/d12/d2e/d44/f26 [4194304,4194304] 0 2023-12-17T11:57:43.239 INFO:tasks.workunit.client.1.smithi119.stdout:8/336: dwrite d7/da/d1a/f1c [0,4194304] 0 2023-12-17T11:57:43.242 INFO:tasks.workunit.client.1.smithi119.stdout:3/448: mknod d9/d11/d87/da3/cac 0 2023-12-17T11:57:43.242 INFO:tasks.workunit.client.1.smithi119.stdout:3/449: chown d9/da/l10 90802 1 2023-12-17T11:57:43.242 INFO:tasks.workunit.client.1.smithi119.stdout:2/433: write d6/f8a [841414,98034] 0 2023-12-17T11:57:43.243 INFO:tasks.workunit.client.0.smithi002.stdout:4/398: write d0/d3e/d56/f77 [360414,31919] 0 2023-12-17T11:57:43.245 INFO:tasks.workunit.client.0.smithi002.stdout:1/486: symlink d3/d6/d16/d61/d8e/la8 0 2023-12-17T11:57:43.246 INFO:tasks.workunit.client.0.smithi002.stdout:1/487: write d3/d2f/f79 [1180709,115416] 0 2023-12-17T11:57:43.252 INFO:tasks.workunit.client.1.smithi119.stdout:0/306: dread d2/d16/d12/d1f/f22 [4194304,4194304] 0 2023-12-17T11:57:43.252 INFO:tasks.workunit.client.1.smithi119.stdout:0/307: write d2/d3/d5/d3f/f52 [635406,118567] 0 2023-12-17T11:57:43.254 INFO:tasks.workunit.client.1.smithi119.stdout:3/450: dread d9/da/df/d41/d33/d5a/f96 [0,4194304] 0 2023-12-17T11:57:43.254 INFO:tasks.workunit.client.1.smithi119.stdout:3/451: stat d9/da/l23 0 2023-12-17T11:57:43.255 INFO:tasks.workunit.client.1.smithi119.stdout:3/452: fdatasync d9/d11/d1e/f37 0 2023-12-17T11:57:43.255 INFO:tasks.workunit.client.1.smithi119.stdout:3/453: creat d9/d44/d8c/fad x:0 0 0 2023-12-17T11:57:43.255 INFO:tasks.workunit.client.1.smithi119.stdout:3/454: write d9/da/df/d41/d33/d3a/d90/f94 [1903865,71209] 0 2023-12-17T11:57:43.257 INFO:tasks.workunit.client.1.smithi119.stdout:1/378: getdents d3/db/d17/d24/d20/d40/d76 0 2023-12-17T11:57:43.261 INFO:tasks.workunit.client.0.smithi002.stdout:9/458: rename dc/d42/d4f/d59/d49 to dc/d42/da0 0 2023-12-17T11:57:43.261 INFO:tasks.workunit.client.0.smithi002.stdout:9/459: chown dc/c9f 243 1 2023-12-17T11:57:43.261 INFO:tasks.workunit.client.0.smithi002.stdout:9/460: write dc/d1d/f78 [1860761,103829] 0 2023-12-17T11:57:43.263 INFO:tasks.workunit.client.0.smithi002.stdout:0/370: dwrite d0/d33/f71 [0,4194304] 0 2023-12-17T11:57:43.267 INFO:tasks.workunit.client.1.smithi119.stdout:6/358: dwrite d2/d2b/f3a [0,4194304] 0 2023-12-17T11:57:43.268 INFO:tasks.workunit.client.1.smithi119.stdout:9/459: link d12/f2c d12/d1d/d49/d85/f90 0 2023-12-17T11:57:43.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/399: dread d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:43.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/400: creat d0/d10/d14/d27/d57/d7d/f84 x:0 0 0 2023-12-17T11:57:43.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/401: dread - d0/d10/d14/d27/d57/f7b zero size 2023-12-17T11:57:43.270 INFO:tasks.workunit.client.1.smithi119.stdout:3/455: dread d9/da/fa7 [0,4194304] 0 2023-12-17T11:57:43.271 INFO:tasks.workunit.client.0.smithi002.stdout:7/405: symlink d6/d17/dc/d13/d21/d2e/d4a/d53/l77 0 2023-12-17T11:57:43.273 INFO:tasks.workunit.client.0.smithi002.stdout:3/442: mkdir d9/d1b/d35/d41/d43/d73/d89 0 2023-12-17T11:57:43.274 INFO:tasks.workunit.client.1.smithi119.stdout:8/337: symlink d7/d12/d69/d2a/l70 0 2023-12-17T11:57:43.274 INFO:tasks.workunit.client.1.smithi119.stdout:8/338: readlink d7/da/d11/d26/d49/l5c 0 2023-12-17T11:57:43.275 INFO:tasks.workunit.client.0.smithi002.stdout:1/488: link d3/d6/d9/d30/d87/l8a d3/d2f/la9 0 2023-12-17T11:57:43.278 INFO:tasks.workunit.client.0.smithi002.stdout:2/419: rename d3/d4/d7/d14/d34/f4b to d3/d4/d7/d14/f9f 0 2023-12-17T11:57:43.280 INFO:tasks.workunit.client.1.smithi119.stdout:0/308: link d2/d16/d12/d2e/l4d d2/d3/l56 0 2023-12-17T11:57:43.280 INFO:tasks.workunit.client.1.smithi119.stdout:0/309: chown d2/d3/ca 319507 1 2023-12-17T11:57:43.280 INFO:tasks.workunit.client.0.smithi002.stdout:9/461: getdents dc/d42/da0/d72/d93/d52 0 2023-12-17T11:57:43.284 INFO:tasks.workunit.client.1.smithi119.stdout:1/379: creat d3/db/d17/d24/d20/d6c/f86 x:0 0 0 2023-12-17T11:57:43.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/380: write d3/db/d26/d19/f4b [1325945,24068] 0 2023-12-17T11:57:43.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/381: readlink d3/db/d17/d24/l10 0 2023-12-17T11:57:43.290 INFO:tasks.workunit.client.1.smithi119.stdout:9/460: mknod d12/d1d/d28/d86/c91 0 2023-12-17T11:57:43.291 INFO:tasks.workunit.client.1.smithi119.stdout:9/461: stat d12/l1b 0 2023-12-17T11:57:43.294 INFO:tasks.workunit.client.1.smithi119.stdout:3/456: mkdir d9/d59/dae 0 2023-12-17T11:57:43.295 INFO:tasks.workunit.client.1.smithi119.stdout:1/382: dread d3/db/d17/f30 [0,4194304] 0 2023-12-17T11:57:43.296 INFO:tasks.workunit.client.1.smithi119.stdout:1/383: fdatasync d3/db/d17/f31 0 2023-12-17T11:57:43.299 INFO:tasks.workunit.client.1.smithi119.stdout:8/339: rename d7/da/d1a/f6f to d7/da/d11/d26/f71 0 2023-12-17T11:57:43.304 INFO:tasks.workunit.client.1.smithi119.stdout:2/434: link d6/d2b/l80 d6/l9a 0 2023-12-17T11:57:43.304 INFO:tasks.workunit.client.1.smithi119.stdout:2/435: write f5 [1710267,105214] 0 2023-12-17T11:57:43.304 INFO:tasks.workunit.client.1.smithi119.stdout:2/436: chown d6/d38/d96 0 1 2023-12-17T11:57:43.306 INFO:tasks.workunit.client.1.smithi119.stdout:0/310: creat d2/d16/d12/d1f/f57 x:0 0 0 2023-12-17T11:57:43.306 INFO:tasks.workunit.client.1.smithi119.stdout:0/311: fsync d2/d16/d12/f25 0 2023-12-17T11:57:43.307 INFO:tasks.workunit.client.1.smithi119.stdout:6/359: dwrite d2/d2b/d43/f5c [0,4194304] 0 2023-12-17T11:57:43.308 INFO:tasks.workunit.client.0.smithi002.stdout:4/402: mkdir d0/d3e/d56/d65/d78/d85 0 2023-12-17T11:57:43.311 INFO:tasks.workunit.client.0.smithi002.stdout:7/406: link d6/d17/dc/d13/d37/d4c/f70 d6/d17/dc/d13/d21/d2e/d4a/d53/f78 0 2023-12-17T11:57:43.311 INFO:tasks.workunit.client.0.smithi002.stdout:7/407: write d6/d17/dc/f76 [357779,36431] 0 2023-12-17T11:57:43.313 INFO:tasks.workunit.client.1.smithi119.stdout:3/457: link d9/d11/c36 d9/caf 0 2023-12-17T11:57:43.313 INFO:tasks.workunit.client.1.smithi119.stdout:3/458: chown d9/da/df/da1/fa9 8 1 2023-12-17T11:57:43.313 INFO:tasks.workunit.client.0.smithi002.stdout:7/408: write d6/d17/dc/d13/d37/d4c/d24/f31 [4596850,16361] 0 2023-12-17T11:57:43.314 INFO:tasks.workunit.client.0.smithi002.stdout:0/371: dwrite d0/d6/fb [0,4194304] 0 2023-12-17T11:57:43.314 INFO:tasks.workunit.client.0.smithi002.stdout:1/489: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa 0 2023-12-17T11:57:43.315 INFO:tasks.workunit.client.1.smithi119.stdout:1/384: mknod d3/db/d26/d5e/c87 0 2023-12-17T11:57:43.315 INFO:tasks.workunit.client.1.smithi119.stdout:1/385: chown d3/db/d17/d24/d20/d40/d6d/f6e 1773 1 2023-12-17T11:57:43.315 INFO:tasks.workunit.client.1.smithi119.stdout:1/386: dread - d3/db/d17/f7d zero size 2023-12-17T11:57:43.317 INFO:tasks.workunit.client.0.smithi002.stdout:5/401: rename dc/d17/d1c/f20 to dc/d1b/d2d/d5b/f8a 0 2023-12-17T11:57:43.318 INFO:tasks.workunit.client.0.smithi002.stdout:5/402: dread - dc/d1b/d75/f88 zero size 2023-12-17T11:57:43.319 INFO:tasks.workunit.client.1.smithi119.stdout:8/340: creat d7/d12/d69/d2a/f72 x:0 0 0 2023-12-17T11:57:43.319 INFO:tasks.workunit.client.1.smithi119.stdout:8/341: dread - d7/da/d1a/f66 zero size 2023-12-17T11:57:43.319 INFO:tasks.workunit.client.1.smithi119.stdout:8/342: write d7/da/f6c [5056359,38080] 0 2023-12-17T11:57:43.319 INFO:tasks.workunit.client.1.smithi119.stdout:8/343: write d7/d12/d69/f24 [68349,83930] 0 2023-12-17T11:57:43.320 INFO:tasks.workunit.client.0.smithi002.stdout:3/443: dwrite d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:43.321 INFO:tasks.workunit.client.0.smithi002.stdout:2/420: creat d3/d56/fa0 x:0 0 0 2023-12-17T11:57:43.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/462: creat dc/d1d/d25/fa1 x:0 0 0 2023-12-17T11:57:43.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/463: chown dc/d42/d4f/d59/d47/d4b/f9d 3 1 2023-12-17T11:57:43.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/464: chown dc/d38 280018 1 2023-12-17T11:57:43.323 INFO:tasks.workunit.client.0.smithi002.stdout:9/465: dread - dc/d32/f71 zero size 2023-12-17T11:57:43.325 INFO:tasks.workunit.client.0.smithi002.stdout:4/403: creat d0/d3e/f86 x:0 0 0 2023-12-17T11:57:43.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/409: creat d6/d17/f79 x:0 0 0 2023-12-17T11:57:43.332 INFO:tasks.workunit.client.0.smithi002.stdout:0/372: mknod d0/d33/c76 0 2023-12-17T11:57:43.336 INFO:tasks.workunit.client.1.smithi119.stdout:3/459: dread d9/d11/d1e/f8e [8388608,4194304] 0 2023-12-17T11:57:43.338 INFO:tasks.workunit.client.1.smithi119.stdout:1/387: write d3/db/f62 [2949113,56131] 0 2023-12-17T11:57:43.344 INFO:tasks.workunit.client.1.smithi119.stdout:0/312: mknod d2/d16/d12/c58 0 2023-12-17T11:57:43.345 INFO:tasks.workunit.client.0.smithi002.stdout:1/490: mknod d3/d6/cab 0 2023-12-17T11:57:43.345 INFO:tasks.workunit.client.0.smithi002.stdout:5/403: symlink dc/l8b 0 2023-12-17T11:57:43.349 INFO:tasks.workunit.client.0.smithi002.stdout:2/421: unlink d3/d4/d7/d14/l3c 0 2023-12-17T11:57:43.350 INFO:tasks.workunit.client.1.smithi119.stdout:3/460: dread d9/da/df/d41/d33/d3a/f40 [0,4194304] 0 2023-12-17T11:57:43.350 INFO:tasks.workunit.client.1.smithi119.stdout:3/461: chown d9/da/df/f15 289307 1 2023-12-17T11:57:43.351 INFO:tasks.workunit.client.0.smithi002.stdout:9/466: link dc/d42/d4f/d59/f30 dc/d42/da0/d72/d93/d83/d91/fa2 0 2023-12-17T11:57:43.352 INFO:tasks.workunit.client.1.smithi119.stdout:2/437: rmdir d6/d2b/d3f 39 2023-12-17T11:57:43.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/410: symlink d6/d17/dc/d13/d37/d4f/l7a 0 2023-12-17T11:57:43.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/411: fsync d6/f72 0 2023-12-17T11:57:43.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/412: write d6/d17/dc/d67/f5d [475170,23559] 0 2023-12-17T11:57:43.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/491: stat d3/d6/d16/l34 0 2023-12-17T11:57:43.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/492: dread - d3/d6/d16/d61/d8e/f78 zero size 2023-12-17T11:57:43.358 INFO:tasks.workunit.client.0.smithi002.stdout:5/404: mknod dc/d2b/c8c 0 2023-12-17T11:57:43.360 INFO:tasks.workunit.client.0.smithi002.stdout:3/444: link d9/l2d d9/d15/d52/l8a 0 2023-12-17T11:57:43.361 INFO:tasks.workunit.client.1.smithi119.stdout:0/313: read d2/d16/d12/d1f/f20 [1647459,129514] 0 2023-12-17T11:57:43.362 INFO:tasks.workunit.client.1.smithi119.stdout:1/388: unlink d3/db/f2b 0 2023-12-17T11:57:43.362 INFO:tasks.workunit.client.1.smithi119.stdout:1/389: write d3/db/d26/d19/d3f/d64/f75 [1181907,68408] 0 2023-12-17T11:57:43.362 INFO:tasks.workunit.client.1.smithi119.stdout:1/390: dread - d3/f65 zero size 2023-12-17T11:57:43.362 INFO:tasks.workunit.client.1.smithi119.stdout:5/432: sync 2023-12-17T11:57:43.363 INFO:tasks.workunit.client.1.smithi119.stdout:4/408: sync 2023-12-17T11:57:43.363 INFO:tasks.workunit.client.1.smithi119.stdout:5/433: fdatasync d1/f35 0 2023-12-17T11:57:43.363 INFO:tasks.workunit.client.1.smithi119.stdout:6/360: rmdir d2/d41 39 2023-12-17T11:57:43.363 INFO:tasks.workunit.client.1.smithi119.stdout:6/361: fdatasync d2/df/f1f 0 2023-12-17T11:57:43.363 INFO:tasks.workunit.client.1.smithi119.stdout:6/362: chown d2/d61 27890 1 2023-12-17T11:57:43.364 INFO:tasks.workunit.client.0.smithi002.stdout:9/467: symlink dc/d1d/d7c/d90/la3 0 2023-12-17T11:57:43.365 INFO:tasks.workunit.client.1.smithi119.stdout:3/462: mknod d9/d59/da6/cb0 0 2023-12-17T11:57:43.368 INFO:tasks.workunit.client.0.smithi002.stdout:7/413: mknod d6/d17/dc/d13/d21/d2e/d4a/c7b 0 2023-12-17T11:57:43.369 INFO:tasks.workunit.client.1.smithi119.stdout:2/438: mkdir d6/d9/d13/d34/d88/d9b 0 2023-12-17T11:57:43.372 INFO:tasks.workunit.client.0.smithi002.stdout:1/493: mkdir d3/d6/d9/d37/d39/d43/d4a/dac 0 2023-12-17T11:57:43.372 INFO:tasks.workunit.client.0.smithi002.stdout:1/494: truncate d3/d6/d9/f13 5724043 0 2023-12-17T11:57:43.373 INFO:tasks.workunit.client.0.smithi002.stdout:8/418: sync 2023-12-17T11:57:43.376 INFO:tasks.workunit.client.1.smithi119.stdout:8/344: dwrite d7/da/d11/d26/f58 [0,4194304] 0 2023-12-17T11:57:43.383 INFO:tasks.workunit.client.1.smithi119.stdout:0/314: rmdir d2/d16/d12/d2e/d44 39 2023-12-17T11:57:43.383 INFO:tasks.workunit.client.1.smithi119.stdout:1/391: rename d3/db/d26/d19/d3f/d64/c81 to d3/db/d17/d24/d20/d6c/c88 0 2023-12-17T11:57:43.383 INFO:tasks.workunit.client.0.smithi002.stdout:3/445: link d9/f1d d9/d1b/d35/d41/d59/d7c/f8b 0 2023-12-17T11:57:43.384 INFO:tasks.workunit.client.0.smithi002.stdout:0/373: dwrite d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:43.386 INFO:tasks.workunit.client.0.smithi002.stdout:7/414: unlink d6/f1c 0 2023-12-17T11:57:43.388 INFO:tasks.workunit.client.1.smithi119.stdout:4/409: unlink dd/d11/c50 0 2023-12-17T11:57:43.391 INFO:tasks.workunit.client.0.smithi002.stdout:8/419: creat d3/d8/d28/f8f x:0 0 0 2023-12-17T11:57:43.393 INFO:tasks.workunit.client.1.smithi119.stdout:6/363: creat d2/df/f6d x:0 0 0 2023-12-17T11:57:43.393 INFO:tasks.workunit.client.1.smithi119.stdout:6/364: chown d2/l5b 0 1 2023-12-17T11:57:43.396 INFO:tasks.workunit.client.0.smithi002.stdout:0/374: mkdir d0/d6/d26/d14/d19/d37/d62/d77 0 2023-12-17T11:57:43.402 INFO:tasks.workunit.client.1.smithi119.stdout:3/463: unlink d9/d11/c6c 0 2023-12-17T11:57:43.408 INFO:tasks.workunit.client.1.smithi119.stdout:0/315: truncate d2/d16/d12/d1f/f20 4721674 0 2023-12-17T11:57:43.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/422: read d3/d4/f5d [2685124,24050] 0 2023-12-17T11:57:43.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/423: stat d3/d4/d7/d14/c15 0 2023-12-17T11:57:43.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/424: chown d3/d4/d17/c25 130466901 1 2023-12-17T11:57:43.410 INFO:tasks.workunit.client.0.smithi002.stdout:0/375: unlink d0/d15/d59/c72 0 2023-12-17T11:57:43.410 INFO:tasks.workunit.client.0.smithi002.stdout:0/376: chown d0/d6/d26/f2d 81124 1 2023-12-17T11:57:43.411 INFO:tasks.workunit.client.1.smithi119.stdout:1/392: mkdir d3/d44/d89 0 2023-12-17T11:57:43.411 INFO:tasks.workunit.client.1.smithi119.stdout:1/393: write d3/d44/f5c [884180,15009] 0 2023-12-17T11:57:43.411 INFO:tasks.workunit.client.0.smithi002.stdout:4/404: dwrite d0/d10/d21/f5d [0,4194304] 0 2023-12-17T11:57:43.411 INFO:tasks.workunit.client.0.smithi002.stdout:4/405: chown d0/d10/d14/d27/f79 1 1 2023-12-17T11:57:43.412 INFO:tasks.workunit.client.1.smithi119.stdout:8/345: rename l5 to d7/da/d11/d26/d2c/l73 0 2023-12-17T11:57:43.414 INFO:tasks.workunit.client.0.smithi002.stdout:2/425: rename d3/d4/fd to d3/d4/d7/fa1 0 2023-12-17T11:57:43.421 INFO:tasks.workunit.client.1.smithi119.stdout:4/410: creat dd/d15/d16/d3d/f84 x:0 0 0 2023-12-17T11:57:43.421 INFO:tasks.workunit.client.1.smithi119.stdout:6/365: symlink d2/l6e 0 2023-12-17T11:57:43.422 INFO:tasks.workunit.client.0.smithi002.stdout:6/401: sync 2023-12-17T11:57:43.423 INFO:tasks.workunit.client.1.smithi119.stdout:3/464: mkdir d9/d44/d8d/db1 0 2023-12-17T11:57:43.423 INFO:tasks.workunit.client.1.smithi119.stdout:1/394: write d3/db/d17/d24/d20/d40/d6d/f6e [86470,117572] 0 2023-12-17T11:57:43.423 INFO:tasks.workunit.client.1.smithi119.stdout:1/395: chown d3/db/d17/d24/f53 174878 1 2023-12-17T11:57:43.424 INFO:tasks.workunit.client.0.smithi002.stdout:7/415: write d6/d17/dc/d13/f30 [1791577,69986] 0 2023-12-17T11:57:43.425 INFO:tasks.workunit.client.1.smithi119.stdout:5/434: dwrite d1/f17 [0,4194304] 0 2023-12-17T11:57:43.426 INFO:tasks.workunit.client.1.smithi119.stdout:5/435: read d1/d36/f47 [3227232,62914] 0 2023-12-17T11:57:43.426 INFO:tasks.workunit.client.1.smithi119.stdout:8/346: write d7/d18/f4f [1790978,38125] 0 2023-12-17T11:57:43.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/495: dwrite d3/d6/d9/d37/d39/fa6 [0,4194304] 0 2023-12-17T11:57:43.430 INFO:tasks.workunit.client.0.smithi002.stdout:1/496: fdatasync d3/d6/d16/d28/f58 0 2023-12-17T11:57:43.437 INFO:tasks.workunit.client.1.smithi119.stdout:6/366: rename d2/d2b/f4c to d2/d2b/f6f 0 2023-12-17T11:57:43.438 INFO:tasks.workunit.client.1.smithi119.stdout:3/465: truncate d9/f50 508649 0 2023-12-17T11:57:43.440 INFO:tasks.workunit.client.0.smithi002.stdout:6/402: mknod d0/d1/dc/d17/d40/c7d 0 2023-12-17T11:57:43.440 INFO:tasks.workunit.client.0.smithi002.stdout:0/377: rename d0/d6/d26/d14/d19/d2f/f60 to d0/d33/d57/f78 0 2023-12-17T11:57:43.440 INFO:tasks.workunit.client.0.smithi002.stdout:0/378: write d0/d6/d26/f3b [2798922,32446] 0 2023-12-17T11:57:43.440 INFO:tasks.workunit.client.0.smithi002.stdout:0/379: getdents d0/d6/d26/d14/d19/d37/d62/d77 0 2023-12-17T11:57:43.441 INFO:tasks.workunit.client.0.smithi002.stdout:2/426: dread d3/d4/d7/d14/f9f [0,4194304] 0 2023-12-17T11:57:43.441 INFO:tasks.workunit.client.0.smithi002.stdout:2/427: chown d3/d4/d17/l55 6332711 1 2023-12-17T11:57:43.441 INFO:tasks.workunit.client.0.smithi002.stdout:2/428: fsync d3/d4/d7/d14/d2e/f7b 0 2023-12-17T11:57:43.447 INFO:tasks.workunit.client.1.smithi119.stdout:6/367: write d2/d2b/d43/d5e/f69 [110267,40334] 0 2023-12-17T11:57:43.447 INFO:tasks.workunit.client.1.smithi119.stdout:1/396: dread d3/db/d17/d24/f37 [0,4194304] 0 2023-12-17T11:57:43.447 INFO:tasks.workunit.client.0.smithi002.stdout:7/416: link d6/d17/dc/d67/c1f d6/d17/dc/d13/d21/d2e/d4a/d53/d75/c7c 0 2023-12-17T11:57:43.448 INFO:tasks.workunit.client.1.smithi119.stdout:2/439: dwrite d6/f33 [0,4194304] 0 2023-12-17T11:57:43.448 INFO:tasks.workunit.client.1.smithi119.stdout:2/440: chown d6/d9/d13/c49 10555894 1 2023-12-17T11:57:43.448 INFO:tasks.workunit.client.1.smithi119.stdout:2/441: chown d6/d9/c29 86033 1 2023-12-17T11:57:43.449 INFO:tasks.workunit.client.0.smithi002.stdout:5/405: dwrite dc/d2b/f35 [0,4194304] 0 2023-12-17T11:57:43.450 INFO:tasks.workunit.client.1.smithi119.stdout:5/436: creat d1/d25/d39/d71/d82/f89 x:0 0 0 2023-12-17T11:57:43.457 INFO:tasks.workunit.client.1.smithi119.stdout:3/466: link d9/d11/c1d d9/d44/d8d/cb2 0 2023-12-17T11:57:43.459 INFO:tasks.workunit.client.1.smithi119.stdout:4/411: dwrite dd/d15/f2e [0,4194304] 0 2023-12-17T11:57:43.460 INFO:tasks.workunit.client.0.smithi002.stdout:6/403: rename d0/la to d0/d1/d5b/l7e 0 2023-12-17T11:57:43.462 INFO:tasks.workunit.client.1.smithi119.stdout:6/368: creat d2/d2b/d43/d5e/f70 x:0 0 0 2023-12-17T11:57:43.462 INFO:tasks.workunit.client.1.smithi119.stdout:6/369: write d2/f4 [3718965,97049] 0 2023-12-17T11:57:43.462 INFO:tasks.workunit.client.1.smithi119.stdout:6/370: creat d2/f71 x:0 0 0 2023-12-17T11:57:43.463 INFO:tasks.workunit.client.1.smithi119.stdout:1/397: mkdir d3/d44/d89/d8a 0 2023-12-17T11:57:43.465 INFO:tasks.workunit.client.1.smithi119.stdout:2/442: getdents d6/d38/d96 0 2023-12-17T11:57:43.467 INFO:tasks.workunit.client.1.smithi119.stdout:7/412: sync 2023-12-17T11:57:43.468 INFO:tasks.workunit.client.0.smithi002.stdout:5/406: creat dc/d2b/d6c/f8d x:0 0 0 2023-12-17T11:57:43.470 INFO:tasks.workunit.client.0.smithi002.stdout:5/407: mkdir dc/d8e 0 2023-12-17T11:57:43.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/408: truncate dc/f3e 4018548 0 2023-12-17T11:57:43.474 INFO:tasks.workunit.client.1.smithi119.stdout:5/437: getdents d1/d25/d39/d71/d82/d86 0 2023-12-17T11:57:43.476 INFO:tasks.workunit.client.0.smithi002.stdout:8/420: dwrite d3/d8/d28/d31/d5a/d7c/f7d [4194304,4194304] 0 2023-12-17T11:57:43.479 INFO:tasks.workunit.client.1.smithi119.stdout:3/467: mkdir d9/d11/d1e/d55/d65/d84/d9d/db3 0 2023-12-17T11:57:43.479 INFO:tasks.workunit.client.1.smithi119.stdout:3/468: readlink d9/da/df/d41/d33/l38 0 2023-12-17T11:57:43.480 INFO:tasks.workunit.client.0.smithi002.stdout:4/406: dwrite d0/d10/f39 [4194304,4194304] 0 2023-12-17T11:57:43.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/497: dread d3/f83 [0,4194304] 0 2023-12-17T11:57:43.480 INFO:tasks.workunit.client.0.smithi002.stdout:1/498: write d3/d6/d16/d61/f6f [404133,20817] 0 2023-12-17T11:57:43.480 INFO:tasks.workunit.client.1.smithi119.stdout:7/413: dread d2/f24 [4194304,4194304] 0 2023-12-17T11:57:43.481 INFO:tasks.workunit.client.1.smithi119.stdout:7/414: fsync d2/d4e/f37 0 2023-12-17T11:57:43.489 INFO:tasks.workunit.client.1.smithi119.stdout:6/371: rename d2/c20 to d2/d61/c72 0 2023-12-17T11:57:43.489 INFO:tasks.workunit.client.1.smithi119.stdout:6/372: chown d2/d2b/d43/l46 452 1 2023-12-17T11:57:43.490 INFO:tasks.workunit.client.1.smithi119.stdout:6/373: truncate d2/df/f4b 2013509 0 2023-12-17T11:57:43.493 INFO:tasks.workunit.client.1.smithi119.stdout:1/398: mknod d3/db/d17/d24/d20/d40/d76/d84/c8b 0 2023-12-17T11:57:43.495 INFO:tasks.workunit.client.1.smithi119.stdout:2/443: symlink d6/d9/d52/d53/d55/d58/d6b/l9c 0 2023-12-17T11:57:43.498 INFO:tasks.workunit.client.0.smithi002.stdout:8/421: mkdir d3/d7/d6e/d7f/d90 0 2023-12-17T11:57:43.498 INFO:tasks.workunit.client.0.smithi002.stdout:8/422: write d3/d8/d28/f8f [431419,37028] 0 2023-12-17T11:57:43.501 INFO:tasks.workunit.client.0.smithi002.stdout:1/499: truncate d3/d6/d9/d30/f4c 545473 0 2023-12-17T11:57:43.506 INFO:tasks.workunit.client.1.smithi119.stdout:3/469: rmdir d9/d44/d8d/db1 0 2023-12-17T11:57:43.508 INFO:tasks.workunit.client.1.smithi119.stdout:7/415: symlink d2/d4/d11/d2c/l82 0 2023-12-17T11:57:43.512 INFO:tasks.workunit.client.1.smithi119.stdout:4/412: rmdir dd/d15/d16 39 2023-12-17T11:57:43.515 INFO:tasks.workunit.client.1.smithi119.stdout:6/374: truncate d2/d2b/d43/f4a 143500 0 2023-12-17T11:57:43.516 INFO:tasks.workunit.client.1.smithi119.stdout:1/399: rmdir d3/d44/d89/d8a 0 2023-12-17T11:57:43.519 INFO:tasks.workunit.client.1.smithi119.stdout:2/444: link d6/d9/d52/d53/d55/c35 d6/d9/d86/c9d 0 2023-12-17T11:57:43.522 INFO:tasks.workunit.client.1.smithi119.stdout:6/375: mknod d2/df/d17/c73 0 2023-12-17T11:57:43.523 INFO:tasks.workunit.client.1.smithi119.stdout:7/416: dread d2/d4/d70/d57/d56/f62 [0,4194304] 0 2023-12-17T11:57:43.526 INFO:tasks.workunit.client.1.smithi119.stdout:1/400: symlink d3/db/l8c 0 2023-12-17T11:57:43.532 INFO:tasks.workunit.client.1.smithi119.stdout:7/417: creat d2/d4/d11/d3c/d75/f83 x:0 0 0 2023-12-17T11:57:43.532 INFO:tasks.workunit.client.1.smithi119.stdout:5/438: fsync d1/d25/d39/d71/d82/f89 0 2023-12-17T11:57:43.534 INFO:tasks.workunit.client.1.smithi119.stdout:1/401: truncate d3/db/d26/d19/f1e 1097366 0 2023-12-17T11:57:43.537 INFO:tasks.workunit.client.1.smithi119.stdout:3/470: rename d9/da/df/d41/d33/d5a to d9/da/df/d41/d33/db4 0 2023-12-17T11:57:43.538 INFO:tasks.workunit.client.1.smithi119.stdout:6/376: dread d2/df/f55 [0,4194304] 0 2023-12-17T11:57:43.539 INFO:tasks.workunit.client.0.smithi002.stdout:7/417: dread d6/d17/dc/d13/d37/d4f/f63 [0,4194304] 0 2023-12-17T11:57:43.540 INFO:tasks.workunit.client.1.smithi119.stdout:7/418: creat d2/d4/d11/d2c/d68/f84 x:0 0 0 2023-12-17T11:57:43.540 INFO:tasks.workunit.client.1.smithi119.stdout:7/419: fsync d2/d4/d70/f64 0 2023-12-17T11:57:43.540 INFO:tasks.workunit.client.1.smithi119.stdout:7/420: stat d2/d4/d1f/f5c 0 2023-12-17T11:57:43.543 INFO:tasks.workunit.client.0.smithi002.stdout:2/429: dwrite d3/d4/d7/d14/d1b/f29 [0,4194304] 0 2023-12-17T11:57:43.545 INFO:tasks.workunit.client.1.smithi119.stdout:8/347: dwrite d7/da/d11/d26/f58 [0,4194304] 0 2023-12-17T11:57:43.548 INFO:tasks.workunit.client.0.smithi002.stdout:6/404: dwrite d0/d1/d28/f3d [0,4194304] 0 2023-12-17T11:57:43.549 INFO:tasks.workunit.client.0.smithi002.stdout:8/423: dwrite d3/d8/f42 [0,4194304] 0 2023-12-17T11:57:43.550 INFO:tasks.workunit.client.0.smithi002.stdout:8/424: fsync d3/d7/d18/d3f/f60 0 2023-12-17T11:57:43.550 INFO:tasks.workunit.client.0.smithi002.stdout:8/425: write d3/d7/d18/d3f/f60 [4132142,35883] 0 2023-12-17T11:57:43.550 INFO:tasks.workunit.client.0.smithi002.stdout:8/426: fsync d3/d8/d28/d31/d5a/d7c/f7e 0 2023-12-17T11:57:43.550 INFO:tasks.workunit.client.1.smithi119.stdout:3/471: mknod d9/d11/d1e/d55/d65/d84/d98/cb5 0 2023-12-17T11:57:43.554 INFO:tasks.workunit.client.1.smithi119.stdout:6/377: unlink d2/d2b/d43/d5e/c65 0 2023-12-17T11:57:43.554 INFO:tasks.workunit.client.1.smithi119.stdout:6/378: truncate d2/f59 734788 0 2023-12-17T11:57:43.555 INFO:tasks.workunit.client.0.smithi002.stdout:4/407: dwrite d0/d10/d14/d27/f79 [0,4194304] 0 2023-12-17T11:57:43.555 INFO:tasks.workunit.client.0.smithi002.stdout:4/408: write d0/d10/d14/f70 [978633,81266] 0 2023-12-17T11:57:43.555 INFO:tasks.workunit.client.0.smithi002.stdout:7/418: creat d6/d17/dc/d13/d37/d4c/d24/f7d x:0 0 0 2023-12-17T11:57:43.556 INFO:tasks.workunit.client.1.smithi119.stdout:5/439: rmdir d1/d44 39 2023-12-17T11:57:43.558 INFO:tasks.workunit.client.0.smithi002.stdout:2/430: creat d3/d4/d17/d19/d4d/fa2 x:0 0 0 2023-12-17T11:57:43.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/427: read d3/d8/da/f8a [229223,114754] 0 2023-12-17T11:57:43.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/428: chown d3/d8/l2e 23780 1 2023-12-17T11:57:43.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/429: chown d3/d8/d28/l51 9587665 1 2023-12-17T11:57:43.563 INFO:tasks.workunit.client.0.smithi002.stdout:8/430: chown d3/d7/d6e/d7f/f54 3906580 1 2023-12-17T11:57:43.564 INFO:tasks.workunit.client.1.smithi119.stdout:8/348: truncate d7/d18/d15/f21 314444 0 2023-12-17T11:57:43.565 INFO:tasks.workunit.client.1.smithi119.stdout:4/413: dwrite dd/d11/f5e [0,4194304] 0 2023-12-17T11:57:43.567 INFO:tasks.workunit.client.0.smithi002.stdout:7/419: write d6/d17/dc/d13/d37/d4f/f63 [3153313,46501] 0 2023-12-17T11:57:43.568 INFO:tasks.workunit.client.1.smithi119.stdout:3/472: creat d9/d11/d1e/d55/d65/fb6 x:0 0 0 2023-12-17T11:57:43.569 INFO:tasks.workunit.client.0.smithi002.stdout:6/405: mkdir d0/d1/dc/d17/d67/d6c/d7f 0 2023-12-17T11:57:43.570 INFO:tasks.workunit.client.0.smithi002.stdout:6/406: chown d0/d1/d21/d56/f78 98 1 2023-12-17T11:57:43.571 INFO:tasks.workunit.client.1.smithi119.stdout:6/379: mknod d2/d2b/c74 0 2023-12-17T11:57:43.571 INFO:tasks.workunit.client.1.smithi119.stdout:6/380: stat d2/df/f1f 0 2023-12-17T11:57:43.573 INFO:tasks.workunit.client.1.smithi119.stdout:5/440: symlink d1/d70/l8a 0 2023-12-17T11:57:43.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/431: dread d3/d4/d7/d14/d1b/f26 [0,4194304] 0 2023-12-17T11:57:43.580 INFO:tasks.workunit.client.1.smithi119.stdout:9/462: sync 2023-12-17T11:57:43.583 INFO:tasks.workunit.client.1.smithi119.stdout:7/421: write d2/d4/d11/d3c/d75/f7f [337678,39523] 0 2023-12-17T11:57:43.583 INFO:tasks.workunit.client.1.smithi119.stdout:7/422: chown d2/d4/d70/d57/d56/f59 13 1 2023-12-17T11:57:43.584 INFO:tasks.workunit.client.1.smithi119.stdout:2/445: dwrite d6/d9/fd [0,4194304] 0 2023-12-17T11:57:43.591 INFO:tasks.workunit.client.0.smithi002.stdout:4/409: getdents d0/d10/d21/d33 0 2023-12-17T11:57:43.592 INFO:tasks.workunit.client.1.smithi119.stdout:4/414: dread dd/f1b [0,4194304] 0 2023-12-17T11:57:43.592 INFO:tasks.workunit.client.1.smithi119.stdout:4/415: readlink dd/d15/d16/l23 0 2023-12-17T11:57:43.592 INFO:tasks.workunit.client.1.smithi119.stdout:8/349: creat d7/d12/d69/f74 x:0 0 0 2023-12-17T11:57:43.594 INFO:tasks.workunit.client.0.smithi002.stdout:8/431: rename d3/l12 to d3/d8/da/l91 0 2023-12-17T11:57:43.595 INFO:tasks.workunit.client.1.smithi119.stdout:1/402: dwrite d3/f65 [0,4194304] 0 2023-12-17T11:57:43.597 INFO:tasks.workunit.client.0.smithi002.stdout:2/432: write d3/d4/d17/d19/d4d/d72/d77/f7a [1519887,48531] 0 2023-12-17T11:57:43.600 INFO:tasks.workunit.client.1.smithi119.stdout:3/473: truncate d9/fc 1384888 0 2023-12-17T11:57:43.602 INFO:tasks.workunit.client.0.smithi002.stdout:8/432: read d3/d7/d1a/f6a [33301,17806] 0 2023-12-17T11:57:43.603 INFO:tasks.workunit.client.1.smithi119.stdout:6/381: mknod d2/d2b/d43/c75 0 2023-12-17T11:57:43.607 INFO:tasks.workunit.client.0.smithi002.stdout:5/409: write dc/f3e [2183977,32357] 0 2023-12-17T11:57:43.607 INFO:tasks.workunit.client.1.smithi119.stdout:5/441: rename d1/d36/c5e to d1/d44/d52/c8b 0 2023-12-17T11:57:43.608 INFO:tasks.workunit.client.1.smithi119.stdout:4/416: write dd/d15/d16/f51 [46161,126283] 0 2023-12-17T11:57:43.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/420: creat d6/d17/dc/d13/d21/d6e/f7e x:0 0 0 2023-12-17T11:57:43.612 INFO:tasks.workunit.client.1.smithi119.stdout:9/463: mkdir d12/d1d/d28/d46/d50/d92 0 2023-12-17T11:57:43.617 INFO:tasks.workunit.client.0.smithi002.stdout:6/407: dwrite d0/d1/d21/d56/d60/f62 [0,4194304] 0 2023-12-17T11:57:43.618 INFO:tasks.workunit.client.1.smithi119.stdout:2/446: mknod d6/d9/d13/d34/c9e 0 2023-12-17T11:57:43.618 INFO:tasks.workunit.client.1.smithi119.stdout:2/447: fdatasync d6/d9/d52/d53/d55/d58/f68 0 2023-12-17T11:57:43.621 INFO:tasks.workunit.client.1.smithi119.stdout:8/350: truncate d7/d12/d69/d2a/f62 3307499 0 2023-12-17T11:57:43.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/410: truncate dc/d1a/f48 644258 0 2023-12-17T11:57:43.628 INFO:tasks.workunit.client.0.smithi002.stdout:7/421: creat d6/d17/dc/d13/d21/d2e/f7f x:0 0 0 2023-12-17T11:57:43.628 INFO:tasks.workunit.client.0.smithi002.stdout:7/422: write d6/f44 [596320,49303] 0 2023-12-17T11:57:43.628 INFO:tasks.workunit.client.0.smithi002.stdout:7/423: creat d6/d17/dc/d13/d37/d4f/f80 x:0 0 0 2023-12-17T11:57:43.633 INFO:tasks.workunit.client.0.smithi002.stdout:2/433: rmdir d3/d4/d17/d19/d4d/d72/d83/d94 39 2023-12-17T11:57:43.637 INFO:tasks.workunit.client.0.smithi002.stdout:6/408: rmdir d0/d1/d21/d56/d60 39 2023-12-17T11:57:43.639 INFO:tasks.workunit.client.1.smithi119.stdout:5/442: creat d1/d44/d52/f8c x:0 0 0 2023-12-17T11:57:43.639 INFO:tasks.workunit.client.1.smithi119.stdout:5/443: chown d1/d44/d52/l58 1 1 2023-12-17T11:57:43.639 INFO:tasks.workunit.client.1.smithi119.stdout:1/403: rename d3/db/d26/d19/d3f/c79 to d3/db/d26/c8d 0 2023-12-17T11:57:43.640 INFO:tasks.workunit.client.1.smithi119.stdout:1/404: creat d3/db/d17/f8e x:0 0 0 2023-12-17T11:57:43.642 INFO:tasks.workunit.client.0.smithi002.stdout:8/433: rmdir d3/d7/d1a 39 2023-12-17T11:57:43.642 INFO:tasks.workunit.client.0.smithi002.stdout:8/434: write d3/d8/d28/d31/d5a/d7c/f89 [6559,67000] 0 2023-12-17T11:57:43.643 INFO:tasks.workunit.client.1.smithi119.stdout:4/417: unlink c3 0 2023-12-17T11:57:43.645 INFO:tasks.workunit.client.1.smithi119.stdout:2/448: chown d6/f40 944916973 1 2023-12-17T11:57:43.645 INFO:tasks.workunit.client.1.smithi119.stdout:2/449: creat d6/d9/d52/d53/d55/d58/d6b/f9f x:0 0 0 2023-12-17T11:57:43.645 INFO:tasks.workunit.client.1.smithi119.stdout:2/450: stat d6/d2b/d4b 0 2023-12-17T11:57:43.645 INFO:tasks.workunit.client.1.smithi119.stdout:2/451: creat d6/d9/d13/d34/fa0 x:0 0 0 2023-12-17T11:57:43.646 INFO:tasks.workunit.client.1.smithi119.stdout:2/452: creat d6/d2b/d4b/d5d/fa1 x:0 0 0 2023-12-17T11:57:43.647 INFO:tasks.workunit.client.0.smithi002.stdout:7/424: unlink d6/d17/dc/d67/l1b 0 2023-12-17T11:57:43.649 INFO:tasks.workunit.client.0.smithi002.stdout:2/434: creat d3/d4/d17/d19/d4d/d72/fa3 x:0 0 0 2023-12-17T11:57:43.649 INFO:tasks.workunit.client.0.smithi002.stdout:2/435: read d3/d4/f5d [1403699,99188] 0 2023-12-17T11:57:43.649 INFO:tasks.workunit.client.1.smithi119.stdout:6/382: rmdir d2/d2b/d43/d5e 39 2023-12-17T11:57:43.650 INFO:tasks.workunit.client.0.smithi002.stdout:6/409: truncate d0/f48 12789 0 2023-12-17T11:57:43.656 INFO:tasks.workunit.client.1.smithi119.stdout:5/444: mknod d1/d25/d39/d71/c8d 0 2023-12-17T11:57:43.656 INFO:tasks.workunit.client.1.smithi119.stdout:5/445: chown d1/d25/f38 4 1 2023-12-17T11:57:43.657 INFO:tasks.workunit.client.0.smithi002.stdout:8/435: symlink d3/d7/l92 0 2023-12-17T11:57:43.660 INFO:tasks.workunit.client.1.smithi119.stdout:3/474: rename d9/d11/d87/da3 to d9/d44/db7 0 2023-12-17T11:57:43.662 INFO:tasks.workunit.client.0.smithi002.stdout:4/410: dwrite d0/f19 [0,4194304] 0 2023-12-17T11:57:43.663 INFO:tasks.workunit.client.0.smithi002.stdout:2/436: mknod d3/d4/d17/d19/d4d/ca4 0 2023-12-17T11:57:43.663 INFO:tasks.workunit.client.0.smithi002.stdout:2/437: stat d3/d4/d7/d14/d2e 0 2023-12-17T11:57:43.664 INFO:tasks.workunit.client.0.smithi002.stdout:7/425: read d6/d17/dc/d13/d37/f3c [5347005,91337] 0 2023-12-17T11:57:43.665 INFO:tasks.workunit.client.1.smithi119.stdout:9/464: dwrite d12/d1d/d49/f77 [4194304,4194304] 0 2023-12-17T11:57:43.665 INFO:tasks.workunit.client.0.smithi002.stdout:8/436: rmdir d3/d7/d1a 39 2023-12-17T11:57:43.666 INFO:tasks.workunit.client.0.smithi002.stdout:8/437: write d3/d7/d6e/d7f/f3a [3966977,68052] 0 2023-12-17T11:57:43.666 INFO:tasks.workunit.client.1.smithi119.stdout:1/405: mkdir d3/db/d26/d8f 0 2023-12-17T11:57:43.667 INFO:tasks.workunit.client.1.smithi119.stdout:1/406: fsync d3/db/d26/f55 0 2023-12-17T11:57:43.671 INFO:tasks.workunit.client.1.smithi119.stdout:4/418: mknod dd/d2a/d55/d81/c85 0 2023-12-17T11:57:43.678 INFO:tasks.workunit.client.1.smithi119.stdout:2/453: mknod d6/d9/d52/d53/d55/d58/d6b/ca2 0 2023-12-17T11:57:43.679 INFO:tasks.workunit.client.1.smithi119.stdout:2/454: write d6/d2b/d4b/d5d/f90 [229313,95414] 0 2023-12-17T11:57:43.682 INFO:tasks.workunit.client.0.smithi002.stdout:6/410: dread d0/d1/dc/d17/f1e [0,4194304] 0 2023-12-17T11:57:43.682 INFO:tasks.workunit.client.0.smithi002.stdout:6/411: write d0/d1/dc/f34 [1490805,112788] 0 2023-12-17T11:57:43.683 INFO:tasks.workunit.client.0.smithi002.stdout:6/412: chown d0/d1/dc/d10 18531 1 2023-12-17T11:57:43.683 INFO:tasks.workunit.client.0.smithi002.stdout:8/438: dread d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:43.684 INFO:tasks.workunit.client.1.smithi119.stdout:3/475: mkdir d9/d11/d1e/d55/d65/d84/d9d/db8 0 2023-12-17T11:57:43.685 INFO:tasks.workunit.client.1.smithi119.stdout:3/476: stat d9/c63 0 2023-12-17T11:57:43.685 INFO:tasks.workunit.client.0.smithi002.stdout:4/411: symlink d0/d3e/d56/l87 0 2023-12-17T11:57:43.689 INFO:tasks.workunit.client.0.smithi002.stdout:2/438: creat d3/d4/d17/fa5 x:0 0 0 2023-12-17T11:57:43.689 INFO:tasks.workunit.client.0.smithi002.stdout:2/439: chown d3/d4/l9 0 1 2023-12-17T11:57:43.689 INFO:tasks.workunit.client.0.smithi002.stdout:2/440: chown d3/d4/d17/l55 4057 1 2023-12-17T11:57:43.690 INFO:tasks.workunit.client.1.smithi119.stdout:0/316: sync 2023-12-17T11:57:43.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/441: write d3/d4/d17/d19/f67 [652544,7160] 0 2023-12-17T11:57:43.690 INFO:tasks.workunit.client.0.smithi002.stdout:2/442: readlink d3/d4/d7/d14/d1b/l1d 0 2023-12-17T11:57:43.690 INFO:tasks.workunit.client.0.smithi002.stdout:5/411: dwrite dc/d1b/f6e [4194304,4194304] 0 2023-12-17T11:57:43.693 INFO:tasks.workunit.client.1.smithi119.stdout:8/351: dwrite d7/da/d11/d26/d2c/f6a [0,4194304] 0 2023-12-17T11:57:43.695 INFO:tasks.workunit.client.0.smithi002.stdout:7/426: mkdir d6/d81 0 2023-12-17T11:57:43.695 INFO:tasks.workunit.client.1.smithi119.stdout:9/465: mknod d12/d1d/d40/c93 0 2023-12-17T11:57:43.696 INFO:tasks.workunit.client.1.smithi119.stdout:9/466: chown d12/d1d/d28/d4d/d73/f74 284 1 2023-12-17T11:57:43.696 INFO:tasks.workunit.client.1.smithi119.stdout:9/467: chown d12/d1d/d28/f87 2 1 2023-12-17T11:57:43.697 INFO:tasks.workunit.client.1.smithi119.stdout:1/407: dread d3/fa [0,4194304] 0 2023-12-17T11:57:43.698 INFO:tasks.workunit.client.1.smithi119.stdout:6/383: dwrite d2/d2b/d43/d5e/f70 [0,4194304] 0 2023-12-17T11:57:43.702 INFO:tasks.workunit.client.0.smithi002.stdout:4/412: symlink d0/l88 0 2023-12-17T11:57:43.702 INFO:tasks.workunit.client.0.smithi002.stdout:4/413: dread - d0/f83 zero size 2023-12-17T11:57:43.702 INFO:tasks.workunit.client.0.smithi002.stdout:4/414: fsync d0/d10/d21/f2f 0 2023-12-17T11:57:43.702 INFO:tasks.workunit.client.0.smithi002.stdout:4/415: dread - d0/d5a/f71 zero size 2023-12-17T11:57:43.703 INFO:tasks.workunit.client.1.smithi119.stdout:3/477: mknod d9/d59/da6/cb9 0 2023-12-17T11:57:43.705 INFO:tasks.workunit.client.0.smithi002.stdout:2/443: truncate d3/d4/d7/d14/f9f 2018986 0 2023-12-17T11:57:43.705 INFO:tasks.workunit.client.0.smithi002.stdout:2/444: write d3/d4/d17/d19/f7c [2113592,22741] 0 2023-12-17T11:57:43.705 INFO:tasks.workunit.client.0.smithi002.stdout:2/445: fsync d3/d4/d7/d14/d1b/f29 0 2023-12-17T11:57:43.707 INFO:tasks.workunit.client.1.smithi119.stdout:0/317: rename d2/d16/d12/f25 to d2/d16/d12/d1f/d24/d50/f59 0 2023-12-17T11:57:43.711 INFO:tasks.workunit.client.1.smithi119.stdout:8/352: mkdir d7/da/d11/d26/d2c/d75 0 2023-12-17T11:57:43.713 INFO:tasks.workunit.client.0.smithi002.stdout:5/412: symlink dc/l8f 0 2023-12-17T11:57:43.713 INFO:tasks.workunit.client.0.smithi002.stdout:5/413: creat dc/d2b/f90 x:0 0 0 2023-12-17T11:57:43.714 INFO:tasks.workunit.client.0.smithi002.stdout:9/468: sync 2023-12-17T11:57:43.714 INFO:tasks.workunit.client.1.smithi119.stdout:9/468: unlink d12/d1d/l45 0 2023-12-17T11:57:43.714 INFO:tasks.workunit.client.1.smithi119.stdout:9/469: chown d12/d65/f7d 273475 1 2023-12-17T11:57:43.722 INFO:tasks.workunit.client.0.smithi002.stdout:2/446: rmdir d3/d4/d7/d14/d2e 39 2023-12-17T11:57:43.722 INFO:tasks.workunit.client.1.smithi119.stdout:4/419: dwrite dd/f71 [0,4194304] 0 2023-12-17T11:57:43.723 INFO:tasks.workunit.client.1.smithi119.stdout:5/446: getdents d1/d36 0 2023-12-17T11:57:43.726 INFO:tasks.workunit.client.1.smithi119.stdout:6/384: unlink d2/d2b/d43/f5c 0 2023-12-17T11:57:43.729 INFO:tasks.workunit.client.1.smithi119.stdout:2/455: getdents d6/d9/d52/d53/d55/d58 0 2023-12-17T11:57:43.733 INFO:tasks.workunit.client.0.smithi002.stdout:5/414: rename dc/d1b/d5a/l70 to dc/d1a/d53/l91 0 2023-12-17T11:57:43.735 INFO:tasks.workunit.client.1.smithi119.stdout:3/478: rename d9/d11/d1e/d55/d77/c78 to d9/d11/d1e/d55/d77/cba 0 2023-12-17T11:57:43.735 INFO:tasks.workunit.client.1.smithi119.stdout:3/479: chown d9/da/df/d41/d33/db4/l6b 23 1 2023-12-17T11:57:43.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/469: creat dc/d42/da0/d82/fa4 x:0 0 0 2023-12-17T11:57:43.739 INFO:tasks.workunit.client.1.smithi119.stdout:0/318: rmdir d2/d16/d12/d2e/d44 39 2023-12-17T11:57:43.746 INFO:tasks.workunit.client.0.smithi002.stdout:2/447: mkdir d3/d4/d8b/da6 0 2023-12-17T11:57:43.747 INFO:tasks.workunit.client.0.smithi002.stdout:6/413: dwrite d0/d1/d21/d56/f78 [0,4194304] 0 2023-12-17T11:57:43.748 INFO:tasks.workunit.client.0.smithi002.stdout:9/470: rename dc/d42/d4f/d59/f30 to dc/d42/da0/d72/d93/d52/fa5 0 2023-12-17T11:57:43.751 INFO:tasks.workunit.client.1.smithi119.stdout:5/447: dread d1/f1e [0,4194304] 0 2023-12-17T11:57:43.751 INFO:tasks.workunit.client.1.smithi119.stdout:5/448: write d1/d25/f31 [570880,104799] 0 2023-12-17T11:57:43.752 INFO:tasks.workunit.client.1.smithi119.stdout:6/385: getdents d2/d41 0 2023-12-17T11:57:43.753 INFO:tasks.workunit.client.1.smithi119.stdout:2/456: mkdir d6/d2b/da3 0 2023-12-17T11:57:43.755 INFO:tasks.workunit.client.0.smithi002.stdout:2/448: write d3/d4/d7/d14/d2e/f7b [1217177,20848] 0 2023-12-17T11:57:43.756 INFO:tasks.workunit.client.1.smithi119.stdout:2/457: write d6/f8a [351592,74826] 0 2023-12-17T11:57:43.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/471: creat dc/d42/da0/d72/d93/d52/fa6 x:0 0 0 2023-12-17T11:57:43.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/472: creat dc/d42/d4f/d59/d47/d4b/fa7 x:0 0 0 2023-12-17T11:57:43.759 INFO:tasks.workunit.client.0.smithi002.stdout:9/473: fdatasync dc/d32/f7a 0 2023-12-17T11:57:43.760 INFO:tasks.workunit.client.0.smithi002.stdout:9/474: stat dc/d1d/f69 0 2023-12-17T11:57:43.761 INFO:tasks.workunit.client.1.smithi119.stdout:0/319: creat d2/d16/f5a x:0 0 0 2023-12-17T11:57:43.764 INFO:tasks.workunit.client.0.smithi002.stdout:2/449: mkdir d3/d4/d17/d19/d4d/d72/d77/da7 0 2023-12-17T11:57:43.764 INFO:tasks.workunit.client.0.smithi002.stdout:2/450: creat d3/d4/d7/d14/fa8 x:0 0 0 2023-12-17T11:57:43.766 INFO:tasks.workunit.client.0.smithi002.stdout:7/427: getdents d6/d17/dc/d13/d37/d4f 0 2023-12-17T11:57:43.767 INFO:tasks.workunit.client.1.smithi119.stdout:6/386: mkdir d2/d2b/d43/d76 0 2023-12-17T11:57:43.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/480: link d9/d11/d1e/l53 d9/d11/d1e/d55/d65/d84/d98/lbb 0 2023-12-17T11:57:43.769 INFO:tasks.workunit.client.1.smithi119.stdout:3/481: read - d9/da/f54 zero size 2023-12-17T11:57:43.772 INFO:tasks.workunit.client.1.smithi119.stdout:1/408: dwrite d3/db/d17/d24/d20/d40/f5b [0,4194304] 0 2023-12-17T11:57:43.773 INFO:tasks.workunit.client.1.smithi119.stdout:9/470: dwrite d12/d1d/d28/d4d/f5e [4194304,4194304] 0 2023-12-17T11:57:43.774 INFO:tasks.workunit.client.1.smithi119.stdout:2/458: symlink d6/d2b/d3f/d5c/la4 0 2023-12-17T11:57:43.776 INFO:tasks.workunit.client.0.smithi002.stdout:5/415: dread dc/f18 [0,4194304] 0 2023-12-17T11:57:43.776 INFO:tasks.workunit.client.0.smithi002.stdout:5/416: fdatasync dc/f83 0 2023-12-17T11:57:43.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/439: dwrite d3/d7/d18/d3f/f57 [0,4194304] 0 2023-12-17T11:57:43.780 INFO:tasks.workunit.client.1.smithi119.stdout:0/320: link d2/d3/d5/l1b d2/d16/d12/d1f/d24/l5b 0 2023-12-17T11:57:43.784 INFO:tasks.workunit.client.1.smithi119.stdout:1/409: rename d3/db/d17/l85 to d3/db/d26/l90 0 2023-12-17T11:57:43.790 INFO:tasks.workunit.client.1.smithi119.stdout:9/471: mknod d12/d1d/d28/c94 0 2023-12-17T11:57:43.790 INFO:tasks.workunit.client.0.smithi002.stdout:9/475: symlink dc/d42/da0/d72/d93/d52/la8 0 2023-12-17T11:57:43.790 INFO:tasks.workunit.client.0.smithi002.stdout:9/476: write dc/d42/d4f/d59/d47/f5c [869102,96530] 0 2023-12-17T11:57:43.790 INFO:tasks.workunit.client.1.smithi119.stdout:2/459: mkdir d6/d9/d52/d53/d55/d58/da5 0 2023-12-17T11:57:43.792 INFO:tasks.workunit.client.0.smithi002.stdout:2/451: creat d3/d4/d7/d14/d42/fa9 x:0 0 0 2023-12-17T11:57:43.793 INFO:tasks.workunit.client.0.smithi002.stdout:2/452: creat d3/d4/d7/d14/faa x:0 0 0 2023-12-17T11:57:43.793 INFO:tasks.workunit.client.1.smithi119.stdout:1/410: mkdir d3/db/d17/d24/d91 0 2023-12-17T11:57:43.794 INFO:tasks.workunit.client.1.smithi119.stdout:6/387: write d2/df/d17/f34 [1600549,90340] 0 2023-12-17T11:57:43.794 INFO:tasks.workunit.client.0.smithi002.stdout:3/446: sync 2023-12-17T11:57:43.795 INFO:tasks.workunit.client.0.smithi002.stdout:0/380: sync 2023-12-17T11:57:43.795 INFO:tasks.workunit.client.1.smithi119.stdout:6/388: creat d2/df/d17/f77 x:0 0 0 2023-12-17T11:57:43.799 INFO:tasks.workunit.client.1.smithi119.stdout:9/472: symlink d12/d1d/d28/d4d/d73/l95 0 2023-12-17T11:57:43.799 INFO:tasks.workunit.client.1.smithi119.stdout:9/473: chown d12/d1d/f2f 921 1 2023-12-17T11:57:43.804 INFO:tasks.workunit.client.1.smithi119.stdout:1/411: link d3/c1c d3/d44/d89/c92 0 2023-12-17T11:57:43.804 INFO:tasks.workunit.client.1.smithi119.stdout:5/449: dwrite d1/d36/f3d [4194304,4194304] 0 2023-12-17T11:57:43.807 INFO:tasks.workunit.client.0.smithi002.stdout:1/500: sync 2023-12-17T11:57:43.811 INFO:tasks.workunit.client.0.smithi002.stdout:3/447: dread d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:43.811 INFO:tasks.workunit.client.0.smithi002.stdout:3/448: truncate d9/d24/f51 1314447 0 2023-12-17T11:57:43.811 INFO:tasks.workunit.client.0.smithi002.stdout:5/417: creat dc/d80/f92 x:0 0 0 2023-12-17T11:57:43.811 INFO:tasks.workunit.client.0.smithi002.stdout:5/418: truncate dc/d80/f92 886994 0 2023-12-17T11:57:43.812 INFO:tasks.workunit.client.1.smithi119.stdout:1/412: read d3/db/d26/d19/f1e [811109,66319] 0 2023-12-17T11:57:43.812 INFO:tasks.workunit.client.1.smithi119.stdout:1/413: write d3/db/d26/d19/f2f [2851310,79265] 0 2023-12-17T11:57:43.814 INFO:tasks.workunit.client.1.smithi119.stdout:6/389: unlink d2/l28 0 2023-12-17T11:57:43.814 INFO:tasks.workunit.client.1.smithi119.stdout:6/390: fdatasync d2/d2b/f6f 0 2023-12-17T11:57:43.820 INFO:tasks.workunit.client.0.smithi002.stdout:6/414: dwrite d0/d1/dc/d17/d40/f5f [0,4194304] 0 2023-12-17T11:57:43.824 INFO:tasks.workunit.client.0.smithi002.stdout:9/477: symlink dc/d42/da0/d72/d93/d76/la9 0 2023-12-17T11:57:43.824 INFO:tasks.workunit.client.0.smithi002.stdout:9/478: fdatasync fb 0 2023-12-17T11:57:43.831 INFO:tasks.workunit.client.0.smithi002.stdout:0/381: symlink d0/d6/l79 0 2023-12-17T11:57:43.832 INFO:tasks.workunit.client.1.smithi119.stdout:1/414: getdents d3/d44 0 2023-12-17T11:57:43.833 INFO:tasks.workunit.client.1.smithi119.stdout:1/415: chown d3/db/c27 6619003 1 2023-12-17T11:57:43.836 INFO:tasks.workunit.client.1.smithi119.stdout:6/391: mknod d2/df/d17/c78 0 2023-12-17T11:57:43.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/419: unlink dc/lf 0 2023-12-17T11:57:43.841 INFO:tasks.workunit.client.1.smithi119.stdout:5/450: getdents d1 0 2023-12-17T11:57:43.841 INFO:tasks.workunit.client.1.smithi119.stdout:5/451: dread - d1/d25/f7e zero size 2023-12-17T11:57:43.846 INFO:tasks.workunit.client.1.smithi119.stdout:2/460: dread d6/f11 [0,4194304] 0 2023-12-17T11:57:43.847 INFO:tasks.workunit.client.1.smithi119.stdout:1/416: rename d3/db/d2a/c47 to d3/db/d17/d24/d20/d40/c93 0 2023-12-17T11:57:43.849 INFO:tasks.workunit.client.0.smithi002.stdout:0/382: dread d0/f13 [0,4194304] 0 2023-12-17T11:57:43.849 INFO:tasks.workunit.client.1.smithi119.stdout:6/392: mkdir d2/df/d17/d79 0 2023-12-17T11:57:43.851 INFO:tasks.workunit.client.0.smithi002.stdout:8/440: rmdir d3/d8/d28/d31/d5a 39 2023-12-17T11:57:43.853 INFO:tasks.workunit.client.1.smithi119.stdout:5/452: dread d1/d44/f74 [0,4194304] 0 2023-12-17T11:57:43.853 INFO:tasks.workunit.client.1.smithi119.stdout:5/453: readlink d1/l2d 0 2023-12-17T11:57:43.853 INFO:tasks.workunit.client.1.smithi119.stdout:2/461: getdents d6/d9/d52 0 2023-12-17T11:57:43.853 INFO:tasks.workunit.client.1.smithi119.stdout:2/462: truncate f4 5193340 0 2023-12-17T11:57:43.853 INFO:tasks.workunit.client.1.smithi119.stdout:2/463: creat d6/d38/fa6 x:0 0 0 2023-12-17T11:57:43.855 INFO:tasks.workunit.client.1.smithi119.stdout:0/321: dwrite d2/d16/d12/d1f/f20 [0,4194304] 0 2023-12-17T11:57:43.856 INFO:tasks.workunit.client.0.smithi002.stdout:7/428: dwrite d6/d17/dc/d13/d21/d2e/f5a [0,4194304] 0 2023-12-17T11:57:43.856 INFO:tasks.workunit.client.0.smithi002.stdout:3/449: dwrite d9/d1b/d35/d41/d59/d7c/f8b [0,4194304] 0 2023-12-17T11:57:43.857 INFO:tasks.workunit.client.1.smithi119.stdout:1/417: creat d3/db/d17/d24/d20/d40/d6d/d7e/f94 x:0 0 0 2023-12-17T11:57:43.860 INFO:tasks.workunit.client.1.smithi119.stdout:9/474: dwrite d12/d1d/d28/d4d/d73/f88 [0,4194304] 0 2023-12-17T11:57:43.860 INFO:tasks.workunit.client.1.smithi119.stdout:9/475: dread - d12/f82 zero size 2023-12-17T11:57:43.862 INFO:tasks.workunit.client.0.smithi002.stdout:6/415: creat d0/d1/dc/d17/d67/d6c/f80 x:0 0 0 2023-12-17T11:57:43.865 INFO:tasks.workunit.client.0.smithi002.stdout:9/479: truncate dc/d42/da0/d72/d93/f46 820208 0 2023-12-17T11:57:43.868 INFO:tasks.workunit.client.0.smithi002.stdout:1/501: getdents d3/d6/d9/d37/d39 0 2023-12-17T11:57:43.868 INFO:tasks.workunit.client.1.smithi119.stdout:3/482: dwrite d9/d1c/f49 [0,4194304] 0 2023-12-17T11:57:43.868 INFO:tasks.workunit.client.1.smithi119.stdout:3/483: chown d9/d11/c4e 1597264482 1 2023-12-17T11:57:43.869 INFO:tasks.workunit.client.1.smithi119.stdout:3/484: creat d9/da/fbc x:0 0 0 2023-12-17T11:57:43.871 INFO:tasks.workunit.client.0.smithi002.stdout:5/420: mknod dc/d80/c93 0 2023-12-17T11:57:43.872 INFO:tasks.workunit.client.0.smithi002.stdout:7/429: mknod d6/d17/dc/d13/d3e/c82 0 2023-12-17T11:57:43.874 INFO:tasks.workunit.client.0.smithi002.stdout:3/450: rmdir d9/d1b/d35/d41/d59 39 2023-12-17T11:57:43.885 INFO:tasks.workunit.client.0.smithi002.stdout:9/480: dread dc/d32/f34 [0,4194304] 0 2023-12-17T11:57:43.886 INFO:tasks.workunit.client.1.smithi119.stdout:0/322: symlink d2/d16/d12/d2e/d44/l5c 0 2023-12-17T11:57:43.887 INFO:tasks.workunit.client.1.smithi119.stdout:1/418: unlink d3/db/d26/d5e/f6a 0 2023-12-17T11:57:43.894 INFO:tasks.workunit.client.0.smithi002.stdout:0/383: write d0/d15/f32 [2499593,99443] 0 2023-12-17T11:57:43.894 INFO:tasks.workunit.client.0.smithi002.stdout:5/421: mkdir dc/d94 0 2023-12-17T11:57:43.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/416: creat d0/d1/dc/d17/d67/d6c/d7f/f81 x:0 0 0 2023-12-17T11:57:43.896 INFO:tasks.workunit.client.0.smithi002.stdout:7/430: mknod d6/d17/dc/d13/c83 0 2023-12-17T11:57:43.897 INFO:tasks.workunit.client.1.smithi119.stdout:3/485: mkdir d9/d35/dbd 0 2023-12-17T11:57:43.897 INFO:tasks.workunit.client.1.smithi119.stdout:3/486: fsync d9/da/df/d67/f89 0 2023-12-17T11:57:43.901 INFO:tasks.workunit.client.0.smithi002.stdout:3/451: rmdir d9/d1b/d35/d41/d43/d4b 39 2023-12-17T11:57:43.903 INFO:tasks.workunit.client.1.smithi119.stdout:6/393: dwrite d2/f59 [0,4194304] 0 2023-12-17T11:57:43.904 INFO:tasks.workunit.client.1.smithi119.stdout:2/464: dread d6/d9/fd [0,4194304] 0 2023-12-17T11:57:43.905 INFO:tasks.workunit.client.1.smithi119.stdout:2/465: creat d6/d38/fa7 x:0 0 0 2023-12-17T11:57:43.910 INFO:tasks.workunit.client.1.smithi119.stdout:1/419: symlink d3/db/d26/d19/d3f/l95 0 2023-12-17T11:57:43.910 INFO:tasks.workunit.client.1.smithi119.stdout:1/420: chown d3/db/d17/f7d 4 1 2023-12-17T11:57:43.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/384: stat d0/d6/d26/d14/c34 0 2023-12-17T11:57:43.913 INFO:tasks.workunit.client.0.smithi002.stdout:9/481: creat dc/d32/faa x:0 0 0 2023-12-17T11:57:43.913 INFO:tasks.workunit.client.0.smithi002.stdout:5/422: rename dc/d2b/f90 to dc/d1b/d2d/f95 0 2023-12-17T11:57:43.915 INFO:tasks.workunit.client.1.smithi119.stdout:3/487: creat d9/d11/d1e/d55/fbe x:0 0 0 2023-12-17T11:57:43.917 INFO:tasks.workunit.client.0.smithi002.stdout:3/452: symlink d9/d1b/d35/d41/d43/d73/l8c 0 2023-12-17T11:57:43.917 INFO:tasks.workunit.client.0.smithi002.stdout:3/453: chown d9/d24/f25 1766 1 2023-12-17T11:57:43.918 INFO:tasks.workunit.client.0.smithi002.stdout:3/454: rename d9/d1b/d35 to d9/d1b/d35/d41/d59/d8d 22 2023-12-17T11:57:43.920 INFO:tasks.workunit.client.0.smithi002.stdout:9/482: link dc/d42/da0/d72/d93/d76/f86 dc/d1d/d7c/fab 0 2023-12-17T11:57:43.924 INFO:tasks.workunit.client.0.smithi002.stdout:8/441: dwrite d3/d7/f27 [0,4194304] 0 2023-12-17T11:57:43.925 INFO:tasks.workunit.client.0.smithi002.stdout:8/442: readlink d3/d8/da/l91 0 2023-12-17T11:57:43.925 INFO:tasks.workunit.client.0.smithi002.stdout:8/443: truncate d3/d8/da/f88 425955 0 2023-12-17T11:57:43.927 INFO:tasks.workunit.client.1.smithi119.stdout:6/394: creat d2/d2b/d43/d76/f7a x:0 0 0 2023-12-17T11:57:43.927 INFO:tasks.workunit.client.1.smithi119.stdout:6/395: write d2/f2e [4066056,89399] 0 2023-12-17T11:57:43.927 INFO:tasks.workunit.client.1.smithi119.stdout:6/396: fdatasync d2/df/f6d 0 2023-12-17T11:57:43.927 INFO:tasks.workunit.client.0.smithi002.stdout:0/385: mknod d0/d6/d26/d14/d19/d37/d62/c7a 0 2023-12-17T11:57:43.928 INFO:tasks.workunit.client.0.smithi002.stdout:0/386: readlink d0/d6/d26/d14/d19/d2b/l47 0 2023-12-17T11:57:43.928 INFO:tasks.workunit.client.0.smithi002.stdout:0/387: stat d0/d6/d26/d14/d19/d2f 0 2023-12-17T11:57:43.928 INFO:tasks.workunit.client.0.smithi002.stdout:0/388: write d0/d15/d59/f6b [674471,110557] 0 2023-12-17T11:57:43.930 INFO:tasks.workunit.client.0.smithi002.stdout:3/455: mknod d9/d1b/d35/d41/d43/c8e 0 2023-12-17T11:57:43.930 INFO:tasks.workunit.client.0.smithi002.stdout:3/456: chown d9/d15/d52/d79 881832172 1 2023-12-17T11:57:43.930 INFO:tasks.workunit.client.0.smithi002.stdout:3/457: readlink d9/l54 0 2023-12-17T11:57:43.930 INFO:tasks.workunit.client.0.smithi002.stdout:9/483: mknod dc/d38/cac 0 2023-12-17T11:57:43.936 INFO:tasks.workunit.client.1.smithi119.stdout:2/466: rename d6/d9/d13/d34/d88/d9b to d6/d2b/d3f/da8 0 2023-12-17T11:57:43.938 INFO:tasks.workunit.client.1.smithi119.stdout:6/397: symlink d2/df/d17/d79/l7b 0 2023-12-17T11:57:43.939 INFO:tasks.workunit.client.1.smithi119.stdout:5/454: dwrite d1/d25/f7e [0,4194304] 0 2023-12-17T11:57:43.940 INFO:tasks.workunit.client.1.smithi119.stdout:0/323: dwrite d2/d3/f14 [4194304,4194304] 0 2023-12-17T11:57:43.943 INFO:tasks.workunit.client.0.smithi002.stdout:0/389: creat d0/d6/d26/d14/d19/d37/d62/f7b x:0 0 0 2023-12-17T11:57:43.943 INFO:tasks.workunit.client.0.smithi002.stdout:3/458: mkdir d9/d1b/d35/d41/d59/d65/d7e/d8f 0 2023-12-17T11:57:43.943 INFO:tasks.workunit.client.0.smithi002.stdout:0/390: dread - d0/d15/d59/f6e zero size 2023-12-17T11:57:43.946 INFO:tasks.workunit.client.0.smithi002.stdout:7/431: dread d6/d17/dc/f51 [0,4194304] 0 2023-12-17T11:57:43.947 INFO:tasks.workunit.client.0.smithi002.stdout:9/484: symlink dc/d42/da0/d72/d93/d52/lad 0 2023-12-17T11:57:43.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/324: mkdir d2/d16/d12/d1f/d24/d50/d5d 0 2023-12-17T11:57:43.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/325: dread - d2/d16/f5a zero size 2023-12-17T11:57:43.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/326: creat d2/d3/d5/d3f/f5e x:0 0 0 2023-12-17T11:57:43.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/327: fsync d2/d3/f3d 0 2023-12-17T11:57:43.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/328: fdatasync d2/f28 0 2023-12-17T11:57:43.951 INFO:tasks.workunit.client.0.smithi002.stdout:5/423: dread dc/d17/d2f/f34 [0,4194304] 0 2023-12-17T11:57:43.953 INFO:tasks.workunit.client.0.smithi002.stdout:8/444: dread d3/d7/f63 [4194304,4194304] 0 2023-12-17T11:57:43.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/432: mknod d6/d81/c84 0 2023-12-17T11:57:43.955 INFO:tasks.workunit.client.0.smithi002.stdout:3/459: creat d9/d1b/d35/d41/d59/d65/d7e/d8f/f90 x:0 0 0 2023-12-17T11:57:43.959 INFO:tasks.workunit.client.1.smithi119.stdout:2/467: dread d6/d9/d52/f72 [0,4194304] 0 2023-12-17T11:57:43.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/502: dwrite d3/d2f/d4d/d95/f96 [0,4194304] 0 2023-12-17T11:57:43.963 INFO:tasks.workunit.client.1.smithi119.stdout:9/476: dwrite d12/f2c [0,4194304] 0 2023-12-17T11:57:43.964 INFO:tasks.workunit.client.1.smithi119.stdout:6/398: write d2/df/d17/f2f [3088714,75224] 0 2023-12-17T11:57:43.964 INFO:tasks.workunit.client.1.smithi119.stdout:6/399: chown d2/c53 1026247 1 2023-12-17T11:57:43.966 INFO:tasks.workunit.client.1.smithi119.stdout:0/329: stat d2/d16/d35/l46 0 2023-12-17T11:57:43.976 INFO:tasks.workunit.client.0.smithi002.stdout:8/445: creat d3/d8/da/f93 x:0 0 0 2023-12-17T11:57:43.976 INFO:tasks.workunit.client.0.smithi002.stdout:8/446: truncate d3/d7/d18/d3f/d49/f52 640144 0 2023-12-17T11:57:43.977 INFO:tasks.workunit.client.0.smithi002.stdout:3/460: truncate f3 624695 0 2023-12-17T11:57:43.978 INFO:tasks.workunit.client.0.smithi002.stdout:7/433: write d6/d17/f65 [2783428,18214] 0 2023-12-17T11:57:43.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/421: dwrite d3/db/d26/f11 [4194304,4194304] 0 2023-12-17T11:57:43.979 INFO:tasks.workunit.client.1.smithi119.stdout:0/330: truncate d2/d3/d5/d3f/f52 646108 0 2023-12-17T11:57:43.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/422: truncate d3/db/d17/f31 981074 0 2023-12-17T11:57:43.979 INFO:tasks.workunit.client.1.smithi119.stdout:0/331: fdatasync d2/d16/f17 0 2023-12-17T11:57:43.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/423: write d3/db/d17/d24/d20/d40/d6d/d7e/f94 [784582,92738] 0 2023-12-17T11:57:43.980 INFO:tasks.workunit.client.1.smithi119.stdout:7/423: sync 2023-12-17T11:57:43.984 INFO:tasks.workunit.client.0.smithi002.stdout:6/417: dwrite d0/d1/dc/d17/f42 [0,4194304] 0 2023-12-17T11:57:43.988 INFO:tasks.workunit.client.1.smithi119.stdout:1/424: mkdir d3/db/d17/d24/d20/d40/d76/d96 0 2023-12-17T11:57:43.990 INFO:tasks.workunit.client.0.smithi002.stdout:0/391: write d0/d33/d57/f78 [184260,30366] 0 2023-12-17T11:57:43.990 INFO:tasks.workunit.client.0.smithi002.stdout:0/392: fsync d0/d6/d26/d14/f3f 0 2023-12-17T11:57:43.991 INFO:tasks.workunit.client.0.smithi002.stdout:0/393: chown d0/d6/d26/d14/d19/d2b/c40 107972833 1 2023-12-17T11:57:43.991 INFO:tasks.workunit.client.0.smithi002.stdout:0/394: stat d0/d6/d26/d14/d19/c69 0 2023-12-17T11:57:43.992 INFO:tasks.workunit.client.1.smithi119.stdout:7/424: link d2/d4/d11/f43 d2/d4/d11/d2c/d68/f85 0 2023-12-17T11:57:43.993 INFO:tasks.workunit.client.1.smithi119.stdout:6/400: dread d2/f11 [4194304,4194304] 0 2023-12-17T11:57:43.993 INFO:tasks.workunit.client.1.smithi119.stdout:6/401: creat d2/df/d17/f7c x:0 0 0 2023-12-17T11:57:43.994 INFO:tasks.workunit.client.1.smithi119.stdout:9/477: dread d12/f2c [0,4194304] 0 2023-12-17T11:57:43.994 INFO:tasks.workunit.client.1.smithi119.stdout:6/402: write d2/d2b/d43/d76/f7a [277663,78689] 0 2023-12-17T11:57:44.002 INFO:tasks.workunit.client.1.smithi119.stdout:1/425: write d3/db/d26/f39 [25935,43839] 0 2023-12-17T11:57:44.004 INFO:tasks.workunit.client.1.smithi119.stdout:5/455: dwrite d1/f2e [0,4194304] 0 2023-12-17T11:57:44.009 INFO:tasks.workunit.client.0.smithi002.stdout:7/434: dread d6/d17/dc/d13/f14 [0,4194304] 0 2023-12-17T11:57:44.013 INFO:tasks.workunit.client.1.smithi119.stdout:7/425: link d2/d4/d11/d2c/d68/d6a/l80 d2/l86 0 2023-12-17T11:57:44.014 INFO:tasks.workunit.client.0.smithi002.stdout:8/447: rmdir d3 39 2023-12-17T11:57:44.014 INFO:tasks.workunit.client.0.smithi002.stdout:8/448: creat d3/d7/d18/d3f/d49/f94 x:0 0 0 2023-12-17T11:57:44.014 INFO:tasks.workunit.client.0.smithi002.stdout:8/449: truncate d3/d8/da/f88 1201403 0 2023-12-17T11:57:44.016 INFO:tasks.workunit.client.1.smithi119.stdout:2/468: dwrite d6/d9/d52/d53/d55/d58/d6b/f9f [0,4194304] 0 2023-12-17T11:57:44.017 INFO:tasks.workunit.client.1.smithi119.stdout:2/469: fdatasync d6/d9/d13/f32 0 2023-12-17T11:57:44.017 INFO:tasks.workunit.client.1.smithi119.stdout:6/403: creat d2/df/d17/d79/f7d x:0 0 0 2023-12-17T11:57:44.021 INFO:tasks.workunit.client.1.smithi119.stdout:1/426: truncate d3/db/d17/d24/f37 438611 0 2023-12-17T11:57:44.022 INFO:tasks.workunit.client.1.smithi119.stdout:1/427: creat d3/db/d26/d19/d3f/f97 x:0 0 0 2023-12-17T11:57:44.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/420: sync 2023-12-17T11:57:44.028 INFO:tasks.workunit.client.1.smithi119.stdout:8/353: sync 2023-12-17T11:57:44.029 INFO:tasks.workunit.client.0.smithi002.stdout:6/418: truncate d0/d1/d28/f3d 3432470 0 2023-12-17T11:57:44.029 INFO:tasks.workunit.client.0.smithi002.stdout:6/419: creat d0/d1/dc/d10/f82 x:0 0 0 2023-12-17T11:57:44.032 INFO:tasks.workunit.client.0.smithi002.stdout:9/485: dwrite dc/d32/f7a [0,4194304] 0 2023-12-17T11:57:44.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/395: link d0/f2e d0/d6/d26/d14/d19/d61/f7c 0 2023-12-17T11:57:44.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/396: chown d0/d6/d26/f35 22966229 1 2023-12-17T11:57:44.041 INFO:tasks.workunit.client.1.smithi119.stdout:5/456: read d1/f30 [3919120,44023] 0 2023-12-17T11:57:44.044 INFO:tasks.workunit.client.1.smithi119.stdout:2/470: unlink d6/d9/d13/d1d/c39 0 2023-12-17T11:57:44.046 INFO:tasks.workunit.client.1.smithi119.stdout:6/404: mkdir d2/d7e 0 2023-12-17T11:57:44.050 INFO:tasks.workunit.client.0.smithi002.stdout:1/503: rmdir d3/d2f 39 2023-12-17T11:57:44.051 INFO:tasks.workunit.client.0.smithi002.stdout:3/461: dread d9/d15/f19 [0,4194304] 0 2023-12-17T11:57:44.051 INFO:tasks.workunit.client.1.smithi119.stdout:4/421: mkdir dd/d11/d26/d86 0 2023-12-17T11:57:44.054 INFO:tasks.workunit.client.1.smithi119.stdout:8/354: link d7/d12/d69/f74 d7/d18/d45/f76 0 2023-12-17T11:57:44.055 INFO:tasks.workunit.client.1.smithi119.stdout:8/355: creat d7/f77 x:0 0 0 2023-12-17T11:57:44.055 INFO:tasks.workunit.client.1.smithi119.stdout:8/356: dread - d7/d18/d45/f53 zero size 2023-12-17T11:57:44.057 INFO:tasks.workunit.client.0.smithi002.stdout:5/424: rename dc/d2b to dc/d1b/d5a/d96 0 2023-12-17T11:57:44.062 INFO:tasks.workunit.client.1.smithi119.stdout:6/405: mkdir d2/d2b/d7f 0 2023-12-17T11:57:44.062 INFO:tasks.workunit.client.1.smithi119.stdout:6/406: write d2/df/d17/f77 [866245,10393] 0 2023-12-17T11:57:44.063 INFO:tasks.workunit.client.1.smithi119.stdout:0/332: dwrite d2/d16/d12/d2e/d44/f26 [0,4194304] 0 2023-12-17T11:57:44.063 INFO:tasks.workunit.client.1.smithi119.stdout:0/333: write d2/d16/f5a [886698,127867] 0 2023-12-17T11:57:44.064 INFO:tasks.workunit.client.0.smithi002.stdout:8/450: mknod d3/d8/da/c95 0 2023-12-17T11:57:44.067 INFO:tasks.workunit.client.1.smithi119.stdout:4/422: creat dd/d4b/f87 x:0 0 0 2023-12-17T11:57:44.067 INFO:tasks.workunit.client.1.smithi119.stdout:4/423: fdatasync dd/d2a/d55/f80 0 2023-12-17T11:57:44.067 INFO:tasks.workunit.client.1.smithi119.stdout:4/424: chown dd/d2a/c5f 8738 1 2023-12-17T11:57:44.075 INFO:tasks.workunit.client.0.smithi002.stdout:6/420: mkdir d0/d1/d6d/d83 0 2023-12-17T11:57:44.075 INFO:tasks.workunit.client.0.smithi002.stdout:6/421: chown d0/d1/dc/d17/d40 202854502 1 2023-12-17T11:57:44.075 INFO:tasks.workunit.client.0.smithi002.stdout:6/422: fsync d0/d1/dc/d17/f2e 0 2023-12-17T11:57:44.076 INFO:tasks.workunit.client.1.smithi119.stdout:7/426: dwrite d2/f35 [0,4194304] 0 2023-12-17T11:57:44.076 INFO:tasks.workunit.client.1.smithi119.stdout:7/427: creat d2/d4/d70/f87 x:0 0 0 2023-12-17T11:57:44.076 INFO:tasks.workunit.client.1.smithi119.stdout:7/428: write d2/d40/f5a [5940257,110482] 0 2023-12-17T11:57:44.077 INFO:tasks.workunit.client.1.smithi119.stdout:8/357: link d7/d12/d69/d2a/f72 d7/da/d11/d26/d49/f78 0 2023-12-17T11:57:44.078 INFO:tasks.workunit.client.0.smithi002.stdout:3/462: write d9/d15/f22 [169737,55317] 0 2023-12-17T11:57:44.082 INFO:tasks.workunit.client.1.smithi119.stdout:5/457: mkdir d1/d25/d8e 0 2023-12-17T11:57:44.082 INFO:tasks.workunit.client.1.smithi119.stdout:9/478: write d12/d1d/d28/d4d/d73/f74 [1729323,130074] 0 2023-12-17T11:57:44.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/397: dread d0/f48 [0,4194304] 0 2023-12-17T11:57:44.083 INFO:tasks.workunit.client.0.smithi002.stdout:7/435: getdents d6/d17/dc/d13/d21/d2e/d4a/d53 0 2023-12-17T11:57:44.083 INFO:tasks.workunit.client.0.smithi002.stdout:7/436: stat d6/d17/f48 0 2023-12-17T11:57:44.083 INFO:tasks.workunit.client.0.smithi002.stdout:0/398: write d0/d33/d57/f78 [3735049,103789] 0 2023-12-17T11:57:44.083 INFO:tasks.workunit.client.0.smithi002.stdout:7/437: fdatasync d6/d17/dc/d13/d37/f3c 0 2023-12-17T11:57:44.084 INFO:tasks.workunit.client.0.smithi002.stdout:7/438: dread - d6/d17/f79 zero size 2023-12-17T11:57:44.087 INFO:tasks.workunit.client.0.smithi002.stdout:1/504: rename d3/d6/d9/c14 to d3/cad 0 2023-12-17T11:57:44.087 INFO:tasks.workunit.client.0.smithi002.stdout:1/505: write d3/d6/d9/d37/d39/d43/fa4 [589791,69505] 0 2023-12-17T11:57:44.088 INFO:tasks.workunit.client.0.smithi002.stdout:1/506: write d3/d6/d16/f7a [523199,109728] 0 2023-12-17T11:57:44.090 INFO:tasks.workunit.client.0.smithi002.stdout:9/486: dwrite dc/d32/f77 [0,4194304] 0 2023-12-17T11:57:44.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/425: mkdir dc/d1b/d5a/d68/d97 0 2023-12-17T11:57:44.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/426: fsync dc/d1b/d5a/d96/d6c/f8d 0 2023-12-17T11:57:44.093 INFO:tasks.workunit.client.1.smithi119.stdout:6/407: symlink d2/df/l80 0 2023-12-17T11:57:44.093 INFO:tasks.workunit.client.1.smithi119.stdout:4/425: mkdir dd/d2a/d55/d81/d88 0 2023-12-17T11:57:44.093 INFO:tasks.workunit.client.1.smithi119.stdout:4/426: dread - dd/d4b/f87 zero size 2023-12-17T11:57:44.093 INFO:tasks.workunit.client.1.smithi119.stdout:4/427: chown f4 359075 1 2023-12-17T11:57:44.093 INFO:tasks.workunit.client.1.smithi119.stdout:4/428: chown dd/d11/d26 950710 1 2023-12-17T11:57:44.093 INFO:tasks.workunit.client.0.smithi002.stdout:6/423: creat d0/d1/dc/d17/d67/f84 x:0 0 0 2023-12-17T11:57:44.094 INFO:tasks.workunit.client.1.smithi119.stdout:0/334: read d2/d16/d12/d1f/f4e [323819,87458] 0 2023-12-17T11:57:44.094 INFO:tasks.workunit.client.1.smithi119.stdout:0/335: fsync d2/f4 0 2023-12-17T11:57:44.094 INFO:tasks.workunit.client.1.smithi119.stdout:6/408: write d2/df/d17/f77 [383734,13056] 0 2023-12-17T11:57:44.094 INFO:tasks.workunit.client.1.smithi119.stdout:1/428: dwrite d3/db/d17/d24/d20/d40/f5b [4194304,4194304] 0 2023-12-17T11:57:44.096 INFO:tasks.workunit.client.0.smithi002.stdout:3/463: creat d9/d24/d6f/f91 x:0 0 0 2023-12-17T11:57:44.100 INFO:tasks.workunit.client.0.smithi002.stdout:4/416: sync 2023-12-17T11:57:44.100 INFO:tasks.workunit.client.0.smithi002.stdout:2/453: sync 2023-12-17T11:57:44.100 INFO:tasks.workunit.client.0.smithi002.stdout:2/454: fdatasync d3/d4/d7/fa1 0 2023-12-17T11:57:44.100 INFO:tasks.workunit.client.0.smithi002.stdout:4/417: write d0/f83 [849000,129354] 0 2023-12-17T11:57:44.113 INFO:tasks.workunit.client.0.smithi002.stdout:0/399: truncate d0/d15/f27 1899136 0 2023-12-17T11:57:44.116 INFO:tasks.workunit.client.1.smithi119.stdout:7/429: creat d2/d4/d11/d3c/f88 x:0 0 0 2023-12-17T11:57:44.117 INFO:tasks.workunit.client.0.smithi002.stdout:9/487: creat dc/d42/d4f/d59/fae x:0 0 0 2023-12-17T11:57:44.120 INFO:tasks.workunit.client.1.smithi119.stdout:9/479: unlink d12/d1d/d28/d46/d50/c84 0 2023-12-17T11:57:44.120 INFO:tasks.workunit.client.1.smithi119.stdout:9/480: fdatasync d12/d1d/d28/d46/d50/f60 0 2023-12-17T11:57:44.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/424: creat d0/d1/d21/d56/d60/f85 x:0 0 0 2023-12-17T11:57:44.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/425: fsync d0/d1/dc/d58/f77 0 2023-12-17T11:57:44.121 INFO:tasks.workunit.client.1.smithi119.stdout:5/458: getdents d1/d70/d85 0 2023-12-17T11:57:44.123 INFO:tasks.workunit.client.0.smithi002.stdout:9/488: dread dc/d42/f55 [0,4194304] 0 2023-12-17T11:57:44.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/464: mkdir d9/d1b/d35/d41/d43/d4b/d92 0 2023-12-17T11:57:44.124 INFO:tasks.workunit.client.1.smithi119.stdout:4/429: creat dd/d15/d16/d20/d42/d78/f89 x:0 0 0 2023-12-17T11:57:44.126 INFO:tasks.workunit.client.0.smithi002.stdout:2/455: symlink d3/d4/d17/d19/d4d/d72/d83/lab 0 2023-12-17T11:57:44.126 INFO:tasks.workunit.client.0.smithi002.stdout:6/426: dread d0/d1/dc/f54 [0,4194304] 0 2023-12-17T11:57:44.126 INFO:tasks.workunit.client.0.smithi002.stdout:6/427: creat d0/d1/dc/d10/f86 x:0 0 0 2023-12-17T11:57:44.126 INFO:tasks.workunit.client.0.smithi002.stdout:6/428: dread - d0/d1/dc/d17/d4c/f55 zero size 2023-12-17T11:57:44.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/418: creat d0/d10/d21/d33/f89 x:0 0 0 2023-12-17T11:57:44.129 INFO:tasks.workunit.client.1.smithi119.stdout:6/409: mknod d2/c81 0 2023-12-17T11:57:44.129 INFO:tasks.workunit.client.1.smithi119.stdout:6/410: fsync d2/df/d17/f50 0 2023-12-17T11:57:44.131 INFO:tasks.workunit.client.1.smithi119.stdout:7/430: getdents d2/d4/d11/d2c/d55 0 2023-12-17T11:57:44.134 INFO:tasks.workunit.client.0.smithi002.stdout:9/489: unlink dc/d32/f34 0 2023-12-17T11:57:44.135 INFO:tasks.workunit.client.1.smithi119.stdout:8/358: getdents d7/da/d11 0 2023-12-17T11:57:44.135 INFO:tasks.workunit.client.1.smithi119.stdout:8/359: creat d7/da/d11/d26/d49/f79 x:0 0 0 2023-12-17T11:57:44.135 INFO:tasks.workunit.client.1.smithi119.stdout:8/360: chown d7/da/d11/d26/d2c 54584 1 2023-12-17T11:57:44.138 INFO:tasks.workunit.client.0.smithi002.stdout:3/465: symlink d9/d1b/d35/l93 0 2023-12-17T11:57:44.138 INFO:tasks.workunit.client.0.smithi002.stdout:3/466: truncate d9/d15/f19 4330156 0 2023-12-17T11:57:44.138 INFO:tasks.workunit.client.1.smithi119.stdout:5/459: creat d1/d25/d8e/f8f x:0 0 0 2023-12-17T11:57:44.141 INFO:tasks.workunit.client.1.smithi119.stdout:4/430: symlink dd/l8a 0 2023-12-17T11:57:44.141 INFO:tasks.workunit.client.1.smithi119.stdout:4/431: write dd/d15/d16/d20/d42/d78/f89 [700391,43209] 0 2023-12-17T11:57:44.141 INFO:tasks.workunit.client.0.smithi002.stdout:2/456: rmdir d3/d4/d7/d14/d1b 39 2023-12-17T11:57:44.142 INFO:tasks.workunit.client.0.smithi002.stdout:2/457: readlink d3/d4/d7/d14/d1b/d5b/l71 0 2023-12-17T11:57:44.142 INFO:tasks.workunit.client.0.smithi002.stdout:2/458: truncate d3/d4/d7/d14/f92 115188 0 2023-12-17T11:57:44.142 INFO:tasks.workunit.client.0.smithi002.stdout:2/459: readlink d3/d4/d17/l2a 0 2023-12-17T11:57:44.144 INFO:tasks.workunit.client.0.smithi002.stdout:7/439: dread d6/d17/dc/d13/f57 [0,4194304] 0 2023-12-17T11:57:44.146 INFO:tasks.workunit.client.1.smithi119.stdout:2/471: dwrite d6/d2b/f87 [0,4194304] 0 2023-12-17T11:57:44.148 INFO:tasks.workunit.client.0.smithi002.stdout:4/419: truncate d0/d10/d21/f42 8357625 0 2023-12-17T11:57:44.149 INFO:tasks.workunit.client.0.smithi002.stdout:4/420: fdatasync d0/d3e/d56/f72 0 2023-12-17T11:57:44.149 INFO:tasks.workunit.client.1.smithi119.stdout:6/411: rename d2/df/d17/f57 to d2/d61/f82 0 2023-12-17T11:57:44.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/427: rename dc/d80 to dc/d1b/d2d/d98 0 2023-12-17T11:57:44.154 INFO:tasks.workunit.client.0.smithi002.stdout:2/460: mknod d3/d4/d7/d14/cac 0 2023-12-17T11:57:44.157 INFO:tasks.workunit.client.0.smithi002.stdout:0/400: dread d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:44.157 INFO:tasks.workunit.client.0.smithi002.stdout:0/401: stat d0/d6/d26/d14/d19/c69 0 2023-12-17T11:57:44.158 INFO:tasks.workunit.client.1.smithi119.stdout:4/432: symlink dd/d4b/l8b 0 2023-12-17T11:57:44.159 INFO:tasks.workunit.client.0.smithi002.stdout:7/440: getdents d6/d17/dc/d13/d21/d2e/d4a/d53/d75 0 2023-12-17T11:57:44.161 INFO:tasks.workunit.client.1.smithi119.stdout:5/460: write d1/f35 [2329576,48119] 0 2023-12-17T11:57:44.164 INFO:tasks.workunit.client.0.smithi002.stdout:5/428: mkdir dc/d17/d2f/d99 0 2023-12-17T11:57:44.168 INFO:tasks.workunit.client.0.smithi002.stdout:3/467: link d9/d15/c3c d9/d15/d52/d85/c94 0 2023-12-17T11:57:44.168 INFO:tasks.workunit.client.1.smithi119.stdout:7/431: rmdir d2/d5b 39 2023-12-17T11:57:44.169 INFO:tasks.workunit.client.1.smithi119.stdout:1/429: dwrite d3/f12 [0,4194304] 0 2023-12-17T11:57:44.169 INFO:tasks.workunit.client.1.smithi119.stdout:1/430: creat d3/db/d26/d19/d3f/d64/f98 x:0 0 0 2023-12-17T11:57:44.170 INFO:tasks.workunit.client.0.smithi002.stdout:2/461: creat d3/d4/d7/d14/d2e/d37/d3f/fad x:0 0 0 2023-12-17T11:57:44.170 INFO:tasks.workunit.client.0.smithi002.stdout:2/462: chown d3/d4/d7/d14/d1b/d5b 20 1 2023-12-17T11:57:44.170 INFO:tasks.workunit.client.0.smithi002.stdout:2/463: write d3/d4/d7/d14/d2e/d37/f7d [63956,44644] 0 2023-12-17T11:57:44.171 INFO:tasks.workunit.client.1.smithi119.stdout:6/412: mknod d2/d7e/c83 0 2023-12-17T11:57:44.171 INFO:tasks.workunit.client.1.smithi119.stdout:2/472: write d6/d9/d52/d5a/f65 [1821292,106837] 0 2023-12-17T11:57:44.171 INFO:tasks.workunit.client.1.smithi119.stdout:6/413: stat d2/df 0 2023-12-17T11:57:44.171 INFO:tasks.workunit.client.1.smithi119.stdout:2/473: write d6/d9/d13/d1d/f24 [3522627,99633] 0 2023-12-17T11:57:44.172 INFO:tasks.workunit.client.0.smithi002.stdout:7/441: symlink d6/l85 0 2023-12-17T11:57:44.173 INFO:tasks.workunit.client.1.smithi119.stdout:8/361: getdents d7/da/d1a 0 2023-12-17T11:57:44.174 INFO:tasks.workunit.client.0.smithi002.stdout:5/429: symlink dc/d1b/d75/l9a 0 2023-12-17T11:57:44.177 INFO:tasks.workunit.client.1.smithi119.stdout:3/488: sync 2023-12-17T11:57:44.177 INFO:tasks.workunit.client.1.smithi119.stdout:4/433: creat dd/d15/d16/d3d/f8c x:0 0 0 2023-12-17T11:57:44.178 INFO:tasks.workunit.client.0.smithi002.stdout:1/507: dwrite d3/d6/d16/d28/f69 [0,4194304] 0 2023-12-17T11:57:44.178 INFO:tasks.workunit.client.1.smithi119.stdout:4/434: truncate dd/d11/d26/f66 623679 0 2023-12-17T11:57:44.182 INFO:tasks.workunit.client.0.smithi002.stdout:3/468: chown d9/d15/f2b 117 1 2023-12-17T11:57:44.183 INFO:tasks.workunit.client.0.smithi002.stdout:0/402: dread d0/d15/f54 [0,4194304] 0 2023-12-17T11:57:44.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/490: read dc/d42/d4f/d59/d47/f48 [2000529,25892] 0 2023-12-17T11:57:44.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/491: dread - dc/d32/f71 zero size 2023-12-17T11:57:44.183 INFO:tasks.workunit.client.0.smithi002.stdout:9/492: fsync f1 0 2023-12-17T11:57:44.184 INFO:tasks.workunit.client.0.smithi002.stdout:0/403: read d0/d6/d26/d14/d19/d37/f4d [78577,107130] 0 2023-12-17T11:57:44.184 INFO:tasks.workunit.client.1.smithi119.stdout:7/432: mknod d2/c89 0 2023-12-17T11:57:44.186 INFO:tasks.workunit.client.0.smithi002.stdout:2/464: mkdir d3/d4/d7/d14/d42/dae 0 2023-12-17T11:57:44.187 INFO:tasks.workunit.client.1.smithi119.stdout:9/481: dwrite d12/d1d/d49/f77 [0,4194304] 0 2023-12-17T11:57:44.187 INFO:tasks.workunit.client.1.smithi119.stdout:9/482: creat d12/d1d/d28/d4d/d73/f96 x:0 0 0 2023-12-17T11:57:44.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/442: getdents d6/d17/dc/d13/d37/d4c 0 2023-12-17T11:57:44.189 INFO:tasks.workunit.client.1.smithi119.stdout:5/461: write d1/d44/d52/f55 [3931019,50759] 0 2023-12-17T11:57:44.189 INFO:tasks.workunit.client.1.smithi119.stdout:5/462: readlink d1/d25/d39/d71/d82/d86/l5d 0 2023-12-17T11:57:44.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/429: dwrite d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:44.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/430: dread - d0/d1/dc/d17/d67/f84 zero size 2023-12-17T11:57:44.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/430: dread dc/d1a/f48 [0,4194304] 0 2023-12-17T11:57:44.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/431: fdatasync dc/d17/f2c 0 2023-12-17T11:57:44.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/431: creat d0/d1/dc/d17/d67/d6c/f87 x:0 0 0 2023-12-17T11:57:44.190 INFO:tasks.workunit.client.0.smithi002.stdout:6/432: write d0/d1/d21/d56/f5a [151821,33446] 0 2023-12-17T11:57:44.194 INFO:tasks.workunit.client.1.smithi119.stdout:1/431: mkdir d3/db/d17/d24/d20/d40/d76/d96/d99 0 2023-12-17T11:57:44.194 INFO:tasks.workunit.client.1.smithi119.stdout:1/432: fdatasync d3/db/d26/d19/d3f/f4a 0 2023-12-17T11:57:44.195 INFO:tasks.workunit.client.0.smithi002.stdout:4/421: dwrite d0/d10/d21/f48 [0,4194304] 0 2023-12-17T11:57:44.195 INFO:tasks.workunit.client.0.smithi002.stdout:4/422: chown d0/c9 4525 1 2023-12-17T11:57:44.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/508: mknod d3/d6/d16/d61/d8e/cae 0 2023-12-17T11:57:44.196 INFO:tasks.workunit.client.0.smithi002.stdout:1/509: fsync d3/d5c/f5d 0 2023-12-17T11:57:44.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/493: creat dc/d42/d4f/d59/d47/faf x:0 0 0 2023-12-17T11:57:44.199 INFO:tasks.workunit.client.0.smithi002.stdout:9/494: stat dc/d42/d4f/d59/d47/f5c 0 2023-12-17T11:57:44.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/495: stat dc/d32/f53 0 2023-12-17T11:57:44.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/496: creat dc/d42/fb0 x:0 0 0 2023-12-17T11:57:44.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/497: truncate dc/d42/d4f/f98 223830 0 2023-12-17T11:57:44.203 INFO:tasks.workunit.client.0.smithi002.stdout:0/404: unlink d0/d6/d26/d14/c34 0 2023-12-17T11:57:44.207 INFO:tasks.workunit.client.1.smithi119.stdout:1/433: dread d3/db/d2a/f66 [0,4194304] 0 2023-12-17T11:57:44.214 INFO:tasks.workunit.client.0.smithi002.stdout:7/443: mkdir d6/d17/dc/d67/d86 0 2023-12-17T11:57:44.216 INFO:tasks.workunit.client.1.smithi119.stdout:2/474: symlink d6/d38/d96/la9 0 2023-12-17T11:57:44.217 INFO:tasks.workunit.client.1.smithi119.stdout:4/435: dwrite f2 [0,4194304] 0 2023-12-17T11:57:44.222 INFO:tasks.workunit.client.1.smithi119.stdout:3/489: creat d9/d11/d1e/d9f/fbf x:0 0 0 2023-12-17T11:57:44.225 INFO:tasks.workunit.client.1.smithi119.stdout:1/434: dread d3/db/d17/d24/f2e [0,4194304] 0 2023-12-17T11:57:44.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/483: creat d12/f97 x:0 0 0 2023-12-17T11:57:44.233 INFO:tasks.workunit.client.1.smithi119.stdout:5/463: symlink d1/d25/d39/d71/d82/l90 0 2023-12-17T11:57:44.233 INFO:tasks.workunit.client.1.smithi119.stdout:7/433: dwrite d2/d4/d70/f45 [0,4194304] 0 2023-12-17T11:57:44.233 INFO:tasks.workunit.client.1.smithi119.stdout:7/434: chown d2/d4/c1b 0 1 2023-12-17T11:57:44.238 INFO:tasks.workunit.client.1.smithi119.stdout:8/362: getdents d7/d12/d69 0 2023-12-17T11:57:44.241 INFO:tasks.workunit.client.0.smithi002.stdout:5/432: mkdir dc/d1a/d47/d9b 0 2023-12-17T11:57:44.242 INFO:tasks.workunit.client.0.smithi002.stdout:5/433: stat dc/d17/d2f/d82 0 2023-12-17T11:57:44.242 INFO:tasks.workunit.client.0.smithi002.stdout:5/434: chown dc/d17/d2f 9811385 1 2023-12-17T11:57:44.243 INFO:tasks.workunit.client.1.smithi119.stdout:3/490: symlink d9/da/df/lc0 0 2023-12-17T11:57:44.245 INFO:tasks.workunit.client.0.smithi002.stdout:3/469: dwrite d9/d40/f6e [0,4194304] 0 2023-12-17T11:57:44.245 INFO:tasks.workunit.client.0.smithi002.stdout:6/433: rename d0/d1/l29 to d0/d1/d28/l88 0 2023-12-17T11:57:44.245 INFO:tasks.workunit.client.0.smithi002.stdout:6/434: write d0/d1/dc/d17/d40/f4e [4877925,27485] 0 2023-12-17T11:57:44.245 INFO:tasks.workunit.client.0.smithi002.stdout:6/435: write d0/d1/dc/f39 [4214187,24802] 0 2023-12-17T11:57:44.247 INFO:tasks.workunit.client.1.smithi119.stdout:1/435: mkdir d3/db/d17/d24/d20/d40/d76/d96/d99/d9a 0 2023-12-17T11:57:44.250 INFO:tasks.workunit.client.1.smithi119.stdout:7/435: creat d2/d4/d11/d2c/d55/d67/f8a x:0 0 0 2023-12-17T11:57:44.251 INFO:tasks.workunit.client.0.smithi002.stdout:9/498: dwrite f1 [4194304,4194304] 0 2023-12-17T11:57:44.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/423: truncate d0/d10/d14/f60 206149 0 2023-12-17T11:57:44.252 INFO:tasks.workunit.client.1.smithi119.stdout:2/475: getdents d6/d2b/d4b/d5d 0 2023-12-17T11:57:44.255 INFO:tasks.workunit.client.0.smithi002.stdout:1/510: mknod d3/d6/d9/d37/d39/d94/caf 0 2023-12-17T11:57:44.255 INFO:tasks.workunit.client.0.smithi002.stdout:1/511: write d3/d6/d9/f35 [784028,45458] 0 2023-12-17T11:57:44.256 INFO:tasks.workunit.client.1.smithi119.stdout:8/363: mkdir d7/da/d11/d26/d2c/d75/d7a 0 2023-12-17T11:57:44.258 INFO:tasks.workunit.client.1.smithi119.stdout:3/491: creat d9/d44/fc1 x:0 0 0 2023-12-17T11:57:44.261 INFO:tasks.workunit.client.0.smithi002.stdout:0/405: mknod d0/d33/d57/d64/c7d 0 2023-12-17T11:57:44.261 INFO:tasks.workunit.client.0.smithi002.stdout:0/406: fsync d0/d6/d26/d14/d19/d2b/f42 0 2023-12-17T11:57:44.266 INFO:tasks.workunit.client.1.smithi119.stdout:7/436: mknod d2/d5b/c8b 0 2023-12-17T11:57:44.266 INFO:tasks.workunit.client.1.smithi119.stdout:7/437: getdents d2/d4/d11/d2c/d55 0 2023-12-17T11:57:44.267 INFO:tasks.workunit.client.1.smithi119.stdout:7/438: chown d2/d4e/f2b 2 1 2023-12-17T11:57:44.267 INFO:tasks.workunit.client.1.smithi119.stdout:2/476: rename d6/d9/d13/d34/d56/c5f to d6/d2b/d4b/d5d/caa 0 2023-12-17T11:57:44.267 INFO:tasks.workunit.client.1.smithi119.stdout:2/477: readlink d6/d9/d52/d53/d55/d58/d6b/l9c 0 2023-12-17T11:57:44.269 INFO:tasks.workunit.client.1.smithi119.stdout:1/436: dread d3/db/d26/f83 [0,4194304] 0 2023-12-17T11:57:44.271 INFO:tasks.workunit.client.1.smithi119.stdout:3/492: mknod d9/d11/d1e/d55/d65/d84/d9d/db3/cc2 0 2023-12-17T11:57:44.271 INFO:tasks.workunit.client.1.smithi119.stdout:3/493: write d9/da/df/d67/fa0 [611929,73423] 0 2023-12-17T11:57:44.272 INFO:tasks.workunit.client.0.smithi002.stdout:2/465: rmdir d3/d4/d17/d19/d4d 39 2023-12-17T11:57:44.273 INFO:tasks.workunit.client.0.smithi002.stdout:9/499: write dc/d42/d4f/d59/f33 [1158172,74812] 0 2023-12-17T11:57:44.277 INFO:tasks.workunit.client.1.smithi119.stdout:7/439: dread d2/d4/d1f/f4c [0,4194304] 0 2023-12-17T11:57:44.278 INFO:tasks.workunit.client.0.smithi002.stdout:5/435: link dc/d17/d1c/f69 dc/d1a/d47/d9b/f9c 0 2023-12-17T11:57:44.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/424: dread d0/d3e/f74 [0,4194304] 0 2023-12-17T11:57:44.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/425: truncate d0/d5a/f71 970345 0 2023-12-17T11:57:44.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/426: chown d0/d10/d14/d27/d57/d7d/f7f 12591629 1 2023-12-17T11:57:44.278 INFO:tasks.workunit.client.0.smithi002.stdout:4/427: creat d0/f8a x:0 0 0 2023-12-17T11:57:44.281 INFO:tasks.workunit.client.1.smithi119.stdout:4/436: dwrite f8 [0,4194304] 0 2023-12-17T11:57:44.281 INFO:tasks.workunit.client.1.smithi119.stdout:4/437: write dd/d15/d16/d3d/f7c [1548063,22515] 0 2023-12-17T11:57:44.283 INFO:tasks.workunit.client.1.smithi119.stdout:3/494: mknod d9/d59/dae/cc3 0 2023-12-17T11:57:44.283 INFO:tasks.workunit.client.1.smithi119.stdout:3/495: chown d9/d44 54 1 2023-12-17T11:57:44.285 INFO:tasks.workunit.client.1.smithi119.stdout:9/484: dwrite ff [0,4194304] 0 2023-12-17T11:57:44.286 INFO:tasks.workunit.client.0.smithi002.stdout:3/470: rename d9/c1a to d9/d24/d6f/c95 0 2023-12-17T11:57:44.287 INFO:tasks.workunit.client.1.smithi119.stdout:2/478: rmdir d6/d9/d13/d34/d70 39 2023-12-17T11:57:44.292 INFO:tasks.workunit.client.0.smithi002.stdout:8/451: sync 2023-12-17T11:57:44.292 INFO:tasks.workunit.client.0.smithi002.stdout:8/452: stat d3/d8/d28/d31/d5a/d7c/f7d 0 2023-12-17T11:57:44.292 INFO:tasks.workunit.client.0.smithi002.stdout:8/453: truncate d3/d8/da/f88 2023059 0 2023-12-17T11:57:44.293 INFO:tasks.workunit.client.0.smithi002.stdout:6/436: creat d0/d1/d21/d56/f89 x:0 0 0 2023-12-17T11:57:44.297 INFO:tasks.workunit.client.0.smithi002.stdout:5/436: write fa [2751617,116473] 0 2023-12-17T11:57:44.297 INFO:tasks.workunit.client.0.smithi002.stdout:5/437: truncate dc/d1b/d5a/d96/d6c/f8d 689086 0 2023-12-17T11:57:44.297 INFO:tasks.workunit.client.0.smithi002.stdout:5/438: readlink dc/d1b/d2d/l7d 0 2023-12-17T11:57:44.299 INFO:tasks.workunit.client.0.smithi002.stdout:1/512: creat d3/d6/d9/d37/d39/d94/fb0 x:0 0 0 2023-12-17T11:57:44.299 INFO:tasks.workunit.client.0.smithi002.stdout:1/513: fsync d3/d6/d9/d30/d87/f89 0 2023-12-17T11:57:44.300 INFO:tasks.workunit.client.0.smithi002.stdout:1/514: write d3/d2f/f79 [1501532,22375] 0 2023-12-17T11:57:44.302 INFO:tasks.workunit.client.0.smithi002.stdout:0/407: unlink d0/d15/f67 0 2023-12-17T11:57:44.303 INFO:tasks.workunit.client.0.smithi002.stdout:8/454: dread d3/d7/d1a/f6a [0,4194304] 0 2023-12-17T11:57:44.304 INFO:tasks.workunit.client.1.smithi119.stdout:8/364: dwrite d7/d18/f5f [0,4194304] 0 2023-12-17T11:57:44.311 INFO:tasks.workunit.client.1.smithi119.stdout:7/440: getdents d2/d4/d11/d3c/d75 0 2023-12-17T11:57:44.311 INFO:tasks.workunit.client.1.smithi119.stdout:7/441: getdents d2/d4/d11/d2c/d55 0 2023-12-17T11:57:44.314 INFO:tasks.workunit.client.1.smithi119.stdout:2/479: mknod d6/d9/d52/d53/d55/cab 0 2023-12-17T11:57:44.315 INFO:tasks.workunit.client.1.smithi119.stdout:2/480: fsync d6/d2b/d3f/f83 0 2023-12-17T11:57:44.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/438: getdents dd/d15/d4f 0 2023-12-17T11:57:44.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/439: readlink dd/d4b/l8b 0 2023-12-17T11:57:44.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/440: fsync dd/d11/f5e 0 2023-12-17T11:57:44.325 INFO:tasks.workunit.client.1.smithi119.stdout:9/485: rmdir d12/d1d/d28/d4d/d73 39 2023-12-17T11:57:44.328 INFO:tasks.workunit.client.1.smithi119.stdout:7/442: symlink d2/d4/d11/d2c/d55/d67/l8c 0 2023-12-17T11:57:44.328 INFO:tasks.workunit.client.1.smithi119.stdout:7/443: truncate d2/f26 664825 0 2023-12-17T11:57:44.333 INFO:tasks.workunit.client.0.smithi002.stdout:9/500: dwrite dc/d42/da0/d72/d93/f7f [0,4194304] 0 2023-12-17T11:57:44.334 INFO:tasks.workunit.client.0.smithi002.stdout:7/444: rmdir d6/d17 39 2023-12-17T11:57:44.340 INFO:tasks.workunit.client.1.smithi119.stdout:7/444: truncate d2/d4e/f30 2622183 0 2023-12-17T11:57:44.340 INFO:tasks.workunit.client.1.smithi119.stdout:7/445: dread - d2/d4/f47 zero size 2023-12-17T11:57:44.340 INFO:tasks.workunit.client.1.smithi119.stdout:3/496: dwrite d9/da/fa7 [0,4194304] 0 2023-12-17T11:57:44.347 INFO:tasks.workunit.client.0.smithi002.stdout:4/428: mknod d0/d3e/c8b 0 2023-12-17T11:57:44.356 INFO:tasks.workunit.client.0.smithi002.stdout:6/437: mkdir d0/d8a 0 2023-12-17T11:57:44.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/466: dwrite d3/d4/d7/d14/d2e/d37/f5a [4194304,4194304] 0 2023-12-17T11:57:44.360 INFO:tasks.workunit.client.1.smithi119.stdout:0/336: sync 2023-12-17T11:57:44.360 INFO:tasks.workunit.client.0.smithi002.stdout:5/439: creat dc/d17/d2f/d99/f9d x:0 0 0 2023-12-17T11:57:44.363 INFO:tasks.workunit.client.0.smithi002.stdout:1/515: unlink d3/cad 0 2023-12-17T11:57:44.363 INFO:tasks.workunit.client.0.smithi002.stdout:1/516: truncate d3/d6/d16/d61/f93 489689 0 2023-12-17T11:57:44.363 INFO:tasks.workunit.client.1.smithi119.stdout:8/365: rmdir d7/d18/d15 39 2023-12-17T11:57:44.363 INFO:tasks.workunit.client.1.smithi119.stdout:8/366: write d7/da/d11/d26/f32 [1142275,76751] 0 2023-12-17T11:57:44.368 INFO:tasks.workunit.client.1.smithi119.stdout:0/337: unlink d2/d16/l23 0 2023-12-17T11:57:44.368 INFO:tasks.workunit.client.1.smithi119.stdout:0/338: dread - d2/d16/d35/d39/f4a zero size 2023-12-17T11:57:44.368 INFO:tasks.workunit.client.1.smithi119.stdout:0/339: chown d2/d3/d5/d3f/l40 21003 1 2023-12-17T11:57:44.368 INFO:tasks.workunit.client.0.smithi002.stdout:0/408: getdents d0/d6/d26/d14/d19/d37 0 2023-12-17T11:57:44.370 INFO:tasks.workunit.client.0.smithi002.stdout:8/455: dwrite d3/d8/da/f93 [0,4194304] 0 2023-12-17T11:57:44.375 INFO:tasks.workunit.client.0.smithi002.stdout:4/429: mknod d0/d10/d14/d27/d69/c8c 0 2023-12-17T11:57:44.375 INFO:tasks.workunit.client.0.smithi002.stdout:4/430: chown d0/d10/d21/f49 2060241 1 2023-12-17T11:57:44.375 INFO:tasks.workunit.client.0.smithi002.stdout:3/471: rename d9/d15/c67 to d9/d1b/d35/d41/d59/c96 0 2023-12-17T11:57:44.376 INFO:tasks.workunit.client.1.smithi119.stdout:7/446: read d2/f19 [2581012,114078] 0 2023-12-17T11:57:44.376 INFO:tasks.workunit.client.1.smithi119.stdout:9/486: dread d12/d1d/d28/d46/d50/f62 [4194304,4194304] 0 2023-12-17T11:57:44.381 INFO:tasks.workunit.client.0.smithi002.stdout:2/467: link d3/d4/c6b d3/d4/d7/d14/d42/caf 0 2023-12-17T11:57:44.382 INFO:tasks.workunit.client.1.smithi119.stdout:9/487: unlink d12/d1d/d40/f5c 0 2023-12-17T11:57:44.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/440: symlink dc/d1b/d5a/d96/l9e 0 2023-12-17T11:57:44.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/441: stat dc/d17/f81 0 2023-12-17T11:57:44.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/442: truncate dc/d17/f84 325760 0 2023-12-17T11:57:44.390 INFO:tasks.workunit.client.1.smithi119.stdout:2/481: dwrite d6/d9/d52/d5a/f65 [0,4194304] 0 2023-12-17T11:57:44.390 INFO:tasks.workunit.client.1.smithi119.stdout:2/482: read d6/d9/d52/f72 [4130086,123717] 0 2023-12-17T11:57:44.391 INFO:tasks.workunit.client.0.smithi002.stdout:9/501: rename dc/d42/d4f/d59/d47/faf to dc/d1d/d7c/fb1 0 2023-12-17T11:57:44.391 INFO:tasks.workunit.client.0.smithi002.stdout:9/502: dread - dc/d42/f8c zero size 2023-12-17T11:57:44.391 INFO:tasks.workunit.client.1.smithi119.stdout:4/441: dwrite dd/d15/d16/d5a/f70 [0,4194304] 0 2023-12-17T11:57:44.394 INFO:tasks.workunit.client.1.smithi119.stdout:9/488: dread d12/f23 [0,4194304] 0 2023-12-17T11:57:44.394 INFO:tasks.workunit.client.1.smithi119.stdout:0/340: dread d2/d3/d5/f4f [0,4194304] 0 2023-12-17T11:57:44.394 INFO:tasks.workunit.client.1.smithi119.stdout:0/341: dread - d2/d3/d5/f55 zero size 2023-12-17T11:57:44.394 INFO:tasks.workunit.client.1.smithi119.stdout:8/367: read d7/da/d1a/f1c [887408,54508] 0 2023-12-17T11:57:44.395 INFO:tasks.workunit.client.0.smithi002.stdout:3/472: creat d9/d1b/d35/d41/d43/f97 x:0 0 0 2023-12-17T11:57:44.395 INFO:tasks.workunit.client.0.smithi002.stdout:3/473: fsync d9/d1b/d35/d41/d59/d7c/f5f 0 2023-12-17T11:57:44.395 INFO:tasks.workunit.client.1.smithi119.stdout:7/447: dread d2/d4/d1f/f5c [0,4194304] 0 2023-12-17T11:57:44.395 INFO:tasks.workunit.client.1.smithi119.stdout:7/448: readlink d2/d4/d11/d2c/d68/d6a/l80 0 2023-12-17T11:57:44.396 INFO:tasks.workunit.client.1.smithi119.stdout:7/449: write d2/f19 [2295367,125478] 0 2023-12-17T11:57:44.396 INFO:tasks.workunit.client.0.smithi002.stdout:8/456: rename d3/d7/d18/c19 to d3/d8/d28/d31/c96 0 2023-12-17T11:57:44.396 INFO:tasks.workunit.client.0.smithi002.stdout:8/457: chown d3/d7/f5d 7818 1 2023-12-17T11:57:44.397 INFO:tasks.workunit.client.1.smithi119.stdout:3/497: dwrite d9/d11/f72 [0,4194304] 0 2023-12-17T11:57:44.397 INFO:tasks.workunit.client.1.smithi119.stdout:3/498: chown d9/da/df/l29 168 1 2023-12-17T11:57:44.401 INFO:tasks.workunit.client.1.smithi119.stdout:2/483: creat d6/d38/d96/fac x:0 0 0 2023-12-17T11:57:44.409 INFO:tasks.workunit.client.0.smithi002.stdout:4/431: read d0/d3e/d56/f72 [545692,35382] 0 2023-12-17T11:57:44.409 INFO:tasks.workunit.client.0.smithi002.stdout:5/443: write dc/d17/f2c [3317942,93659] 0 2023-12-17T11:57:44.409 INFO:tasks.workunit.client.1.smithi119.stdout:4/442: creat dd/d15/d4f/f8d x:0 0 0 2023-12-17T11:57:44.413 INFO:tasks.workunit.client.1.smithi119.stdout:0/342: rename d2/d16/d12/d1f/d24/d50/f59 to d2/d16/d12/d2e/d44/f5f 0 2023-12-17T11:57:44.414 INFO:tasks.workunit.client.1.smithi119.stdout:8/368: mkdir d7/da/d11/d26/d2c/d7b 0 2023-12-17T11:57:44.416 INFO:tasks.workunit.client.0.smithi002.stdout:0/409: write d0/f48 [1995399,126302] 0 2023-12-17T11:57:44.416 INFO:tasks.workunit.client.0.smithi002.stdout:0/410: chown d0/d15/c18 2550275 1 2023-12-17T11:57:44.416 INFO:tasks.workunit.client.0.smithi002.stdout:0/411: write d0/d6/d26/f24 [4726536,107004] 0 2023-12-17T11:57:44.422 INFO:tasks.workunit.client.1.smithi119.stdout:3/499: symlink d9/d59/lc4 0 2023-12-17T11:57:44.422 INFO:tasks.workunit.client.1.smithi119.stdout:3/500: creat d9/d11/d1e/d55/d65/fc5 x:0 0 0 2023-12-17T11:57:44.423 INFO:tasks.workunit.client.0.smithi002.stdout:5/444: link dc/d1b/d5a/d96/l9e dc/d17/d1c/l9f 0 2023-12-17T11:57:44.426 INFO:tasks.workunit.client.1.smithi119.stdout:2/484: creat d6/d2b/d3f/da8/fad x:0 0 0 2023-12-17T11:57:44.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/412: mkdir d0/d6/d26/d14/d6d/d7e 0 2023-12-17T11:57:44.433 INFO:tasks.workunit.client.0.smithi002.stdout:0/413: mknod d0/d6/d26/d25/c7f 0 2023-12-17T11:57:44.433 INFO:tasks.workunit.client.0.smithi002.stdout:0/414: fdatasync d0/d6/d26/f35 0 2023-12-17T11:57:44.433 INFO:tasks.workunit.client.0.smithi002.stdout:0/415: read - d0/d6/d26/d14/d19/d37/d62/f7b zero size 2023-12-17T11:57:44.433 INFO:tasks.workunit.client.1.smithi119.stdout:7/450: rename d2/d4/d11/d2c/c5d to d2/d40/c8d 0 2023-12-17T11:57:44.433 INFO:tasks.workunit.client.1.smithi119.stdout:7/451: dread - d2/f31 zero size 2023-12-17T11:57:44.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/416: rmdir d0/d6/d26/d14/d19/d2f 39 2023-12-17T11:57:44.454 INFO:tasks.workunit.client.1.smithi119.stdout:0/343: write d2/d16/d12/d2e/d44/f26 [7706472,37929] 0 2023-12-17T11:57:44.454 INFO:tasks.workunit.client.0.smithi002.stdout:6/438: dwrite d0/d1/d21/d56/d60/f62 [0,4194304] 0 2023-12-17T11:57:44.459 INFO:tasks.workunit.client.1.smithi119.stdout:0/344: rename d2/d3/d5/dc/l15 to d2/d16/d12/d1f/d24/d50/l60 0 2023-12-17T11:57:44.459 INFO:tasks.workunit.client.1.smithi119.stdout:2/485: write d6/d9/d52/d53/d55/f4c [1145394,58885] 0 2023-12-17T11:57:44.460 INFO:tasks.workunit.client.1.smithi119.stdout:2/486: readlink d6/d9/d13/d34/l3d 0 2023-12-17T11:57:44.464 INFO:tasks.workunit.client.1.smithi119.stdout:2/487: creat d6/d9/d52/d53/d55/d58/fae x:0 0 0 2023-12-17T11:57:44.465 INFO:tasks.workunit.client.0.smithi002.stdout:1/517: dwrite d3/d6/f3e [0,4194304] 0 2023-12-17T11:57:44.467 INFO:tasks.workunit.client.1.smithi119.stdout:2/488: unlink d6/d9/d86/c9d 0 2023-12-17T11:57:44.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/458: dwrite d3/d7/d18/d3f/f60 [0,4194304] 0 2023-12-17T11:57:44.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/459: readlink d3/d7/d6e/l78 0 2023-12-17T11:57:44.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/460: dread - d3/d7/d18/d3f/f86 zero size 2023-12-17T11:57:44.468 INFO:tasks.workunit.client.0.smithi002.stdout:8/461: fdatasync d3/d7/d18/d3f/d49/f4b 0 2023-12-17T11:57:44.473 INFO:tasks.workunit.client.1.smithi119.stdout:2/489: mkdir d6/d9/d52/d53/d55/daf 0 2023-12-17T11:57:44.473 INFO:tasks.workunit.client.0.smithi002.stdout:1/518: mknod d3/d6/d9/d30/d9c/cb1 0 2023-12-17T11:57:44.474 INFO:tasks.workunit.client.1.smithi119.stdout:5/464: sync 2023-12-17T11:57:44.474 INFO:tasks.workunit.client.1.smithi119.stdout:6/414: sync 2023-12-17T11:57:44.476 INFO:tasks.workunit.client.0.smithi002.stdout:9/503: dwrite dc/d1d/d7c/fb1 [0,4194304] 0 2023-12-17T11:57:44.478 INFO:tasks.workunit.client.0.smithi002.stdout:1/519: link d3/d6/d9/la0 d3/d6/d16/d61/d8e/lb2 0 2023-12-17T11:57:44.482 INFO:tasks.workunit.client.1.smithi119.stdout:2/490: mkdir d6/d9/d86/db0 0 2023-12-17T11:57:44.482 INFO:tasks.workunit.client.1.smithi119.stdout:2/491: truncate d6/d9/f60 970521 0 2023-12-17T11:57:44.482 INFO:tasks.workunit.client.1.smithi119.stdout:2/492: chown d6/d2b/d4b/d5d/caa 68916 1 2023-12-17T11:57:44.484 INFO:tasks.workunit.client.1.smithi119.stdout:5/465: creat d1/d36/f91 x:0 0 0 2023-12-17T11:57:44.485 INFO:tasks.workunit.client.1.smithi119.stdout:9/489: dwrite d12/d1d/d28/d46/f4e [0,4194304] 0 2023-12-17T11:57:44.492 INFO:tasks.workunit.client.0.smithi002.stdout:5/445: write dc/d17/d2f/f3a [293082,105806] 0 2023-12-17T11:57:44.492 INFO:tasks.workunit.client.0.smithi002.stdout:1/520: write d3/d6/d16/d28/f69 [2238485,125075] 0 2023-12-17T11:57:44.493 INFO:tasks.workunit.client.0.smithi002.stdout:2/468: dwrite d3/d4/d7/d14/d2e/d37/d3f/f91 [0,4194304] 0 2023-12-17T11:57:44.494 INFO:tasks.workunit.client.1.smithi119.stdout:9/490: mknod d12/d1d/d28/c98 0 2023-12-17T11:57:44.496 INFO:tasks.workunit.client.1.smithi119.stdout:2/493: getdents d6/d9/d52/d53/d55/d58/d6b 0 2023-12-17T11:57:44.496 INFO:tasks.workunit.client.1.smithi119.stdout:2/494: readlink d6/l9a 0 2023-12-17T11:57:44.496 INFO:tasks.workunit.client.0.smithi002.stdout:4/432: dwrite d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:44.496 INFO:tasks.workunit.client.0.smithi002.stdout:4/433: read d0/d10/f4b [2992640,54541] 0 2023-12-17T11:57:44.500 INFO:tasks.workunit.client.0.smithi002.stdout:0/417: dwrite d0/d6/d26/d14/d19/d61/f73 [0,4194304] 0 2023-12-17T11:57:44.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/446: write dc/f83 [1602842,5736] 0 2023-12-17T11:57:44.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/447: dread - dc/d17/d2f/d99/f9d zero size 2023-12-17T11:57:44.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/448: write dc/d1b/f63 [2029400,120000] 0 2023-12-17T11:57:44.505 INFO:tasks.workunit.client.0.smithi002.stdout:9/504: write dc/d42/da0/d72/d93/f73 [3018277,124502] 0 2023-12-17T11:57:44.505 INFO:tasks.workunit.client.0.smithi002.stdout:9/505: write dc/d42/d4f/f92 [648968,82326] 0 2023-12-17T11:57:44.506 INFO:tasks.workunit.client.1.smithi119.stdout:8/369: dwrite d7/fb [0,4194304] 0 2023-12-17T11:57:44.506 INFO:tasks.workunit.client.1.smithi119.stdout:7/452: dwrite d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:44.506 INFO:tasks.workunit.client.1.smithi119.stdout:2/495: rename d6/d9/d13/d1d/c2e to d6/d9/d13/cb1 0 2023-12-17T11:57:44.515 INFO:tasks.workunit.client.0.smithi002.stdout:2/469: creat d3/d4/d7/fb0 x:0 0 0 2023-12-17T11:57:44.516 INFO:tasks.workunit.client.0.smithi002.stdout:2/470: chown d3/d4/d7/d14/d1b/l75 296513 1 2023-12-17T11:57:44.517 INFO:tasks.workunit.client.1.smithi119.stdout:2/496: mknod d6/d2b/d4b/d5d/cb2 0 2023-12-17T11:57:44.520 INFO:tasks.workunit.client.0.smithi002.stdout:4/434: mknod d0/d10/d14/d4e/c8d 0 2023-12-17T11:57:44.530 INFO:tasks.workunit.client.0.smithi002.stdout:5/449: mkdir dc/d1b/d5a/d96/d6c/da0 0 2023-12-17T11:57:44.530 INFO:tasks.workunit.client.0.smithi002.stdout:9/506: mkdir dc/d42/da0/d72/d93/d83/d91/db2 0 2023-12-17T11:57:44.531 INFO:tasks.workunit.client.1.smithi119.stdout:2/497: link d6/d9/d52/d53/d55/d58/d6b/l6e d6/d9/d52/lb3 0 2023-12-17T11:57:44.531 INFO:tasks.workunit.client.1.smithi119.stdout:2/498: dread - d6/d2b/d4b/d5d/fa1 zero size 2023-12-17T11:57:44.531 INFO:tasks.workunit.client.1.smithi119.stdout:2/499: readlink d6/d9/l30 0 2023-12-17T11:57:44.531 INFO:tasks.workunit.client.1.smithi119.stdout:2/500: write f5 [284738,3760] 0 2023-12-17T11:57:44.531 INFO:tasks.workunit.client.1.smithi119.stdout:2/501: chown d6/l9a 1 1 2023-12-17T11:57:44.531 INFO:tasks.workunit.client.0.smithi002.stdout:6/439: dread d0/d1/dc/d17/d3c/f47 [0,4194304] 0 2023-12-17T11:57:44.532 INFO:tasks.workunit.client.0.smithi002.stdout:4/435: getdents d0/d3e/d41 0 2023-12-17T11:57:44.532 INFO:tasks.workunit.client.0.smithi002.stdout:9/507: mknod dc/d42/da0/cb3 0 2023-12-17T11:57:44.533 INFO:tasks.workunit.client.0.smithi002.stdout:5/450: symlink dc/d1a/d61/la1 0 2023-12-17T11:57:44.533 INFO:tasks.workunit.client.0.smithi002.stdout:6/440: mkdir d0/d1/dc/d8b 0 2023-12-17T11:57:44.534 INFO:tasks.workunit.client.0.smithi002.stdout:6/441: fsync d0/d1/dc/d17/d67/d6c/d7f/f81 0 2023-12-17T11:57:44.534 INFO:tasks.workunit.client.0.smithi002.stdout:6/442: truncate d0/d1/d21/f76 849054 0 2023-12-17T11:57:44.535 INFO:tasks.workunit.client.1.smithi119.stdout:6/415: dwrite d2/d2b/f47 [0,4194304] 0 2023-12-17T11:57:44.536 INFO:tasks.workunit.client.0.smithi002.stdout:5/451: creat dc/d1b/d2d/d5b/fa2 x:0 0 0 2023-12-17T11:57:44.536 INFO:tasks.workunit.client.0.smithi002.stdout:5/452: stat dc/d1b/d2d/d98/c93 0 2023-12-17T11:57:44.538 INFO:tasks.workunit.client.0.smithi002.stdout:6/443: unlink d0/d1/dc/d17/d67/d6c/f87 0 2023-12-17T11:57:44.545 INFO:tasks.workunit.client.1.smithi119.stdout:6/416: link d2/f26 d2/d2b/f84 0 2023-12-17T11:57:44.546 INFO:tasks.workunit.client.1.smithi119.stdout:2/502: dread d6/d9/d52/d53/d55/d58/f68 [0,4194304] 0 2023-12-17T11:57:44.546 INFO:tasks.workunit.client.1.smithi119.stdout:0/345: dwrite d2/d16/d12/d2e/d44/f5f [0,4194304] 0 2023-12-17T11:57:44.547 INFO:tasks.workunit.client.0.smithi002.stdout:9/508: dread dc/d1d/d7c/fb1 [0,4194304] 0 2023-12-17T11:57:44.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/521: dread d3/d2f/f48 [0,4194304] 0 2023-12-17T11:57:44.548 INFO:tasks.workunit.client.0.smithi002.stdout:1/522: stat d3/d6/d9/d37/d39/d43/d4a/f5f 0 2023-12-17T11:57:44.549 INFO:tasks.workunit.client.0.smithi002.stdout:5/453: symlink dc/d17/d2f/d99/la3 0 2023-12-17T11:57:44.549 INFO:tasks.workunit.client.0.smithi002.stdout:6/444: mkdir d0/d1/d21/d56/d8c 0 2023-12-17T11:57:44.551 INFO:tasks.workunit.client.0.smithi002.stdout:9/509: symlink dc/d42/lb4 0 2023-12-17T11:57:44.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/454: symlink dc/d1b/d5a/d96/d6c/la4 0 2023-12-17T11:57:44.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/455: stat dc/d1b/d2d/c4c 0 2023-12-17T11:57:44.554 INFO:tasks.workunit.client.0.smithi002.stdout:9/510: mknod dc/d42/da0/d72/cb5 0 2023-12-17T11:57:44.555 INFO:tasks.workunit.client.0.smithi002.stdout:5/456: creat dc/d1a/fa5 x:0 0 0 2023-12-17T11:57:44.557 INFO:tasks.workunit.client.0.smithi002.stdout:9/511: creat dc/d42/da0/d72/d93/d83/d91/db2/fb6 x:0 0 0 2023-12-17T11:57:44.559 INFO:tasks.workunit.client.0.smithi002.stdout:5/457: link dc/d1b/d2d/d98/c93 dc/d1b/d75/ca6 0 2023-12-17T11:57:44.559 INFO:tasks.workunit.client.0.smithi002.stdout:5/458: dread - dc/d17/d1c/f69 zero size 2023-12-17T11:57:44.565 INFO:tasks.workunit.client.1.smithi119.stdout:5/466: dwrite d1/d25/f6c [0,4194304] 0 2023-12-17T11:57:44.565 INFO:tasks.workunit.client.1.smithi119.stdout:5/467: dread - d1/d70/d6b/f87 zero size 2023-12-17T11:57:44.565 INFO:tasks.workunit.client.1.smithi119.stdout:5/468: write d1/d25/d39/d71/f84 [381170,43683] 0 2023-12-17T11:57:44.580 INFO:tasks.workunit.client.0.smithi002.stdout:9/512: dread dc/d42/f64 [0,4194304] 0 2023-12-17T11:57:44.580 INFO:tasks.workunit.client.0.smithi002.stdout:0/418: dwrite d0/d15/f23 [0,4194304] 0 2023-12-17T11:57:44.590 INFO:tasks.workunit.client.0.smithi002.stdout:9/513: truncate dc/d42/da0/d72/d93/d83/d91/fa2 899292 0 2023-12-17T11:57:44.590 INFO:tasks.workunit.client.1.smithi119.stdout:8/370: dwrite d7/da/d11/d26/f58 [0,4194304] 0 2023-12-17T11:57:44.590 INFO:tasks.workunit.client.1.smithi119.stdout:8/371: fdatasync d7/d18/d45/f53 0 2023-12-17T11:57:44.590 INFO:tasks.workunit.client.0.smithi002.stdout:4/436: dread d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:44.593 INFO:tasks.workunit.client.1.smithi119.stdout:5/469: dread d1/f17 [4194304,4194304] 0 2023-12-17T11:57:44.599 INFO:tasks.workunit.client.0.smithi002.stdout:9/514: getdents dc/d42/da0 0 2023-12-17T11:57:44.601 INFO:tasks.workunit.client.0.smithi002.stdout:4/437: rename d0/d3e/d56/f72 to d0/d10/d14/f8e 0 2023-12-17T11:57:44.601 INFO:tasks.workunit.client.0.smithi002.stdout:4/438: fsync d0/d10/d21/f2f 0 2023-12-17T11:57:44.602 INFO:tasks.workunit.client.1.smithi119.stdout:5/470: symlink d1/d25/d39/d71/d82/d86/l92 0 2023-12-17T11:57:44.603 INFO:tasks.workunit.client.0.smithi002.stdout:9/515: symlink dc/d1d/d25/lb7 0 2023-12-17T11:57:44.604 INFO:tasks.workunit.client.0.smithi002.stdout:0/419: dread d0/d6/d26/d14/f53 [0,4194304] 0 2023-12-17T11:57:44.605 INFO:tasks.workunit.client.0.smithi002.stdout:4/439: rename d0/l88 to d0/d10/d14/d27/d57/l8f 0 2023-12-17T11:57:44.606 INFO:tasks.workunit.client.1.smithi119.stdout:5/471: creat d1/d70/d85/f93 x:0 0 0 2023-12-17T11:57:44.613 INFO:tasks.workunit.client.1.smithi119.stdout:2/503: fsync d6/f21 0 2023-12-17T11:57:44.613 INFO:tasks.workunit.client.0.smithi002.stdout:8/462: dwrite d3/d7/d18/d3f/d49/f52 [0,4194304] 0 2023-12-17T11:57:44.614 INFO:tasks.workunit.client.1.smithi119.stdout:2/504: link d6/d9/d52/d5a/f65 d6/d9/d86/fb4 0 2023-12-17T11:57:44.615 INFO:tasks.workunit.client.0.smithi002.stdout:7/445: sync 2023-12-17T11:57:44.616 INFO:tasks.workunit.client.1.smithi119.stdout:9/491: dwrite d12/d1d/f41 [0,4194304] 0 2023-12-17T11:57:44.618 INFO:tasks.workunit.client.1.smithi119.stdout:2/505: unlink d6/d9/d52/d53/d55/d58/d6b/l9c 0 2023-12-17T11:57:44.618 INFO:tasks.workunit.client.1.smithi119.stdout:2/506: dread - d6/d9/d52/d53/d55/d58/d6b/f93 zero size 2023-12-17T11:57:44.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/463: rename d3/d8/da/c62 to d3/d7/d6e/d7f/d90/c97 0 2023-12-17T11:57:44.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/464: chown d3/d7/l92 6271 1 2023-12-17T11:57:44.624 INFO:tasks.workunit.client.0.smithi002.stdout:7/446: creat d6/d17/dc/d67/f87 x:0 0 0 2023-12-17T11:57:44.626 INFO:tasks.workunit.client.1.smithi119.stdout:6/417: dwrite d2/d2b/f6f [0,4194304] 0 2023-12-17T11:57:44.626 INFO:tasks.workunit.client.1.smithi119.stdout:6/418: write d2/d2b/d43/f62 [456510,6417] 0 2023-12-17T11:57:44.626 INFO:tasks.workunit.client.1.smithi119.stdout:6/419: creat d2/d2b/d43/f85 x:0 0 0 2023-12-17T11:57:44.628 INFO:tasks.workunit.client.0.smithi002.stdout:4/440: dread d0/f83 [0,4194304] 0 2023-12-17T11:57:44.628 INFO:tasks.workunit.client.0.smithi002.stdout:5/459: dwrite fa [0,4194304] 0 2023-12-17T11:57:44.629 INFO:tasks.workunit.client.1.smithi119.stdout:5/472: dread d1/d25/d39/d71/f84 [0,4194304] 0 2023-12-17T11:57:44.629 INFO:tasks.workunit.client.1.smithi119.stdout:5/473: dread - d1/d70/d6b/f87 zero size 2023-12-17T11:57:44.629 INFO:tasks.workunit.client.1.smithi119.stdout:5/474: chown d1/fa 749434 1 2023-12-17T11:57:44.629 INFO:tasks.workunit.client.1.smithi119.stdout:5/475: creat d1/d25/d39/d71/f94 x:0 0 0 2023-12-17T11:57:44.629 INFO:tasks.workunit.client.1.smithi119.stdout:2/507: mknod d6/d38/d96/cb5 0 2023-12-17T11:57:44.629 INFO:tasks.workunit.client.1.smithi119.stdout:0/346: dwrite d2/d16/f5a [0,4194304] 0 2023-12-17T11:57:44.630 INFO:tasks.workunit.client.1.smithi119.stdout:9/492: creat d12/d1d/d79/f99 x:0 0 0 2023-12-17T11:57:44.630 INFO:tasks.workunit.client.1.smithi119.stdout:9/493: chown d12/d1d/d28/d46/f59 3 1 2023-12-17T11:57:44.630 INFO:tasks.workunit.client.0.smithi002.stdout:5/460: read dc/d1b/d5a/f71 [652337,92825] 0 2023-12-17T11:57:44.631 INFO:tasks.workunit.client.1.smithi119.stdout:1/437: sync 2023-12-17T11:57:44.631 INFO:tasks.workunit.client.1.smithi119.stdout:1/438: truncate d3/db/d17/d24/f3c 422176 0 2023-12-17T11:57:44.635 INFO:tasks.workunit.client.0.smithi002.stdout:4/441: mkdir d0/d10/d14/d90 0 2023-12-17T11:57:44.635 INFO:tasks.workunit.client.0.smithi002.stdout:4/442: chown d0/d10/f40 508409 1 2023-12-17T11:57:44.639 INFO:tasks.workunit.client.0.smithi002.stdout:8/465: dread d3/d8/da/f8a [0,4194304] 0 2023-12-17T11:57:44.643 INFO:tasks.workunit.client.0.smithi002.stdout:4/443: rename d0/d10/f2d to d0/d3e/d56/d65/d78/f91 0 2023-12-17T11:57:44.645 INFO:tasks.workunit.client.0.smithi002.stdout:8/466: dread d3/d7/d1a/f6a [0,4194304] 0 2023-12-17T11:57:44.645 INFO:tasks.workunit.client.0.smithi002.stdout:8/467: rename d3/d8 to d3/d8/d28/d31/d5a/d98 22 2023-12-17T11:57:44.648 INFO:tasks.workunit.client.0.smithi002.stdout:1/523: dwrite d3/d6/d9/d37/d39/fa6 [0,4194304] 0 2023-12-17T11:57:44.650 INFO:tasks.workunit.client.1.smithi119.stdout:5/476: rmdir d1/d25/d39/d71/d82/d86 39 2023-12-17T11:57:44.652 INFO:tasks.workunit.client.1.smithi119.stdout:9/494: read d12/d1d/d49/d85/f90 [2973748,121612] 0 2023-12-17T11:57:44.652 INFO:tasks.workunit.client.1.smithi119.stdout:9/495: creat d12/d1d/d28/f9a x:0 0 0 2023-12-17T11:57:44.652 INFO:tasks.workunit.client.1.smithi119.stdout:9/496: write d12/d1d/d28/d46/f66 [1018588,25386] 0 2023-12-17T11:57:44.654 INFO:tasks.workunit.client.1.smithi119.stdout:0/347: truncate d2/d16/d12/f1a 3193017 0 2023-12-17T11:57:44.658 INFO:tasks.workunit.client.0.smithi002.stdout:5/461: dread dc/d1b/d5a/d96/f36 [0,4194304] 0 2023-12-17T11:57:44.663 INFO:tasks.workunit.client.1.smithi119.stdout:2/508: dread d6/f40 [0,4194304] 0 2023-12-17T11:57:44.664 INFO:tasks.workunit.client.1.smithi119.stdout:1/439: symlink d3/db/d17/d24/d20/d40/d76/d84/l9b 0 2023-12-17T11:57:44.669 INFO:tasks.workunit.client.1.smithi119.stdout:8/372: dwrite d7/d18/f4f [0,4194304] 0 2023-12-17T11:57:44.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/524: creat d3/d6/d9/d37/d39/fb3 x:0 0 0 2023-12-17T11:57:44.670 INFO:tasks.workunit.client.0.smithi002.stdout:4/444: dread d0/d3e/f74 [0,4194304] 0 2023-12-17T11:57:44.670 INFO:tasks.workunit.client.0.smithi002.stdout:0/420: dwrite d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:44.670 INFO:tasks.workunit.client.1.smithi119.stdout:9/497: truncate d12/d1d/f27 2064417 0 2023-12-17T11:57:44.670 INFO:tasks.workunit.client.1.smithi119.stdout:9/498: truncate d12/f42 1733851 0 2023-12-17T11:57:44.672 INFO:tasks.workunit.client.1.smithi119.stdout:2/509: mknod d6/d9/d13/cb6 0 2023-12-17T11:57:44.673 INFO:tasks.workunit.client.1.smithi119.stdout:6/420: dwrite d2/d2b/f63 [0,4194304] 0 2023-12-17T11:57:44.673 INFO:tasks.workunit.client.1.smithi119.stdout:6/421: read d2/f4 [1701265,31820] 0 2023-12-17T11:57:44.675 INFO:tasks.workunit.client.1.smithi119.stdout:4/443: sync 2023-12-17T11:57:44.676 INFO:tasks.workunit.client.0.smithi002.stdout:3/474: sync 2023-12-17T11:57:44.679 INFO:tasks.workunit.client.1.smithi119.stdout:1/440: link d3/db/d17/d24/d20/f50 d3/db/d17/d24/d20/d40/d6d/d7e/f9c 0 2023-12-17T11:57:44.679 INFO:tasks.workunit.client.1.smithi119.stdout:1/441: truncate d3/db/d26/d19/d3f/f51 169265 0 2023-12-17T11:57:44.680 INFO:tasks.workunit.client.0.smithi002.stdout:1/525: link d3/d6/d9/d37/d39/d43/f50 d3/d2f/fb4 0 2023-12-17T11:57:44.680 INFO:tasks.workunit.client.0.smithi002.stdout:1/526: readlink d3/d6/d9/d37/l68 0 2023-12-17T11:57:44.680 INFO:tasks.workunit.client.0.smithi002.stdout:1/527: fdatasync d3/d6/d9/f2e 0 2023-12-17T11:57:44.688 INFO:tasks.workunit.client.0.smithi002.stdout:3/475: mknod d9/c98 0 2023-12-17T11:57:44.689 INFO:tasks.workunit.client.0.smithi002.stdout:0/421: creat d0/d6/d26/d14/d6d/d7e/f80 x:0 0 0 2023-12-17T11:57:44.689 INFO:tasks.workunit.client.1.smithi119.stdout:7/453: sync 2023-12-17T11:57:44.689 INFO:tasks.workunit.client.0.smithi002.stdout:5/462: dread fb [0,4194304] 0 2023-12-17T11:57:44.689 INFO:tasks.workunit.client.0.smithi002.stdout:5/463: stat dc/d1b/d2d 0 2023-12-17T11:57:44.691 INFO:tasks.workunit.client.0.smithi002.stdout:9/516: dwrite dc/d42/d4f/d59/f4e [0,4194304] 0 2023-12-17T11:57:44.691 INFO:tasks.workunit.client.0.smithi002.stdout:9/517: creat dc/d42/d4f/d59/fb8 x:0 0 0 2023-12-17T11:57:44.693 INFO:tasks.workunit.client.0.smithi002.stdout:1/528: truncate d3/d6/d9/d37/d39/d43/d4a/f75 1118094 0 2023-12-17T11:57:44.694 INFO:tasks.workunit.client.0.smithi002.stdout:8/468: dwrite d3/d7/d18/d3f/d49/f4e [0,4194304] 0 2023-12-17T11:57:44.694 INFO:tasks.workunit.client.0.smithi002.stdout:8/469: chown d3/d8/da/dd 496142 1 2023-12-17T11:57:44.699 INFO:tasks.workunit.client.0.smithi002.stdout:0/422: rename d0/d6/d26/d14/d19/d2b/l47 to d0/d6/l81 0 2023-12-17T11:57:44.701 INFO:tasks.workunit.client.0.smithi002.stdout:5/464: mkdir dc/d17/d2f/d99/da7 0 2023-12-17T11:57:44.702 INFO:tasks.workunit.client.1.smithi119.stdout:8/373: symlink d7/da/d11/d26/d2c/d7b/l7c 0 2023-12-17T11:57:44.702 INFO:tasks.workunit.client.1.smithi119.stdout:8/374: dread - d7/da/d11/d26/d49/f78 zero size 2023-12-17T11:57:44.702 INFO:tasks.workunit.client.1.smithi119.stdout:8/375: creat d7/d12/d23/f7d x:0 0 0 2023-12-17T11:57:44.703 INFO:tasks.workunit.client.0.smithi002.stdout:4/445: dread d0/d10/f11 [0,4194304] 0 2023-12-17T11:57:44.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/499: getdents d12/d1d/d28/d46/d6e 0 2023-12-17T11:57:44.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/500: stat d12/d1d/d40/l64 0 2023-12-17T11:57:44.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/501: chown d12/d1d/d40 37972891 1 2023-12-17T11:57:44.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/518: mknod dc/d1d/d7c/d90/cb9 0 2023-12-17T11:57:44.707 INFO:tasks.workunit.client.1.smithi119.stdout:9/502: write d12/d1d/f8e [863055,10217] 0 2023-12-17T11:57:44.707 INFO:tasks.workunit.client.1.smithi119.stdout:7/454: dread d2/d4e/f30 [0,4194304] 0 2023-12-17T11:57:44.707 INFO:tasks.workunit.client.1.smithi119.stdout:7/455: readlink d2/d5b/l63 0 2023-12-17T11:57:44.707 INFO:tasks.workunit.client.1.smithi119.stdout:7/456: write d2/f31 [107651,68579] 0 2023-12-17T11:57:44.707 INFO:tasks.workunit.client.0.smithi002.stdout:1/529: mknod d3/d6/d9/cb5 0 2023-12-17T11:57:44.708 INFO:tasks.workunit.client.1.smithi119.stdout:2/510: getdents d6/d2b/d3f/da8 0 2023-12-17T11:57:44.711 INFO:tasks.workunit.client.1.smithi119.stdout:6/422: unlink d2/d2b/d43/d5e/l60 0 2023-12-17T11:57:44.714 INFO:tasks.workunit.client.1.smithi119.stdout:4/444: mknod dd/d11/d2d/c8e 0 2023-12-17T11:57:44.714 INFO:tasks.workunit.client.1.smithi119.stdout:4/445: fdatasync dd/d15/d16/f1a 0 2023-12-17T11:57:44.714 INFO:tasks.workunit.client.1.smithi119.stdout:4/446: write dd/d15/d16/d20/d42/f65 [890593,25195] 0 2023-12-17T11:57:44.716 INFO:tasks.workunit.client.1.smithi119.stdout:1/442: mkdir d3/db/d17/d24/d20/d40/d76/d96/d99/d9d 0 2023-12-17T11:57:44.718 INFO:tasks.workunit.client.0.smithi002.stdout:8/470: mknod d3/d8/da/c99 0 2023-12-17T11:57:44.718 INFO:tasks.workunit.client.0.smithi002.stdout:8/471: readlink d3/d8/d28/l45 0 2023-12-17T11:57:44.718 INFO:tasks.workunit.client.1.smithi119.stdout:5/477: rename d1/d25/d8e to d1/d70/d85/d95 0 2023-12-17T11:57:44.720 INFO:tasks.workunit.client.1.smithi119.stdout:9/503: write d12/d1d/d28/d4d/d73/f88 [1001070,109813] 0 2023-12-17T11:57:44.720 INFO:tasks.workunit.client.1.smithi119.stdout:9/504: chown d12/l1a 5801 1 2023-12-17T11:57:44.724 INFO:tasks.workunit.client.1.smithi119.stdout:8/376: creat d7/da/d11/d26/d2c/f7e x:0 0 0 2023-12-17T11:57:44.725 INFO:tasks.workunit.client.1.smithi119.stdout:7/457: write d2/d4/d70/f45 [18270,34123] 0 2023-12-17T11:57:44.725 INFO:tasks.workunit.client.1.smithi119.stdout:7/458: chown d2/d4/d11 17346442 1 2023-12-17T11:57:44.725 INFO:tasks.workunit.client.1.smithi119.stdout:7/459: fsync d2/d4/d11/d3c/d75/f7f 0 2023-12-17T11:57:44.725 INFO:tasks.workunit.client.0.smithi002.stdout:0/423: symlink d0/d6/d26/d14/d19/d2b/l82 0 2023-12-17T11:57:44.726 INFO:tasks.workunit.client.0.smithi002.stdout:5/465: rename dc/d1a/l44 to dc/d17/d2f/d99/la8 0 2023-12-17T11:57:44.727 INFO:tasks.workunit.client.1.smithi119.stdout:2/511: mkdir d6/d9/d13/d1d/db7 0 2023-12-17T11:57:44.727 INFO:tasks.workunit.client.1.smithi119.stdout:2/512: truncate d6/f8a 2080643 0 2023-12-17T11:57:44.728 INFO:tasks.workunit.client.0.smithi002.stdout:9/519: symlink dc/d1d/d7c/d90/lba 0 2023-12-17T11:57:44.729 INFO:tasks.workunit.client.0.smithi002.stdout:1/530: mkdir d3/d2f/d4d/d91/db6 0 2023-12-17T11:57:44.730 INFO:tasks.workunit.client.1.smithi119.stdout:1/443: creat d3/db/d26/d8f/f9e x:0 0 0 2023-12-17T11:57:44.730 INFO:tasks.workunit.client.1.smithi119.stdout:1/444: readlink d3/db/d26/l4c 0 2023-12-17T11:57:44.730 INFO:tasks.workunit.client.1.smithi119.stdout:1/445: stat d3/db/l8c 0 2023-12-17T11:57:44.730 INFO:tasks.workunit.client.1.smithi119.stdout:1/446: fsync d3/db/d26/f7b 0 2023-12-17T11:57:44.731 INFO:tasks.workunit.client.0.smithi002.stdout:8/472: creat d3/d8/f9a x:0 0 0 2023-12-17T11:57:44.731 INFO:tasks.workunit.client.0.smithi002.stdout:8/473: stat d3/d7/d18 0 2023-12-17T11:57:44.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/424: symlink d0/d6/d26/d14/l83 0 2023-12-17T11:57:44.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/425: chown d0/d6/d26/d14/d19 7818 1 2023-12-17T11:57:44.735 INFO:tasks.workunit.client.0.smithi002.stdout:0/426: write d0/d6/d26/d14/f5d [437231,15737] 0 2023-12-17T11:57:44.735 INFO:tasks.workunit.client.0.smithi002.stdout:3/476: dwrite d9/d1b/d4f/f68 [0,4194304] 0 2023-12-17T11:57:44.735 INFO:tasks.workunit.client.1.smithi119.stdout:0/348: dwrite d2/d16/d12/d1f/f57 [0,4194304] 0 2023-12-17T11:57:44.736 INFO:tasks.workunit.client.1.smithi119.stdout:9/505: truncate d12/d1d/d28/d4d/f5e 6480653 0 2023-12-17T11:57:44.739 INFO:tasks.workunit.client.0.smithi002.stdout:8/474: creat d3/d8/d28/d31/d5a/d7c/f9b x:0 0 0 2023-12-17T11:57:44.740 INFO:tasks.workunit.client.1.smithi119.stdout:8/377: mknod d7/da/d1a/c7f 0 2023-12-17T11:57:44.740 INFO:tasks.workunit.client.1.smithi119.stdout:5/478: write d1/f17 [6894315,51516] 0 2023-12-17T11:57:44.746 INFO:tasks.workunit.client.1.smithi119.stdout:7/460: truncate d2/d40/f6d 108471 0 2023-12-17T11:57:44.746 INFO:tasks.workunit.client.0.smithi002.stdout:2/471: sync 2023-12-17T11:57:44.747 INFO:tasks.workunit.client.0.smithi002.stdout:6/445: sync 2023-12-17T11:57:44.747 INFO:tasks.workunit.client.0.smithi002.stdout:2/472: chown d3/d4/d7/d14/d2e 1401386 1 2023-12-17T11:57:44.747 INFO:tasks.workunit.client.0.smithi002.stdout:2/473: truncate d3/d4/d17/d19/f89 461136 0 2023-12-17T11:57:44.751 INFO:tasks.workunit.client.0.smithi002.stdout:3/477: unlink d9/d1b/d35/d41/d43/c64 0 2023-12-17T11:57:44.751 INFO:tasks.workunit.client.0.smithi002.stdout:9/520: write f1 [4702116,57402] 0 2023-12-17T11:57:44.753 INFO:tasks.workunit.client.1.smithi119.stdout:1/447: link d3/db/d26/d5e/f7a d3/f9f 0 2023-12-17T11:57:44.754 INFO:tasks.workunit.client.1.smithi119.stdout:3/501: sync 2023-12-17T11:57:44.758 INFO:tasks.workunit.client.0.smithi002.stdout:5/466: getdents dc 0 2023-12-17T11:57:44.759 INFO:tasks.workunit.client.0.smithi002.stdout:4/446: dwrite d0/d10/d14/f59 [0,4194304] 0 2023-12-17T11:57:44.761 INFO:tasks.workunit.client.0.smithi002.stdout:4/447: truncate d0/d3e/d56/f77 4599801 0 2023-12-17T11:57:44.766 INFO:tasks.workunit.client.0.smithi002.stdout:8/475: creat d3/d7/d1a/f9c x:0 0 0 2023-12-17T11:57:44.768 INFO:tasks.workunit.client.0.smithi002.stdout:3/478: mknod d9/d1b/d4f/c99 0 2023-12-17T11:57:44.770 INFO:tasks.workunit.client.1.smithi119.stdout:6/423: rmdir d2/df 39 2023-12-17T11:57:44.770 INFO:tasks.workunit.client.1.smithi119.stdout:6/424: creat d2/f86 x:0 0 0 2023-12-17T11:57:44.770 INFO:tasks.workunit.client.1.smithi119.stdout:6/425: dread - d2/d2b/f3d zero size 2023-12-17T11:57:44.770 INFO:tasks.workunit.client.1.smithi119.stdout:6/426: write d2/d2b/d43/d76/f7a [1274095,18487] 0 2023-12-17T11:57:44.776 INFO:tasks.workunit.client.0.smithi002.stdout:6/446: rmdir d0/d1/dc/d17/d67/d6c 39 2023-12-17T11:57:44.778 INFO:tasks.workunit.client.1.smithi119.stdout:4/447: rename dd/d2a to dd/d4b/d6a/d8f 0 2023-12-17T11:57:44.783 INFO:tasks.workunit.client.0.smithi002.stdout:8/476: link d3/d7/d1a/c56 d3/c9d 0 2023-12-17T11:57:44.783 INFO:tasks.workunit.client.0.smithi002.stdout:8/477: stat d3/d8/c17 0 2023-12-17T11:57:44.783 INFO:tasks.workunit.client.0.smithi002.stdout:8/478: fdatasync d3/d8/f42 0 2023-12-17T11:57:44.785 INFO:tasks.workunit.client.1.smithi119.stdout:8/378: mknod d7/d18/d15/d64/c80 0 2023-12-17T11:57:44.786 INFO:tasks.workunit.client.0.smithi002.stdout:3/479: creat d9/d40/f9a x:0 0 0 2023-12-17T11:57:44.788 INFO:tasks.workunit.client.1.smithi119.stdout:7/461: mknod d2/d4/d11/d2c/d55/c8e 0 2023-12-17T11:57:44.788 INFO:tasks.workunit.client.1.smithi119.stdout:7/462: dread - d2/d4/d70/f87 zero size 2023-12-17T11:57:44.789 INFO:tasks.workunit.client.1.smithi119.stdout:7/463: write d2/d4/d1f/f5c [2605898,60550] 0 2023-12-17T11:57:44.790 INFO:tasks.workunit.client.0.smithi002.stdout:6/447: rmdir d0/d8a 0 2023-12-17T11:57:44.790 INFO:tasks.workunit.client.0.smithi002.stdout:6/448: dread - d0/d1/d21/d56/d60/f85 zero size 2023-12-17T11:57:44.790 INFO:tasks.workunit.client.0.smithi002.stdout:4/448: dread d0/d10/d14/f59 [0,4194304] 0 2023-12-17T11:57:44.791 INFO:tasks.workunit.client.0.smithi002.stdout:4/449: write d0/d10/f4b [89835,50403] 0 2023-12-17T11:57:44.791 INFO:tasks.workunit.client.0.smithi002.stdout:6/449: creat d0/d1/dc/d17/d3c/d65/f8d x:0 0 0 2023-12-17T11:57:44.792 INFO:tasks.workunit.client.1.smithi119.stdout:2/513: unlink d6/f45 0 2023-12-17T11:57:44.797 INFO:tasks.workunit.client.0.smithi002.stdout:8/479: link d3/d8/da/l67 d3/d7/d18/d3f/l9e 0 2023-12-17T11:57:44.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/427: dwrite d0/d6/d26/d14/f5d [0,4194304] 0 2023-12-17T11:57:44.801 INFO:tasks.workunit.client.0.smithi002.stdout:0/428: write d0/f13 [3570948,41119] 0 2023-12-17T11:57:44.803 INFO:tasks.workunit.client.0.smithi002.stdout:3/480: creat d9/d1b/d4f/d88/f9b x:0 0 0 2023-12-17T11:57:44.808 INFO:tasks.workunit.client.1.smithi119.stdout:3/502: symlink d9/d59/dae/lc6 0 2023-12-17T11:57:44.808 INFO:tasks.workunit.client.1.smithi119.stdout:3/503: dread - d9/da/f83 zero size 2023-12-17T11:57:44.809 INFO:tasks.workunit.client.1.smithi119.stdout:3/504: write d9/d11/d1e/d55/f6e [919169,77301] 0 2023-12-17T11:57:44.809 INFO:tasks.workunit.client.1.smithi119.stdout:3/505: dread - d9/da/df/d41/d33/f62 zero size 2023-12-17T11:57:44.809 INFO:tasks.workunit.client.1.smithi119.stdout:7/464: dread d2/d4/f16 [4194304,4194304] 0 2023-12-17T11:57:44.809 INFO:tasks.workunit.client.0.smithi002.stdout:5/467: dwrite dc/f83 [0,4194304] 0 2023-12-17T11:57:44.809 INFO:tasks.workunit.client.0.smithi002.stdout:5/468: write dc/d17/f2c [861716,7048] 0 2023-12-17T11:57:44.810 INFO:tasks.workunit.client.1.smithi119.stdout:0/349: dwrite d2/d16/f17 [0,4194304] 0 2023-12-17T11:57:44.811 INFO:tasks.workunit.client.0.smithi002.stdout:6/450: creat d0/d1/dc/d17/d4c/f8e x:0 0 0 2023-12-17T11:57:44.812 INFO:tasks.workunit.client.1.smithi119.stdout:6/427: symlink d2/d2b/d43/d5e/l87 0 2023-12-17T11:57:44.813 INFO:tasks.workunit.client.0.smithi002.stdout:8/480: link d3/d8/d28/d31/d5a/d7c/f7e d3/d8/da/f9f 0 2023-12-17T11:57:44.814 INFO:tasks.workunit.client.1.smithi119.stdout:3/506: dread d9/d11/f3f [0,4194304] 0 2023-12-17T11:57:44.814 INFO:tasks.workunit.client.1.smithi119.stdout:3/507: fdatasync d9/d44/d8c/f9e 0 2023-12-17T11:57:44.816 INFO:tasks.workunit.client.0.smithi002.stdout:0/429: mknod d0/d33/c84 0 2023-12-17T11:57:44.818 INFO:tasks.workunit.client.0.smithi002.stdout:3/481: symlink d9/d1b/l9c 0 2023-12-17T11:57:44.818 INFO:tasks.workunit.client.0.smithi002.stdout:3/482: dread - d9/d1b/d35/d41/d59/d65/f87 zero size 2023-12-17T11:57:44.822 INFO:tasks.workunit.client.1.smithi119.stdout:4/448: unlink dd/f4a 0 2023-12-17T11:57:44.827 INFO:tasks.workunit.client.0.smithi002.stdout:2/474: dwrite d3/d4/d17/fa5 [0,4194304] 0 2023-12-17T11:57:44.827 INFO:tasks.workunit.client.0.smithi002.stdout:9/521: dwrite dc/d42/da0/d72/d93/f29 [0,4194304] 0 2023-12-17T11:57:44.827 INFO:tasks.workunit.client.0.smithi002.stdout:9/522: write dc/d42/da0/d72/d93/d52/fa5 [1781104,39691] 0 2023-12-17T11:57:44.827 INFO:tasks.workunit.client.0.smithi002.stdout:9/523: truncate dc/d1d/d25/fa1 591604 0 2023-12-17T11:57:44.827 INFO:tasks.workunit.client.1.smithi119.stdout:9/506: dwrite d12/d1d/d28/d4d/d73/f88 [0,4194304] 0 2023-12-17T11:57:44.828 INFO:tasks.workunit.client.1.smithi119.stdout:2/514: symlink d6/d9/d13/d34/d88/lb8 0 2023-12-17T11:57:44.828 INFO:tasks.workunit.client.1.smithi119.stdout:5/479: mknod d1/d25/c96 0 2023-12-17T11:57:44.830 INFO:tasks.workunit.client.1.smithi119.stdout:0/350: getdents d2/d16/d12/d1f/d24/d50 0 2023-12-17T11:57:44.832 INFO:tasks.workunit.client.0.smithi002.stdout:5/469: mkdir dc/d1a/d53/da9 0 2023-12-17T11:57:44.832 INFO:tasks.workunit.client.0.smithi002.stdout:5/470: chown dc/d1b/d2d/d98 2638868 1 2023-12-17T11:57:44.833 INFO:tasks.workunit.client.1.smithi119.stdout:6/428: mknod d2/d2b/c88 0 2023-12-17T11:57:44.833 INFO:tasks.workunit.client.1.smithi119.stdout:6/429: fsync d2/d2b/f3d 0 2023-12-17T11:57:44.833 INFO:tasks.workunit.client.1.smithi119.stdout:6/430: readlink d2/d2b/d43/l46 0 2023-12-17T11:57:44.834 INFO:tasks.workunit.client.0.smithi002.stdout:6/451: mkdir d0/d1/dc/d17/d8f 0 2023-12-17T11:57:44.834 INFO:tasks.workunit.client.0.smithi002.stdout:6/452: chown d0/d1/dc/d10/c27 42438262 1 2023-12-17T11:57:44.834 INFO:tasks.workunit.client.1.smithi119.stdout:3/508: mknod d9/d35/dbd/cc7 0 2023-12-17T11:57:44.835 INFO:tasks.workunit.client.1.smithi119.stdout:3/509: write d9/da/df/f17 [8945658,99682] 0 2023-12-17T11:57:44.836 INFO:tasks.workunit.client.0.smithi002.stdout:8/481: mknod d3/d7/d18/d3f/ca0 0 2023-12-17T11:57:44.841 INFO:tasks.workunit.client.0.smithi002.stdout:0/430: mknod d0/c85 0 2023-12-17T11:57:44.841 INFO:tasks.workunit.client.0.smithi002.stdout:3/483: symlink d9/l9d 0 2023-12-17T11:57:44.841 INFO:tasks.workunit.client.0.smithi002.stdout:3/484: write d9/d40/f9a [844121,78819] 0 2023-12-17T11:57:44.849 INFO:tasks.workunit.client.1.smithi119.stdout:2/515: dread d6/d9/d13/d1d/f50 [0,4194304] 0 2023-12-17T11:57:44.851 INFO:tasks.workunit.client.0.smithi002.stdout:2/475: mknod d3/d4/d7/d14/d34/cb1 0 2023-12-17T11:57:44.853 INFO:tasks.workunit.client.1.smithi119.stdout:5/480: mkdir d1/d25/d39/d71/d97 0 2023-12-17T11:57:44.854 INFO:tasks.workunit.client.0.smithi002.stdout:9/524: rename dc/d32/f71 to dc/d1d/d7c/d90/fbb 0 2023-12-17T11:57:44.855 INFO:tasks.workunit.client.1.smithi119.stdout:0/351: truncate d2/d16/d12/f32 1334407 0 2023-12-17T11:57:44.855 INFO:tasks.workunit.client.1.smithi119.stdout:0/352: truncate d2/d16/d35/d39/f4a 134540 0 2023-12-17T11:57:44.857 INFO:tasks.workunit.client.1.smithi119.stdout:7/465: dwrite d2/d4/d1f/f27 [0,4194304] 0 2023-12-17T11:57:44.857 INFO:tasks.workunit.client.1.smithi119.stdout:7/466: creat d2/d4/d11/d2c/f8f x:0 0 0 2023-12-17T11:57:44.857 INFO:tasks.workunit.client.1.smithi119.stdout:7/467: readlink d2/d4/l12 0 2023-12-17T11:57:44.857 INFO:tasks.workunit.client.1.smithi119.stdout:7/468: getdents d2/d4e/d71 0 2023-12-17T11:57:44.857 INFO:tasks.workunit.client.1.smithi119.stdout:6/431: symlink d2/d2b/d43/l89 0 2023-12-17T11:57:44.860 INFO:tasks.workunit.client.1.smithi119.stdout:8/379: rename d7/d12/d69/d2a to d7/d18/d15/d81 0 2023-12-17T11:57:44.860 INFO:tasks.workunit.client.1.smithi119.stdout:8/380: chown d7/da/f3e 0 1 2023-12-17T11:57:44.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/471: truncate dc/d1a/d47/f4a 34790 0 2023-12-17T11:57:44.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/472: stat dc/d1a/d47 0 2023-12-17T11:57:44.869 INFO:tasks.workunit.client.1.smithi119.stdout:0/353: symlink d2/d3/d5/dc/l61 0 2023-12-17T11:57:44.869 INFO:tasks.workunit.client.0.smithi002.stdout:8/482: creat d3/d7/d6e/d7f/d65/fa1 x:0 0 0 2023-12-17T11:57:44.871 INFO:tasks.workunit.client.0.smithi002.stdout:3/485: mknod d9/d1b/d4f/d88/c9e 0 2023-12-17T11:57:44.880 INFO:tasks.workunit.client.0.smithi002.stdout:8/483: dread d3/d8/da/f88 [0,4194304] 0 2023-12-17T11:57:44.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/453: rename d0/d1/dc/d58/f77 to d0/d1/dc/d17/d3c/d65/f90 0 2023-12-17T11:57:44.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/454: chown d0/d1/dc/d10/c59 54 1 2023-12-17T11:57:44.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/455: creat d0/d1/dc/d17/f91 x:0 0 0 2023-12-17T11:57:44.883 INFO:tasks.workunit.client.0.smithi002.stdout:6/456: fdatasync d0/d1/dc/d17/d3c/d65/f8d 0 2023-12-17T11:57:44.884 INFO:tasks.workunit.client.1.smithi119.stdout:8/381: write d7/da/d11/d26/f58 [2657629,104501] 0 2023-12-17T11:57:44.889 INFO:tasks.workunit.client.0.smithi002.stdout:0/431: dwrite d0/d33/f5b [0,4194304] 0 2023-12-17T11:57:44.892 INFO:tasks.workunit.client.0.smithi002.stdout:3/486: link d9/d1b/d35/d41/d59/l75 d9/d1b/d35/d41/d43/d73/d89/l9f 0 2023-12-17T11:57:44.893 INFO:tasks.workunit.client.1.smithi119.stdout:7/469: truncate d2/f19 3400574 0 2023-12-17T11:57:44.901 INFO:tasks.workunit.client.0.smithi002.stdout:8/484: mkdir d3/d7/d6e/d7f/d65/da2 0 2023-12-17T11:57:44.902 INFO:tasks.workunit.client.1.smithi119.stdout:3/510: rename d9/d11/d1e/d55/f6e to d9/da/df/d41/d33/d3a/fc8 0 2023-12-17T11:57:44.908 INFO:tasks.workunit.client.1.smithi119.stdout:4/449: dwrite dd/d15/d16/d3d/f7c [0,4194304] 0 2023-12-17T11:57:44.908 INFO:tasks.workunit.client.1.smithi119.stdout:4/450: read - dd/d11/d26/f7e zero size 2023-12-17T11:57:44.909 INFO:tasks.workunit.client.1.smithi119.stdout:2/516: getdents d6/d9/d13/d34 0 2023-12-17T11:57:44.909 INFO:tasks.workunit.client.0.smithi002.stdout:7/447: sync 2023-12-17T11:57:44.912 INFO:tasks.workunit.client.0.smithi002.stdout:6/457: mknod d0/d1/dc/d17/d4c/c92 0 2023-12-17T11:57:44.913 INFO:tasks.workunit.client.1.smithi119.stdout:7/470: dread d2/d4/d11/d2c/f3a [0,4194304] 0 2023-12-17T11:57:44.913 INFO:tasks.workunit.client.1.smithi119.stdout:7/471: readlink d2/d4/d11/d2c/d68/d6a/l80 0 2023-12-17T11:57:44.913 INFO:tasks.workunit.client.1.smithi119.stdout:7/472: stat d2/d4b/f52 0 2023-12-17T11:57:44.913 INFO:tasks.workunit.client.1.smithi119.stdout:7/473: stat d2/d40 0 2023-12-17T11:57:44.913 INFO:tasks.workunit.client.1.smithi119.stdout:6/432: dwrite d2/d2b/f63 [0,4194304] 0 2023-12-17T11:57:44.913 INFO:tasks.workunit.client.1.smithi119.stdout:6/433: chown d2/d2b/d43/c75 22513116 1 2023-12-17T11:57:44.914 INFO:tasks.workunit.client.1.smithi119.stdout:6/434: chown d2/f86 4042 1 2023-12-17T11:57:44.916 INFO:tasks.workunit.client.1.smithi119.stdout:5/481: rmdir d1/d25/d39/d71 39 2023-12-17T11:57:44.918 INFO:tasks.workunit.client.0.smithi002.stdout:5/473: dwrite dc/d17/f55 [8388608,4194304] 0 2023-12-17T11:57:44.918 INFO:tasks.workunit.client.0.smithi002.stdout:5/474: chown dc/d1b 61 1 2023-12-17T11:57:44.919 INFO:tasks.workunit.client.0.smithi002.stdout:5/475: creat dc/d1a/faa x:0 0 0 2023-12-17T11:57:44.919 INFO:tasks.workunit.client.0.smithi002.stdout:5/476: truncate dc/f18 4707986 0 2023-12-17T11:57:44.919 INFO:tasks.workunit.client.0.smithi002.stdout:9/525: dwrite dc/d38/f5e [0,4194304] 0 2023-12-17T11:57:44.924 INFO:tasks.workunit.client.1.smithi119.stdout:3/511: creat d9/da/df/d41/d33/db4/fc9 x:0 0 0 2023-12-17T11:57:44.924 INFO:tasks.workunit.client.1.smithi119.stdout:3/512: dread - d9/d1c/f7b zero size 2023-12-17T11:57:44.924 INFO:tasks.workunit.client.1.smithi119.stdout:3/513: write d9/d11/f5f [382481,53905] 0 2023-12-17T11:57:44.924 INFO:tasks.workunit.client.1.smithi119.stdout:3/514: stat d9/d44/d8c/fad 0 2023-12-17T11:57:44.924 INFO:tasks.workunit.client.1.smithi119.stdout:3/515: chown d9/d11/d1e/d55/d65/fc5 0 1 2023-12-17T11:57:44.929 INFO:tasks.workunit.client.0.smithi002.stdout:0/432: mkdir d0/d6/d26/d14/d19/d37/d86 0 2023-12-17T11:57:44.929 INFO:tasks.workunit.client.1.smithi119.stdout:8/382: dwrite d7/da/d1a/f1c [0,4194304] 0 2023-12-17T11:57:44.929 INFO:tasks.workunit.client.1.smithi119.stdout:8/383: chown d7/l48 14208523 1 2023-12-17T11:57:44.932 INFO:tasks.workunit.client.0.smithi002.stdout:3/487: symlink d9/d1b/d35/d41/la0 0 2023-12-17T11:57:44.937 INFO:tasks.workunit.client.0.smithi002.stdout:7/448: unlink d6/d17/dc/d67/c1f 0 2023-12-17T11:57:44.937 INFO:tasks.workunit.client.0.smithi002.stdout:7/449: rename d6 to d6/d17/dc/d67/d86/d88 22 2023-12-17T11:57:44.939 INFO:tasks.workunit.client.1.smithi119.stdout:4/451: mknod dd/d4b/d6a/d8f/d55/d81/c90 0 2023-12-17T11:57:44.942 INFO:tasks.workunit.client.1.smithi119.stdout:2/517: mkdir d6/d2b/db9 0 2023-12-17T11:57:44.949 INFO:tasks.workunit.client.1.smithi119.stdout:7/474: mknod d2/d4b/c90 0 2023-12-17T11:57:44.950 INFO:tasks.workunit.client.1.smithi119.stdout:7/475: fdatasync d2/d4/d11/d2c/d68/f85 0 2023-12-17T11:57:44.950 INFO:tasks.workunit.client.1.smithi119.stdout:7/476: fsync d2/d4/d11/d2c/d68/d77/f79 0 2023-12-17T11:57:44.951 INFO:tasks.workunit.client.1.smithi119.stdout:5/482: creat d1/d70/d6b/d77/f98 x:0 0 0 2023-12-17T11:57:44.952 INFO:tasks.workunit.client.1.smithi119.stdout:5/483: chown d1/d25/d39/d71/d82/d86/f66 1878707 1 2023-12-17T11:57:44.955 INFO:tasks.workunit.client.1.smithi119.stdout:8/384: truncate d7/da/d11/d26/d2c/f5a 164307 0 2023-12-17T11:57:44.957 INFO:tasks.workunit.client.0.smithi002.stdout:9/526: creat dc/fbc x:0 0 0 2023-12-17T11:57:44.958 INFO:tasks.workunit.client.1.smithi119.stdout:0/354: rename d2/d16/d12/d2e/l4d to d2/d16/d35/l62 0 2023-12-17T11:57:44.958 INFO:tasks.workunit.client.1.smithi119.stdout:0/355: read - d2/d3/d5/d3f/f5e zero size 2023-12-17T11:57:44.958 INFO:tasks.workunit.client.1.smithi119.stdout:0/356: getdents d2/d16/d12/d1f/d24/d50 0 2023-12-17T11:57:44.959 INFO:tasks.workunit.client.0.smithi002.stdout:0/433: truncate d0/d6/d26/d14/d19/d2b/f42 423445 0 2023-12-17T11:57:44.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/434: write d0/d6/d26/d14/d19/d37/f39 [4607045,46644] 0 2023-12-17T11:57:44.961 INFO:tasks.workunit.client.0.smithi002.stdout:0/435: creat d0/d15/f87 x:0 0 0 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/488: mknod d9/d1b/d35/d41/d59/d65/ca1 0 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/531: sync 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/532: chown d3/d6/d9/c4f 231 1 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/489: write d9/d1b/d35/d41/d59/d65/d7e/d8f/f90 [937341,28653] 0 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/533: chown d3/d6/d9/d30/d9c/cb1 11827713 1 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:3/490: chown d9/d15/d52/d79 94829 1 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/534: readlink d3/d6/d9/la0 0 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/535: chown d3/d6/d9/d37/c3b 49 1 2023-12-17T11:57:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:1/536: write d3/d6/d16/d61/f86 [189728,7959] 0 2023-12-17T11:57:44.963 INFO:tasks.workunit.client.1.smithi119.stdout:6/435: dwrite d2/d2b/d43/f85 [0,4194304] 0 2023-12-17T11:57:44.963 INFO:tasks.workunit.client.1.smithi119.stdout:4/452: mkdir dd/d4b/d6a/d8f/d55/d81/d88/d91 0 2023-12-17T11:57:44.963 INFO:tasks.workunit.client.1.smithi119.stdout:2/518: truncate d6/d9/d52/d53/d55/d58/f68 325876 0 2023-12-17T11:57:44.963 INFO:tasks.workunit.client.0.smithi002.stdout:6/458: getdents d0/d1/dc/d58 0 2023-12-17T11:57:44.975 INFO:tasks.workunit.client.1.smithi119.stdout:7/477: truncate d2/d4/d70/f45 886737 0 2023-12-17T11:57:44.976 INFO:tasks.workunit.client.1.smithi119.stdout:0/357: write d2/d3/f14 [444012,5175] 0 2023-12-17T11:57:44.976 INFO:tasks.workunit.client.1.smithi119.stdout:0/358: chown d2/d16/d35/l46 0 1 2023-12-17T11:57:44.976 INFO:tasks.workunit.client.1.smithi119.stdout:8/385: dread d7/d18/f4f [0,4194304] 0 2023-12-17T11:57:44.976 INFO:tasks.workunit.client.1.smithi119.stdout:8/386: chown d7/d18/d45/f56 0 1 2023-12-17T11:57:44.980 INFO:tasks.workunit.client.1.smithi119.stdout:5/484: link d1/d25/c96 d1/d25/d39/d71/c99 0 2023-12-17T11:57:44.986 INFO:tasks.workunit.client.0.smithi002.stdout:1/537: rename d3/d2f/d4d/l70 to d3/d2f/d74/d97/lb7 0 2023-12-17T11:57:44.988 INFO:tasks.workunit.client.1.smithi119.stdout:3/516: rmdir d9/d11/d1e/d55 39 2023-12-17T11:57:44.988 INFO:tasks.workunit.client.1.smithi119.stdout:3/517: dread - d9/d44/fc1 zero size 2023-12-17T11:57:44.991 INFO:tasks.workunit.client.0.smithi002.stdout:6/459: mkdir d0/d1/d21/d56/d8c/d93 0 2023-12-17T11:57:44.991 INFO:tasks.workunit.client.0.smithi002.stdout:6/460: stat d0/d1/d21/d56/d60/f6e 0 2023-12-17T11:57:44.992 INFO:tasks.workunit.client.0.smithi002.stdout:5/477: truncate dc/f18 3874619 0 2023-12-17T11:57:44.996 INFO:tasks.workunit.client.1.smithi119.stdout:5/485: dread d1/d44/d52/f5f [0,4194304] 0 2023-12-17T11:57:44.997 INFO:tasks.workunit.client.1.smithi119.stdout:5/486: read d1/d25/d39/f3b [344717,46235] 0 2023-12-17T11:57:45.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/453: mknod dd/d15/d16/d3d/c92 0 2023-12-17T11:57:45.001 INFO:tasks.workunit.client.1.smithi119.stdout:2/519: mkdir d6/d9/d52/d53/d55/d58/dba 0 2023-12-17T11:57:45.003 INFO:tasks.workunit.client.1.smithi119.stdout:8/387: rmdir d7/da/d11/d26 39 2023-12-17T11:57:45.007 INFO:tasks.workunit.client.1.smithi119.stdout:0/359: dread d2/d16/d12/d1f/f22 [0,4194304] 0 2023-12-17T11:57:45.007 INFO:tasks.workunit.client.1.smithi119.stdout:0/360: truncate d2/d16/d12/f53 640976 0 2023-12-17T11:57:45.008 INFO:tasks.workunit.client.0.smithi002.stdout:6/461: read d0/d1/d28/f3d [3248027,15235] 0 2023-12-17T11:57:45.009 INFO:tasks.workunit.client.0.smithi002.stdout:6/462: write d0/d1/d28/f7b [750472,47444] 0 2023-12-17T11:57:45.009 INFO:tasks.workunit.client.0.smithi002.stdout:6/463: truncate d0/d1/dc/d17/d3c/d65/f68 5039341 0 2023-12-17T11:57:45.009 INFO:tasks.workunit.client.0.smithi002.stdout:6/464: creat d0/d1/dc/d17/d3c/f94 x:0 0 0 2023-12-17T11:57:45.009 INFO:tasks.workunit.client.0.smithi002.stdout:6/465: creat d0/d1/d5b/f95 x:0 0 0 2023-12-17T11:57:45.009 INFO:tasks.workunit.client.0.smithi002.stdout:6/466: truncate d0/f48 390567 0 2023-12-17T11:57:45.010 INFO:tasks.workunit.client.1.smithi119.stdout:2/520: creat d6/d9/d52/d53/d55/fbb x:0 0 0 2023-12-17T11:57:45.010 INFO:tasks.workunit.client.1.smithi119.stdout:2/521: chown d6/d2b/d3f/d5c/la4 0 1 2023-12-17T11:57:45.010 INFO:tasks.workunit.client.1.smithi119.stdout:2/522: creat d6/d38/fbc x:0 0 0 2023-12-17T11:57:45.013 INFO:tasks.workunit.client.0.smithi002.stdout:5/478: write dc/d1b/f6e [508526,119145] 0 2023-12-17T11:57:45.013 INFO:tasks.workunit.client.0.smithi002.stdout:5/479: write dc/d1a/d47/d9b/f9c [1038733,106103] 0 2023-12-17T11:57:45.013 INFO:tasks.workunit.client.1.smithi119.stdout:3/518: write d9/da/fa7 [1086764,41642] 0 2023-12-17T11:57:45.014 INFO:tasks.workunit.client.1.smithi119.stdout:8/388: rmdir d7/da/d11/d26/d2c/d75/d7a 0 2023-12-17T11:57:45.014 INFO:tasks.workunit.client.1.smithi119.stdout:3/519: read - d9/d11/d1e/d55/d65/f99 zero size 2023-12-17T11:57:45.017 INFO:tasks.workunit.client.1.smithi119.stdout:0/361: mknod d2/d3/c63 0 2023-12-17T11:57:45.018 INFO:tasks.workunit.client.1.smithi119.stdout:0/362: write d2/d3/d5/d3f/f52 [1331468,86012] 0 2023-12-17T11:57:45.018 INFO:tasks.workunit.client.1.smithi119.stdout:5/487: dread d1/f29 [0,4194304] 0 2023-12-17T11:57:45.020 INFO:tasks.workunit.client.1.smithi119.stdout:6/436: dwrite d2/df/f30 [4194304,4194304] 0 2023-12-17T11:57:45.023 INFO:tasks.workunit.client.0.smithi002.stdout:5/480: creat dc/d1b/d2d/d98/fab x:0 0 0 2023-12-17T11:57:45.023 INFO:tasks.workunit.client.1.smithi119.stdout:2/523: creat d6/fbd x:0 0 0 2023-12-17T11:57:45.023 INFO:tasks.workunit.client.1.smithi119.stdout:2/524: creat d6/d9/d52/d53/d55/d58/fbe x:0 0 0 2023-12-17T11:57:45.025 INFO:tasks.workunit.client.0.smithi002.stdout:0/436: rmdir d0/d15 39 2023-12-17T11:57:45.025 INFO:tasks.workunit.client.0.smithi002.stdout:0/437: creat d0/d6/d26/d14/d19/d61/f88 x:0 0 0 2023-12-17T11:57:45.029 INFO:tasks.workunit.client.1.smithi119.stdout:8/389: symlink d7/da/d11/d26/d2c/d75/l82 0 2023-12-17T11:57:45.036 INFO:tasks.workunit.client.0.smithi002.stdout:5/481: rename dc/d17/d1c/f69 to dc/d17/d2f/d99/fac 0 2023-12-17T11:57:45.039 INFO:tasks.workunit.client.1.smithi119.stdout:0/363: creat d2/d16/d12/d1f/d24/d50/d5d/f64 x:0 0 0 2023-12-17T11:57:45.040 INFO:tasks.workunit.client.1.smithi119.stdout:5/488: chown d1/d25/c2b 1 1 2023-12-17T11:57:45.045 INFO:tasks.workunit.client.0.smithi002.stdout:3/491: dwrite d9/d1b/d35/d41/d59/d7c/f8b [0,4194304] 0 2023-12-17T11:57:45.046 INFO:tasks.workunit.client.1.smithi119.stdout:4/454: dread dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:45.048 INFO:tasks.workunit.client.1.smithi119.stdout:6/437: mkdir d2/d61/d8a 0 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/525: dread d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/526: write d6/d9/d52/d53/d55/fbb [826001,41115] 0 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/527: fdatasync d6/f21 0 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/528: write d6/d38/fa6 [796176,28114] 0 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/529: dread - d6/d2b/d3f/f98 zero size 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/530: write d6/d2b/d3f/f6d [241304,86354] 0 2023-12-17T11:57:45.055 INFO:tasks.workunit.client.1.smithi119.stdout:2/531: truncate d6/f11 2153147 0 2023-12-17T11:57:45.056 INFO:tasks.workunit.client.0.smithi002.stdout:5/482: read dc/d17/f26 [1222783,46516] 0 2023-12-17T11:57:45.056 INFO:tasks.workunit.client.0.smithi002.stdout:1/538: dwrite d3/d5c/f5d [0,4194304] 0 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/507: sync 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/508: truncate d12/d1d/f51 729728 0 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:1/448: sync 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/509: write d12/d1d/d49/d85/f90 [4816141,42689] 0 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/510: creat d12/d1d/d79/f9b x:0 0 0 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/511: chown d12/d1d/c29 109815784 1 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/512: stat d12/d1d/d49 0 2023-12-17T11:57:45.060 INFO:tasks.workunit.client.1.smithi119.stdout:9/513: write d12/d1d/d28/d46/d50/f60 [2576863,73419] 0 2023-12-17T11:57:45.061 INFO:tasks.workunit.client.1.smithi119.stdout:7/478: dwrite d2/f24 [0,4194304] 0 2023-12-17T11:57:45.065 INFO:tasks.workunit.client.1.smithi119.stdout:8/390: getdents d7/d12/d69 0 2023-12-17T11:57:45.069 INFO:tasks.workunit.client.1.smithi119.stdout:2/532: dread d6/d9/d13/d1d/f2d [0,4194304] 0 2023-12-17T11:57:45.069 INFO:tasks.workunit.client.1.smithi119.stdout:2/533: chown d6/d38/fa6 126 1 2023-12-17T11:57:45.079 INFO:tasks.workunit.client.1.smithi119.stdout:9/514: mknod d12/d1d/d49/d89/c9c 0 2023-12-17T11:57:45.082 INFO:tasks.workunit.client.1.smithi119.stdout:9/515: rename d12 to d12/d1d/d49/d89/d9d 22 2023-12-17T11:57:45.083 INFO:tasks.workunit.client.1.smithi119.stdout:7/479: link d2/d4/d11/d2c/c3b d2/d4/d11/d2c/c91 0 2023-12-17T11:57:45.093 INFO:tasks.workunit.client.1.smithi119.stdout:1/449: getdents d3/db 0 2023-12-17T11:57:45.096 INFO:tasks.workunit.client.1.smithi119.stdout:2/534: getdents d6/d9 0 2023-12-17T11:57:45.101 INFO:tasks.workunit.client.1.smithi119.stdout:5/489: dread d1/f29 [0,4194304] 0 2023-12-17T11:57:45.101 INFO:tasks.workunit.client.1.smithi119.stdout:3/520: dwrite d9/d11/d1e/d55/f66 [0,4194304] 0 2023-12-17T11:57:45.102 INFO:tasks.workunit.client.0.smithi002.stdout:5/483: mkdir dc/d1b/dad 0 2023-12-17T11:57:45.104 INFO:tasks.workunit.client.1.smithi119.stdout:4/455: dwrite dd/d15/d16/d20/d42/f67 [0,4194304] 0 2023-12-17T11:57:45.105 INFO:tasks.workunit.client.1.smithi119.stdout:1/450: symlink d3/db/d17/d24/d20/la0 0 2023-12-17T11:57:45.105 INFO:tasks.workunit.client.1.smithi119.stdout:1/451: chown d3/db/d17/d24/d20/d6c 97075715 1 2023-12-17T11:57:45.109 INFO:tasks.workunit.client.0.smithi002.stdout:1/539: creat d3/d2f/fb8 x:0 0 0 2023-12-17T11:57:45.110 INFO:tasks.workunit.client.0.smithi002.stdout:1/540: creat d3/d2f/fb9 x:0 0 0 2023-12-17T11:57:45.111 INFO:tasks.workunit.client.1.smithi119.stdout:9/516: dread d12/d1d/d49/f52 [0,4194304] 0 2023-12-17T11:57:45.111 INFO:tasks.workunit.client.1.smithi119.stdout:5/490: creat d1/d25/d39/d71/d76/d83/f9a x:0 0 0 2023-12-17T11:57:45.111 INFO:tasks.workunit.client.1.smithi119.stdout:9/517: creat d12/d1d/f9e x:0 0 0 2023-12-17T11:57:45.111 INFO:tasks.workunit.client.1.smithi119.stdout:5/491: fsync d1/d25/d39/d71/f73 0 2023-12-17T11:57:45.113 INFO:tasks.workunit.client.0.smithi002.stdout:3/492: symlink d9/d15/d6a/la2 0 2023-12-17T11:57:45.113 INFO:tasks.workunit.client.1.smithi119.stdout:3/521: truncate d9/d11/f72 2270971 0 2023-12-17T11:57:45.113 INFO:tasks.workunit.client.1.smithi119.stdout:3/522: read - d9/f85 zero size 2023-12-17T11:57:45.123 INFO:tasks.workunit.client.1.smithi119.stdout:5/492: mknod d1/d44/d52/c9b 0 2023-12-17T11:57:45.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/493: mkdir d9/d1b/d35/d41/d59/da3 0 2023-12-17T11:57:45.123 INFO:tasks.workunit.client.1.smithi119.stdout:2/535: dread d6/d9/d86/fb4 [0,4194304] 0 2023-12-17T11:57:45.128 INFO:tasks.workunit.client.1.smithi119.stdout:8/391: dwrite d7/da/f3f [0,4194304] 0 2023-12-17T11:57:45.128 INFO:tasks.workunit.client.1.smithi119.stdout:1/452: dread d3/db/d17/f31 [0,4194304] 0 2023-12-17T11:57:45.128 INFO:tasks.workunit.client.1.smithi119.stdout:1/453: stat d3/db/d26/d19/d3f/f51 0 2023-12-17T11:57:45.128 INFO:tasks.workunit.client.1.smithi119.stdout:3/523: mkdir d9/d35/dca 0 2023-12-17T11:57:45.129 INFO:tasks.workunit.client.1.smithi119.stdout:4/456: dread f8 [0,4194304] 0 2023-12-17T11:57:45.129 INFO:tasks.workunit.client.1.smithi119.stdout:5/493: symlink d1/d70/d6b/d77/l9c 0 2023-12-17T11:57:45.129 INFO:tasks.workunit.client.1.smithi119.stdout:5/494: fsync d1/f8 0 2023-12-17T11:57:45.133 INFO:tasks.workunit.client.1.smithi119.stdout:6/438: dwrite d2/d61/f67 [0,4194304] 0 2023-12-17T11:57:45.137 INFO:tasks.workunit.client.1.smithi119.stdout:2/536: dread - d6/d9/d13/d34/f99 zero size 2023-12-17T11:57:45.137 INFO:tasks.workunit.client.1.smithi119.stdout:1/454: mkdir d3/db/d17/d24/d20/d40/d6d/d7e/da1 0 2023-12-17T11:57:45.141 INFO:tasks.workunit.client.1.smithi119.stdout:1/455: dread - d3/db/d26/d19/f70 zero size 2023-12-17T11:57:45.141 INFO:tasks.workunit.client.1.smithi119.stdout:3/524: mknod d9/d44/d8c/ccb 0 2023-12-17T11:57:45.141 INFO:tasks.workunit.client.1.smithi119.stdout:4/457: mknod dd/d4b/d6a/d8f/d55/c93 0 2023-12-17T11:57:45.143 INFO:tasks.workunit.client.1.smithi119.stdout:0/364: dwrite d2/d16/d12/d1f/d24/d50/d5d/f64 [0,4194304] 0 2023-12-17T11:57:45.149 INFO:tasks.workunit.client.1.smithi119.stdout:2/537: write d6/d9/d52/d53/d55/f7d [190476,80988] 0 2023-12-17T11:57:45.151 INFO:tasks.workunit.client.1.smithi119.stdout:7/480: dwrite d2/d4/d70/f87 [0,4194304] 0 2023-12-17T11:57:45.151 INFO:tasks.workunit.client.1.smithi119.stdout:7/481: write d2/f19 [639216,13506] 0 2023-12-17T11:57:45.151 INFO:tasks.workunit.client.1.smithi119.stdout:7/482: chown d2/d4/d11/d2c/d55/c8e 7498 1 2023-12-17T11:57:45.151 INFO:tasks.workunit.client.1.smithi119.stdout:5/495: creat d1/d25/d39/d71/d76/f9d x:0 0 0 2023-12-17T11:57:45.151 INFO:tasks.workunit.client.1.smithi119.stdout:5/496: chown d1/d25/f31 688426935 1 2023-12-17T11:57:45.151 INFO:tasks.workunit.client.1.smithi119.stdout:5/497: write d1/fa [4367099,52859] 0 2023-12-17T11:57:45.152 INFO:tasks.workunit.client.1.smithi119.stdout:5/498: dread - d1/d70/d85/f93 zero size 2023-12-17T11:57:45.164 INFO:tasks.workunit.client.1.smithi119.stdout:3/525: rename d9/d11/d1e/d55/d65/d84/d9d to d9/da/dcc 0 2023-12-17T11:57:45.164 INFO:tasks.workunit.client.1.smithi119.stdout:4/458: read f2 [1463867,121784] 0 2023-12-17T11:57:45.172 INFO:tasks.workunit.client.1.smithi119.stdout:0/365: unlink d2/d16/d12/f32 0 2023-12-17T11:57:45.172 INFO:tasks.workunit.client.1.smithi119.stdout:0/366: dread - d2/d3/d5/d3f/f5e zero size 2023-12-17T11:57:45.173 INFO:tasks.workunit.client.1.smithi119.stdout:1/456: dread d3/db/d2a/f66 [0,4194304] 0 2023-12-17T11:57:45.173 INFO:tasks.workunit.client.1.smithi119.stdout:1/457: readlink d3/db/d17/d24/d20/d40/d76/d84/l9b 0 2023-12-17T11:57:45.177 INFO:tasks.workunit.client.1.smithi119.stdout:2/538: mkdir d6/d9/d13/d1d/dbf 0 2023-12-17T11:57:45.177 INFO:tasks.workunit.client.1.smithi119.stdout:2/539: chown d6/d2b/d4b/d5d/f90 404885 1 2023-12-17T11:57:45.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/484: dwrite dc/d1b/d5a/d96/f36 [0,4194304] 0 2023-12-17T11:57:45.183 INFO:tasks.workunit.client.0.smithi002.stdout:5/485: creat dc/d17/d1c/fae x:0 0 0 2023-12-17T11:57:45.184 INFO:tasks.workunit.client.0.smithi002.stdout:3/494: dwrite d9/d1b/d35/d41/d59/d65/d7e/d8f/f90 [0,4194304] 0 2023-12-17T11:57:45.186 INFO:tasks.workunit.client.0.smithi002.stdout:4/450: sync 2023-12-17T11:57:45.187 INFO:tasks.workunit.client.1.smithi119.stdout:7/483: dread d2/f24 [0,4194304] 0 2023-12-17T11:57:45.187 INFO:tasks.workunit.client.1.smithi119.stdout:7/484: chown d2/d4e/d6c/f7c 208711853 1 2023-12-17T11:57:45.187 INFO:tasks.workunit.client.1.smithi119.stdout:7/485: chown d2/d4/d70/d57/c50 447 1 2023-12-17T11:57:45.188 INFO:tasks.workunit.client.1.smithi119.stdout:4/459: rmdir dd/d15/d16/d5a 39 2023-12-17T11:57:45.189 INFO:tasks.workunit.client.0.smithi002.stdout:2/476: sync 2023-12-17T11:57:45.196 INFO:tasks.workunit.client.1.smithi119.stdout:2/540: mkdir d6/d2b/da3/dc0 0 2023-12-17T11:57:45.196 INFO:tasks.workunit.client.1.smithi119.stdout:2/541: chown d6/d38 1025502 1 2023-12-17T11:57:45.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/467: sync 2023-12-17T11:57:45.203 INFO:tasks.workunit.client.0.smithi002.stdout:9/527: sync 2023-12-17T11:57:45.203 INFO:tasks.workunit.client.0.smithi002.stdout:8/485: sync 2023-12-17T11:57:45.204 INFO:tasks.workunit.client.0.smithi002.stdout:6/468: chown d0/d1/d5b/l7e 310275931 1 2023-12-17T11:57:45.205 INFO:tasks.workunit.client.0.smithi002.stdout:7/450: sync 2023-12-17T11:57:45.205 INFO:tasks.workunit.client.0.smithi002.stdout:0/438: sync 2023-12-17T11:57:45.205 INFO:tasks.workunit.client.1.smithi119.stdout:7/486: link d2/d4/f29 d2/d5b/f92 0 2023-12-17T11:57:45.208 INFO:tasks.workunit.client.1.smithi119.stdout:4/460: link dd/f41 dd/f94 0 2023-12-17T11:57:45.212 INFO:tasks.workunit.client.1.smithi119.stdout:0/367: link d2/d3/d5/lb d2/d16/d35/l65 0 2023-12-17T11:57:45.215 INFO:tasks.workunit.client.0.smithi002.stdout:9/528: dread dc/d42/d4f/f98 [0,4194304] 0 2023-12-17T11:57:45.215 INFO:tasks.workunit.client.0.smithi002.stdout:3/495: creat d9/d1b/fa4 x:0 0 0 2023-12-17T11:57:45.221 INFO:tasks.workunit.client.1.smithi119.stdout:5/499: dwrite d1/d44/f72 [0,4194304] 0 2023-12-17T11:57:45.221 INFO:tasks.workunit.client.1.smithi119.stdout:3/526: dwrite d9/da/df/d41/d33/d3a/fc8 [0,4194304] 0 2023-12-17T11:57:45.224 INFO:tasks.workunit.client.0.smithi002.stdout:8/486: creat d3/d7/d6e/d7f/fa3 x:0 0 0 2023-12-17T11:57:45.224 INFO:tasks.workunit.client.0.smithi002.stdout:8/487: read - d3/d7/d18/d74/f82 zero size 2023-12-17T11:57:45.225 INFO:tasks.workunit.client.1.smithi119.stdout:2/542: mknod d6/d9/d52/d74/cc1 0 2023-12-17T11:57:45.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:44 smithi002 ceph-mon[107131]: pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 180 MiB/s rd, 225 MiB/s wr, 310 op/s 2023-12-17T11:57:45.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/451: dwrite d0/f83 [0,4194304] 0 2023-12-17T11:57:45.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/452: creat d0/d3e/d56/d65/d78/f92 x:0 0 0 2023-12-17T11:57:45.227 INFO:tasks.workunit.client.0.smithi002.stdout:4/453: write d0/d10/d14/f52 [4751548,91652] 0 2023-12-17T11:57:45.229 INFO:tasks.workunit.client.0.smithi002.stdout:0/439: truncate d0/d6/d26/d14/f53 255688 0 2023-12-17T11:57:45.229 INFO:tasks.workunit.client.0.smithi002.stdout:6/469: creat d0/d1/f96 x:0 0 0 2023-12-17T11:57:45.229 INFO:tasks.workunit.client.1.smithi119.stdout:1/458: dwrite d3/db/f1f [4194304,4194304] 0 2023-12-17T11:57:45.234 INFO:tasks.workunit.client.1.smithi119.stdout:7/487: link d2/d5b/l73 d2/d4/d1f/l93 0 2023-12-17T11:57:45.235 INFO:tasks.workunit.client.1.smithi119.stdout:7/488: fsync d2/d4/d70/d57/d56/f62 0 2023-12-17T11:57:45.235 INFO:tasks.workunit.client.1.smithi119.stdout:7/489: write d2/f31 [847879,2958] 0 2023-12-17T11:57:45.235 INFO:tasks.workunit.client.0.smithi002.stdout:5/486: rename dc/d1b/d2d/d98 to dc/d1b/d5a/d68/d97/daf 0 2023-12-17T11:57:45.235 INFO:tasks.workunit.client.1.smithi119.stdout:4/461: rmdir dd/d15 39 2023-12-17T11:57:45.236 INFO:tasks.workunit.client.1.smithi119.stdout:4/462: truncate dd/d15/f53 181191 0 2023-12-17T11:57:45.236 INFO:tasks.workunit.client.0.smithi002.stdout:8/488: mkdir d3/d8/da/d44/da4 0 2023-12-17T11:57:45.237 INFO:tasks.workunit.client.0.smithi002.stdout:8/489: write d3/d7/d6e/d7f/f54 [399071,106604] 0 2023-12-17T11:57:45.240 INFO:tasks.workunit.client.1.smithi119.stdout:5/500: write d1/d44/f72 [3479589,75725] 0 2023-12-17T11:57:45.248 INFO:tasks.workunit.client.1.smithi119.stdout:9/518: dwrite d12/d1d/f51 [0,4194304] 0 2023-12-17T11:57:45.248 INFO:tasks.workunit.client.1.smithi119.stdout:9/519: chown d12/d1d/d40 127 1 2023-12-17T11:57:45.249 INFO:tasks.workunit.client.1.smithi119.stdout:8/392: dwrite d7/da/d11/f59 [0,4194304] 0 2023-12-17T11:57:45.249 INFO:tasks.workunit.client.1.smithi119.stdout:3/527: write d9/d35/f58 [2167279,73931] 0 2023-12-17T11:57:45.250 INFO:tasks.workunit.client.1.smithi119.stdout:3/528: chown d9/d44/fc1 957 1 2023-12-17T11:57:45.255 INFO:tasks.workunit.client.0.smithi002.stdout:4/454: dread d0/d10/d14/f59 [0,4194304] 0 2023-12-17T11:57:45.255 INFO:tasks.workunit.client.0.smithi002.stdout:4/455: dread - d0/d10/d21/d33/f89 zero size 2023-12-17T11:57:45.264 INFO:tasks.workunit.client.1.smithi119.stdout:7/490: symlink d2/d4/d1f/l94 0 2023-12-17T11:57:45.264 INFO:tasks.workunit.client.1.smithi119.stdout:7/491: stat d2/d4e/d71 0 2023-12-17T11:57:45.267 INFO:tasks.workunit.client.0.smithi002.stdout:0/440: truncate d0/d15/f6c 1801861 0 2023-12-17T11:57:45.268 INFO:tasks.workunit.client.0.smithi002.stdout:8/490: dread d3/d7/d18/d3f/f57 [0,4194304] 0 2023-12-17T11:57:45.269 INFO:tasks.workunit.client.1.smithi119.stdout:4/463: creat dd/d15/f95 x:0 0 0 2023-12-17T11:57:45.270 INFO:tasks.workunit.client.0.smithi002.stdout:2/477: rename d3/d4/d17/f20 to d3/d4/d17/d19/fb2 0 2023-12-17T11:57:45.273 INFO:tasks.workunit.client.1.smithi119.stdout:8/393: read d7/d18/f5f [2861317,20731] 0 2023-12-17T11:57:45.273 INFO:tasks.workunit.client.1.smithi119.stdout:8/394: chown d7/d12/l30 935066 1 2023-12-17T11:57:45.273 INFO:tasks.workunit.client.1.smithi119.stdout:8/395: getdents d7/d12/d69 0 2023-12-17T11:57:45.273 INFO:tasks.workunit.client.1.smithi119.stdout:8/396: getdents d7/da/d11 0 2023-12-17T11:57:45.274 INFO:tasks.workunit.client.0.smithi002.stdout:9/529: dwrite dc/d38/f5e [0,4194304] 0 2023-12-17T11:57:45.278 INFO:tasks.workunit.client.1.smithi119.stdout:5/501: rename d1/d36/d3a/l50 to d1/d25/d39/d71/d76/l9e 0 2023-12-17T11:57:45.278 INFO:tasks.workunit.client.0.smithi002.stdout:3/496: dwrite d9/d1b/f1c [0,4194304] 0 2023-12-17T11:57:45.283 INFO:tasks.workunit.client.0.smithi002.stdout:2/478: unlink d3/d4/d7/d14/d42/fa9 0 2023-12-17T11:57:45.283 INFO:tasks.workunit.client.0.smithi002.stdout:2/479: fdatasync d3/d4/d7/d14/f82 0 2023-12-17T11:57:45.291 INFO:tasks.workunit.client.0.smithi002.stdout:0/441: dread d0/d6/d26/f3b [0,4194304] 0 2023-12-17T11:57:45.292 INFO:tasks.workunit.client.0.smithi002.stdout:9/530: rename f4 to dc/d42/da0/d72/fbd 0 2023-12-17T11:57:45.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/541: sync 2023-12-17T11:57:45.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/542: chown d3/d6/fa 1369011 1 2023-12-17T11:57:45.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/543: write d3/d6/d9/d37/d39/d94/fb0 [79066,5079] 0 2023-12-17T11:57:45.300 INFO:tasks.workunit.client.0.smithi002.stdout:8/491: rmdir d3/d8/da 39 2023-12-17T11:57:45.300 INFO:tasks.workunit.client.0.smithi002.stdout:8/492: write d3/d8/da/dd/f5f [651202,377] 0 2023-12-17T11:57:45.303 INFO:tasks.workunit.client.0.smithi002.stdout:3/497: creat d9/d15/fa5 x:0 0 0 2023-12-17T11:57:45.310 INFO:tasks.workunit.client.0.smithi002.stdout:9/531: symlink dc/d1d/d7c/d90/lbe 0 2023-12-17T11:57:45.311 INFO:tasks.workunit.client.1.smithi119.stdout:0/368: dwrite d2/d3/d5/f4f [0,4194304] 0 2023-12-17T11:57:45.311 INFO:tasks.workunit.client.1.smithi119.stdout:2/543: dwrite d6/d9/d52/d53/d55/f4e [0,4194304] 0 2023-12-17T11:57:45.311 INFO:tasks.workunit.client.1.smithi119.stdout:2/544: creat d6/d9/d52/d53/d55/fc2 x:0 0 0 2023-12-17T11:57:45.311 INFO:tasks.workunit.client.1.smithi119.stdout:2/545: dread - d6/d2b/d4b/d5d/fa1 zero size 2023-12-17T11:57:45.311 INFO:tasks.workunit.client.1.smithi119.stdout:9/520: symlink d12/d1d/d28/d46/l9f 0 2023-12-17T11:57:45.312 INFO:tasks.workunit.client.1.smithi119.stdout:1/459: dwrite d3/f9f [0,4194304] 0 2023-12-17T11:57:45.312 INFO:tasks.workunit.client.0.smithi002.stdout:6/470: dwrite d0/d1/dc/f39 [0,4194304] 0 2023-12-17T11:57:45.312 INFO:tasks.workunit.client.0.smithi002.stdout:6/471: chown d0/d1/dc/d10/c22 7273 1 2023-12-17T11:57:45.313 INFO:tasks.workunit.client.0.smithi002.stdout:1/544: unlink d3/d6/d9/f2e 0 2023-12-17T11:57:45.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/493: symlink d3/d7/d6e/d7f/d65/la5 0 2023-12-17T11:57:45.315 INFO:tasks.workunit.client.0.smithi002.stdout:8/494: dread - d3/d7/d18/d74/f82 zero size 2023-12-17T11:57:45.316 INFO:tasks.workunit.client.0.smithi002.stdout:8/495: write d3/d8/da/f9f [525249,26575] 0 2023-12-17T11:57:45.319 INFO:tasks.workunit.client.0.smithi002.stdout:5/487: dwrite dc/d17/f87 [0,4194304] 0 2023-12-17T11:57:45.322 INFO:tasks.workunit.client.1.smithi119.stdout:3/529: mkdir d9/d11/d1e/d55/d77/dcd 0 2023-12-17T11:57:45.322 INFO:tasks.workunit.client.0.smithi002.stdout:2/480: rename d3/d4/d7/d14/d2e/f7e to d3/d4/d17/d19/d4d/d72/d83/fb3 0 2023-12-17T11:57:45.322 INFO:tasks.workunit.client.0.smithi002.stdout:2/481: dread - d3/d4/d7/d14/d34/f6c zero size 2023-12-17T11:57:45.322 INFO:tasks.workunit.client.0.smithi002.stdout:2/482: read - d3/d4/d7/d14/d34/f6c zero size 2023-12-17T11:57:45.324 INFO:tasks.workunit.client.1.smithi119.stdout:7/492: mknod d2/d4/d11/d2c/d68/c95 0 2023-12-17T11:57:45.324 INFO:tasks.workunit.client.1.smithi119.stdout:7/493: write d2/d4/d70/d57/d56/f59 [5424979,89370] 0 2023-12-17T11:57:45.327 INFO:tasks.workunit.client.1.smithi119.stdout:4/464: mknod dd/d4b/d6a/c96 0 2023-12-17T11:57:45.327 INFO:tasks.workunit.client.0.smithi002.stdout:6/472: link d0/d1/d21/f76 d0/d1/dc/d17/d3c/d65/f97 0 2023-12-17T11:57:45.328 INFO:tasks.workunit.client.0.smithi002.stdout:6/473: write d0/d1/dc/d17/f91 [19485,120643] 0 2023-12-17T11:57:45.330 INFO:tasks.workunit.client.0.smithi002.stdout:8/496: creat d3/d8/da/fa6 x:0 0 0 2023-12-17T11:57:45.330 INFO:tasks.workunit.client.1.smithi119.stdout:8/397: getdents d7/d12 0 2023-12-17T11:57:45.330 INFO:tasks.workunit.client.1.smithi119.stdout:8/398: read - d7/d12/f25 zero size 2023-12-17T11:57:45.330 INFO:tasks.workunit.client.1.smithi119.stdout:8/399: dread - d7/d18/f6b zero size 2023-12-17T11:57:45.333 INFO:tasks.workunit.client.1.smithi119.stdout:5/502: creat d1/d25/d39/d71/d82/f9f x:0 0 0 2023-12-17T11:57:45.333 INFO:tasks.workunit.client.1.smithi119.stdout:5/503: chown d1/d44/d52/c9b 39583545 1 2023-12-17T11:57:45.333 INFO:tasks.workunit.client.1.smithi119.stdout:5/504: chown d1/f29 2034 1 2023-12-17T11:57:45.339 INFO:tasks.workunit.client.0.smithi002.stdout:0/442: write d0/d6/d26/f2d [1617660,54938] 0 2023-12-17T11:57:45.343 INFO:tasks.workunit.client.0.smithi002.stdout:4/456: dwrite d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:45.343 INFO:tasks.workunit.client.0.smithi002.stdout:4/457: readlink d0/d10/l2b 0 2023-12-17T11:57:45.343 INFO:tasks.workunit.client.0.smithi002.stdout:4/458: stat d0/d3e/l73 0 2023-12-17T11:57:45.350 INFO:tasks.workunit.client.0.smithi002.stdout:0/443: truncate d0/d33/d57/f78 2437122 0 2023-12-17T11:57:45.350 INFO:tasks.workunit.client.0.smithi002.stdout:0/444: chown d0/d33 622030 1 2023-12-17T11:57:45.355 INFO:tasks.workunit.client.1.smithi119.stdout:9/521: mkdir d12/d1d/d28/d4d/d73/d78/d8b/da0 0 2023-12-17T11:57:45.357 INFO:tasks.workunit.client.0.smithi002.stdout:6/474: dread d0/d1/dc/f34 [0,4194304] 0 2023-12-17T11:57:45.357 INFO:tasks.workunit.client.0.smithi002.stdout:8/497: dread d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:45.357 INFO:tasks.workunit.client.0.smithi002.stdout:8/498: creat d3/d8/d28/d31/d5a/d7c/fa7 x:0 0 0 2023-12-17T11:57:45.359 INFO:tasks.workunit.client.0.smithi002.stdout:4/459: creat d0/d3e/d56/d65/d78/d85/f93 x:0 0 0 2023-12-17T11:57:45.359 INFO:tasks.workunit.client.0.smithi002.stdout:0/445: read d0/f13 [4254428,81789] 0 2023-12-17T11:57:45.360 INFO:tasks.workunit.client.1.smithi119.stdout:1/460: rename d3/db/d26/d5e/f7a to d3/db/d26/d5e/fa2 0 2023-12-17T11:57:45.364 INFO:tasks.workunit.client.0.smithi002.stdout:3/498: dwrite d9/d1b/f5e [0,4194304] 0 2023-12-17T11:57:45.365 INFO:tasks.workunit.client.1.smithi119.stdout:7/494: link d2/d4/f29 d2/d5b/f96 0 2023-12-17T11:57:45.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/499: write d3/d7/f73 [666215,117777] 0 2023-12-17T11:57:45.369 INFO:tasks.workunit.client.1.smithi119.stdout:5/505: unlink d1/d25/d39/f3c 0 2023-12-17T11:57:45.369 INFO:tasks.workunit.client.1.smithi119.stdout:5/506: chown d1/d44/d52/l58 0 1 2023-12-17T11:57:45.377 INFO:tasks.workunit.client.0.smithi002.stdout:5/488: dwrite dc/d17/d2f/f34 [4194304,4194304] 0 2023-12-17T11:57:45.378 INFO:tasks.workunit.client.0.smithi002.stdout:5/489: chown dc/d1b/d5a/d68/d97 14070 1 2023-12-17T11:57:45.378 INFO:tasks.workunit.client.0.smithi002.stdout:5/490: dread - dc/d1b/d2d/d5b/fa2 zero size 2023-12-17T11:57:45.379 INFO:tasks.workunit.client.1.smithi119.stdout:2/546: getdents d6/d9/d86 0 2023-12-17T11:57:45.380 INFO:tasks.workunit.client.1.smithi119.stdout:2/547: stat d6/d9/d13/d34/c4a 0 2023-12-17T11:57:45.383 INFO:tasks.workunit.client.1.smithi119.stdout:9/522: truncate d12/d1d/d28/d4d/d73/f74 2696184 0 2023-12-17T11:57:45.388 INFO:tasks.workunit.client.1.smithi119.stdout:1/461: unlink d3/db/d26/f21 0 2023-12-17T11:57:45.389 INFO:tasks.workunit.client.0.smithi002.stdout:1/545: dread d3/d6/fa [0,4194304] 0 2023-12-17T11:57:45.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/460: unlink d0/d10/f40 0 2023-12-17T11:57:45.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/461: write d0/f8a [983779,46069] 0 2023-12-17T11:57:45.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/499: write d9/d24/f81 [1344348,38535] 0 2023-12-17T11:57:45.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/446: symlink d0/d6/d26/d14/d19/d61/l89 0 2023-12-17T11:57:45.390 INFO:tasks.workunit.client.1.smithi119.stdout:7/495: symlink d2/d4/d11/d2c/d55/d67/l97 0 2023-12-17T11:57:45.391 INFO:tasks.workunit.client.1.smithi119.stdout:7/496: write d2/d4/d11/d3c/f4d [4340272,105312] 0 2023-12-17T11:57:45.393 INFO:tasks.workunit.client.1.smithi119.stdout:5/507: creat d1/d25/d39/d71/d97/fa0 x:0 0 0 2023-12-17T11:57:45.395 INFO:tasks.workunit.client.0.smithi002.stdout:8/500: rename d3/d8/c64 to d3/d7/d18/ca8 0 2023-12-17T11:57:45.395 INFO:tasks.workunit.client.0.smithi002.stdout:8/501: write d3/d7/d1a/f9c [308141,116138] 0 2023-12-17T11:57:45.397 INFO:tasks.workunit.client.1.smithi119.stdout:0/369: rename d2/d16/d12 to d2/d66 0 2023-12-17T11:57:45.398 INFO:tasks.workunit.client.0.smithi002.stdout:1/546: dread d3/d6/d9/d37/f6c [0,4194304] 0 2023-12-17T11:57:45.399 INFO:tasks.workunit.client.1.smithi119.stdout:2/548: creat d6/d2b/d4b/d81/fc3 x:0 0 0 2023-12-17T11:57:45.402 INFO:tasks.workunit.client.1.smithi119.stdout:9/523: write d12/d1d/d28/d46/f4e [254256,34714] 0 2023-12-17T11:57:45.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/462: link d3/db/d26/d19/d3f/d64/l6b d3/db/d17/d24/d20/d40/d76/d96/d99/la3 0 2023-12-17T11:57:45.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/463: dread - d3/db/d17/d24/d20/d6c/f86 zero size 2023-12-17T11:57:45.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/464: creat d3/db/d26/fa4 x:0 0 0 2023-12-17T11:57:45.403 INFO:tasks.workunit.client.1.smithi119.stdout:4/465: dwrite dd/d11/d2d/f3e [0,4194304] 0 2023-12-17T11:57:45.404 INFO:tasks.workunit.client.0.smithi002.stdout:9/532: dwrite dc/d42/da0/d72/fbd [0,4194304] 0 2023-12-17T11:57:45.405 INFO:tasks.workunit.client.0.smithi002.stdout:4/462: link d0/d3e/d56/d65/f67 d0/d10/f94 0 2023-12-17T11:57:45.406 INFO:tasks.workunit.client.0.smithi002.stdout:1/547: dread d3/d6/d16/d61/f93 [0,4194304] 0 2023-12-17T11:57:45.407 INFO:tasks.workunit.client.1.smithi119.stdout:7/497: mkdir d2/d4/d11/d2c/d68/d98 0 2023-12-17T11:57:45.407 INFO:tasks.workunit.client.0.smithi002.stdout:3/500: unlink d9/d1b/d35/d41/d59/c96 0 2023-12-17T11:57:45.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:44 smithi119 ceph-mon[117414]: pgmap v25: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 180 MiB/s rd, 225 MiB/s wr, 310 op/s 2023-12-17T11:57:45.408 INFO:tasks.workunit.client.1.smithi119.stdout:0/370: stat d2/d16/d35/l45 0 2023-12-17T11:57:45.408 INFO:tasks.workunit.client.1.smithi119.stdout:0/371: read d2/d3/f14 [283503,115736] 0 2023-12-17T11:57:45.409 INFO:tasks.workunit.client.0.smithi002.stdout:0/447: truncate d0/d15/f54 1208121 0 2023-12-17T11:57:45.410 INFO:tasks.workunit.client.1.smithi119.stdout:3/530: rename d9/d44/f86 to d9/da/df/fce 0 2023-12-17T11:57:45.410 INFO:tasks.workunit.client.1.smithi119.stdout:3/531: chown d9/d59/da6/cb9 19440 1 2023-12-17T11:57:45.411 INFO:tasks.workunit.client.0.smithi002.stdout:5/491: rename dc/d1b/d5a/d96/c8c to dc/d1a/d53/da9/cb0 0 2023-12-17T11:57:45.414 INFO:tasks.workunit.client.0.smithi002.stdout:8/502: stat d3/c9d 0 2023-12-17T11:57:45.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/475: dwrite d0/d1/f96 [0,4194304] 0 2023-12-17T11:57:45.416 INFO:tasks.workunit.client.0.smithi002.stdout:6/476: creat d0/d1/dc/d10/f98 x:0 0 0 2023-12-17T11:57:45.416 INFO:tasks.workunit.client.1.smithi119.stdout:9/524: mkdir d12/d1d/d28/d46/d50/d92/da1 0 2023-12-17T11:57:45.420 INFO:tasks.workunit.client.0.smithi002.stdout:9/533: mkdir dc/d42/da0/d72/d93/d83/d91/db2/dbf 0 2023-12-17T11:57:45.421 INFO:tasks.workunit.client.0.smithi002.stdout:4/463: dread d0/d10/f39 [0,4194304] 0 2023-12-17T11:57:45.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/464: readlink d0/d10/l1f 0 2023-12-17T11:57:45.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/465: readlink d0/d10/d14/l18 0 2023-12-17T11:57:45.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/466: chown d0/d10/d21/c46 237 1 2023-12-17T11:57:45.422 INFO:tasks.workunit.client.0.smithi002.stdout:7/451: sync 2023-12-17T11:57:45.423 INFO:tasks.workunit.client.0.smithi002.stdout:1/548: unlink d3/d6/d16/d28/l32 0 2023-12-17T11:57:45.424 INFO:tasks.workunit.client.1.smithi119.stdout:1/465: symlink d3/db/d26/d8f/la5 0 2023-12-17T11:57:45.425 INFO:tasks.workunit.client.0.smithi002.stdout:0/448: getdents d0/d33/d57/d64 0 2023-12-17T11:57:45.430 INFO:tasks.workunit.client.1.smithi119.stdout:4/466: creat dd/d4b/d6a/d8f/d55/d81/f97 x:0 0 0 2023-12-17T11:57:45.430 INFO:tasks.workunit.client.1.smithi119.stdout:4/467: dread - dd/d15/d16/d3d/f8c zero size 2023-12-17T11:57:45.430 INFO:tasks.workunit.client.1.smithi119.stdout:4/468: stat f2 0 2023-12-17T11:57:45.430 INFO:tasks.workunit.client.1.smithi119.stdout:4/469: creat dd/d15/d16/d20/d42/d78/f98 x:0 0 0 2023-12-17T11:57:45.430 INFO:tasks.workunit.client.1.smithi119.stdout:4/470: dread - dd/d15/d16/d3d/f84 zero size 2023-12-17T11:57:45.433 INFO:tasks.workunit.client.1.smithi119.stdout:7/498: truncate d2/d4/d11/d3c/d75/f7f 5423010 0 2023-12-17T11:57:45.436 INFO:tasks.workunit.client.0.smithi002.stdout:3/501: rename d9/d1b/d35/d41/d43/f46 to d9/d1b/d35/fa6 0 2023-12-17T11:57:45.437 INFO:tasks.workunit.client.0.smithi002.stdout:3/502: truncate d9/d1b/fa4 1015584 0 2023-12-17T11:57:45.437 INFO:tasks.workunit.client.0.smithi002.stdout:3/503: chown d9/cd 8 1 2023-12-17T11:57:45.438 INFO:tasks.workunit.client.1.smithi119.stdout:0/372: truncate d2/d66/d1f/f22 3805856 0 2023-12-17T11:57:45.441 INFO:tasks.workunit.client.0.smithi002.stdout:5/492: unlink dc/d17/d2f/f60 0 2023-12-17T11:57:45.444 INFO:tasks.workunit.client.1.smithi119.stdout:6/439: sync 2023-12-17T11:57:45.444 INFO:tasks.workunit.client.1.smithi119.stdout:6/440: creat d2/d2b/d43/f8b x:0 0 0 2023-12-17T11:57:45.444 INFO:tasks.workunit.client.1.smithi119.stdout:8/400: rename d7/d18/f6b to d7/d18/d45/f83 0 2023-12-17T11:57:45.444 INFO:tasks.workunit.client.1.smithi119.stdout:6/441: readlink d2/l45 0 2023-12-17T11:57:45.446 INFO:tasks.workunit.client.0.smithi002.stdout:8/503: symlink d3/d8/d28/d31/d5a/la9 0 2023-12-17T11:57:45.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/508: dwrite d1/f8 [4194304,4194304] 0 2023-12-17T11:57:45.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/509: write d1/d70/d6b/f87 [565697,66638] 0 2023-12-17T11:57:45.452 INFO:tasks.workunit.client.1.smithi119.stdout:3/532: unlink d9/d11/d1e/d9f/fbf 0 2023-12-17T11:57:45.452 INFO:tasks.workunit.client.1.smithi119.stdout:4/471: dread dd/d15/d16/d20/d42/f67 [0,4194304] 0 2023-12-17T11:57:45.453 INFO:tasks.workunit.client.1.smithi119.stdout:9/525: mknod d12/d1d/d28/d4d/d73/d78/d8b/ca2 0 2023-12-17T11:57:45.453 INFO:tasks.workunit.client.1.smithi119.stdout:2/549: dwrite d6/d38/fa7 [0,4194304] 0 2023-12-17T11:57:45.457 INFO:tasks.workunit.client.1.smithi119.stdout:1/466: creat d3/db/d17/d24/d20/d40/d76/d96/d99/fa6 x:0 0 0 2023-12-17T11:57:45.457 INFO:tasks.workunit.client.1.smithi119.stdout:1/467: write d3/db/d26/f11 [1987383,48916] 0 2023-12-17T11:57:45.465 INFO:tasks.workunit.client.1.smithi119.stdout:5/510: dread d1/f8 [4194304,4194304] 0 2023-12-17T11:57:45.472 INFO:tasks.workunit.client.1.smithi119.stdout:8/401: unlink d7/da/d1a/c29 0 2023-12-17T11:57:45.472 INFO:tasks.workunit.client.1.smithi119.stdout:8/402: stat d7/d18/d45/f56 0 2023-12-17T11:57:45.475 INFO:tasks.workunit.client.1.smithi119.stdout:6/442: creat d2/df/d17/d79/f8c x:0 0 0 2023-12-17T11:57:45.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/452: rmdir d6/d17/dc/d6c 39 2023-12-17T11:57:45.481 INFO:tasks.workunit.client.0.smithi002.stdout:7/453: fsync d6/d17/f79 0 2023-12-17T11:57:45.482 INFO:tasks.workunit.client.1.smithi119.stdout:3/533: mknod d9/d1c/ccf 0 2023-12-17T11:57:45.483 INFO:tasks.workunit.client.0.smithi002.stdout:1/549: rmdir d3/d6/d16/d9f 39 2023-12-17T11:57:45.485 INFO:tasks.workunit.client.1.smithi119.stdout:4/472: creat dd/d15/d16/d5a/f99 x:0 0 0 2023-12-17T11:57:45.487 INFO:tasks.workunit.client.0.smithi002.stdout:0/449: chown d0/d6/d26/d25/c3c 0 1 2023-12-17T11:57:45.487 INFO:tasks.workunit.client.0.smithi002.stdout:0/450: stat d0/d15/f32 0 2023-12-17T11:57:45.489 INFO:tasks.workunit.client.1.smithi119.stdout:9/526: mkdir d12/d1d/d28/d46/d50/da3 0 2023-12-17T11:57:45.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/477: rename d0/d1/dc/d10/c27 to d0/d1/dc/d17/d8f/c99 0 2023-12-17T11:57:45.496 INFO:tasks.workunit.client.1.smithi119.stdout:2/550: dwrite d6/d9/d52/d53/d55/f4c [0,4194304] 0 2023-12-17T11:57:45.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/467: dwrite d0/d10/d14/d4e/f80 [0,4194304] 0 2023-12-17T11:57:45.497 INFO:tasks.workunit.client.1.smithi119.stdout:0/373: dwrite d2/d66/f41 [0,4194304] 0 2023-12-17T11:57:45.497 INFO:tasks.workunit.client.1.smithi119.stdout:0/374: stat d2/d16/d35/l46 0 2023-12-17T11:57:45.498 INFO:tasks.workunit.client.0.smithi002.stdout:2/483: sync 2023-12-17T11:57:45.499 INFO:tasks.workunit.client.0.smithi002.stdout:3/504: link d9/d24/d6f/f91 d9/d1b/fa7 0 2023-12-17T11:57:45.501 INFO:tasks.workunit.client.1.smithi119.stdout:1/468: link d3/db/l68 d3/db/d26/d8f/la7 0 2023-12-17T11:57:45.501 INFO:tasks.workunit.client.1.smithi119.stdout:1/469: creat d3/db/d26/d8f/fa8 x:0 0 0 2023-12-17T11:57:45.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/451: write d0/d6/fb [3071134,52073] 0 2023-12-17T11:57:45.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/452: write d0/d6/d26/f3a [973697,100976] 0 2023-12-17T11:57:45.502 INFO:tasks.workunit.client.0.smithi002.stdout:0/453: readlink d0/d6/d26/d14/d19/d37/d62/l6a 0 2023-12-17T11:57:45.503 INFO:tasks.workunit.client.0.smithi002.stdout:5/493: unlink dc/d17/d1c/l9f 0 2023-12-17T11:57:45.503 INFO:tasks.workunit.client.1.smithi119.stdout:3/534: dread d9/d1c/f4d [0,4194304] 0 2023-12-17T11:57:45.503 INFO:tasks.workunit.client.1.smithi119.stdout:5/511: chown d1/d25/c37 4 1 2023-12-17T11:57:45.505 INFO:tasks.workunit.client.0.smithi002.stdout:8/504: mkdir d3/d7/d6e/daa 0 2023-12-17T11:57:45.506 INFO:tasks.workunit.client.1.smithi119.stdout:8/403: mkdir d7/da/d1a/d84 0 2023-12-17T11:57:45.506 INFO:tasks.workunit.client.1.smithi119.stdout:8/404: chown d7/da/d11/d26/d2c 4521010 1 2023-12-17T11:57:45.508 INFO:tasks.workunit.client.0.smithi002.stdout:7/454: unlink d6/d17/dc/d13/c4d 0 2023-12-17T11:57:45.508 INFO:tasks.workunit.client.0.smithi002.stdout:7/455: chown d6/d17/dc/d13/d37/d4c/d24 27146814 1 2023-12-17T11:57:45.510 INFO:tasks.workunit.client.0.smithi002.stdout:1/550: symlink d3/d6/d9/d37/lba 0 2023-12-17T11:57:45.511 INFO:tasks.workunit.client.1.smithi119.stdout:9/527: dread d12/d1d/f2f [0,4194304] 0 2023-12-17T11:57:45.511 INFO:tasks.workunit.client.1.smithi119.stdout:6/443: mkdir d2/d2b/d43/d76/d8d 0 2023-12-17T11:57:45.512 INFO:tasks.workunit.client.1.smithi119.stdout:6/444: write d2/df/d17/f5f [414282,49077] 0 2023-12-17T11:57:45.514 INFO:tasks.workunit.client.1.smithi119.stdout:4/473: symlink dd/d15/d16/d20/l9a 0 2023-12-17T11:57:45.517 INFO:tasks.workunit.client.0.smithi002.stdout:8/505: dread d3/d7/d6e/f77 [0,4194304] 0 2023-12-17T11:57:45.526 INFO:tasks.workunit.client.0.smithi002.stdout:1/551: dread d3/d6/d9/f29 [0,4194304] 0 2023-12-17T11:57:45.529 INFO:tasks.workunit.client.1.smithi119.stdout:7/499: rename d2/d4e to d2/d4/d11/d2c/d68/d99 0 2023-12-17T11:57:45.529 INFO:tasks.workunit.client.1.smithi119.stdout:7/500: truncate d2/d40/f6d 904605 0 2023-12-17T11:57:45.530 INFO:tasks.workunit.client.0.smithi002.stdout:4/468: mknod d0/d10/d14/d27/d57/c95 0 2023-12-17T11:57:45.535 INFO:tasks.workunit.client.1.smithi119.stdout:2/551: unlink d6/d2b/d4b/d5d/f90 0 2023-12-17T11:57:45.535 INFO:tasks.workunit.client.1.smithi119.stdout:2/552: fdatasync d6/d38/fbc 0 2023-12-17T11:57:45.537 INFO:tasks.workunit.client.0.smithi002.stdout:2/484: mknod d3/d4/d7/d14/d34/cb4 0 2023-12-17T11:57:45.538 INFO:tasks.workunit.client.1.smithi119.stdout:0/375: creat d2/f67 x:0 0 0 2023-12-17T11:57:45.538 INFO:tasks.workunit.client.1.smithi119.stdout:0/376: chown d2/d66/d2e/d44/f5f 601 1 2023-12-17T11:57:45.542 INFO:tasks.workunit.client.1.smithi119.stdout:8/405: write d7/da/d11/f59 [72519,14570] 0 2023-12-17T11:57:45.542 INFO:tasks.workunit.client.1.smithi119.stdout:8/406: readlink d7/da/d11/d26/d2c/d7b/l7c 0 2023-12-17T11:57:45.548 INFO:tasks.workunit.client.1.smithi119.stdout:1/470: truncate d3/db/f22 2091396 0 2023-12-17T11:57:45.552 INFO:tasks.workunit.client.1.smithi119.stdout:4/474: truncate f8 652632 0 2023-12-17T11:57:45.553 INFO:tasks.workunit.client.0.smithi002.stdout:0/454: truncate d0/d6/d26/f35 1559210 0 2023-12-17T11:57:45.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/494: mknod dc/d1b/d75/cb1 0 2023-12-17T11:57:45.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/495: fdatasync dc/d17/d2f/d99/f9d 0 2023-12-17T11:57:45.554 INFO:tasks.workunit.client.0.smithi002.stdout:7/456: creat d6/d17/dc/f89 x:0 0 0 2023-12-17T11:57:45.555 INFO:tasks.workunit.client.1.smithi119.stdout:3/535: rename d9/d44/d8c/ccb to d9/da/df/da1/cd0 0 2023-12-17T11:57:45.555 INFO:tasks.workunit.client.0.smithi002.stdout:8/506: symlink d3/d8/d28/d31/d5a/lab 0 2023-12-17T11:57:45.557 INFO:tasks.workunit.client.1.smithi119.stdout:2/553: creat d6/d9/d13/d1d/dbf/fc4 x:0 0 0 2023-12-17T11:57:45.558 INFO:tasks.workunit.client.0.smithi002.stdout:1/552: unlink d3/d6/d9/d30/f3d 0 2023-12-17T11:57:45.558 INFO:tasks.workunit.client.1.smithi119.stdout:0/377: rmdir d2/d66/d1f/d24/d50/d5d 39 2023-12-17T11:57:45.559 INFO:tasks.workunit.client.1.smithi119.stdout:0/378: fdatasync d2/d66/d1f/f20 0 2023-12-17T11:57:45.559 INFO:tasks.workunit.client.1.smithi119.stdout:0/379: chown d2/d16/d35/l46 0 1 2023-12-17T11:57:45.559 INFO:tasks.workunit.client.1.smithi119.stdout:0/380: dread - d2/d3/d5/d3f/f5e zero size 2023-12-17T11:57:45.560 INFO:tasks.workunit.client.1.smithi119.stdout:8/407: symlink d7/d12/d69/l85 0 2023-12-17T11:57:45.560 INFO:tasks.workunit.client.1.smithi119.stdout:8/408: write d7/da/d11/d26/f58 [819722,87000] 0 2023-12-17T11:57:45.560 INFO:tasks.workunit.client.1.smithi119.stdout:8/409: write d7/da/d11/d26/f58 [365909,110658] 0 2023-12-17T11:57:45.560 INFO:tasks.workunit.client.1.smithi119.stdout:8/410: chown d7/d18/d45/f76 52756 1 2023-12-17T11:57:45.560 INFO:tasks.workunit.client.1.smithi119.stdout:8/411: chown d7/da/d11/d26/d2c/d7b/l7c 409 1 2023-12-17T11:57:45.561 INFO:tasks.workunit.client.0.smithi002.stdout:6/478: dwrite d0/d1/d21/d56/d60/f62 [4194304,4194304] 0 2023-12-17T11:57:45.562 INFO:tasks.workunit.client.1.smithi119.stdout:1/471: symlink d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/la9 0 2023-12-17T11:57:45.562 INFO:tasks.workunit.client.1.smithi119.stdout:1/472: fdatasync d3/db/d17/d24/d20/d40/d6d/d7e/f94 0 2023-12-17T11:57:45.563 INFO:tasks.workunit.client.1.smithi119.stdout:4/475: symlink dd/d15/d16/d20/d82/l9b 0 2023-12-17T11:57:45.564 INFO:tasks.workunit.client.1.smithi119.stdout:4/476: write dd/f94 [5224762,54765] 0 2023-12-17T11:57:45.565 INFO:tasks.workunit.client.1.smithi119.stdout:7/501: rename d2/d4/d11/d2c/d55/c8e to d2/d4/d11/d2c/d68/c9a 0 2023-12-17T11:57:45.566 INFO:tasks.workunit.client.1.smithi119.stdout:3/536: truncate d9/d11/d1e/d55/f66 4157073 0 2023-12-17T11:57:45.570 INFO:tasks.workunit.client.1.smithi119.stdout:0/381: rmdir d2/d66/d1f/d24/d50 39 2023-12-17T11:57:45.570 INFO:tasks.workunit.client.1.smithi119.stdout:6/445: dwrite d2/f11 [0,4194304] 0 2023-12-17T11:57:45.575 INFO:tasks.workunit.client.1.smithi119.stdout:5/512: dwrite d1/d25/d39/d71/d82/d86/f66 [0,4194304] 0 2023-12-17T11:57:45.575 INFO:tasks.workunit.client.1.smithi119.stdout:9/528: dwrite d12/d1d/d28/d4d/f8c [0,4194304] 0 2023-12-17T11:57:45.578 INFO:tasks.workunit.client.0.smithi002.stdout:2/485: write d3/d4/d7/f11 [6829330,88003] 0 2023-12-17T11:57:45.579 INFO:tasks.workunit.client.0.smithi002.stdout:2/486: readlink d3/d4/l93 0 2023-12-17T11:57:45.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/537: mknod d9/da/dcc/db3/cd1 0 2023-12-17T11:57:45.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/538: write d9/d11/d1e/d55/d65/fc5 [253890,80967] 0 2023-12-17T11:57:45.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/539: write d9/d44/fc1 [660187,99455] 0 2023-12-17T11:57:45.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/540: dread - d9/da/df/d41/d33/db4/fc9 zero size 2023-12-17T11:57:45.581 INFO:tasks.workunit.client.1.smithi119.stdout:2/554: getdents d6/d9/d52/d53/d55/d58 0 2023-12-17T11:57:45.582 INFO:tasks.workunit.client.0.smithi002.stdout:7/457: mknod d6/d17/dc/d67/d86/c8a 0 2023-12-17T11:57:45.582 INFO:tasks.workunit.client.0.smithi002.stdout:1/553: symlink d3/d6/d9/d37/d39/d43/d4a/dac/lbb 0 2023-12-17T11:57:45.584 INFO:tasks.workunit.client.0.smithi002.stdout:3/505: rmdir d9/d1b 39 2023-12-17T11:57:45.587 INFO:tasks.workunit.client.1.smithi119.stdout:4/477: write dd/f71 [1976821,121546] 0 2023-12-17T11:57:45.587 INFO:tasks.workunit.client.1.smithi119.stdout:4/478: chown f2 15296 1 2023-12-17T11:57:45.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/496: dread dc/d1a/f46 [0,4194304] 0 2023-12-17T11:57:45.589 INFO:tasks.workunit.client.1.smithi119.stdout:0/382: creat d2/d66/d1f/f68 x:0 0 0 2023-12-17T11:57:45.590 INFO:tasks.workunit.client.1.smithi119.stdout:0/383: stat d2/d66/d1f/l31 0 2023-12-17T11:57:45.590 INFO:tasks.workunit.client.1.smithi119.stdout:0/384: fsync d2/d3/f14 0 2023-12-17T11:57:45.591 INFO:tasks.workunit.client.0.smithi002.stdout:8/507: dread d3/d7/d1a/f5c [0,4194304] 0 2023-12-17T11:57:45.591 INFO:tasks.workunit.client.0.smithi002.stdout:8/508: chown d3/d7/d18/d74/f82 457284857 1 2023-12-17T11:57:45.592 INFO:tasks.workunit.client.1.smithi119.stdout:6/446: dread d2/d2b/d43/f85 [0,4194304] 0 2023-12-17T11:57:45.592 INFO:tasks.workunit.client.1.smithi119.stdout:6/447: fdatasync d2/d2b/d43/f58 0 2023-12-17T11:57:45.598 INFO:tasks.workunit.client.1.smithi119.stdout:8/412: creat d7/d18/d15/d64/f86 x:0 0 0 2023-12-17T11:57:45.604 INFO:tasks.workunit.client.1.smithi119.stdout:0/385: dread d2/d16/d35/d39/f4a [0,4194304] 0 2023-12-17T11:57:45.604 INFO:tasks.workunit.client.1.smithi119.stdout:0/386: creat d2/d66/d1f/f69 x:0 0 0 2023-12-17T11:57:45.604 INFO:tasks.workunit.client.1.smithi119.stdout:0/387: chown d2/d3/d5/f4f 26753 1 2023-12-17T11:57:45.604 INFO:tasks.workunit.client.1.smithi119.stdout:0/388: fdatasync d2/d66/d1f/f57 0 2023-12-17T11:57:45.608 INFO:tasks.workunit.client.0.smithi002.stdout:2/487: mknod d3/d4/d7/cb5 0 2023-12-17T11:57:45.612 INFO:tasks.workunit.client.0.smithi002.stdout:7/458: rename d6/d17/dc/d13/d37/d4c to d6/d17/dc/d67/d8b 0 2023-12-17T11:57:45.612 INFO:tasks.workunit.client.0.smithi002.stdout:7/459: write d6/d17/dc/d13/d21/d2e/f7f [404796,15394] 0 2023-12-17T11:57:45.614 INFO:tasks.workunit.client.1.smithi119.stdout:7/502: dwrite d2/d4/d11/d2c/d68/f84 [0,4194304] 0 2023-12-17T11:57:45.615 INFO:tasks.workunit.client.0.smithi002.stdout:6/479: dwrite d0/d1/dc/d17/f91 [0,4194304] 0 2023-12-17T11:57:45.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/455: dwrite d0/d6/d26/d14/d19/d2b/f30 [4194304,4194304] 0 2023-12-17T11:57:45.617 INFO:tasks.workunit.client.1.smithi119.stdout:5/513: unlink d1/d25/d39/d71/d82/d86/f81 0 2023-12-17T11:57:45.619 INFO:tasks.workunit.client.0.smithi002.stdout:2/488: symlink d3/d4/d17/lb6 0 2023-12-17T11:57:45.619 INFO:tasks.workunit.client.0.smithi002.stdout:3/506: rename d9/d1b/d4f/d88/f9b to d9/d24/fa8 0 2023-12-17T11:57:45.620 INFO:tasks.workunit.client.1.smithi119.stdout:9/529: mknod d12/d1d/d28/d46/d6e/ca4 0 2023-12-17T11:57:45.622 INFO:tasks.workunit.client.1.smithi119.stdout:3/541: symlink d9/d44/db7/ld2 0 2023-12-17T11:57:45.623 INFO:tasks.workunit.client.1.smithi119.stdout:3/542: chown d9/d11/f3f 126 1 2023-12-17T11:57:45.624 INFO:tasks.workunit.client.1.smithi119.stdout:2/555: creat d6/d2b/da3/fc5 x:0 0 0 2023-12-17T11:57:45.628 INFO:tasks.workunit.client.0.smithi002.stdout:9/534: sync 2023-12-17T11:57:45.629 INFO:tasks.workunit.client.1.smithi119.stdout:1/473: dwrite d3/db/d26/d5e/fa2 [0,4194304] 0 2023-12-17T11:57:45.632 INFO:tasks.workunit.client.0.smithi002.stdout:0/456: write d0/d6/d26/d14/d19/d61/f73 [2410919,51580] 0 2023-12-17T11:57:45.637 INFO:tasks.workunit.client.1.smithi119.stdout:1/474: dread d3/d44/f5c [0,4194304] 0 2023-12-17T11:57:45.640 INFO:tasks.workunit.client.1.smithi119.stdout:6/448: mkdir d2/d2b/d8e 0 2023-12-17T11:57:45.643 INFO:tasks.workunit.client.0.smithi002.stdout:6/480: rename d0/d1/dc/ce to d0/c9a 0 2023-12-17T11:57:45.643 INFO:tasks.workunit.client.0.smithi002.stdout:6/481: truncate d0/d1/f96 4567215 0 2023-12-17T11:57:45.643 INFO:tasks.workunit.client.0.smithi002.stdout:6/482: readlink d0/d1/d21/d56/d60/l7a 0 2023-12-17T11:57:45.643 INFO:tasks.workunit.client.0.smithi002.stdout:6/483: truncate d0/d1/dc/d10/f52 790458 0 2023-12-17T11:57:45.643 INFO:tasks.workunit.client.0.smithi002.stdout:6/484: write d0/d1/dc/d17/f79 [243499,99424] 0 2023-12-17T11:57:45.645 INFO:tasks.workunit.client.0.smithi002.stdout:3/507: rename d9/d1b/d35/d41/d59/d65/d7e to d9/d1b/d35/d41/d59/d65/da9 0 2023-12-17T11:57:45.647 INFO:tasks.workunit.client.1.smithi119.stdout:8/413: creat d7/da/d11/f87 x:0 0 0 2023-12-17T11:57:45.647 INFO:tasks.workunit.client.0.smithi002.stdout:7/460: getdents d6/d17/dc/d13/d37 0 2023-12-17T11:57:45.652 INFO:tasks.workunit.client.0.smithi002.stdout:9/535: unlink dc/d42/da0/d72/d93/d52/fa6 0 2023-12-17T11:57:45.660 INFO:tasks.workunit.client.1.smithi119.stdout:7/503: unlink d2/d4/d11/d2c/d55/d67/f8a 0 2023-12-17T11:57:45.660 INFO:tasks.workunit.client.1.smithi119.stdout:7/504: truncate d2/d4/d11/d2c/d68/d77/f79 292303 0 2023-12-17T11:57:45.661 INFO:tasks.workunit.client.1.smithi119.stdout:1/475: read d3/db/d26/d19/d3f/f4a [5948615,41589] 0 2023-12-17T11:57:45.664 INFO:tasks.workunit.client.1.smithi119.stdout:4/479: rename dd/d4b/d6a/d8f to dd/d11/d2d/d9c 0 2023-12-17T11:57:45.664 INFO:tasks.workunit.client.1.smithi119.stdout:4/480: chown dd/d15/d16/f1e 13023 1 2023-12-17T11:57:45.664 INFO:tasks.workunit.client.1.smithi119.stdout:4/481: write f4 [2038770,12407] 0 2023-12-17T11:57:45.664 INFO:tasks.workunit.client.1.smithi119.stdout:4/482: read - dd/d15/f95 zero size 2023-12-17T11:57:45.664 INFO:tasks.workunit.client.1.smithi119.stdout:4/483: creat dd/d11/d2d/f9d x:0 0 0 2023-12-17T11:57:45.667 INFO:tasks.workunit.client.0.smithi002.stdout:2/489: getdents d3/d4/d7/d14/d2e/d37/d3f 0 2023-12-17T11:57:45.667 INFO:tasks.workunit.client.0.smithi002.stdout:6/485: symlink d0/d1/dc/d17/d4c/l9b 0 2023-12-17T11:57:45.667 INFO:tasks.workunit.client.0.smithi002.stdout:2/490: dread - d3/d4/d7/d14/d34/f6c zero size 2023-12-17T11:57:45.667 INFO:tasks.workunit.client.0.smithi002.stdout:6/486: creat d0/d1/dc/d17/d67/f9c x:0 0 0 2023-12-17T11:57:45.667 INFO:tasks.workunit.client.0.smithi002.stdout:3/508: rename d9/d15/d52/d85/c94 to d9/d15/d52/d79/caa 0 2023-12-17T11:57:45.668 INFO:tasks.workunit.client.1.smithi119.stdout:6/449: symlink d2/d61/l8f 0 2023-12-17T11:57:45.670 INFO:tasks.workunit.client.0.smithi002.stdout:9/536: mkdir dc/d1d/d7c/d90/dc0 0 2023-12-17T11:57:45.671 INFO:tasks.workunit.client.1.smithi119.stdout:8/414: mknod d7/da/d11/d26/d2c/c88 0 2023-12-17T11:57:45.675 INFO:tasks.workunit.client.1.smithi119.stdout:7/505: creat d2/d4/d1f/f9b x:0 0 0 2023-12-17T11:57:45.677 INFO:tasks.workunit.client.1.smithi119.stdout:1/476: unlink d3/cf 0 2023-12-17T11:57:45.682 INFO:tasks.workunit.client.0.smithi002.stdout:2/491: rename d3/d4/f52 to d3/d4/d17/d19/d8d/fb7 0 2023-12-17T11:57:45.682 INFO:tasks.workunit.client.0.smithi002.stdout:6/487: unlink d0/d1/dc/d17/f43 0 2023-12-17T11:57:45.682 INFO:tasks.workunit.client.0.smithi002.stdout:2/492: getdents d3/d4/d17/d19/d4d/d72/d77/da7 0 2023-12-17T11:57:45.684 INFO:tasks.workunit.client.1.smithi119.stdout:0/389: read d2/d3/d5/f4f [3491766,108052] 0 2023-12-17T11:57:45.685 INFO:tasks.workunit.client.0.smithi002.stdout:5/497: dwrite dc/d1b/d5a/d96/d6c/f8d [0,4194304] 0 2023-12-17T11:57:45.685 INFO:tasks.workunit.client.0.smithi002.stdout:5/498: stat dc/d1b/d5a/d68 0 2023-12-17T11:57:45.686 INFO:tasks.workunit.client.0.smithi002.stdout:8/509: dwrite d3/d7/d18/d74/d7b/f81 [0,4194304] 0 2023-12-17T11:57:45.691 INFO:tasks.workunit.client.1.smithi119.stdout:4/484: mknod dd/d11/d26/d86/c9e 0 2023-12-17T11:57:45.691 INFO:tasks.workunit.client.1.smithi119.stdout:6/450: rename d2/df/d17/c73 to d2/df/d17/c90 0 2023-12-17T11:57:45.692 INFO:tasks.workunit.client.0.smithi002.stdout:6/488: creat d0/d1/dc/d17/d8f/f9d x:0 0 0 2023-12-17T11:57:45.693 INFO:tasks.workunit.client.1.smithi119.stdout:5/514: dread d1/f33 [0,4194304] 0 2023-12-17T11:57:45.704 INFO:tasks.workunit.client.0.smithi002.stdout:3/509: write d9/d24/f6d [3587008,86154] 0 2023-12-17T11:57:45.705 INFO:tasks.workunit.client.1.smithi119.stdout:8/415: link d7/d18/d45/c51 d7/d18/d15/d81/c89 0 2023-12-17T11:57:45.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/499: link dc/d1b/d2d/l7d dc/d1b/lb2 0 2023-12-17T11:57:45.709 INFO:tasks.workunit.client.0.smithi002.stdout:4/469: dwrite d0/d10/d21/f42 [0,4194304] 0 2023-12-17T11:57:45.711 INFO:tasks.workunit.client.1.smithi119.stdout:1/477: rmdir d3/db/d17/d24/d20/d40/d6d/d7e 39 2023-12-17T11:57:45.711 INFO:tasks.workunit.client.1.smithi119.stdout:1/478: creat d3/db/d26/faa x:0 0 0 2023-12-17T11:57:45.714 INFO:tasks.workunit.client.1.smithi119.stdout:9/530: dwrite d12/d1d/d28/d46/d50/f60 [0,4194304] 0 2023-12-17T11:57:45.718 INFO:tasks.workunit.client.0.smithi002.stdout:1/554: dwrite d3/d6/d16/d28/f69 [0,4194304] 0 2023-12-17T11:57:45.718 INFO:tasks.workunit.client.0.smithi002.stdout:1/555: chown d3/d6/d9/d37/d39/d43/d4a/f77 105692104 1 2023-12-17T11:57:45.720 INFO:tasks.workunit.client.0.smithi002.stdout:8/510: dread d3/d8/da/f93 [0,4194304] 0 2023-12-17T11:57:45.724 INFO:tasks.workunit.client.1.smithi119.stdout:7/506: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:45.725 INFO:tasks.workunit.client.0.smithi002.stdout:6/489: write d0/d1/d21/f38 [3312018,126219] 0 2023-12-17T11:57:45.725 INFO:tasks.workunit.client.0.smithi002.stdout:6/490: creat d0/d1/dc/d17/d67/f9e x:0 0 0 2023-12-17T11:57:45.726 INFO:tasks.workunit.client.0.smithi002.stdout:2/493: unlink d3/d4/d7/d14/d2e/f57 0 2023-12-17T11:57:45.726 INFO:tasks.workunit.client.0.smithi002.stdout:2/494: chown d3/d4/d7/d14/d2e/d37/d3f/c4c 65167540 1 2023-12-17T11:57:45.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/543: rename d9/da/df/da1 to d9/d11/d1e/d55/d65/d84/dd3 0 2023-12-17T11:57:45.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/544: chown d9/d11/d1e/f1f 28 1 2023-12-17T11:57:45.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/545: chown d9/d44/db7 23 1 2023-12-17T11:57:45.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/546: fdatasync d9/da/df/f15 0 2023-12-17T11:57:45.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/547: dread - d9/da/f91 zero size 2023-12-17T11:57:45.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/548: creat d9/da/fd4 x:0 0 0 2023-12-17T11:57:45.733 INFO:tasks.workunit.client.0.smithi002.stdout:7/461: dwrite d6/d17/dc/f89 [0,4194304] 0 2023-12-17T11:57:45.739 INFO:tasks.workunit.client.1.smithi119.stdout:8/416: mkdir d7/da/d1a/d8a 0 2023-12-17T11:57:45.741 INFO:tasks.workunit.client.0.smithi002.stdout:3/510: mkdir d9/d15/d52/d79/dab 0 2023-12-17T11:57:45.742 INFO:tasks.workunit.client.0.smithi002.stdout:3/511: write d9/d15/f19 [2859874,81173] 0 2023-12-17T11:57:45.745 INFO:tasks.workunit.client.1.smithi119.stdout:9/531: dread d12/d1d/d28/d4d/f8c [0,4194304] 0 2023-12-17T11:57:45.745 INFO:tasks.workunit.client.1.smithi119.stdout:2/556: dwrite d6/d9/d52/d5a/f65 [0,4194304] 0 2023-12-17T11:57:45.746 INFO:tasks.workunit.client.1.smithi119.stdout:5/515: dread d1/d25/f46 [0,4194304] 0 2023-12-17T11:57:45.746 INFO:tasks.workunit.client.1.smithi119.stdout:0/390: dwrite d2/d66/d1f/f22 [0,4194304] 0 2023-12-17T11:57:45.746 INFO:tasks.workunit.client.1.smithi119.stdout:5/516: write d1/d25/d39/d71/d97/fa0 [508461,64922] 0 2023-12-17T11:57:45.751 INFO:tasks.workunit.client.1.smithi119.stdout:6/451: dwrite d2/d2b/f4f [0,4194304] 0 2023-12-17T11:57:45.753 INFO:tasks.workunit.client.1.smithi119.stdout:4/485: dwrite dd/d11/d2d/f3e [0,4194304] 0 2023-12-17T11:57:45.754 INFO:tasks.workunit.client.0.smithi002.stdout:1/556: symlink d3/d6/d16/d61/lbc 0 2023-12-17T11:57:45.754 INFO:tasks.workunit.client.0.smithi002.stdout:1/557: stat d3/d6/d9/d37/d39/fa6 0 2023-12-17T11:57:45.754 INFO:tasks.workunit.client.0.smithi002.stdout:0/457: dwrite d0/d6/d26/d25/f46 [0,4194304] 0 2023-12-17T11:57:45.756 INFO:tasks.workunit.client.1.smithi119.stdout:3/549: truncate f4 3269109 0 2023-12-17T11:57:45.756 INFO:tasks.workunit.client.1.smithi119.stdout:3/550: truncate d9/d44/d8c/f9e 5122577 0 2023-12-17T11:57:45.756 INFO:tasks.workunit.client.1.smithi119.stdout:7/507: unlink d2/d4/d11/d2c/d68/d6a/f72 0 2023-12-17T11:57:45.757 INFO:tasks.workunit.client.0.smithi002.stdout:8/511: rmdir d3/d8/da/dd 39 2023-12-17T11:57:45.758 INFO:tasks.workunit.client.0.smithi002.stdout:8/512: stat d3/d7/d1a/f6a 0 2023-12-17T11:57:45.758 INFO:tasks.workunit.client.0.smithi002.stdout:8/513: stat d3/d8/d28/l45 0 2023-12-17T11:57:45.758 INFO:tasks.workunit.client.1.smithi119.stdout:8/417: creat d7/da/d11/d60/f8b x:0 0 0 2023-12-17T11:57:45.758 INFO:tasks.workunit.client.1.smithi119.stdout:8/418: chown d7/d18/d45/c51 717026 1 2023-12-17T11:57:45.760 INFO:tasks.workunit.client.1.smithi119.stdout:9/532: creat d12/d1d/d28/d86/d8f/fa5 x:0 0 0 2023-12-17T11:57:45.761 INFO:tasks.workunit.client.0.smithi002.stdout:6/491: rmdir d0/d1/d21 39 2023-12-17T11:57:45.763 INFO:tasks.workunit.client.0.smithi002.stdout:2/495: rmdir d3/d4/d7/d14/d1b 39 2023-12-17T11:57:45.764 INFO:tasks.workunit.client.0.smithi002.stdout:2/496: fsync d3/d4/d7/d14/f92 0 2023-12-17T11:57:45.764 INFO:tasks.workunit.client.1.smithi119.stdout:0/391: rmdir d2/d66/d1f/d24/d50 39 2023-12-17T11:57:45.768 INFO:tasks.workunit.client.0.smithi002.stdout:1/558: dread d3/d6/f2b [0,4194304] 0 2023-12-17T11:57:45.768 INFO:tasks.workunit.client.0.smithi002.stdout:1/559: chown d3/d6/d16 110871805 1 2023-12-17T11:57:45.774 INFO:tasks.workunit.client.1.smithi119.stdout:1/479: dwrite d3/db/d26/f1d [0,4194304] 0 2023-12-17T11:57:45.776 INFO:tasks.workunit.client.1.smithi119.stdout:6/452: mknod d2/df/c91 0 2023-12-17T11:57:45.776 INFO:tasks.workunit.client.1.smithi119.stdout:6/453: truncate d2/df/d17/d79/f8c 19973 0 2023-12-17T11:57:45.776 INFO:tasks.workunit.client.0.smithi002.stdout:7/462: symlink d6/d17/dc/d13/d21/d2e/l8c 0 2023-12-17T11:57:45.781 INFO:tasks.workunit.client.1.smithi119.stdout:3/551: rename d9/f85 to d9/d35/dca/fd5 0 2023-12-17T11:57:45.781 INFO:tasks.workunit.client.1.smithi119.stdout:8/419: rename d7 to d7/da/d1a/d8c 22 2023-12-17T11:57:45.781 INFO:tasks.workunit.client.1.smithi119.stdout:3/552: readlink d9/da/l23 0 2023-12-17T11:57:45.781 INFO:tasks.workunit.client.1.smithi119.stdout:3/553: fsync d9/d59/f5d 0 2023-12-17T11:57:45.782 INFO:tasks.workunit.client.1.smithi119.stdout:8/420: creat d7/da/d11/d26/d49/f8d x:0 0 0 2023-12-17T11:57:45.782 INFO:tasks.workunit.client.1.smithi119.stdout:8/421: stat d7/da/d11/d26/d2c/d75/l82 0 2023-12-17T11:57:45.785 INFO:tasks.workunit.client.1.smithi119.stdout:0/392: symlink d2/d66/d1f/d24/d50/l6a 0 2023-12-17T11:57:45.786 INFO:tasks.workunit.client.0.smithi002.stdout:4/470: mkdir d0/d10/d21/d33/d96 0 2023-12-17T11:57:45.789 INFO:tasks.workunit.client.1.smithi119.stdout:1/480: symlink d3/db/d26/d19/lab 0 2023-12-17T11:57:45.790 INFO:tasks.workunit.client.1.smithi119.stdout:6/454: mkdir d2/d2b/d43/d5e/d92 0 2023-12-17T11:57:45.791 INFO:tasks.workunit.client.1.smithi119.stdout:6/455: chown d2/df/d17 14 1 2023-12-17T11:57:45.796 INFO:tasks.workunit.client.1.smithi119.stdout:3/554: mknod d9/da/df/d67/cd6 0 2023-12-17T11:57:45.800 INFO:tasks.workunit.client.0.smithi002.stdout:0/458: mknod d0/d6/d26/d14/d19/d37/d62/d77/c8a 0 2023-12-17T11:57:45.800 INFO:tasks.workunit.client.0.smithi002.stdout:4/471: write d0/d10/d14/f4c [185865,29725] 0 2023-12-17T11:57:45.800 INFO:tasks.workunit.client.1.smithi119.stdout:8/422: mkdir d7/d18/d15/d81/d8e 0 2023-12-17T11:57:45.801 INFO:tasks.workunit.client.1.smithi119.stdout:4/486: read dd/d11/f14 [1458175,125127] 0 2023-12-17T11:57:45.801 INFO:tasks.workunit.client.1.smithi119.stdout:4/487: creat dd/d11/d26/f9f x:0 0 0 2023-12-17T11:57:45.802 INFO:tasks.workunit.client.0.smithi002.stdout:8/514: unlink d3/d7/d6e/d7f/d65/c84 0 2023-12-17T11:57:45.804 INFO:tasks.workunit.client.1.smithi119.stdout:5/517: dwrite d1/d36/f47 [4194304,4194304] 0 2023-12-17T11:57:45.805 INFO:tasks.workunit.client.1.smithi119.stdout:5/518: creat d1/d25/d39/d71/d82/fa1 x:0 0 0 2023-12-17T11:57:45.807 INFO:tasks.workunit.client.0.smithi002.stdout:2/497: symlink d3/d4/d8b/da6/lb8 0 2023-12-17T11:57:45.808 INFO:tasks.workunit.client.0.smithi002.stdout:1/560: rmdir d3/d2f/d4d/d91 39 2023-12-17T11:57:45.809 INFO:tasks.workunit.client.0.smithi002.stdout:1/561: fsync d3/d6/d9/d37/d39/d43/d4a/f77 0 2023-12-17T11:57:45.809 INFO:tasks.workunit.client.1.smithi119.stdout:0/393: unlink d2/d66/d1f/d24/d50/l60 0 2023-12-17T11:57:45.809 INFO:tasks.workunit.client.1.smithi119.stdout:0/394: creat d2/f6b x:0 0 0 2023-12-17T11:57:45.813 INFO:tasks.workunit.client.1.smithi119.stdout:6/456: mkdir d2/d7e/d93 0 2023-12-17T11:57:45.815 INFO:tasks.workunit.client.1.smithi119.stdout:6/457: creat d2/d61/f94 x:0 0 0 2023-12-17T11:57:45.816 INFO:tasks.workunit.client.0.smithi002.stdout:8/515: dread d3/d7/f5d [0,4194304] 0 2023-12-17T11:57:45.816 INFO:tasks.workunit.client.0.smithi002.stdout:8/516: dread - d3/d8/da/fa6 zero size 2023-12-17T11:57:45.823 INFO:tasks.workunit.client.0.smithi002.stdout:3/512: rename d9/d1b/d35/d41/d59/d65/da9/l83 to d9/d15/d71/d82/lac 0 2023-12-17T11:57:45.823 INFO:tasks.workunit.client.0.smithi002.stdout:3/513: chown d9/d24/l55 1 1 2023-12-17T11:57:45.823 INFO:tasks.workunit.client.1.smithi119.stdout:4/488: rename dd/d11/d26/f7e to dd/d11/d2d/fa0 0 2023-12-17T11:57:45.826 INFO:tasks.workunit.client.0.smithi002.stdout:0/459: truncate d0/d6/d26/d14/f5d 2754577 0 2023-12-17T11:57:45.827 INFO:tasks.workunit.client.1.smithi119.stdout:1/481: truncate d3/db/f22 391153 0 2023-12-17T11:57:45.834 INFO:tasks.workunit.client.1.smithi119.stdout:5/519: dread d1/f51 [0,4194304] 0 2023-12-17T11:57:45.834 INFO:tasks.workunit.client.1.smithi119.stdout:5/520: fdatasync d1/d44/d52/f8c 0 2023-12-17T11:57:45.834 INFO:tasks.workunit.client.1.smithi119.stdout:5/521: chown d1/d36/d3a/f4b 44104 1 2023-12-17T11:57:45.834 INFO:tasks.workunit.client.1.smithi119.stdout:5/522: chown d1/d25/f68 1119 1 2023-12-17T11:57:45.835 INFO:tasks.workunit.client.0.smithi002.stdout:2/498: creat d3/d4/d7/d14/d42/dae/fb9 x:0 0 0 2023-12-17T11:57:45.836 INFO:tasks.workunit.client.1.smithi119.stdout:9/533: dwrite d12/d1d/d28/d46/d50/f60 [0,4194304] 0 2023-12-17T11:57:45.838 INFO:tasks.workunit.client.0.smithi002.stdout:1/562: truncate d3/d6/d9/d37/f65 888189 0 2023-12-17T11:57:45.839 INFO:tasks.workunit.client.1.smithi119.stdout:1/482: link d3/db/d17/d24/d20/d40/d76/d84/c8b d3/db/d26/d5e/cac 0 2023-12-17T11:57:45.840 INFO:tasks.workunit.client.0.smithi002.stdout:8/517: rmdir d3 39 2023-12-17T11:57:45.841 INFO:tasks.workunit.client.0.smithi002.stdout:3/514: truncate d9/d1b/d4f/f68 2814681 0 2023-12-17T11:57:45.841 INFO:tasks.workunit.client.0.smithi002.stdout:3/515: truncate d9/d1b/d35/d41/d59/d65/f77 1364167 0 2023-12-17T11:57:45.846 INFO:tasks.workunit.client.1.smithi119.stdout:5/523: mknod d1/d25/ca2 0 2023-12-17T11:57:45.846 INFO:tasks.workunit.client.1.smithi119.stdout:4/489: read f8 [505796,128045] 0 2023-12-17T11:57:45.858 INFO:tasks.workunit.client.0.smithi002.stdout:4/472: getdents d0/d10/d14/d4e 0 2023-12-17T11:57:45.858 INFO:tasks.workunit.client.0.smithi002.stdout:4/473: fsync d0/d3e/d56/d65/d78/f92 0 2023-12-17T11:57:45.861 INFO:tasks.workunit.client.1.smithi119.stdout:6/458: read d2/d2b/f63 [6289106,102262] 0 2023-12-17T11:57:45.861 INFO:tasks.workunit.client.1.smithi119.stdout:5/524: mkdir d1/d70/da3 0 2023-12-17T11:57:45.861 INFO:tasks.workunit.client.1.smithi119.stdout:5/525: dread - d1/d70/d6b/f7c zero size 2023-12-17T11:57:45.861 INFO:tasks.workunit.client.0.smithi002.stdout:8/518: rename d3/d7/d6e/f77 to d3/d7/d1a/fac 0 2023-12-17T11:57:45.861 INFO:tasks.workunit.client.1.smithi119.stdout:9/534: read ff [1696258,114458] 0 2023-12-17T11:57:45.862 INFO:tasks.workunit.client.1.smithi119.stdout:9/535: readlink d12/d65/l7b 0 2023-12-17T11:57:45.862 INFO:tasks.workunit.client.1.smithi119.stdout:9/536: fdatasync d12/d1d/d49/f77 0 2023-12-17T11:57:45.862 INFO:tasks.workunit.client.1.smithi119.stdout:9/537: getdents d12/d1d/d28/d46/d50/d92/da1 0 2023-12-17T11:57:45.862 INFO:tasks.workunit.client.0.smithi002.stdout:3/516: truncate d9/d1b/d35/d41/d59/d65/da9/d8f/f90 1001609 0 2023-12-17T11:57:45.862 INFO:tasks.workunit.client.1.smithi119.stdout:4/490: mkdir dd/d11/d2d/d9c/d55/d81/da1 0 2023-12-17T11:57:45.862 INFO:tasks.workunit.client.1.smithi119.stdout:4/491: chown dd/d15/l1f 1 1 2023-12-17T11:57:45.864 INFO:tasks.workunit.client.1.smithi119.stdout:2/557: dwrite d6/d9/d52/d53/d55/d58/d6b/f93 [0,4194304] 0 2023-12-17T11:57:45.865 INFO:tasks.workunit.client.0.smithi002.stdout:0/460: link d0/f2e d0/d6/d26/d25/f8b 0 2023-12-17T11:57:45.866 INFO:tasks.workunit.client.0.smithi002.stdout:1/563: dread d3/d6/d9/d37/d39/d43/d4a/f5f [0,4194304] 0 2023-12-17T11:57:45.868 INFO:tasks.workunit.client.1.smithi119.stdout:7/508: dwrite d2/d4/d11/d3c/f4d [4194304,4194304] 0 2023-12-17T11:57:45.873 INFO:tasks.workunit.client.1.smithi119.stdout:6/459: symlink d2/d2b/d7f/l95 0 2023-12-17T11:57:45.877 INFO:tasks.workunit.client.1.smithi119.stdout:9/538: rename d12/d1d/d49/d85/f90 to d12/d1d/d49/fa6 0 2023-12-17T11:57:45.878 INFO:tasks.workunit.client.1.smithi119.stdout:3/555: dwrite d9/d11/f76 [0,4194304] 0 2023-12-17T11:57:45.878 INFO:tasks.workunit.client.1.smithi119.stdout:8/423: dwrite d7/f27 [0,4194304] 0 2023-12-17T11:57:45.879 INFO:tasks.workunit.client.0.smithi002.stdout:8/519: creat d3/d8/da/d44/fad x:0 0 0 2023-12-17T11:57:45.882 INFO:tasks.workunit.client.1.smithi119.stdout:0/395: dwrite d2/d3/f14 [4194304,4194304] 0 2023-12-17T11:57:45.883 INFO:tasks.workunit.client.0.smithi002.stdout:8/520: creat d3/d8/da/d44/fae x:0 0 0 2023-12-17T11:57:45.883 INFO:tasks.workunit.client.0.smithi002.stdout:8/521: truncate d3/d7/d1a/f9c 1180868 0 2023-12-17T11:57:45.883 INFO:tasks.workunit.client.0.smithi002.stdout:5/500: sync 2023-12-17T11:57:45.883 INFO:tasks.workunit.client.0.smithi002.stdout:9/537: sync 2023-12-17T11:57:45.885 INFO:tasks.workunit.client.0.smithi002.stdout:3/517: creat d9/d15/fad x:0 0 0 2023-12-17T11:57:45.885 INFO:tasks.workunit.client.0.smithi002.stdout:3/518: read d9/d1b/d35/d41/d43/f61 [3327199,114333] 0 2023-12-17T11:57:45.887 INFO:tasks.workunit.client.0.smithi002.stdout:0/461: rename d0/d15/l58 to d0/l8c 0 2023-12-17T11:57:45.888 INFO:tasks.workunit.client.1.smithi119.stdout:2/558: creat d6/d9/d52/d53/d55/d58/da5/fc6 x:0 0 0 2023-12-17T11:57:45.888 INFO:tasks.workunit.client.1.smithi119.stdout:2/559: creat d6/d38/fc7 x:0 0 0 2023-12-17T11:57:45.894 INFO:tasks.workunit.client.1.smithi119.stdout:9/539: symlink d12/d1d/d28/d46/d6e/la7 0 2023-12-17T11:57:45.900 INFO:tasks.workunit.client.0.smithi002.stdout:5/501: mkdir dc/d1a/d53/da9/db3 0 2023-12-17T11:57:45.902 INFO:tasks.workunit.client.1.smithi119.stdout:6/460: write d2/d61/f67 [313787,37425] 0 2023-12-17T11:57:45.902 INFO:tasks.workunit.client.1.smithi119.stdout:6/461: creat d2/df/d17/d79/f96 x:0 0 0 2023-12-17T11:57:45.903 INFO:tasks.workunit.client.1.smithi119.stdout:6/462: chown d2/df/d17/f5f 11 1 2023-12-17T11:57:45.903 INFO:tasks.workunit.client.1.smithi119.stdout:7/509: write d2/f24 [1867376,47996] 0 2023-12-17T11:57:45.903 INFO:tasks.workunit.client.1.smithi119.stdout:4/492: rename dd/d15/d16/d20/l9a to dd/d15/d16/d20/d42/la2 0 2023-12-17T11:57:45.903 INFO:tasks.workunit.client.0.smithi002.stdout:1/564: dread d3/d6/f84 [0,4194304] 0 2023-12-17T11:57:45.904 INFO:tasks.workunit.client.0.smithi002.stdout:5/502: mknod dc/d1b/d5a/d68/cb4 0 2023-12-17T11:57:45.907 INFO:tasks.workunit.client.0.smithi002.stdout:0/462: dread d0/d15/f54 [0,4194304] 0 2023-12-17T11:57:45.907 INFO:tasks.workunit.client.0.smithi002.stdout:9/538: dread dc/f15 [0,4194304] 0 2023-12-17T11:57:45.911 INFO:tasks.workunit.client.0.smithi002.stdout:1/565: rename d3/d6/d16/d61/d8e to d3/d2f/d74/dbd 0 2023-12-17T11:57:45.915 INFO:tasks.workunit.client.1.smithi119.stdout:8/424: truncate d7/f35 1239916 0 2023-12-17T11:57:45.916 INFO:tasks.workunit.client.1.smithi119.stdout:3/556: dread d9/d35/f6a [0,4194304] 0 2023-12-17T11:57:45.921 INFO:tasks.workunit.client.0.smithi002.stdout:0/463: rename d0/d15/f87 to d0/d6/d26/d14/d19/d2f/f8d 0 2023-12-17T11:57:45.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/566: mkdir d3/d2f/d74/dbe 0 2023-12-17T11:57:45.925 INFO:tasks.workunit.client.1.smithi119.stdout:6/463: write d2/d2b/d43/d76/f7a [817771,98063] 0 2023-12-17T11:57:45.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/539: rename dc/d42/d4f/d59/d47/d4b/f7e to dc/d42/da0/d72/d93/d76/fc1 0 2023-12-17T11:57:45.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/540: fsync dc/d38/f5b 0 2023-12-17T11:57:45.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/541: read - dc/d42/da0/d72/d93/d76/f94 zero size 2023-12-17T11:57:45.926 INFO:tasks.workunit.client.0.smithi002.stdout:9/542: readlink dc/d42/d4f/d59/l31 0 2023-12-17T11:57:45.926 INFO:tasks.workunit.client.1.smithi119.stdout:4/493: dread dd/d15/d16/d3d/f4c [0,4194304] 0 2023-12-17T11:57:45.927 INFO:tasks.workunit.client.1.smithi119.stdout:4/494: truncate dd/d11/d2d/f9d 732731 0 2023-12-17T11:57:45.927 INFO:tasks.workunit.client.1.smithi119.stdout:3/557: dread d9/d11/f5f [0,4194304] 0 2023-12-17T11:57:45.931 INFO:tasks.workunit.client.0.smithi002.stdout:4/474: dwrite d0/fd [0,4194304] 0 2023-12-17T11:57:45.931 INFO:tasks.workunit.client.0.smithi002.stdout:4/475: fsync d0/f83 0 2023-12-17T11:57:45.931 INFO:tasks.workunit.client.0.smithi002.stdout:4/476: creat d0/d10/d14/d27/d57/f97 x:0 0 0 2023-12-17T11:57:45.934 INFO:tasks.workunit.client.0.smithi002.stdout:1/567: unlink d3/d6/d16/d61/lbc 0 2023-12-17T11:57:45.935 INFO:tasks.workunit.client.0.smithi002.stdout:2/499: dwrite d3/d4/d7/d14/d2e/f7b [0,4194304] 0 2023-12-17T11:57:45.935 INFO:tasks.workunit.client.0.smithi002.stdout:2/500: chown d3/d4/d7/fa1 0 1 2023-12-17T11:57:45.940 INFO:tasks.workunit.client.1.smithi119.stdout:1/483: dwrite d3/db/d17/d24/d20/d40/f5a [0,4194304] 0 2023-12-17T11:57:45.940 INFO:tasks.workunit.client.1.smithi119.stdout:0/396: dread d2/d16/f5a [0,4194304] 0 2023-12-17T11:57:45.941 INFO:tasks.workunit.client.1.smithi119.stdout:1/484: write d3/db/d26/d19/f70 [774326,90995] 0 2023-12-17T11:57:45.942 INFO:tasks.workunit.client.0.smithi002.stdout:0/464: creat d0/d33/f8e x:0 0 0 2023-12-17T11:57:45.944 INFO:tasks.workunit.client.1.smithi119.stdout:5/526: dwrite d1/d44/f4c [0,4194304] 0 2023-12-17T11:57:45.944 INFO:tasks.workunit.client.1.smithi119.stdout:5/527: readlink d1/l18 0 2023-12-17T11:57:45.950 INFO:tasks.workunit.client.1.smithi119.stdout:6/464: link d2/d2b/d43/f62 d2/d2b/d43/d76/d8d/f97 0 2023-12-17T11:57:45.950 INFO:tasks.workunit.client.1.smithi119.stdout:6/465: chown d2/d61/c72 7894361 1 2023-12-17T11:57:45.956 INFO:tasks.workunit.client.0.smithi002.stdout:3/519: dwrite d9/d1b/d4f/f68 [0,4194304] 0 2023-12-17T11:57:45.956 INFO:tasks.workunit.client.1.smithi119.stdout:5/528: dread d1/d25/d39/d71/f84 [0,4194304] 0 2023-12-17T11:57:45.957 INFO:tasks.workunit.client.1.smithi119.stdout:5/529: creat d1/d25/d39/d71/d97/fa4 x:0 0 0 2023-12-17T11:57:45.960 INFO:tasks.workunit.client.1.smithi119.stdout:4/495: mknod dd/d11/d26/d86/ca3 0 2023-12-17T11:57:45.960 INFO:tasks.workunit.client.1.smithi119.stdout:4/496: chown dd/d15/d4f/c61 275455 1 2023-12-17T11:57:45.961 INFO:tasks.workunit.client.0.smithi002.stdout:4/477: creat d0/d10/d14/f98 x:0 0 0 2023-12-17T11:57:45.962 INFO:tasks.workunit.client.0.smithi002.stdout:4/478: write d0/d3e/d56/d65/d78/f92 [818429,116506] 0 2023-12-17T11:57:45.964 INFO:tasks.workunit.client.1.smithi119.stdout:3/558: creat d9/d11/d92/fd7 x:0 0 0 2023-12-17T11:57:45.969 INFO:tasks.workunit.client.1.smithi119.stdout:7/510: dwrite d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:45.969 INFO:tasks.workunit.client.0.smithi002.stdout:1/568: creat d3/d6/d9/d37/d39/d43/d8f/fbf x:0 0 0 2023-12-17T11:57:45.969 INFO:tasks.workunit.client.0.smithi002.stdout:1/569: chown d3/d2f/l8b 665 1 2023-12-17T11:57:45.969 INFO:tasks.workunit.client.0.smithi002.stdout:1/570: truncate d3/d6/d9/f29 2488877 0 2023-12-17T11:57:45.969 INFO:tasks.workunit.client.0.smithi002.stdout:1/571: write d3/d6/fa2 [580348,18358] 0 2023-12-17T11:57:45.972 INFO:tasks.workunit.client.1.smithi119.stdout:2/560: dwrite d6/fbd [0,4194304] 0 2023-12-17T11:57:45.973 INFO:tasks.workunit.client.1.smithi119.stdout:8/425: dwrite d7/da/d11/d26/d2c/f6a [0,4194304] 0 2023-12-17T11:57:45.973 INFO:tasks.workunit.client.1.smithi119.stdout:8/426: readlink d7/da/d11/d26/d49/l5c 0 2023-12-17T11:57:45.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/543: rename dc/d42/da0/d72/d93/d83 to dc/d1d/d25/d85/dc2 0 2023-12-17T11:57:45.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/544: write dc/d42/da0/d72/d93/f6f [594946,116906] 0 2023-12-17T11:57:45.985 INFO:tasks.workunit.client.0.smithi002.stdout:4/479: unlink d0/d10/d14/d27/d57/d7d/f7f 0 2023-12-17T11:57:45.985 INFO:tasks.workunit.client.0.smithi002.stdout:4/480: write d0/d10/d14/f8e [3955208,117581] 0 2023-12-17T11:57:45.987 INFO:tasks.workunit.client.1.smithi119.stdout:0/397: creat d2/d16/d35/f6c x:0 0 0 2023-12-17T11:57:45.989 INFO:tasks.workunit.client.0.smithi002.stdout:1/572: creat d3/d2f/d4d/d95/fc0 x:0 0 0 2023-12-17T11:57:45.992 INFO:tasks.workunit.client.1.smithi119.stdout:1/485: symlink d3/d44/lad 0 2023-12-17T11:57:45.992 INFO:tasks.workunit.client.1.smithi119.stdout:1/486: creat d3/db/d26/d19/d3f/d64/fae x:0 0 0 2023-12-17T11:57:45.994 INFO:tasks.workunit.client.0.smithi002.stdout:0/465: mkdir d0/d6/d26/d8f 0 2023-12-17T11:57:45.995 INFO:tasks.workunit.client.0.smithi002.stdout:0/466: chown d0/d6/d26/d14/d19/d37/d62/d77 490427926 1 2023-12-17T11:57:46.000 INFO:tasks.workunit.client.0.smithi002.stdout:2/501: rename d3/d4/d7/d14/d1b/c33 to d3/d4/d7/d14/d2e/d37/cba 0 2023-12-17T11:57:46.007 INFO:tasks.workunit.client.0.smithi002.stdout:1/573: dread d3/d6/fa [0,4194304] 0 2023-12-17T11:57:46.007 INFO:tasks.workunit.client.0.smithi002.stdout:5/503: dwrite dc/d1b/d5a/d96/f65 [4194304,4194304] 0 2023-12-17T11:57:46.007 INFO:tasks.workunit.client.0.smithi002.stdout:8/522: dwrite d3/d8/da/f93 [0,4194304] 0 2023-12-17T11:57:46.012 INFO:tasks.workunit.client.0.smithi002.stdout:0/467: rename d0/d33/d57 to d0/d6/d26/d14/d90 0 2023-12-17T11:57:46.016 INFO:tasks.workunit.client.0.smithi002.stdout:2/502: symlink d3/d4/d7/d14/d42/lbb 0 2023-12-17T11:57:46.018 INFO:tasks.workunit.client.1.smithi119.stdout:6/466: rename d2/d2b/f47 to d2/f98 0 2023-12-17T11:57:46.019 INFO:tasks.workunit.client.1.smithi119.stdout:6/467: stat d2/d2b/c40 0 2023-12-17T11:57:46.028 INFO:tasks.workunit.client.1.smithi119.stdout:7/511: rmdir d2/d4/d11/d2c/d68/d99/d6c 39 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:4/497: dread dd/d15/f53 [0,4194304] 0 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:4/498: chown dd/d15/d16/f1e 86 1 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:4/499: readlink dd/d4b/d6a/l72 0 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:4/500: dread - dd/d15/d16/f45 zero size 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:4/501: creat dd/d4b/fa4 x:0 0 0 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:7/512: read d2/d4/d11/f43 [200912,117631] 0 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:7/513: truncate d2/d40/f6b 1020694 0 2023-12-17T11:57:46.030 INFO:tasks.workunit.client.1.smithi119.stdout:7/514: write d2/d4/d11/d2c/d68/d99/f37 [2755374,123484] 0 2023-12-17T11:57:46.031 INFO:tasks.workunit.client.0.smithi002.stdout:4/481: dwrite d0/d10/f25 [0,4194304] 0 2023-12-17T11:57:46.033 INFO:tasks.workunit.client.1.smithi119.stdout:3/559: rmdir d9/da/df/d41 39 2023-12-17T11:57:46.033 INFO:tasks.workunit.client.0.smithi002.stdout:0/468: dread d0/d6/d26/f2d [4194304,4194304] 0 2023-12-17T11:57:46.034 INFO:tasks.workunit.client.0.smithi002.stdout:3/520: dwrite d9/d1b/f7b [0,4194304] 0 2023-12-17T11:57:46.034 INFO:tasks.workunit.client.0.smithi002.stdout:3/521: chown d9/f13 99354534 1 2023-12-17T11:57:46.038 INFO:tasks.workunit.client.1.smithi119.stdout:2/561: creat d6/d9/d52/d53/d55/d58/d6b/fc8 x:0 0 0 2023-12-17T11:57:46.040 INFO:tasks.workunit.client.1.smithi119.stdout:8/427: rename d7/d18/d15/d81/f72 to d7/d18/d15/d81/f8f 0 2023-12-17T11:57:46.045 INFO:tasks.workunit.client.1.smithi119.stdout:0/398: link d2/f6b d2/d66/d2e/f6d 0 2023-12-17T11:57:46.045 INFO:tasks.workunit.client.1.smithi119.stdout:0/399: write d2/d66/d1f/f4e [3965086,52637] 0 2023-12-17T11:57:46.045 INFO:tasks.workunit.client.1.smithi119.stdout:0/400: creat d2/d16/d35/d39/f6e x:0 0 0 2023-12-17T11:57:46.045 INFO:tasks.workunit.client.1.smithi119.stdout:0/401: creat d2/d16/f6f x:0 0 0 2023-12-17T11:57:46.045 INFO:tasks.workunit.client.1.smithi119.stdout:0/402: write d2/d16/f27 [2059122,35634] 0 2023-12-17T11:57:46.048 INFO:tasks.workunit.client.0.smithi002.stdout:9/545: getdents dc/d42/da0/d72/d93/d52 0 2023-12-17T11:57:46.050 INFO:tasks.workunit.client.1.smithi119.stdout:1/487: mknod d3/db/d17/d24/d91/caf 0 2023-12-17T11:57:46.050 INFO:tasks.workunit.client.1.smithi119.stdout:1/488: readlink d3/l4f 0 2023-12-17T11:57:46.054 INFO:tasks.workunit.client.1.smithi119.stdout:5/530: rename d1/d36/l3f to d1/d44/la5 0 2023-12-17T11:57:46.054 INFO:tasks.workunit.client.1.smithi119.stdout:5/531: fsync d1/d70/d85/f93 0 2023-12-17T11:57:46.055 INFO:tasks.workunit.client.0.smithi002.stdout:5/504: rename dc/d1b/d5a/d96/d6c/f8d to dc/d1b/d5a/d96/d6c/fb5 0 2023-12-17T11:57:46.057 INFO:tasks.workunit.client.1.smithi119.stdout:2/562: dread d6/d9/d13/d34/f64 [0,4194304] 0 2023-12-17T11:57:46.057 INFO:tasks.workunit.client.1.smithi119.stdout:2/563: creat d6/d2b/d4b/fc9 x:0 0 0 2023-12-17T11:57:46.057 INFO:tasks.workunit.client.1.smithi119.stdout:2/564: write d6/d9/d52/d53/d55/d58/fae [931847,9913] 0 2023-12-17T11:57:46.060 INFO:tasks.workunit.client.0.smithi002.stdout:8/523: unlink d3/d8/da/d44/fad 0 2023-12-17T11:57:46.064 INFO:tasks.workunit.client.0.smithi002.stdout:2/503: mkdir d3/d4/dbc 0 2023-12-17T11:57:46.065 INFO:tasks.workunit.client.0.smithi002.stdout:2/504: dread - d3/d4/d7/fb0 zero size 2023-12-17T11:57:46.068 INFO:tasks.workunit.client.1.smithi119.stdout:7/515: creat d2/d4/d11/d3c/f9c x:0 0 0 2023-12-17T11:57:46.069 INFO:tasks.workunit.client.1.smithi119.stdout:7/516: write d2/d4/d11/d2c/d68/d6a/f78 [324927,77813] 0 2023-12-17T11:57:46.069 INFO:tasks.workunit.client.0.smithi002.stdout:4/482: mkdir d0/d3e/d56/d99 0 2023-12-17T11:57:46.069 INFO:tasks.workunit.client.0.smithi002.stdout:4/483: creat d0/d3e/d56/f9a x:0 0 0 2023-12-17T11:57:46.069 INFO:tasks.workunit.client.0.smithi002.stdout:4/484: stat d0/d5a 0 2023-12-17T11:57:46.070 INFO:tasks.workunit.client.1.smithi119.stdout:3/560: mknod d9/d59/dae/cd8 0 2023-12-17T11:57:46.070 INFO:tasks.workunit.client.1.smithi119.stdout:3/561: chown d9/d35/dbd 61905 1 2023-12-17T11:57:46.071 INFO:tasks.workunit.client.0.smithi002.stdout:8/524: dread d3/d7/d18/d3f/f60 [0,4194304] 0 2023-12-17T11:57:46.073 INFO:tasks.workunit.client.1.smithi119.stdout:8/428: creat d7/da/d11/d26/d2c/d75/f90 x:0 0 0 2023-12-17T11:57:46.074 INFO:tasks.workunit.client.0.smithi002.stdout:0/469: mkdir d0/d6/d26/d14/d19/d37/d91 0 2023-12-17T11:57:46.078 INFO:tasks.workunit.client.0.smithi002.stdout:3/522: unlink d9/d1b/d35/f7a 0 2023-12-17T11:57:46.081 INFO:tasks.workunit.client.0.smithi002.stdout:7/463: sync 2023-12-17T11:57:46.081 INFO:tasks.workunit.client.0.smithi002.stdout:7/464: stat d6/d17/dc/d13/d21/d2e/d4a/d53/l74 0 2023-12-17T11:57:46.084 INFO:tasks.workunit.client.0.smithi002.stdout:1/574: dwrite d3/d2f/fb4 [0,4194304] 0 2023-12-17T11:57:46.084 INFO:tasks.workunit.client.1.smithi119.stdout:4/502: dwrite dd/f41 [0,4194304] 0 2023-12-17T11:57:46.084 INFO:tasks.workunit.client.1.smithi119.stdout:4/503: write f4 [8559669,103534] 0 2023-12-17T11:57:46.086 INFO:tasks.workunit.client.1.smithi119.stdout:0/403: creat d2/d66/d1f/d24/d50/d5d/f70 x:0 0 0 2023-12-17T11:57:46.089 INFO:tasks.workunit.client.1.smithi119.stdout:5/532: dwrite d1/d25/f2c [0,4194304] 0 2023-12-17T11:57:46.091 INFO:tasks.workunit.client.0.smithi002.stdout:9/546: creat dc/d42/da0/d72/d93/d76/fc3 x:0 0 0 2023-12-17T11:57:46.091 INFO:tasks.workunit.client.0.smithi002.stdout:6/492: sync 2023-12-17T11:57:46.091 INFO:tasks.workunit.client.0.smithi002.stdout:5/505: symlink dc/d1b/lb6 0 2023-12-17T11:57:46.091 INFO:tasks.workunit.client.0.smithi002.stdout:2/505: symlink d3/d4/d7/d14/d34/lbd 0 2023-12-17T11:57:46.092 INFO:tasks.workunit.client.1.smithi119.stdout:1/489: symlink d3/db/d26/lb0 0 2023-12-17T11:57:46.092 INFO:tasks.workunit.client.0.smithi002.stdout:4/485: symlink d0/d3e/d56/d65/l9b 0 2023-12-17T11:57:46.093 INFO:tasks.workunit.client.1.smithi119.stdout:2/565: creat d6/d9/d52/d53/fca x:0 0 0 2023-12-17T11:57:46.094 INFO:tasks.workunit.client.1.smithi119.stdout:2/566: creat d6/d9/d13/fcb x:0 0 0 2023-12-17T11:57:46.096 INFO:tasks.workunit.client.1.smithi119.stdout:7/517: rename d2/d4/d11/f21 to d2/d4/d70/f9d 0 2023-12-17T11:57:46.096 INFO:tasks.workunit.client.1.smithi119.stdout:7/518: chown d2/d4/f29 220312 1 2023-12-17T11:57:46.097 INFO:tasks.workunit.client.1.smithi119.stdout:3/562: mknod d9/cd9 0 2023-12-17T11:57:46.097 INFO:tasks.workunit.client.1.smithi119.stdout:3/563: read - d9/d1c/f7b zero size 2023-12-17T11:57:46.098 INFO:tasks.workunit.client.1.smithi119.stdout:3/564: write d9/d11/d92/fd7 [202772,6642] 0 2023-12-17T11:57:46.098 INFO:tasks.workunit.client.0.smithi002.stdout:8/525: symlink d3/d8/d28/d31/d5a/laf 0 2023-12-17T11:57:46.098 INFO:tasks.workunit.client.0.smithi002.stdout:3/523: dread d9/d24/f81 [0,4194304] 0 2023-12-17T11:57:46.099 INFO:tasks.workunit.client.0.smithi002.stdout:7/465: truncate d6/d17/dc/d13/d21/d2e/f5a 2308617 0 2023-12-17T11:57:46.099 INFO:tasks.workunit.client.1.smithi119.stdout:8/429: rmdir d7/da/d11/d26/d2c/d7b 39 2023-12-17T11:57:46.101 INFO:tasks.workunit.client.1.smithi119.stdout:4/504: creat dd/d15/d16/d20/d82/fa5 x:0 0 0 2023-12-17T11:57:46.101 INFO:tasks.workunit.client.0.smithi002.stdout:1/575: symlink d3/d6/d16/d9f/lc1 0 2023-12-17T11:57:46.103 INFO:tasks.workunit.client.1.smithi119.stdout:0/404: creat d2/d66/f71 x:0 0 0 2023-12-17T11:57:46.105 INFO:tasks.workunit.client.0.smithi002.stdout:6/493: unlink d0/f71 0 2023-12-17T11:57:46.109 INFO:tasks.workunit.client.0.smithi002.stdout:5/506: dread dc/d17/f55 [0,4194304] 0 2023-12-17T11:57:46.110 INFO:tasks.workunit.client.1.smithi119.stdout:1/490: mknod d3/db/d26/d5e/cb1 0 2023-12-17T11:57:46.110 INFO:tasks.workunit.client.0.smithi002.stdout:7/466: link d6/d17/dc/d13/d37/d4f/f63 d6/d17/dc/f8d 0 2023-12-17T11:57:46.110 INFO:tasks.workunit.client.0.smithi002.stdout:7/467: chown d6/d17/dc/d13/d3e/l4e 21 1 2023-12-17T11:57:46.110 INFO:tasks.workunit.client.0.smithi002.stdout:2/506: getdents d3/d4/d7 0 2023-12-17T11:57:46.111 INFO:tasks.workunit.client.0.smithi002.stdout:5/507: rename dc/d1b/d2d to dc/d1b/d2d/d5b/db7 22 2023-12-17T11:57:46.111 INFO:tasks.workunit.client.0.smithi002.stdout:5/508: creat dc/d17/d2f/fb8 x:0 0 0 2023-12-17T11:57:46.111 INFO:tasks.workunit.client.0.smithi002.stdout:5/509: fsync dc/f83 0 2023-12-17T11:57:46.112 INFO:tasks.workunit.client.1.smithi119.stdout:7/519: creat d2/d4/d11/d3c/f9e x:0 0 0 2023-12-17T11:57:46.112 INFO:tasks.workunit.client.1.smithi119.stdout:7/520: creat d2/f9f x:0 0 0 2023-12-17T11:57:46.112 INFO:tasks.workunit.client.1.smithi119.stdout:5/533: dread d1/f30 [0,4194304] 0 2023-12-17T11:57:46.113 INFO:tasks.workunit.client.1.smithi119.stdout:7/521: fdatasync d2/f24 0 2023-12-17T11:57:46.113 INFO:tasks.workunit.client.1.smithi119.stdout:5/534: chown d1/d36/f47 1 1 2023-12-17T11:57:46.114 INFO:tasks.workunit.client.0.smithi002.stdout:7/468: mkdir d6/d17/dc/d8e 0 2023-12-17T11:57:46.115 INFO:tasks.workunit.client.1.smithi119.stdout:3/565: mkdir d9/d59/dda 0 2023-12-17T11:57:46.118 INFO:tasks.workunit.client.0.smithi002.stdout:2/507: symlink d3/d4/d7/d14/d1b/lbe 0 2023-12-17T11:57:46.119 INFO:tasks.workunit.client.1.smithi119.stdout:8/430: creat d7/d12/d69/d67/f91 x:0 0 0 2023-12-17T11:57:46.124 INFO:tasks.workunit.client.1.smithi119.stdout:4/505: symlink dd/d11/d26/la6 0 2023-12-17T11:57:46.127 INFO:tasks.workunit.client.0.smithi002.stdout:5/510: creat dc/d1a/d53/da9/fb9 x:0 0 0 2023-12-17T11:57:46.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/486: dread d0/d10/f31 [0,4194304] 0 2023-12-17T11:57:46.131 INFO:tasks.workunit.client.1.smithi119.stdout:5/535: write d1/f20 [3267283,79835] 0 2023-12-17T11:57:46.132 INFO:tasks.workunit.client.1.smithi119.stdout:5/536: stat d1/d25/d39/d71/c8d 0 2023-12-17T11:57:46.134 INFO:tasks.workunit.client.0.smithi002.stdout:2/508: creat d3/d4/d8b/da6/fbf x:0 0 0 2023-12-17T11:57:46.136 INFO:tasks.workunit.client.1.smithi119.stdout:1/491: mkdir d3/db/d26/d19/d3f/d64/db2 0 2023-12-17T11:57:46.139 INFO:tasks.workunit.client.0.smithi002.stdout:5/511: unlink dc/d17/d2f/d99/la3 0 2023-12-17T11:57:46.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/512: creat dc/d17/d2f/d99/fba x:0 0 0 2023-12-17T11:57:46.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/513: read - dc/d17/d2f/f7a zero size 2023-12-17T11:57:46.142 INFO:tasks.workunit.client.0.smithi002.stdout:2/509: creat d3/d50/fc0 x:0 0 0 2023-12-17T11:57:46.149 INFO:tasks.workunit.client.1.smithi119.stdout:7/522: mknod d2/d4/d11/d2c/d55/d67/ca0 0 2023-12-17T11:57:46.149 INFO:tasks.workunit.client.1.smithi119.stdout:7/523: fsync d2/d40/f5a 0 2023-12-17T11:57:46.150 INFO:tasks.workunit.client.0.smithi002.stdout:8/526: dwrite d3/d8/da/dd/f35 [0,4194304] 0 2023-12-17T11:57:46.150 INFO:tasks.workunit.client.0.smithi002.stdout:8/527: write d3/d7/d18/d74/f79 [951311,87336] 0 2023-12-17T11:57:46.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/528: read d3/d8/d28/d31/d5a/f7a [188093,90905] 0 2023-12-17T11:57:46.153 INFO:tasks.workunit.client.0.smithi002.stdout:8/529: fdatasync d3/d8/d28/d31/f34 0 2023-12-17T11:57:46.154 INFO:tasks.workunit.client.0.smithi002.stdout:5/514: rename dc/l1e to dc/d1b/d5a/d68/lbb 0 2023-12-17T11:57:46.156 INFO:tasks.workunit.client.1.smithi119.stdout:3/566: symlink d9/d44/db7/ldb 0 2023-12-17T11:57:46.160 INFO:tasks.workunit.client.1.smithi119.stdout:8/431: unlink d7/c6e 0 2023-12-17T11:57:46.161 INFO:tasks.workunit.client.0.smithi002.stdout:2/510: creat d3/d4/d7/d14/d9b/fc1 x:0 0 0 2023-12-17T11:57:46.162 INFO:tasks.workunit.client.0.smithi002.stdout:5/515: creat dc/fbc x:0 0 0 2023-12-17T11:57:46.164 INFO:tasks.workunit.client.1.smithi119.stdout:4/506: creat dd/d11/d2d/d9c/d55/d81/d88/fa7 x:0 0 0 2023-12-17T11:57:46.169 INFO:tasks.workunit.client.1.smithi119.stdout:2/567: rename d6/d9/fb to d6/d9/d13/d34/d88/fcc 0 2023-12-17T11:57:46.169 INFO:tasks.workunit.client.1.smithi119.stdout:2/568: creat d6/d9/d52/d53/fcd x:0 0 0 2023-12-17T11:57:46.173 INFO:tasks.workunit.client.0.smithi002.stdout:8/530: write d3/d8/da/dd/f35 [5433101,35807] 0 2023-12-17T11:57:46.173 INFO:tasks.workunit.client.0.smithi002.stdout:8/531: write d3/d8/da/f8a [1676032,100662] 0 2023-12-17T11:57:46.173 INFO:tasks.workunit.client.1.smithi119.stdout:0/405: rename d2/d16/d35/l65 to d2/d16/d35/l72 0 2023-12-17T11:57:46.176 INFO:tasks.workunit.client.1.smithi119.stdout:5/537: symlink d1/d36/la6 0 2023-12-17T11:57:46.177 INFO:tasks.workunit.client.1.smithi119.stdout:5/538: readlink d1/l1c 0 2023-12-17T11:57:46.177 INFO:tasks.workunit.client.0.smithi002.stdout:3/524: write d9/d1b/d35/d41/d59/d7c/f8b [1400213,60883] 0 2023-12-17T11:57:46.178 INFO:tasks.workunit.client.0.smithi002.stdout:3/525: chown d9/d24/f81 77298231 1 2023-12-17T11:57:46.178 INFO:tasks.workunit.client.0.smithi002.stdout:0/470: dwrite d0/d6/d26/d14/f53 [0,4194304] 0 2023-12-17T11:57:46.183 INFO:tasks.workunit.client.0.smithi002.stdout:8/532: truncate d3/d7/f37 2614600 0 2023-12-17T11:57:46.190 INFO:tasks.workunit.client.0.smithi002.stdout:9/547: dwrite dc/d42/d4f/f92 [0,4194304] 0 2023-12-17T11:57:46.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/516: dread dc/d17/f87 [0,4194304] 0 2023-12-17T11:57:46.193 INFO:tasks.workunit.client.0.smithi002.stdout:3/526: getdents d9/d1b/d35/d41/d43/d4b 0 2023-12-17T11:57:46.197 INFO:tasks.workunit.client.0.smithi002.stdout:8/533: mkdir d3/d8/da/dd/db0 0 2023-12-17T11:57:46.197 INFO:tasks.workunit.client.1.smithi119.stdout:2/569: write d6/d9/d86/fb4 [3626652,72927] 0 2023-12-17T11:57:46.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/494: dwrite d0/d1/dc/f54 [0,4194304] 0 2023-12-17T11:57:46.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/495: dread - d0/d1/dc/d10/f86 zero size 2023-12-17T11:57:46.203 INFO:tasks.workunit.client.0.smithi002.stdout:6/496: chown d0/d1/dc/d10/c1b 175510 1 2023-12-17T11:57:46.205 INFO:tasks.workunit.client.1.smithi119.stdout:7/524: rmdir d2/d5b 39 2023-12-17T11:57:46.205 INFO:tasks.workunit.client.1.smithi119.stdout:7/525: dread - d2/f74 zero size 2023-12-17T11:57:46.209 INFO:tasks.workunit.client.1.smithi119.stdout:4/507: rename dd/f38 to dd/d15/d16/fa8 0 2023-12-17T11:57:46.209 INFO:tasks.workunit.client.1.smithi119.stdout:4/508: dread - dd/d4b/f87 zero size 2023-12-17T11:57:46.210 INFO:tasks.workunit.client.0.smithi002.stdout:6/497: mkdir d0/d1/dc/d17/d67/d6c/d9f 0 2023-12-17T11:57:46.211 INFO:tasks.workunit.client.1.smithi119.stdout:2/570: creat d6/d9/d52/d5a/fce x:0 0 0 2023-12-17T11:57:46.212 INFO:tasks.workunit.client.1.smithi119.stdout:7/526: symlink d2/d4/d70/d57/la1 0 2023-12-17T11:57:46.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/527: dread d9/d40/f6e [0,4194304] 0 2023-12-17T11:57:46.213 INFO:tasks.workunit.client.0.smithi002.stdout:3/528: write d9/d24/f6d [3569170,69806] 0 2023-12-17T11:57:46.214 INFO:tasks.workunit.client.1.smithi119.stdout:0/406: rename d2/d3/ca to d2/d66/d2e/d44/c73 0 2023-12-17T11:57:46.215 INFO:tasks.workunit.client.1.smithi119.stdout:4/509: truncate dd/d15/d16/d3d/f4c 2291859 0 2023-12-17T11:57:46.215 INFO:tasks.workunit.client.1.smithi119.stdout:4/510: write dd/d11/d2d/d9c/d55/f80 [205130,105030] 0 2023-12-17T11:57:46.215 INFO:tasks.workunit.client.1.smithi119.stdout:4/511: fsync dd/d15/d4f/f6b 0 2023-12-17T11:57:46.218 INFO:tasks.workunit.client.1.smithi119.stdout:2/571: mkdir d6/d9/d13/d34/dcf 0 2023-12-17T11:57:46.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/527: mknod d2/d4/d11/d2c/d68/d6a/ca2 0 2023-12-17T11:57:46.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/528: creat d2/d4/d1f/fa3 x:0 0 0 2023-12-17T11:57:46.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:45 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:46.226 INFO:tasks.workunit.client.1.smithi119.stdout:4/512: unlink dd/d15/f2e 0 2023-12-17T11:57:46.226 INFO:tasks.workunit.client.1.smithi119.stdout:4/513: creat dd/d11/d2d/d9c/d55/d81/d88/fa9 x:0 0 0 2023-12-17T11:57:46.228 INFO:tasks.workunit.client.0.smithi002.stdout:3/529: rmdir d9/d24 39 2023-12-17T11:57:46.230 INFO:tasks.workunit.client.1.smithi119.stdout:7/529: mknod d2/d4/ca4 0 2023-12-17T11:57:46.230 INFO:tasks.workunit.client.1.smithi119.stdout:7/530: dread - d2/d4/d11/d2c/f8f zero size 2023-12-17T11:57:46.231 INFO:tasks.workunit.client.1.smithi119.stdout:0/407: mkdir d2/d16/d35/d74 0 2023-12-17T11:57:46.237 INFO:tasks.workunit.client.1.smithi119.stdout:4/514: symlink dd/d11/d26/laa 0 2023-12-17T11:57:46.240 INFO:tasks.workunit.client.1.smithi119.stdout:5/539: rename d1/d25/d39 to d1/da7 0 2023-12-17T11:57:46.241 INFO:tasks.workunit.client.1.smithi119.stdout:4/515: mkdir dd/d15/d16/d3d/dab 0 2023-12-17T11:57:46.242 INFO:tasks.workunit.client.1.smithi119.stdout:7/531: rmdir d2/d4/d70/d57/d56 39 2023-12-17T11:57:46.244 INFO:tasks.workunit.client.0.smithi002.stdout:3/530: write d9/d1b/d35/d41/d59/d65/f74 [608287,92228] 0 2023-12-17T11:57:46.244 INFO:tasks.workunit.client.0.smithi002.stdout:3/531: fdatasync d9/d1b/d35/d41/d43/f50 0 2023-12-17T11:57:46.245 INFO:tasks.workunit.client.1.smithi119.stdout:2/572: rename d6/d9/d52/d53/d55/fc2 to d6/d9/d52/d53/d55/d58/dba/fd0 0 2023-12-17T11:57:46.245 INFO:tasks.workunit.client.1.smithi119.stdout:2/573: dread - d6/d2b/d4b/f77 zero size 2023-12-17T11:57:46.249 INFO:tasks.workunit.client.1.smithi119.stdout:5/540: creat d1/fa8 x:0 0 0 2023-12-17T11:57:46.249 INFO:tasks.workunit.client.1.smithi119.stdout:5/541: write d1/d44/f72 [4379891,19449] 0 2023-12-17T11:57:46.254 INFO:tasks.workunit.client.1.smithi119.stdout:7/532: rename d2/d4/d70/f45 to d2/d4/d11/d2c/d68/d99/d6c/fa5 0 2023-12-17T11:57:46.254 INFO:tasks.workunit.client.1.smithi119.stdout:7/533: fsync d2/d4/d1f/f9b 0 2023-12-17T11:57:46.254 INFO:tasks.workunit.client.1.smithi119.stdout:7/534: chown d2/d4/d11/d3c/c51 54071 1 2023-12-17T11:57:46.254 INFO:tasks.workunit.client.0.smithi002.stdout:7/469: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:46.256 INFO:tasks.workunit.client.0.smithi002.stdout:3/532: rename d9/d15/d71/d82/lac to d9/d1b/d35/d41/d43/d73/d89/lae 0 2023-12-17T11:57:46.256 INFO:tasks.workunit.client.0.smithi002.stdout:3/533: fdatasync d9/f1d 0 2023-12-17T11:57:46.256 INFO:tasks.workunit.client.0.smithi002.stdout:3/534: read f3 [488651,15532] 0 2023-12-17T11:57:46.257 INFO:tasks.workunit.client.1.smithi119.stdout:4/516: dread dd/d15/d16/d20/d42/f67 [0,4194304] 0 2023-12-17T11:57:46.257 INFO:tasks.workunit.client.1.smithi119.stdout:4/517: write dd/d15/d4f/f6b [124166,18054] 0 2023-12-17T11:57:46.257 INFO:tasks.workunit.client.1.smithi119.stdout:4/518: chown dd/f1b 908680865 1 2023-12-17T11:57:46.257 INFO:tasks.workunit.client.1.smithi119.stdout:8/432: dwrite d7/d12/d23/f38 [0,4194304] 0 2023-12-17T11:57:46.260 INFO:tasks.workunit.client.1.smithi119.stdout:5/542: rename d1/d44/d52/f5f to d1/da7/d71/d97/fa9 0 2023-12-17T11:57:46.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/534: dwrite d3/d8/da/dd/f2d [0,4194304] 0 2023-12-17T11:57:46.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/535: creat d3/d7/d6e/fb1 x:0 0 0 2023-12-17T11:57:46.262 INFO:tasks.workunit.client.0.smithi002.stdout:6/498: dwrite d0/d1/d5b/f95 [0,4194304] 0 2023-12-17T11:57:46.263 INFO:tasks.workunit.client.0.smithi002.stdout:6/499: dread - d0/d1/dc/d17/d3c/f94 zero size 2023-12-17T11:57:46.263 INFO:tasks.workunit.client.0.smithi002.stdout:7/470: creat d6/d17/dc/d13/d21/f8f x:0 0 0 2023-12-17T11:57:46.263 INFO:tasks.workunit.client.0.smithi002.stdout:7/471: stat d6/d17/dc/d67/c23 0 2023-12-17T11:57:46.263 INFO:tasks.workunit.client.1.smithi119.stdout:7/535: getdents d2/d4/d11/d2c 0 2023-12-17T11:57:46.264 INFO:tasks.workunit.client.1.smithi119.stdout:2/574: write d6/f73 [4094069,97896] 0 2023-12-17T11:57:46.265 INFO:tasks.workunit.client.0.smithi002.stdout:9/548: dread dc/d42/da0/d72/d93/f29 [0,4194304] 0 2023-12-17T11:57:46.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/535: link d9/d40/l70 d9/d24/d6f/laf 0 2023-12-17T11:57:46.265 INFO:tasks.workunit.client.0.smithi002.stdout:3/536: readlink d9/l2d 0 2023-12-17T11:57:46.266 INFO:tasks.workunit.client.1.smithi119.stdout:4/519: unlink dd/d15/d16/d20/c2b 0 2023-12-17T11:57:46.266 INFO:tasks.workunit.client.1.smithi119.stdout:4/520: chown dd/d15/d4f 2791259 1 2023-12-17T11:57:46.267 INFO:tasks.workunit.client.1.smithi119.stdout:4/521: fsync dd/d15/d16/d5a/f70 0 2023-12-17T11:57:46.267 INFO:tasks.workunit.client.1.smithi119.stdout:4/522: write dd/d15/d16/f1a [2143164,37401] 0 2023-12-17T11:57:46.267 INFO:tasks.workunit.client.1.smithi119.stdout:4/523: creat dd/d4b/fac x:0 0 0 2023-12-17T11:57:46.267 INFO:tasks.workunit.client.1.smithi119.stdout:4/524: write dd/d4b/fa4 [888410,84309] 0 2023-12-17T11:57:46.272 INFO:tasks.workunit.client.1.smithi119.stdout:8/433: mkdir d7/da/d11/d26/d2c/d7b/d92 0 2023-12-17T11:57:46.278 INFO:tasks.workunit.client.0.smithi002.stdout:8/536: rename d3/d8/d28/c5e to d3/d7/d6e/d7f/d65/da2/cb2 0 2023-12-17T11:57:46.278 INFO:tasks.workunit.client.0.smithi002.stdout:6/500: rmdir d0/d1/d6d 39 2023-12-17T11:57:46.279 INFO:tasks.workunit.client.1.smithi119.stdout:0/408: getdents d2/d66/d2e/d44 0 2023-12-17T11:57:46.284 INFO:tasks.workunit.client.1.smithi119.stdout:5/543: creat d1/da7/faa x:0 0 0 2023-12-17T11:57:46.285 INFO:tasks.workunit.client.1.smithi119.stdout:5/544: write d1/da7/d71/d97/fa9 [1396239,45539] 0 2023-12-17T11:57:46.287 INFO:tasks.workunit.client.1.smithi119.stdout:7/536: mknod d2/d4/ca6 0 2023-12-17T11:57:46.289 INFO:tasks.workunit.client.0.smithi002.stdout:7/472: rename d6/d17/dc/d13/d21/l59 to d6/d17/l90 0 2023-12-17T11:57:46.290 INFO:tasks.workunit.client.1.smithi119.stdout:4/525: read dd/d15/d16/d3d/f4c [2107376,87696] 0 2023-12-17T11:57:46.292 INFO:tasks.workunit.client.1.smithi119.stdout:2/575: truncate d6/f40 4425800 0 2023-12-17T11:57:46.295 INFO:tasks.workunit.client.1.smithi119.stdout:8/434: rmdir d7/d12 39 2023-12-17T11:57:46.295 INFO:tasks.workunit.client.1.smithi119.stdout:8/435: chown d7/d12/d69 113537293 1 2023-12-17T11:57:46.295 INFO:tasks.workunit.client.1.smithi119.stdout:0/409: creat d2/d66/d2e/f75 x:0 0 0 2023-12-17T11:57:46.295 INFO:tasks.workunit.client.1.smithi119.stdout:0/410: creat d2/d16/d35/d39/f76 x:0 0 0 2023-12-17T11:57:46.296 INFO:tasks.workunit.client.0.smithi002.stdout:6/501: dread d0/d1/dc/d17/d40/f5f [0,4194304] 0 2023-12-17T11:57:46.297 INFO:tasks.workunit.client.1.smithi119.stdout:5/545: creat d1/da7/d71/d76/fab x:0 0 0 2023-12-17T11:57:46.298 INFO:tasks.workunit.client.1.smithi119.stdout:7/537: getdents d2/d4/d11/d2c/d68/d99 0 2023-12-17T11:57:46.301 INFO:tasks.workunit.client.1.smithi119.stdout:2/576: creat d6/d9/fd1 x:0 0 0 2023-12-17T11:57:46.303 INFO:tasks.workunit.client.1.smithi119.stdout:8/436: symlink d7/da/d1a/d84/l93 0 2023-12-17T11:57:46.309 INFO:tasks.workunit.client.1.smithi119.stdout:0/411: link d2/d66/d2e/d44/c73 d2/d66/d2e/c77 0 2023-12-17T11:57:46.311 INFO:tasks.workunit.client.1.smithi119.stdout:5/546: rename d1/d36/c7d to d1/d70/da3/cac 0 2023-12-17T11:57:46.312 INFO:tasks.workunit.client.1.smithi119.stdout:7/538: mkdir d2/d40/da7 0 2023-12-17T11:57:46.312 INFO:tasks.workunit.client.1.smithi119.stdout:7/539: stat d2 0 2023-12-17T11:57:46.315 INFO:tasks.workunit.client.0.smithi002.stdout:7/473: dread d6/d17/dc/f51 [0,4194304] 0 2023-12-17T11:57:46.317 INFO:tasks.workunit.client.1.smithi119.stdout:4/526: rmdir dd/d11/d26 39 2023-12-17T11:57:46.317 INFO:tasks.workunit.client.1.smithi119.stdout:4/527: chown dd/d11/d2d/d9c/d55/d81 6 1 2023-12-17T11:57:46.317 INFO:tasks.workunit.client.1.smithi119.stdout:4/528: stat dd/d11/d26 0 2023-12-17T11:57:46.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/529: dread - dd/d15/d4f/f8d zero size 2023-12-17T11:57:46.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/530: readlink dd/d15/d16/d20/d42/la2 0 2023-12-17T11:57:46.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/531: truncate dd/d15/d4f/f6b 604198 0 2023-12-17T11:57:46.318 INFO:tasks.workunit.client.1.smithi119.stdout:4/532: readlink dd/d15/d16/d20/l2c 0 2023-12-17T11:57:46.318 INFO:tasks.workunit.client.1.smithi119.stdout:2/577: creat d6/d9/d86/db0/fd2 x:0 0 0 2023-12-17T11:57:46.322 INFO:tasks.workunit.client.1.smithi119.stdout:5/547: getdents d1/da7/d71/d82 0 2023-12-17T11:57:46.324 INFO:tasks.workunit.client.1.smithi119.stdout:7/540: creat d2/d4/d11/d2c/d68/d98/fa8 x:0 0 0 2023-12-17T11:57:46.325 INFO:tasks.workunit.client.1.smithi119.stdout:7/541: read d2/f24 [636277,89531] 0 2023-12-17T11:57:46.325 INFO:tasks.workunit.client.1.smithi119.stdout:7/542: dread - d2/d4/f47 zero size 2023-12-17T11:57:46.325 INFO:tasks.workunit.client.1.smithi119.stdout:7/543: dread - d2/d4/d1f/fa3 zero size 2023-12-17T11:57:46.325 INFO:tasks.workunit.client.1.smithi119.stdout:7/544: fsync d2/d4/d11/d2c/f3a 0 2023-12-17T11:57:46.326 INFO:tasks.workunit.client.1.smithi119.stdout:4/533: getdents dd/d11/d2d/d9c/d55/d81 0 2023-12-17T11:57:46.326 INFO:tasks.workunit.client.1.smithi119.stdout:4/534: fdatasync dd/d4b/f54 0 2023-12-17T11:57:46.328 INFO:tasks.workunit.client.1.smithi119.stdout:2/578: creat d6/d2b/d4b/d5d/fd3 x:0 0 0 2023-12-17T11:57:46.328 INFO:tasks.workunit.client.1.smithi119.stdout:2/579: readlink d6/d2b/l66 0 2023-12-17T11:57:46.329 INFO:tasks.workunit.client.1.smithi119.stdout:0/412: unlink d2/d3/d5/dc/l61 0 2023-12-17T11:57:46.330 INFO:tasks.workunit.client.1.smithi119.stdout:0/413: stat d2/d66/d1f/l31 0 2023-12-17T11:57:46.333 INFO:tasks.workunit.client.1.smithi119.stdout:7/545: symlink d2/d4/d1f/la9 0 2023-12-17T11:57:46.333 INFO:tasks.workunit.client.1.smithi119.stdout:7/546: write d2/d4/d1f/f9b [148394,78131] 0 2023-12-17T11:57:46.334 INFO:tasks.workunit.client.1.smithi119.stdout:4/535: link dd/d15/d16/d5a/l69 dd/d11/d2d/d9c/d55/d81/da1/lad 0 2023-12-17T11:57:46.335 INFO:tasks.workunit.client.0.smithi002.stdout:3/537: write d9/d15/f16 [1948936,67414] 0 2023-12-17T11:57:46.336 INFO:tasks.workunit.client.1.smithi119.stdout:0/414: stat d2/d66/d2e/d44/c73 0 2023-12-17T11:57:46.336 INFO:tasks.workunit.client.1.smithi119.stdout:0/415: fsync d2/d66/d1f/f69 0 2023-12-17T11:57:46.336 INFO:tasks.workunit.client.1.smithi119.stdout:0/416: fdatasync d2/d3/f14 0 2023-12-17T11:57:46.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/547: symlink d2/d4/d11/d2c/d68/d77/laa 0 2023-12-17T11:57:46.340 INFO:tasks.workunit.client.0.smithi002.stdout:3/538: creat d9/d1b/d35/d41/fb0 x:0 0 0 2023-12-17T11:57:46.341 INFO:tasks.workunit.client.1.smithi119.stdout:0/417: creat d2/d66/d2e/d44/f78 x:0 0 0 2023-12-17T11:57:46.343 INFO:tasks.workunit.client.0.smithi002.stdout:3/539: creat d9/d1b/d4f/fb1 x:0 0 0 2023-12-17T11:57:46.343 INFO:tasks.workunit.client.0.smithi002.stdout:3/540: chown d9/d24 153988 1 2023-12-17T11:57:46.343 INFO:tasks.workunit.client.0.smithi002.stdout:6/502: dwrite d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:46.343 INFO:tasks.workunit.client.0.smithi002.stdout:3/541: creat d9/d1b/d4f/fb2 x:0 0 0 2023-12-17T11:57:46.343 INFO:tasks.workunit.client.0.smithi002.stdout:6/503: chown d0/d1/d21/d56/d60/f6e 247 1 2023-12-17T11:57:46.343 INFO:tasks.workunit.client.0.smithi002.stdout:6/504: creat d0/d1/dc/d17/fa0 x:0 0 0 2023-12-17T11:57:46.347 INFO:tasks.workunit.client.0.smithi002.stdout:3/542: creat d9/d1b/d4f/d88/fb3 x:0 0 0 2023-12-17T11:57:46.350 INFO:tasks.workunit.client.1.smithi119.stdout:5/548: getdents d1/da7/d71/d76 0 2023-12-17T11:57:46.353 INFO:tasks.workunit.client.0.smithi002.stdout:6/505: symlink d0/d1/dc/d17/d67/d6c/d7f/la1 0 2023-12-17T11:57:46.358 INFO:tasks.workunit.client.0.smithi002.stdout:6/506: mkdir d0/d1/d6d/d83/da2 0 2023-12-17T11:57:46.368 INFO:tasks.workunit.client.1.smithi119.stdout:0/418: dread d2/d66/d2e/d44/f26 [4194304,4194304] 0 2023-12-17T11:57:46.368 INFO:tasks.workunit.client.1.smithi119.stdout:0/419: fsync d2/d3/f14 0 2023-12-17T11:57:46.368 INFO:tasks.workunit.client.1.smithi119.stdout:0/420: chown d2/d16/d35/d74 802 1 2023-12-17T11:57:46.370 INFO:tasks.workunit.client.1.smithi119.stdout:0/421: mknod d2/d16/c79 0 2023-12-17T11:57:46.377 INFO:tasks.workunit.client.1.smithi119.stdout:0/422: mknod d2/d16/c7a 0 2023-12-17T11:57:46.377 INFO:tasks.workunit.client.1.smithi119.stdout:0/423: write d2/d16/d35/d39/f6e [590393,28163] 0 2023-12-17T11:57:46.379 INFO:tasks.workunit.client.1.smithi119.stdout:5/549: dread d1/f51 [0,4194304] 0 2023-12-17T11:57:46.379 INFO:tasks.workunit.client.1.smithi119.stdout:5/550: dread - d1/da7/d71/d76/d83/f9a zero size 2023-12-17T11:57:46.380 INFO:tasks.workunit.client.1.smithi119.stdout:0/424: rename d2/d3 to d2/d66/d2e/d44/d7b 0 2023-12-17T11:57:46.381 INFO:tasks.workunit.client.0.smithi002.stdout:3/543: dread d9/d1b/f7b [0,4194304] 0 2023-12-17T11:57:46.381 INFO:tasks.workunit.client.0.smithi002.stdout:3/544: chown d9/d15/d52 5 1 2023-12-17T11:57:46.381 INFO:tasks.workunit.client.0.smithi002.stdout:3/545: chown d9/d15/f19 910 1 2023-12-17T11:57:46.382 INFO:tasks.workunit.client.1.smithi119.stdout:0/425: creat d2/d16/f7c x:0 0 0 2023-12-17T11:57:46.382 INFO:tasks.workunit.client.1.smithi119.stdout:5/551: rename d1/d70/d85/f93 to d1/d70/fad 0 2023-12-17T11:57:46.386 INFO:tasks.workunit.client.1.smithi119.stdout:0/426: link d2/d66/d1f/d24/d50/d5d/f64 d2/d16/f7d 0 2023-12-17T11:57:46.386 INFO:tasks.workunit.client.0.smithi002.stdout:3/546: chown d9/d15/c2c 707234 1 2023-12-17T11:57:46.388 INFO:tasks.workunit.client.0.smithi002.stdout:6/507: write d0/d1/dc/d17/f91 [739694,125694] 0 2023-12-17T11:57:46.389 INFO:tasks.workunit.client.0.smithi002.stdout:7/474: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:46.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/547: link d9/d1b/d35/d41/d59/d7c/l7f d9/d1b/d35/d41/d59/d72/lb4 0 2023-12-17T11:57:46.393 INFO:tasks.workunit.client.0.smithi002.stdout:7/475: mkdir d6/d17/dc/d13/d21/d2e/d4a/d91 0 2023-12-17T11:57:46.394 INFO:tasks.workunit.client.0.smithi002.stdout:7/476: truncate d6/d17/dc/d13/d21/d2e/f7f 1146181 0 2023-12-17T11:57:46.408 INFO:tasks.workunit.client.1.smithi119.stdout:0/427: read d2/d66/d2e/d44/d7b/d5/d3f/f52 [553795,44666] 0 2023-12-17T11:57:46.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:45 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:57:46.409 INFO:tasks.workunit.client.1.smithi119.stdout:7/548: dwrite d2/d4/d70/d57/d56/f59 [0,4194304] 0 2023-12-17T11:57:46.410 INFO:tasks.workunit.client.1.smithi119.stdout:2/580: dwrite d6/d9/d52/d53/d55/f7d [0,4194304] 0 2023-12-17T11:57:46.411 INFO:tasks.workunit.client.1.smithi119.stdout:7/549: write d2/d40/f6b [261062,704] 0 2023-12-17T11:57:46.411 INFO:tasks.workunit.client.1.smithi119.stdout:7/550: readlink d2/d4/d11/d2c/d68/d77/laa 0 2023-12-17T11:57:46.411 INFO:tasks.workunit.client.1.smithi119.stdout:7/551: creat d2/d4/d11/d2c/d68/d98/fab x:0 0 0 2023-12-17T11:57:46.411 INFO:tasks.workunit.client.1.smithi119.stdout:7/552: readlink d2/d4/d1f/l94 0 2023-12-17T11:57:46.411 INFO:tasks.workunit.client.1.smithi119.stdout:7/553: write d2/d4/f47 [322698,8450] 0 2023-12-17T11:57:46.412 INFO:tasks.workunit.client.1.smithi119.stdout:0/428: creat d2/d66/d2e/d44/d7b/d5/dc/f7e x:0 0 0 2023-12-17T11:57:46.412 INFO:tasks.workunit.client.1.smithi119.stdout:0/429: dread - d2/d66/d2e/d44/d7b/d5/d3f/f5e zero size 2023-12-17T11:57:46.412 INFO:tasks.workunit.client.0.smithi002.stdout:1/576: sync 2023-12-17T11:57:46.413 INFO:tasks.workunit.client.0.smithi002.stdout:0/471: sync 2023-12-17T11:57:46.413 INFO:tasks.workunit.client.0.smithi002.stdout:0/472: fsync d0/d6/d26/f35 0 2023-12-17T11:57:46.413 INFO:tasks.workunit.client.0.smithi002.stdout:5/517: sync 2023-12-17T11:57:46.414 INFO:tasks.workunit.client.1.smithi119.stdout:2/581: creat d6/d9/d13/d34/d88/fd4 x:0 0 0 2023-12-17T11:57:46.414 INFO:tasks.workunit.client.1.smithi119.stdout:2/582: stat d6/d2b/d4b/f77 0 2023-12-17T11:57:46.415 INFO:tasks.workunit.client.1.smithi119.stdout:7/554: mkdir d2/d4/d70/dac 0 2023-12-17T11:57:46.416 INFO:tasks.workunit.client.1.smithi119.stdout:0/430: truncate d2/f4 1854149 0 2023-12-17T11:57:46.417 INFO:tasks.workunit.client.0.smithi002.stdout:2/511: sync 2023-12-17T11:57:46.417 INFO:tasks.workunit.client.0.smithi002.stdout:2/512: fsync d3/d4/d17/d19/f67 0 2023-12-17T11:57:46.418 INFO:tasks.workunit.client.0.smithi002.stdout:9/549: sync 2023-12-17T11:57:46.418 INFO:tasks.workunit.client.0.smithi002.stdout:9/550: truncate dc/d38/f5b 4824594 0 2023-12-17T11:57:46.418 INFO:tasks.workunit.client.0.smithi002.stdout:4/487: sync 2023-12-17T11:57:46.419 INFO:tasks.workunit.client.1.smithi119.stdout:0/431: mkdir d2/d66/d2e/d44/d7b/d5/dc/d7f 0 2023-12-17T11:57:46.422 INFO:tasks.workunit.client.0.smithi002.stdout:2/513: mkdir d3/d4/d7/d14/d2e/d37/dc2 0 2023-12-17T11:57:46.425 INFO:tasks.workunit.client.0.smithi002.stdout:9/551: symlink dc/d42/lc4 0 2023-12-17T11:57:46.425 INFO:tasks.workunit.client.0.smithi002.stdout:9/552: fsync dc/d42/da0/d72/d93/f73 0 2023-12-17T11:57:46.426 INFO:tasks.workunit.client.0.smithi002.stdout:9/553: write fb [541192,4040] 0 2023-12-17T11:57:46.429 INFO:tasks.workunit.client.1.smithi119.stdout:7/555: rmdir d2/d4/d11/d2c/d68/d99 39 2023-12-17T11:57:46.429 INFO:tasks.workunit.client.1.smithi119.stdout:4/536: dwrite dd/d11/d26/f9f [0,4194304] 0 2023-12-17T11:57:46.432 INFO:tasks.workunit.client.0.smithi002.stdout:4/488: rename d0/d10/d14/d27/d57/d7d/f84 to d0/d10/d14/d4e/f9c 0 2023-12-17T11:57:46.433 INFO:tasks.workunit.client.0.smithi002.stdout:2/514: creat d3/d4/d7/d14/d42/d8a/fc3 x:0 0 0 2023-12-17T11:57:46.435 INFO:tasks.workunit.client.0.smithi002.stdout:2/515: read - d3/d4/d7/fb0 zero size 2023-12-17T11:57:46.437 INFO:tasks.workunit.client.1.smithi119.stdout:0/432: rmdir d2/d66 39 2023-12-17T11:57:46.437 INFO:tasks.workunit.client.1.smithi119.stdout:0/433: fdatasync d2/d66/d2e/d44/d7b/f3d 0 2023-12-17T11:57:46.438 INFO:tasks.workunit.client.1.smithi119.stdout:5/552: dwrite d1/d25/f79 [0,4194304] 0 2023-12-17T11:57:46.438 INFO:tasks.workunit.client.1.smithi119.stdout:5/553: write d1/f1a [1126160,112244] 0 2023-12-17T11:57:46.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/554: creat dc/d1d/d25/d85/dc2/d91/db2/dbf/fc5 x:0 0 0 2023-12-17T11:57:46.441 INFO:tasks.workunit.client.0.smithi002.stdout:9/555: read - dc/d42/da0/d72/d93/d52/f89 zero size 2023-12-17T11:57:46.453 INFO:tasks.workunit.client.1.smithi119.stdout:0/434: mkdir d2/d66/d1f/d24/d50/d5d/d80 0 2023-12-17T11:57:46.459 INFO:tasks.workunit.client.1.smithi119.stdout:0/435: mkdir d2/d66/d1f/d24/d50/d81 0 2023-12-17T11:57:46.461 INFO:tasks.workunit.client.1.smithi119.stdout:0/436: symlink d2/d66/d1f/d24/d50/l82 0 2023-12-17T11:57:46.462 INFO:tasks.workunit.client.1.smithi119.stdout:0/437: unlink d2/d66/d2e/d44/d7b/d5/l1e 0 2023-12-17T11:57:46.466 INFO:tasks.workunit.client.1.smithi119.stdout:0/438: truncate d2/d66/f1c 609845 0 2023-12-17T11:57:46.471 INFO:tasks.workunit.client.1.smithi119.stdout:0/439: link d2/d66/d2e/d44/d7b/f3d d2/d16/d35/d74/f83 0 2023-12-17T11:57:46.471 INFO:tasks.workunit.client.1.smithi119.stdout:0/440: chown d2/d66/d2e/d44/d7b/d5/l2b 50027 1 2023-12-17T11:57:46.472 INFO:tasks.workunit.client.1.smithi119.stdout:7/556: dread d2/d4/d70/f9d [0,4194304] 0 2023-12-17T11:57:46.475 INFO:tasks.workunit.client.1.smithi119.stdout:7/557: mkdir d2/d4/d11/d3c/d75/dad 0 2023-12-17T11:57:46.476 INFO:tasks.workunit.client.0.smithi002.stdout:5/518: dread dc/d1b/d2d/d5b/f8a [0,4194304] 0 2023-12-17T11:57:46.477 INFO:tasks.workunit.client.1.smithi119.stdout:7/558: creat d2/d4/d11/d2c/d68/d98/fae x:0 0 0 2023-12-17T11:57:46.478 INFO:tasks.workunit.client.0.smithi002.stdout:3/548: dwrite d9/d15/f16 [0,4194304] 0 2023-12-17T11:57:46.478 INFO:tasks.workunit.client.0.smithi002.stdout:5/519: unlink dc/c16 0 2023-12-17T11:57:46.483 INFO:tasks.workunit.client.0.smithi002.stdout:3/549: mknod d9/d15/d52/d79/cb5 0 2023-12-17T11:57:46.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/520: mknod dc/d1a/d53/d6f/cbd 0 2023-12-17T11:57:46.483 INFO:tasks.workunit.client.0.smithi002.stdout:4/489: dread d0/d3e/d56/d65/d78/f91 [0,4194304] 0 2023-12-17T11:57:46.486 INFO:tasks.workunit.client.0.smithi002.stdout:3/550: creat d9/d24/d6f/fb6 x:0 0 0 2023-12-17T11:57:46.488 INFO:tasks.workunit.client.0.smithi002.stdout:5/521: mknod dc/d1b/d2d/d5b/cbe 0 2023-12-17T11:57:46.491 INFO:tasks.workunit.client.0.smithi002.stdout:5/522: mknod dc/d1a/d53/d6f/cbf 0 2023-12-17T11:57:46.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/490: mknod d0/d10/d21/c9d 0 2023-12-17T11:57:46.492 INFO:tasks.workunit.client.0.smithi002.stdout:3/551: truncate d9/d15/f66 2788301 0 2023-12-17T11:57:46.494 INFO:tasks.workunit.client.0.smithi002.stdout:5/523: mkdir dc/d17/dc0 0 2023-12-17T11:57:46.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/552: mkdir d9/d1b/d35/d41/d59/d7c/db7 0 2023-12-17T11:57:46.497 INFO:tasks.workunit.client.0.smithi002.stdout:3/553: dread - d9/d15/fad zero size 2023-12-17T11:57:46.499 INFO:tasks.workunit.client.1.smithi119.stdout:5/554: dread d1/f8 [4194304,4194304] 0 2023-12-17T11:57:46.499 INFO:tasks.workunit.client.0.smithi002.stdout:4/491: write d0/d10/d14/f70 [102626,39672] 0 2023-12-17T11:57:46.499 INFO:tasks.workunit.client.0.smithi002.stdout:4/492: chown d0/d3e/d56/d65/d78/f81 3 1 2023-12-17T11:57:46.499 INFO:tasks.workunit.client.0.smithi002.stdout:4/493: chown d0/d5a/c68 33 1 2023-12-17T11:57:46.499 INFO:tasks.workunit.client.1.smithi119.stdout:5/555: mkdir d1/d70/d6b/d77/dae 0 2023-12-17T11:57:46.499 INFO:tasks.workunit.client.1.smithi119.stdout:5/556: chown d1/l24 1331041345 1 2023-12-17T11:57:46.500 INFO:tasks.workunit.client.1.smithi119.stdout:5/557: write d1/f1e [4842130,36780] 0 2023-12-17T11:57:46.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/494: link d0/f19 d0/d3e/d56/f9e 0 2023-12-17T11:57:46.504 INFO:tasks.workunit.client.0.smithi002.stdout:6/508: dwrite d0/d1/dc/d17/fa0 [0,4194304] 0 2023-12-17T11:57:46.504 INFO:tasks.workunit.client.0.smithi002.stdout:6/509: creat d0/d1/dc/d17/d3c/fa3 x:0 0 0 2023-12-17T11:57:46.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/510: symlink d0/d1/d21/d56/d60/la4 0 2023-12-17T11:57:46.506 INFO:tasks.workunit.client.0.smithi002.stdout:6/511: truncate d0/d1/dc/d17/d67/d6c/f80 993463 0 2023-12-17T11:57:46.508 INFO:tasks.workunit.client.0.smithi002.stdout:2/516: dwrite d3/d4/d7/d14/d2e/d37/d3f/fad [0,4194304] 0 2023-12-17T11:57:46.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/512: truncate d0/d1/dc/d17/f1e 1996752 0 2023-12-17T11:57:46.513 INFO:tasks.workunit.client.0.smithi002.stdout:6/513: readlink d0/d1/d21/l3b 0 2023-12-17T11:57:46.516 INFO:tasks.workunit.client.1.smithi119.stdout:0/441: write d2/d16/d35/d74/f83 [3204070,25045] 0 2023-12-17T11:57:46.518 INFO:tasks.workunit.client.0.smithi002.stdout:0/473: dwrite d0/d6/d26/f2d [4194304,4194304] 0 2023-12-17T11:57:46.518 INFO:tasks.workunit.client.1.smithi119.stdout:2/583: dwrite d6/d2b/d4b/f77 [0,4194304] 0 2023-12-17T11:57:46.518 INFO:tasks.workunit.client.1.smithi119.stdout:2/584: creat d6/d2b/da3/fd5 x:0 0 0 2023-12-17T11:57:46.521 INFO:tasks.workunit.client.0.smithi002.stdout:6/514: truncate d0/d1/d28/f3d 3187033 0 2023-12-17T11:57:46.523 INFO:tasks.workunit.client.0.smithi002.stdout:9/556: dwrite dc/d42/d4f/d59/f4e [4194304,4194304] 0 2023-12-17T11:57:46.525 INFO:tasks.workunit.client.0.smithi002.stdout:0/474: symlink d0/l92 0 2023-12-17T11:57:46.526 INFO:tasks.workunit.client.1.smithi119.stdout:2/585: symlink d6/d2b/d3f/ld6 0 2023-12-17T11:57:46.526 INFO:tasks.workunit.client.1.smithi119.stdout:2/586: read - d6/d9/d52/d53/d55/d58/da5/fc6 zero size 2023-12-17T11:57:46.527 INFO:tasks.workunit.client.1.smithi119.stdout:2/587: creat d6/d2b/d4b/d5d/fd7 x:0 0 0 2023-12-17T11:57:46.530 INFO:tasks.workunit.client.1.smithi119.stdout:9/540: sync 2023-12-17T11:57:46.530 INFO:tasks.workunit.client.1.smithi119.stdout:9/541: stat d12/d1d/d28/d4d/d73/f96 0 2023-12-17T11:57:46.530 INFO:tasks.workunit.client.1.smithi119.stdout:4/537: dwrite dd/d15/d4f/f6b [0,4194304] 0 2023-12-17T11:57:46.536 INFO:tasks.workunit.client.0.smithi002.stdout:0/475: mknod d0/d6/d26/d14/d19/d61/c93 0 2023-12-17T11:57:46.536 INFO:tasks.workunit.client.0.smithi002.stdout:0/476: truncate d0/d15/f27 2544824 0 2023-12-17T11:57:46.537 INFO:tasks.workunit.client.1.smithi119.stdout:0/442: dread d2/f4 [0,4194304] 0 2023-12-17T11:57:46.539 INFO:tasks.workunit.client.0.smithi002.stdout:1/577: dwrite d3/d6/d16/d61/f93 [0,4194304] 0 2023-12-17T11:57:46.539 INFO:tasks.workunit.client.0.smithi002.stdout:1/578: dread - d3/d6/d9/d37/d39/d43/d4a/fa5 zero size 2023-12-17T11:57:46.543 INFO:tasks.workunit.client.0.smithi002.stdout:6/515: rename d0/d1/dc/d17/d3c/d65 to d0/d1/d21/d56/d8c/d93/da5 0 2023-12-17T11:57:46.552 INFO:tasks.workunit.client.1.smithi119.stdout:9/542: rename d12/d1d/d28/d86/f8a to d12/d65/fa8 0 2023-12-17T11:57:46.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/524: dwrite dc/d1a/d47/d9b/f9c [0,4194304] 0 2023-12-17T11:57:46.554 INFO:tasks.workunit.client.1.smithi119.stdout:7/559: dwrite d2/d4/d11/d3c/d75/f83 [0,4194304] 0 2023-12-17T11:57:46.556 INFO:tasks.workunit.client.0.smithi002.stdout:1/579: truncate d3/d2f/f79 148269 0 2023-12-17T11:57:46.556 INFO:tasks.workunit.client.0.smithi002.stdout:7/477: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:46.557 INFO:tasks.workunit.client.0.smithi002.stdout:7/478: fsync d6/d17/dc/d6c/f6f 0 2023-12-17T11:57:46.557 INFO:tasks.workunit.client.0.smithi002.stdout:9/557: rename dc/d42/da0/d72/d93/d52/lad to dc/d1d/lc6 0 2023-12-17T11:57:46.558 INFO:tasks.workunit.client.0.smithi002.stdout:9/558: chown dc/d1d/d7c/d90/c6a 80 1 2023-12-17T11:57:46.558 INFO:tasks.workunit.client.0.smithi002.stdout:9/559: creat dc/d42/d4f/d59/d47/fc7 x:0 0 0 2023-12-17T11:57:46.558 INFO:tasks.workunit.client.0.smithi002.stdout:9/560: chown dc/d1d/d25/l40 799928 1 2023-12-17T11:57:46.560 INFO:tasks.workunit.client.1.smithi119.stdout:4/538: creat dd/d11/d2d/d9c/d55/d81/d88/d91/fae x:0 0 0 2023-12-17T11:57:46.561 INFO:tasks.workunit.client.1.smithi119.stdout:4/539: creat dd/d15/d16/d20/d42/d78/faf x:0 0 0 2023-12-17T11:57:46.562 INFO:tasks.workunit.client.0.smithi002.stdout:6/516: creat d0/d1/d21/d56/d8c/d93/da5/fa6 x:0 0 0 2023-12-17T11:57:46.563 INFO:tasks.workunit.client.1.smithi119.stdout:7/560: dread d2/d5b/f96 [0,4194304] 0 2023-12-17T11:57:46.564 INFO:tasks.workunit.client.1.smithi119.stdout:0/443: mknod d2/d66/d2e/c84 0 2023-12-17T11:57:46.564 INFO:tasks.workunit.client.1.smithi119.stdout:0/444: fdatasync d2/d66/d2e/d44/d7b/d5/f4f 0 2023-12-17T11:57:46.568 INFO:tasks.workunit.client.1.smithi119.stdout:9/543: link d12/d65/f72 d12/d1d/d28/d4d/d73/d78/fa9 0 2023-12-17T11:57:46.568 INFO:tasks.workunit.client.0.smithi002.stdout:3/554: dwrite d9/f1d [0,4194304] 0 2023-12-17T11:57:46.568 INFO:tasks.workunit.client.0.smithi002.stdout:3/555: stat d9/d1b/d4f 0 2023-12-17T11:57:46.568 INFO:tasks.workunit.client.0.smithi002.stdout:3/556: fsync d9/d1b/f5e 0 2023-12-17T11:57:46.575 INFO:tasks.workunit.client.1.smithi119.stdout:2/588: dwrite d6/d9/d52/d53/d55/d58/f68 [0,4194304] 0 2023-12-17T11:57:46.576 INFO:tasks.workunit.client.0.smithi002.stdout:2/517: dread d3/d4/d17/d19/d4d/d72/d77/f7a [0,4194304] 0 2023-12-17T11:57:46.576 INFO:tasks.workunit.client.0.smithi002.stdout:4/495: dwrite d0/d3e/f74 [0,4194304] 0 2023-12-17T11:57:46.577 INFO:tasks.workunit.client.1.smithi119.stdout:4/540: link dd/d15/d16/d5a/l69 dd/d15/lb0 0 2023-12-17T11:57:46.580 INFO:tasks.workunit.client.1.smithi119.stdout:7/561: rename d2/d4b/c90 to d2/d4/d11/d2c/d55/caf 0 2023-12-17T11:57:46.582 INFO:tasks.workunit.client.1.smithi119.stdout:0/445: creat d2/d16/d35/f85 x:0 0 0 2023-12-17T11:57:46.582 INFO:tasks.workunit.client.1.smithi119.stdout:0/446: write d2/d66/d2e/f75 [561926,48343] 0 2023-12-17T11:57:46.584 INFO:tasks.workunit.client.0.smithi002.stdout:5/525: write fb [263992,129456] 0 2023-12-17T11:57:46.587 INFO:tasks.workunit.client.0.smithi002.stdout:7/479: unlink d6/d17/dc/d13/d21/d2e/d4a/d53/f5f 0 2023-12-17T11:57:46.588 INFO:tasks.workunit.client.1.smithi119.stdout:9/544: symlink d12/d1d/d49/d89/laa 0 2023-12-17T11:57:46.589 INFO:tasks.workunit.client.0.smithi002.stdout:0/477: rename d0/d6/d26/d14/d19/d2b/l82 to d0/d6/d26/d14/l94 0 2023-12-17T11:57:46.593 INFO:tasks.workunit.client.1.smithi119.stdout:6/468: sync 2023-12-17T11:57:46.593 INFO:tasks.workunit.client.1.smithi119.stdout:1/492: sync 2023-12-17T11:57:46.594 INFO:tasks.workunit.client.0.smithi002.stdout:9/561: creat dc/d1d/d7c/d90/dc0/fc8 x:0 0 0 2023-12-17T11:57:46.596 INFO:tasks.workunit.client.1.smithi119.stdout:1/493: creat d3/db/d26/d5e/fb3 x:0 0 0 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:1/494: dread - d3/db/d26/f7b zero size 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:1/495: dread - d3/db/d26/fa4 zero size 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:1/496: write d3/db/d17/d24/d20/d40/f5b [6793541,6080] 0 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:1/497: write d3/db/d17/f8e [40307,23828] 0 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:1/498: read d3/db/d17/d24/d20/d40/d6d/d7e/f94 [793570,79772] 0 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:9/545: dread d12/f42 [0,4194304] 0 2023-12-17T11:57:46.597 INFO:tasks.workunit.client.1.smithi119.stdout:2/589: symlink d6/d2b/d4b/ld8 0 2023-12-17T11:57:46.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/517: symlink d0/d1/dc/d10/la7 0 2023-12-17T11:57:46.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/518: fdatasync d0/d1/d21/f38 0 2023-12-17T11:57:46.600 INFO:tasks.workunit.client.0.smithi002.stdout:6/519: stat d0/d1/dc/lb 0 2023-12-17T11:57:46.601 INFO:tasks.workunit.client.1.smithi119.stdout:0/447: mknod d2/d16/c86 0 2023-12-17T11:57:46.604 INFO:tasks.workunit.client.1.smithi119.stdout:6/469: mknod d2/d7e/d93/c99 0 2023-12-17T11:57:46.606 INFO:tasks.workunit.client.0.smithi002.stdout:5/526: dread dc/d1b/f63 [0,4194304] 0 2023-12-17T11:57:46.607 INFO:tasks.workunit.client.0.smithi002.stdout:3/557: creat d9/d1b/d35/d41/d59/da3/fb8 x:0 0 0 2023-12-17T11:57:46.607 INFO:tasks.workunit.client.0.smithi002.stdout:3/558: readlink d9/d1b/d35/d41/d59/d7c/l48 0 2023-12-17T11:57:46.612 INFO:tasks.workunit.client.0.smithi002.stdout:4/496: creat d0/d3e/d56/d99/f9f x:0 0 0 2023-12-17T11:57:46.613 INFO:tasks.workunit.client.1.smithi119.stdout:3/567: sync 2023-12-17T11:57:46.614 INFO:tasks.workunit.client.1.smithi119.stdout:3/568: read f4 [1163759,16514] 0 2023-12-17T11:57:46.614 INFO:tasks.workunit.client.1.smithi119.stdout:3/569: rename d9 to d9/da/dcc/ddc 22 2023-12-17T11:57:46.616 INFO:tasks.workunit.client.0.smithi002.stdout:7/480: dread d6/d17/f48 [0,4194304] 0 2023-12-17T11:57:46.617 INFO:tasks.workunit.client.0.smithi002.stdout:7/481: dread - d6/d17/dc/d67/f87 zero size 2023-12-17T11:57:46.618 INFO:tasks.workunit.client.0.smithi002.stdout:1/580: rename d3/d2f/d4d/d91/db6 to d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2 0 2023-12-17T11:57:46.620 INFO:tasks.workunit.client.1.smithi119.stdout:9/546: dread fe [0,4194304] 0 2023-12-17T11:57:46.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/478: rename d0/d6/d26/d14/d19/d2b/c40 to d0/d6/d26/d14/d19/d2b/c95 0 2023-12-17T11:57:46.625 INFO:tasks.workunit.client.1.smithi119.stdout:0/448: getdents d2/d66/d2e/d44/d7b/d5/d3f 0 2023-12-17T11:57:46.627 INFO:tasks.workunit.client.0.smithi002.stdout:6/520: creat d0/d1/dc/d58/fa8 x:0 0 0 2023-12-17T11:57:46.629 INFO:tasks.workunit.client.0.smithi002.stdout:2/518: dwrite d3/d4/d7/d14/d2e/d37/d3f/fad [4194304,4194304] 0 2023-12-17T11:57:46.629 INFO:tasks.workunit.client.0.smithi002.stdout:2/519: creat d3/d4/d8b/da6/fc4 x:0 0 0 2023-12-17T11:57:46.629 INFO:tasks.workunit.client.0.smithi002.stdout:2/520: fdatasync d3/d4/d7/d14/d42/f47 0 2023-12-17T11:57:46.629 INFO:tasks.workunit.client.1.smithi119.stdout:6/470: creat d2/d61/d8a/f9a x:0 0 0 2023-12-17T11:57:46.634 INFO:tasks.workunit.client.0.smithi002.stdout:5/527: link dc/f18 dc/d1b/d5a/d96/fc1 0 2023-12-17T11:57:46.635 INFO:tasks.workunit.client.0.smithi002.stdout:5/528: write dc/d1b/d5a/f71 [904463,87226] 0 2023-12-17T11:57:46.635 INFO:tasks.workunit.client.0.smithi002.stdout:5/529: read - dc/d1b/d2d/d5b/fa2 zero size 2023-12-17T11:57:46.635 INFO:tasks.workunit.client.0.smithi002.stdout:5/530: creat dc/d1a/d47/fc2 x:0 0 0 2023-12-17T11:57:46.636 INFO:tasks.workunit.client.1.smithi119.stdout:9/547: mknod d12/d1d/d28/d86/d8f/cab 0 2023-12-17T11:57:46.637 INFO:tasks.workunit.client.0.smithi002.stdout:8/537: sync 2023-12-17T11:57:46.639 INFO:tasks.workunit.client.1.smithi119.stdout:0/449: rename d2/d66/d1f/l31 to d2/d66/d1f/l87 0 2023-12-17T11:57:46.639 INFO:tasks.workunit.client.1.smithi119.stdout:0/450: truncate d2/d16/d35/d39/f76 970160 0 2023-12-17T11:57:46.639 INFO:tasks.workunit.client.1.smithi119.stdout:0/451: dread - d2/d66/d1f/d24/d50/d5d/f70 zero size 2023-12-17T11:57:46.641 INFO:tasks.workunit.client.1.smithi119.stdout:7/562: dwrite d2/d4/d11/d3c/f4d [4194304,4194304] 0 2023-12-17T11:57:46.641 INFO:tasks.workunit.client.1.smithi119.stdout:7/563: write d2/d40/f5a [2539949,79862] 0 2023-12-17T11:57:46.641 INFO:tasks.workunit.client.1.smithi119.stdout:7/564: chown d2/d4/d1f/f27 10379891 1 2023-12-17T11:57:46.644 INFO:tasks.workunit.client.0.smithi002.stdout:3/559: dwrite d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:46.646 INFO:tasks.workunit.client.1.smithi119.stdout:9/548: dread d12/d1d/d49/f5b [0,4194304] 0 2023-12-17T11:57:46.650 INFO:tasks.workunit.client.1.smithi119.stdout:6/471: dread d2/f2e [0,4194304] 0 2023-12-17T11:57:46.651 INFO:tasks.workunit.client.0.smithi002.stdout:7/482: creat d6/d17/dc/d13/d21/d2e/d4a/f92 x:0 0 0 2023-12-17T11:57:46.651 INFO:tasks.workunit.client.0.smithi002.stdout:7/483: fsync d6/d17/dc/d13/d37/d4f/f6d 0 2023-12-17T11:57:46.651 INFO:tasks.workunit.client.0.smithi002.stdout:7/484: write d6/d17/dc/d13/d37/d4f/f80 [433499,23946] 0 2023-12-17T11:57:46.652 INFO:tasks.workunit.client.1.smithi119.stdout:0/452: rename d2/d16/d35/l45 to d2/l88 0 2023-12-17T11:57:46.653 INFO:tasks.workunit.client.0.smithi002.stdout:1/581: symlink d3/d6/d9/d37/d39/d43/d4a/d7b/daa/lc3 0 2023-12-17T11:57:46.656 INFO:tasks.workunit.client.0.smithi002.stdout:0/479: creat d0/d6/d26/d25/f96 x:0 0 0 2023-12-17T11:57:46.658 INFO:tasks.workunit.client.1.smithi119.stdout:7/565: link d2/lc d2/d4/d70/d57/lb0 0 2023-12-17T11:57:46.658 INFO:tasks.workunit.client.1.smithi119.stdout:3/570: dwrite d9/da/df/d41/d33/d3a/f40 [0,4194304] 0 2023-12-17T11:57:46.658 INFO:tasks.workunit.client.0.smithi002.stdout:9/562: rmdir dc/d42/da0/d82 39 2023-12-17T11:57:46.659 INFO:tasks.workunit.client.1.smithi119.stdout:9/549: creat d12/d1d/d28/d4d/d73/d78/d8b/da0/fac x:0 0 0 2023-12-17T11:57:46.663 INFO:tasks.workunit.client.1.smithi119.stdout:6/472: rmdir d2/d2b/d8e 0 2023-12-17T11:57:46.664 INFO:tasks.workunit.client.1.smithi119.stdout:6/473: write d2/df/d17/f77 [1006848,7218] 0 2023-12-17T11:57:46.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/521: symlink d0/d1/dc/d17/d40/la9 0 2023-12-17T11:57:46.664 INFO:tasks.workunit.client.0.smithi002.stdout:6/522: readlink d0/d1/dc/d10/l1d 0 2023-12-17T11:57:46.667 INFO:tasks.workunit.client.1.smithi119.stdout:0/453: mknod d2/d66/d1f/d24/d50/d5d/c89 0 2023-12-17T11:57:46.668 INFO:tasks.workunit.client.1.smithi119.stdout:0/454: chown d2/d16/d35/d74 10476589 1 2023-12-17T11:57:46.668 INFO:tasks.workunit.client.0.smithi002.stdout:4/497: dwrite d0/d10/f25 [0,4194304] 0 2023-12-17T11:57:46.668 INFO:tasks.workunit.client.0.smithi002.stdout:4/498: fsync d0/d3e/d56/f77 0 2023-12-17T11:57:46.671 INFO:tasks.workunit.client.1.smithi119.stdout:7/566: creat d2/d4/d11/d3c/d75/fb1 x:0 0 0 2023-12-17T11:57:46.674 INFO:tasks.workunit.client.0.smithi002.stdout:2/521: mkdir d3/d4/d17/d19/d4d/d72/d77/da7/dc5 0 2023-12-17T11:57:46.680 INFO:tasks.workunit.client.1.smithi119.stdout:6/474: mkdir d2/d9b 0 2023-12-17T11:57:46.687 INFO:tasks.workunit.client.0.smithi002.stdout:4/499: dread d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:46.690 INFO:tasks.workunit.client.0.smithi002.stdout:5/531: truncate dc/d1b/d5a/d96/f35 249181 0 2023-12-17T11:57:46.692 INFO:tasks.workunit.client.0.smithi002.stdout:8/538: dwrite d3/d8/da/f93 [0,4194304] 0 2023-12-17T11:57:46.699 INFO:tasks.workunit.client.0.smithi002.stdout:3/560: mkdir d9/d15/d52/d85/db9 0 2023-12-17T11:57:46.699 INFO:tasks.workunit.client.0.smithi002.stdout:3/561: stat d9/d1b/d35/d41/d43/d73/l8c 0 2023-12-17T11:57:46.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/485: mkdir d6/d17/dc/d6c/d93 0 2023-12-17T11:57:46.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/486: dread - d6/d17/dc/d13/d21/d2e/d4a/f92 zero size 2023-12-17T11:57:46.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/487: write d6/d17/f48 [1191705,96081] 0 2023-12-17T11:57:46.702 INFO:tasks.workunit.client.0.smithi002.stdout:7/488: dread - d6/d17/dc/d13/d21/f8f zero size 2023-12-17T11:57:46.704 INFO:tasks.workunit.client.0.smithi002.stdout:1/582: mkdir d3/d2f/d74/dbd/dc4 0 2023-12-17T11:57:46.705 INFO:tasks.workunit.client.1.smithi119.stdout:0/455: rmdir d2/d66/d1f/d24/d50/d81 0 2023-12-17T11:57:46.707 INFO:tasks.workunit.client.0.smithi002.stdout:0/480: rename d0/d15/f54 to d0/d6/d26/d14/d19/d2b/f97 0 2023-12-17T11:57:46.707 INFO:tasks.workunit.client.1.smithi119.stdout:3/571: dwrite d9/d11/d1e/f37 [0,4194304] 0 2023-12-17T11:57:46.708 INFO:tasks.workunit.client.1.smithi119.stdout:7/567: fsync d2/d4/d11/d3c/d75/f83 0 2023-12-17T11:57:46.708 INFO:tasks.workunit.client.0.smithi002.stdout:9/563: symlink dc/d42/da0/d82/lc9 0 2023-12-17T11:57:46.710 INFO:tasks.workunit.client.1.smithi119.stdout:6/475: link d2/f86 d2/d9b/f9c 0 2023-12-17T11:57:46.711 INFO:tasks.workunit.client.0.smithi002.stdout:6/523: symlink d0/d1/d21/d56/d8c/d93/da5/laa 0 2023-12-17T11:57:46.713 INFO:tasks.workunit.client.1.smithi119.stdout:0/456: creat d2/d66/d2e/f8a x:0 0 0 2023-12-17T11:57:46.720 INFO:tasks.workunit.client.0.smithi002.stdout:4/500: mknod d0/d10/d14/d27/d57/d7d/ca0 0 2023-12-17T11:57:46.725 INFO:tasks.workunit.client.1.smithi119.stdout:8/437: sync 2023-12-17T11:57:46.728 INFO:tasks.workunit.client.0.smithi002.stdout:8/539: mknod d3/d7/d6e/d7f/cb3 0 2023-12-17T11:57:46.729 INFO:tasks.workunit.client.1.smithi119.stdout:0/457: getdents d2/d66/d1f/d24/d50/d5d 0 2023-12-17T11:57:46.731 INFO:tasks.workunit.client.0.smithi002.stdout:3/562: unlink d9/d15/f16 0 2023-12-17T11:57:46.731 INFO:tasks.workunit.client.0.smithi002.stdout:3/563: write f3 [770633,99445] 0 2023-12-17T11:57:46.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/583: symlink d3/d6/lc5 0 2023-12-17T11:57:46.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/584: write d3/d6/fe [1400391,61123] 0 2023-12-17T11:57:46.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/585: chown d3/d6/d9/d37/d39/d43/d8f 136269 1 2023-12-17T11:57:46.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/586: stat d3/d6/d16/d61/f6f 0 2023-12-17T11:57:46.736 INFO:tasks.workunit.client.0.smithi002.stdout:4/501: dread d0/f8a [0,4194304] 0 2023-12-17T11:57:46.736 INFO:tasks.workunit.client.1.smithi119.stdout:7/568: rename d2/d4/c18 to d2/d4b/cb2 0 2023-12-17T11:57:46.737 INFO:tasks.workunit.client.0.smithi002.stdout:5/532: rename dc/f18 to dc/d1a/d53/fc3 0 2023-12-17T11:57:46.740 INFO:tasks.workunit.client.0.smithi002.stdout:0/481: creat d0/d6/d26/d14/d19/d37/d86/f98 x:0 0 0 2023-12-17T11:57:46.740 INFO:tasks.workunit.client.1.smithi119.stdout:8/438: mknod d7/d12/d69/d67/c94 0 2023-12-17T11:57:46.744 INFO:tasks.workunit.client.1.smithi119.stdout:7/569: write d2/f9f [827464,56631] 0 2023-12-17T11:57:46.746 INFO:tasks.workunit.client.1.smithi119.stdout:7/570: read d2/f26 [88492,104539] 0 2023-12-17T11:57:46.746 INFO:tasks.workunit.client.1.smithi119.stdout:7/571: truncate d2/d4/f29 1134087 0 2023-12-17T11:57:46.749 INFO:tasks.workunit.client.0.smithi002.stdout:9/564: unlink dc/d42/d4f/l6b 0 2023-12-17T11:57:46.749 INFO:tasks.workunit.client.0.smithi002.stdout:9/565: fsync dc/d1d/f78 0 2023-12-17T11:57:46.749 INFO:tasks.workunit.client.0.smithi002.stdout:4/502: rename d0/d10/d21/d33/c75 to d0/d10/d21/d33/ca1 0 2023-12-17T11:57:46.750 INFO:tasks.workunit.client.0.smithi002.stdout:7/489: rename d6/d17/dc/d67/c3d to d6/d17/dc/d67/d8b/c94 0 2023-12-17T11:57:46.754 INFO:tasks.workunit.client.1.smithi119.stdout:7/572: creat d2/d4b/fb3 x:0 0 0 2023-12-17T11:57:46.754 INFO:tasks.workunit.client.0.smithi002.stdout:2/522: symlink d3/d4/d7/d14/d2e/lc6 0 2023-12-17T11:57:46.754 INFO:tasks.workunit.client.0.smithi002.stdout:2/523: creat d3/d4/d7/d14/d42/dae/fc7 x:0 0 0 2023-12-17T11:57:46.754 INFO:tasks.workunit.client.0.smithi002.stdout:2/524: chown d3/d4/d17/d19/d4d/c6a 100 1 2023-12-17T11:57:46.754 INFO:tasks.workunit.client.0.smithi002.stdout:1/587: mknod d3/d2f/d74/d97/cc6 0 2023-12-17T11:57:46.754 INFO:tasks.workunit.client.0.smithi002.stdout:1/588: write d3/d6/d16/f7a [671028,84115] 0 2023-12-17T11:57:46.755 INFO:tasks.workunit.client.0.smithi002.stdout:0/482: creat d0/d6/d26/d14/d19/d37/f99 x:0 0 0 2023-12-17T11:57:46.757 INFO:tasks.workunit.client.0.smithi002.stdout:9/566: rename dc/d42/d4f/d59/d47/c88 to dc/cca 0 2023-12-17T11:57:46.759 INFO:tasks.workunit.client.0.smithi002.stdout:4/503: rmdir d0/d3e/d56/d65/d78/d85 39 2023-12-17T11:57:46.760 INFO:tasks.workunit.client.0.smithi002.stdout:9/567: write dc/d42/da0/d72/d93/f2b [3082640,65972] 0 2023-12-17T11:57:46.760 INFO:tasks.workunit.client.0.smithi002.stdout:4/504: chown d0/d10/d14/f60 103 1 2023-12-17T11:57:46.763 INFO:tasks.workunit.client.0.smithi002.stdout:0/483: symlink d0/d6/d26/d8f/l9a 0 2023-12-17T11:57:46.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/568: link dc/d38/l6d dc/d38/lcb 0 2023-12-17T11:57:46.764 INFO:tasks.workunit.client.0.smithi002.stdout:9/569: fdatasync dc/d42/da0/d72/d93/d76/f94 0 2023-12-17T11:57:46.766 INFO:tasks.workunit.client.0.smithi002.stdout:4/505: creat d0/d10/d21/fa2 x:0 0 0 2023-12-17T11:57:46.767 INFO:tasks.workunit.client.0.smithi002.stdout:0/484: truncate d0/d6/d26/d14/d19/d2b/f30 7295308 0 2023-12-17T11:57:46.769 INFO:tasks.workunit.client.1.smithi119.stdout:6/476: dread d2/d61/f82 [0,4194304] 0 2023-12-17T11:57:46.770 INFO:tasks.workunit.client.1.smithi119.stdout:3/572: dwrite d9/f1b [0,4194304] 0 2023-12-17T11:57:46.770 INFO:tasks.workunit.client.1.smithi119.stdout:3/573: read d9/da/df/f32 [1409845,32333] 0 2023-12-17T11:57:46.771 INFO:tasks.workunit.client.1.smithi119.stdout:7/573: write d2/d4/d11/d2c/d68/f84 [1971070,112021] 0 2023-12-17T11:57:46.772 INFO:tasks.workunit.client.0.smithi002.stdout:4/506: mkdir d0/d3e/d56/d65/d78/d85/da3 0 2023-12-17T11:57:46.772 INFO:tasks.workunit.client.0.smithi002.stdout:9/570: mknod dc/d42/da0/ccc 0 2023-12-17T11:57:46.777 INFO:tasks.workunit.client.0.smithi002.stdout:3/564: dread d9/d15/f2b [0,4194304] 0 2023-12-17T11:57:46.781 INFO:tasks.workunit.client.0.smithi002.stdout:3/565: symlink d9/d15/lba 0 2023-12-17T11:57:46.781 INFO:tasks.workunit.client.0.smithi002.stdout:3/566: fsync d9/f1d 0 2023-12-17T11:57:46.781 INFO:tasks.workunit.client.0.smithi002.stdout:3/567: chown d9/d1b/f28 3936 1 2023-12-17T11:57:46.782 INFO:tasks.workunit.client.1.smithi119.stdout:6/477: dread d2/df/f30 [0,4194304] 0 2023-12-17T11:57:46.782 INFO:tasks.workunit.client.1.smithi119.stdout:6/478: readlink d2/df/d17/l3c 0 2023-12-17T11:57:46.784 INFO:tasks.workunit.client.0.smithi002.stdout:3/568: mkdir d9/d15/d71/dbb 0 2023-12-17T11:57:46.785 INFO:tasks.workunit.client.1.smithi119.stdout:3/574: getdents d9/d11/d1e/d55/d65/d84/dd3 0 2023-12-17T11:57:46.789 INFO:tasks.workunit.client.1.smithi119.stdout:7/574: mkdir d2/d4/d11/d2c/d68/db4 0 2023-12-17T11:57:46.793 INFO:tasks.workunit.client.0.smithi002.stdout:7/490: dread d6/d17/dc/d13/d37/f3c [0,4194304] 0 2023-12-17T11:57:46.802 INFO:tasks.workunit.client.1.smithi119.stdout:0/458: dwrite d2/d66/d2e/d44/d7b/d5/d3f/f5e [0,4194304] 0 2023-12-17T11:57:46.803 INFO:tasks.workunit.client.1.smithi119.stdout:7/575: dread d2/d4/d1f/f4c [0,4194304] 0 2023-12-17T11:57:46.804 INFO:tasks.workunit.client.1.smithi119.stdout:6/479: write d2/df/f55 [2179009,75369] 0 2023-12-17T11:57:46.806 INFO:tasks.workunit.client.0.smithi002.stdout:6/524: dwrite d0/d1/d28/f3d [0,4194304] 0 2023-12-17T11:57:46.806 INFO:tasks.workunit.client.0.smithi002.stdout:6/525: fsync d0/d1/d21/d56/d60/f6e 0 2023-12-17T11:57:46.806 INFO:tasks.workunit.client.0.smithi002.stdout:7/491: mknod d6/d17/dc/d6c/d93/c95 0 2023-12-17T11:57:46.806 INFO:tasks.workunit.client.0.smithi002.stdout:7/492: write d6/d17/dc/d13/d21/d2e/d4a/f92 [88679,123764] 0 2023-12-17T11:57:46.807 INFO:tasks.workunit.client.0.smithi002.stdout:2/525: read d3/d4/d7/d14/d2e/d37/f7d [17610,107141] 0 2023-12-17T11:57:46.807 INFO:tasks.workunit.client.0.smithi002.stdout:2/526: write d3/d4/ff [1135588,27320] 0 2023-12-17T11:57:46.811 INFO:tasks.workunit.client.0.smithi002.stdout:6/526: mkdir d0/d1/d28/dab 0 2023-12-17T11:57:46.814 INFO:tasks.workunit.client.0.smithi002.stdout:7/493: creat d6/d17/dc/d8e/f96 x:0 0 0 2023-12-17T11:57:46.814 INFO:tasks.workunit.client.0.smithi002.stdout:7/494: fdatasync d6/d17/dc/d67/d8b/d24/f43 0 2023-12-17T11:57:46.816 INFO:tasks.workunit.client.1.smithi119.stdout:0/459: truncate d2/d66/d1f/f4e 1145437 0 2023-12-17T11:57:46.817 INFO:tasks.workunit.client.1.smithi119.stdout:7/576: getdents d2/d4/d11/d2c/d55 0 2023-12-17T11:57:46.821 INFO:tasks.workunit.client.0.smithi002.stdout:6/527: creat d0/d1/d28/dab/fac x:0 0 0 2023-12-17T11:57:46.823 INFO:tasks.workunit.client.0.smithi002.stdout:2/527: rmdir d3/d4/d17 39 2023-12-17T11:57:46.823 INFO:tasks.workunit.client.0.smithi002.stdout:2/528: creat d3/d4/d43/fc8 x:0 0 0 2023-12-17T11:57:46.826 INFO:tasks.workunit.client.1.smithi119.stdout:5/558: sync 2023-12-17T11:57:46.826 INFO:tasks.workunit.client.1.smithi119.stdout:5/559: write d1/d36/d3a/f4b [3790198,85940] 0 2023-12-17T11:57:46.830 INFO:tasks.workunit.client.0.smithi002.stdout:4/507: read d0/d3e/d56/d65/d78/f91 [3141905,102804] 0 2023-12-17T11:57:46.837 INFO:tasks.workunit.client.0.smithi002.stdout:0/485: dread d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:46.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/528: symlink d0/lad 0 2023-12-17T11:57:46.837 INFO:tasks.workunit.client.0.smithi002.stdout:2/529: mknod d3/d4/d17/d19/d4d/d72/d77/cc9 0 2023-12-17T11:57:46.837 INFO:tasks.workunit.client.0.smithi002.stdout:8/540: dwrite d3/d7/d1a/f6a [0,4194304] 0 2023-12-17T11:57:46.841 INFO:tasks.workunit.client.1.smithi119.stdout:8/439: dwrite d7/d18/f5b [0,4194304] 0 2023-12-17T11:57:46.846 INFO:tasks.workunit.client.1.smithi119.stdout:3/575: dread d9/d35/f6a [0,4194304] 0 2023-12-17T11:57:46.848 INFO:tasks.workunit.client.1.smithi119.stdout:8/440: creat d7/d18/f95 x:0 0 0 2023-12-17T11:57:46.851 INFO:tasks.workunit.client.1.smithi119.stdout:3/576: creat d9/da/df/d41/fdd x:0 0 0 2023-12-17T11:57:46.851 INFO:tasks.workunit.client.1.smithi119.stdout:3/577: fsync d9/da/df/f32 0 2023-12-17T11:57:46.852 INFO:tasks.workunit.client.1.smithi119.stdout:8/441: mknod d7/d12/d69/d67/c96 0 2023-12-17T11:57:46.854 INFO:tasks.workunit.client.0.smithi002.stdout:3/569: dwrite d9/d1b/d35/d41/d43/f61 [0,4194304] 0 2023-12-17T11:57:46.854 INFO:tasks.workunit.client.1.smithi119.stdout:3/578: getdents d9/d59 0 2023-12-17T11:57:46.855 INFO:tasks.workunit.client.1.smithi119.stdout:7/577: read d2/f35 [2376025,98769] 0 2023-12-17T11:57:46.855 INFO:tasks.workunit.client.0.smithi002.stdout:6/529: mkdir d0/d1/dc/d58/dae 0 2023-12-17T11:57:46.857 INFO:tasks.workunit.client.0.smithi002.stdout:0/486: getdents d0/d6/d26/d14/d19/d2f 0 2023-12-17T11:57:46.857 INFO:tasks.workunit.client.0.smithi002.stdout:0/487: readlink d0/d6/d26/d14/d19/d2f/l4b 0 2023-12-17T11:57:46.858 INFO:tasks.workunit.client.1.smithi119.stdout:7/578: mknod d2/d4/d11/d2c/d68/d99/cb5 0 2023-12-17T11:57:46.858 INFO:tasks.workunit.client.1.smithi119.stdout:7/579: readlink d2/d4/d11/d2c/d55/d67/l8c 0 2023-12-17T11:57:46.858 INFO:tasks.workunit.client.1.smithi119.stdout:7/580: chown d2/d4/d11/d3c/c51 9127 1 2023-12-17T11:57:46.859 INFO:tasks.workunit.client.0.smithi002.stdout:8/541: mkdir d3/d8/d28/d31/d5a/db4 0 2023-12-17T11:57:46.863 INFO:tasks.workunit.client.0.smithi002.stdout:4/508: getdents d0/d10/d14/d27/d57/d7d 0 2023-12-17T11:57:46.866 INFO:tasks.workunit.client.0.smithi002.stdout:6/530: link d0/f3a d0/d1/d6d/d83/faf 0 2023-12-17T11:57:46.867 INFO:tasks.workunit.client.0.smithi002.stdout:6/531: write d0/d1/dc/d10/f82 [666401,59294] 0 2023-12-17T11:57:46.867 INFO:tasks.workunit.client.0.smithi002.stdout:6/532: write d0/d1/dc/d10/f98 [509450,27038] 0 2023-12-17T11:57:46.873 INFO:tasks.workunit.client.0.smithi002.stdout:1/589: dwrite d3/d6/d9/f57 [8388608,4194304] 0 2023-12-17T11:57:46.873 INFO:tasks.workunit.client.0.smithi002.stdout:1/590: fdatasync d3/d6/d9/d37/d39/d43/f6d 0 2023-12-17T11:57:46.873 INFO:tasks.workunit.client.0.smithi002.stdout:1/591: fdatasync d3/d6/d9/d37/d39/fb3 0 2023-12-17T11:57:46.874 INFO:tasks.workunit.client.0.smithi002.stdout:1/592: write d3/d6/d9/d37/d39/f8c [1301140,68970] 0 2023-12-17T11:57:46.878 INFO:tasks.workunit.client.0.smithi002.stdout:3/570: dread d9/f13 [0,4194304] 0 2023-12-17T11:57:46.879 INFO:tasks.workunit.client.1.smithi119.stdout:6/480: dwrite d2/f26 [0,4194304] 0 2023-12-17T11:57:46.879 INFO:tasks.workunit.client.1.smithi119.stdout:6/481: truncate d2/d41/f56 224860 0 2023-12-17T11:57:46.879 INFO:tasks.workunit.client.1.smithi119.stdout:6/482: truncate d2/d2b/d43/f4a 444496 0 2023-12-17T11:57:46.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/495: dwrite d6/d17/dc/d13/d3e/f4b [4194304,4194304] 0 2023-12-17T11:57:46.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/496: getdents d6/d17/dc/d13/d37/d4f 0 2023-12-17T11:57:46.887 INFO:tasks.workunit.client.1.smithi119.stdout:0/460: dwrite d2/d66/f1a [0,4194304] 0 2023-12-17T11:57:46.889 INFO:tasks.workunit.client.0.smithi002.stdout:0/488: rmdir d0/d6/d26 39 2023-12-17T11:57:46.890 INFO:tasks.workunit.client.0.smithi002.stdout:4/509: dread d0/d10/d14/f4c [0,4194304] 0 2023-12-17T11:57:46.899 INFO:tasks.workunit.client.0.smithi002.stdout:2/530: link d3/d4/d7/d14/d2e/d37/f7d d3/d4/d7/d14/d2e/fca 0 2023-12-17T11:57:46.899 INFO:tasks.workunit.client.0.smithi002.stdout:8/542: creat d3/d7/d6e/d7f/d65/da2/fb5 x:0 0 0 2023-12-17T11:57:46.899 INFO:tasks.workunit.client.0.smithi002.stdout:8/543: fsync d3/d7/f63 0 2023-12-17T11:57:46.899 INFO:tasks.workunit.client.0.smithi002.stdout:1/593: write d3/d6/d16/d61/f93 [1233280,76778] 0 2023-12-17T11:57:46.902 INFO:tasks.workunit.client.0.smithi002.stdout:7/497: dread d6/f72 [4194304,4194304] 0 2023-12-17T11:57:46.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/533: link d0/d1/d28/l88 d0/d1/dc/d17/d67/d6c/d7f/lb0 0 2023-12-17T11:57:46.903 INFO:tasks.workunit.client.0.smithi002.stdout:6/534: stat d0/d1/dc/d10/f82 0 2023-12-17T11:57:46.906 INFO:tasks.workunit.client.1.smithi119.stdout:7/581: getdents d2/d5b 0 2023-12-17T11:57:46.907 INFO:tasks.workunit.client.1.smithi119.stdout:7/582: write d2/d5b/f7e [431063,112777] 0 2023-12-17T11:57:46.943 INFO:tasks.workunit.client.1.smithi119.stdout:6/483: stat d2/d61/c72 0 2023-12-17T11:57:46.943 INFO:tasks.workunit.client.1.smithi119.stdout:6/484: dread - d2/df/d17/f64 zero size 2023-12-17T11:57:46.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/571: unlink d9/le 0 2023-12-17T11:57:46.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/572: chown d9/d24/d6f/laf 10 1 2023-12-17T11:57:46.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/573: truncate d9/d1b/d4f/d88/fb3 59948 0 2023-12-17T11:57:46.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/574: write d9/d15/fad [120062,41822] 0 2023-12-17T11:57:46.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/575: chown d9/d24 12350141 1 2023-12-17T11:57:46.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/576: rename d9 to d9/d15/d71/dbc 22 2023-12-17T11:57:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.945+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/939097891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 msgr2=0x7fb5a8070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.945+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/939097891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a8070030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb598004940 tx=0x7fb598009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.946+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/939097891 shutdown_connections 2023-12-17T11:57:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.946+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/939097891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8070570 0x7fb5a80709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.946+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/939097891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a8070030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.946+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/939097891 >> 172.21.15.2:0/939097891 conn(0x7fb5a80f82d0 msgr2=0x7fb5a80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.947+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/939097891 shutdown_connections 2023-12-17T11:57:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.947+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/939097891 wait complete. 2023-12-17T11:57:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.948+0000 7fb5ad3fb700 1 Processor -- start 2023-12-17T11:57:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.949+0000 7fb5ad3fb700 1 -- start start 2023-12-17T11:57:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.949+0000 7fb5ad3fb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8070570 0x7fb5a806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.949+0000 7fb5ad3fb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.949+0000 7fb5ad3fb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a806f8b0 con 0x7fb5a8070570 2023-12-17T11:57:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.949+0000 7fb5ad3fb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a811d6e0 con 0x7fb5a8071bc0 2023-12-17T11:57:46.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.951+0000 7fb5a6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8070570 0x7fb5a806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:46.953 INFO:tasks.workunit.client.1.smithi119.stdout:1/499: sync 2023-12-17T11:57:46.953 INFO:tasks.workunit.client.1.smithi119.stdout:4/541: sync 2023-12-17T11:57:46.953 INFO:tasks.workunit.client.1.smithi119.stdout:2/590: sync 2023-12-17T11:57:46.954 INFO:tasks.workunit.client.1.smithi119.stdout:9/550: sync 2023-12-17T11:57:46.954 INFO:tasks.workunit.client.1.smithi119.stdout:9/551: dread - d12/d1d/d28/f9a zero size 2023-12-17T11:57:46.954 INFO:tasks.workunit.client.1.smithi119.stdout:1/500: write d3/db/d26/f83 [4409905,114503] 0 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.952+0000 7fb5a67fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.952+0000 7fb5a67fc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a806f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:55272/0 (socket says 172.21.15.2:55272) 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.952+0000 7fb5a67fc700 1 -- 172.21.15.2:0/360028570 learned_addr learned my addr 172.21.15.2:0/360028570 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.952+0000 7fb5a67fc700 1 -- 172.21.15.2:0/360028570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8070570 msgr2=0x7fb5a806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.952+0000 7fb5a67fc700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8070570 0x7fb5a806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.952+0000 7fb5a67fc700 1 -- 172.21.15.2:0/360028570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590005040 con 0x7fb5a8071bc0 2023-12-17T11:57:46.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.953+0000 7fb5a67fc700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a806f280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5900096d0 tx=0x7fb590009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.953+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59000e840 con 0x7fb5a8071bc0 2023-12-17T11:57:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.953+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb59000f040 con 0x7fb5a8071bc0 2023-12-17T11:57:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.954+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb598005040 con 0x7fb5a8071bc0 2023-12-17T11:57:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.954+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a811dd20 con 0x7fb5a8071bc0 2023-12-17T11:57:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.954+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb590013d50 con 0x7fb5a8071bc0 2023-12-17T11:57:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.956+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a804bb80 con 0x7fb5a8071bc0 2023-12-17T11:57:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.958+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fb59000e9a0 con 0x7fb5a8071bc0 2023-12-17T11:57:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.959+0000 7fb59f7fe700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fb59406ae40 0x7fb59406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.959+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb5900896f0 con 0x7fb5a8071bc0 2023-12-17T11:57:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.960+0000 7fb5a6ffd700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fb59406ae40 0x7fb59406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.961+0000 7fb5a6ffd700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fb59406ae40 0x7fb59406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb598013600 tx=0x7fb598009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:46.965 INFO:tasks.workunit.client.0.smithi002.stdout:3/577: write d9/f13 [1863756,128335] 0 2023-12-17T11:57:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:46.968+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb590057420 con 0x7fb5a8071bc0 2023-12-17T11:57:46.976 INFO:tasks.workunit.client.0.smithi002.stdout:6/535: dwrite d0/d1/dc/f39 [0,4194304] 0 2023-12-17T11:57:46.984 INFO:tasks.workunit.client.1.smithi119.stdout:6/485: creat d2/d7e/f9d x:0 0 0 2023-12-17T11:57:46.984 INFO:tasks.workunit.client.1.smithi119.stdout:6/486: write d2/f59 [4526412,10372] 0 2023-12-17T11:57:46.989 INFO:tasks.workunit.client.1.smithi119.stdout:4/542: mkdir dd/d15/d16/d3d/dab/db1 0 2023-12-17T11:57:46.994 INFO:tasks.workunit.client.1.smithi119.stdout:9/552: mkdir d12/d1d/d49/dad 0 2023-12-17T11:57:46.994 INFO:tasks.workunit.client.1.smithi119.stdout:9/553: readlink d12/d1d/d49/d89/laa 0 2023-12-17T11:57:46.997 INFO:tasks.workunit.client.1.smithi119.stdout:1/501: getdents d3/db/d17/d24/d20/d40/d76/d96/d99/d9a 0 2023-12-17T11:57:47.000 INFO:tasks.workunit.client.1.smithi119.stdout:7/583: mkdir d2/d4/d70/d57/d56/db6 0 2023-12-17T11:57:47.008 INFO:tasks.workunit.client.1.smithi119.stdout:2/591: getdents d6/d9/d13 0 2023-12-17T11:57:47.009 INFO:tasks.workunit.client.1.smithi119.stdout:2/592: chown d6/d9/d52/d53/fca 35687 1 2023-12-17T11:57:47.009 INFO:tasks.workunit.client.1.smithi119.stdout:2/593: fsync d6/d9/d13/f4d 0 2023-12-17T11:57:47.010 INFO:tasks.workunit.client.1.smithi119.stdout:4/543: creat dd/d15/d16/d3d/dab/db1/fb2 x:0 0 0 2023-12-17T11:57:47.010 INFO:tasks.workunit.client.1.smithi119.stdout:4/544: stat dd/d15/d16/d20/d42/d78/f98 0 2023-12-17T11:57:47.010 INFO:tasks.workunit.client.0.smithi002.stdout:0/489: symlink d0/d6/d26/d14/d19/l9b 0 2023-12-17T11:57:47.014 INFO:tasks.workunit.client.0.smithi002.stdout:4/510: mknod d0/d3e/d56/d65/d78/d85/da3/ca4 0 2023-12-17T11:57:47.014 INFO:tasks.workunit.client.0.smithi002.stdout:4/511: fdatasync d0/d10/f31 0 2023-12-17T11:57:47.016 INFO:tasks.workunit.client.1.smithi119.stdout:9/554: mkdir d12/d1d/d28/d46/d50/d92/dae 0 2023-12-17T11:57:47.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/544: stat d3/d8/l2e 0 2023-12-17T11:57:47.019 INFO:tasks.workunit.client.1.smithi119.stdout:9/555: mkdir d12/d1d/d28/d46/d50/d92/daf 0 2023-12-17T11:57:47.019 INFO:tasks.workunit.client.1.smithi119.stdout:9/556: chown d12 5170 1 2023-12-17T11:57:47.020 INFO:tasks.workunit.client.0.smithi002.stdout:1/594: getdents d3/d6/d9/d37/d39/d43/d4a/d7b/daa 0 2023-12-17T11:57:47.020 INFO:tasks.workunit.client.0.smithi002.stdout:1/595: stat d3/d6/d9/d30/c44 0 2023-12-17T11:57:47.021 INFO:tasks.workunit.client.0.smithi002.stdout:7/498: symlink d6/d17/dc/d8e/l97 0 2023-12-17T11:57:47.021 INFO:tasks.workunit.client.0.smithi002.stdout:7/499: chown c2 0 1 2023-12-17T11:57:47.025 INFO:tasks.workunit.client.0.smithi002.stdout:3/578: unlink d9/d1b/d35/f3b 0 2023-12-17T11:57:47.026 INFO:tasks.workunit.client.1.smithi119.stdout:6/487: dwrite d2/f38 [0,4194304] 0 2023-12-17T11:57:47.028 INFO:tasks.workunit.client.0.smithi002.stdout:6/536: rename d0/d1/dc/d17/d67/d6c/d7f/f81 to d0/d1/d21/d56/d60/fb1 0 2023-12-17T11:57:47.030 INFO:tasks.workunit.client.0.smithi002.stdout:0/490: creat d0/d6/d26/d14/d19/d2b/f9c x:0 0 0 2023-12-17T11:57:47.043 INFO:tasks.workunit.client.0.smithi002.stdout:8/545: write d3/d7/d1a/f5c [462270,108391] 0 2023-12-17T11:57:47.043 INFO:tasks.workunit.client.0.smithi002.stdout:6/537: getdents d0/d1/dc 0 2023-12-17T11:57:47.043 INFO:tasks.workunit.client.0.smithi002.stdout:2/531: getdents d3/d4/d7/d14/d2e 0 2023-12-17T11:57:47.043 INFO:tasks.workunit.client.0.smithi002.stdout:2/532: write d3/d4/d17/d19/d4d/d72/d77/f7a [3047363,64949] 0 2023-12-17T11:57:47.045 INFO:tasks.workunit.client.1.smithi119.stdout:4/545: read dd/d11/f5e [2163810,8482] 0 2023-12-17T11:57:47.045 INFO:tasks.workunit.client.1.smithi119.stdout:4/546: chown dd/d15/d16/d20/l2c 20426503 1 2023-12-17T11:57:47.045 INFO:tasks.workunit.client.1.smithi119.stdout:4/547: dread - dd/d15/d16/d3d/f8c zero size 2023-12-17T11:57:47.046 INFO:tasks.workunit.client.1.smithi119.stdout:4/548: fdatasync dd/d15/d16/d5a/f99 0 2023-12-17T11:57:47.046 INFO:tasks.workunit.client.1.smithi119.stdout:9/557: dread d12/d1d/d28/d4d/f8c [0,4194304] 0 2023-12-17T11:57:47.048 INFO:tasks.workunit.client.1.smithi119.stdout:9/558: creat d12/d1d/d28/d46/d50/fb0 x:0 0 0 2023-12-17T11:57:47.051 INFO:tasks.workunit.client.0.smithi002.stdout:8/546: rename d3/d8/d28/c50 to d3/d7/d6e/d7f/d90/cb6 0 2023-12-17T11:57:47.060 INFO:tasks.workunit.client.1.smithi119.stdout:1/502: mknod d3/db/d17/d24/cb4 0 2023-12-17T11:57:47.068 INFO:tasks.workunit.client.0.smithi002.stdout:5/533: sync 2023-12-17T11:57:47.073 INFO:tasks.workunit.client.0.smithi002.stdout:5/534: mknod dc/d1b/d5a/d96/cc4 0 2023-12-17T11:57:47.074 INFO:tasks.workunit.client.0.smithi002.stdout:9/571: sync 2023-12-17T11:57:47.076 INFO:tasks.workunit.client.0.smithi002.stdout:9/572: symlink dc/d32/lcd 0 2023-12-17T11:57:47.084 INFO:tasks.workunit.client.1.smithi119.stdout:7/584: dwrite d2/f35 [0,4194304] 0 2023-12-17T11:57:47.086 INFO:tasks.workunit.client.1.smithi119.stdout:3/579: sync 2023-12-17T11:57:47.086 INFO:tasks.workunit.client.1.smithi119.stdout:8/442: sync 2023-12-17T11:57:47.086 INFO:tasks.workunit.client.1.smithi119.stdout:8/443: chown d7/f35 336 1 2023-12-17T11:57:47.087 INFO:tasks.workunit.client.1.smithi119.stdout:5/560: sync 2023-12-17T11:57:47.091 INFO:tasks.workunit.client.1.smithi119.stdout:8/444: unlink d7/d18/d15/d64/f86 0 2023-12-17T11:57:47.091 INFO:tasks.workunit.client.1.smithi119.stdout:8/445: fsync d7/da/d11/d60/f8b 0 2023-12-17T11:57:47.095 INFO:tasks.workunit.client.1.smithi119.stdout:8/446: mknod d7/c97 0 2023-12-17T11:57:47.095 INFO:tasks.workunit.client.1.smithi119.stdout:8/447: chown d7/l9 1714 1 2023-12-17T11:57:47.096 INFO:tasks.workunit.client.1.smithi119.stdout:8/448: mkdir d7/d12/d69/d98 0 2023-12-17T11:57:47.105 INFO:tasks.workunit.client.0.smithi002.stdout:6/538: read d0/d1/dc/f8 [633668,53598] 0 2023-12-17T11:57:47.113 INFO:tasks.workunit.client.1.smithi119.stdout:5/561: read d1/d36/f3d [7887188,103125] 0 2023-12-17T11:57:47.115 INFO:tasks.workunit.client.1.smithi119.stdout:4/549: dwrite dd/d15/d16/d3d/f77 [0,4194304] 0 2023-12-17T11:57:47.115 INFO:tasks.workunit.client.1.smithi119.stdout:4/550: write f2 [1607782,108075] 0 2023-12-17T11:57:47.115 INFO:tasks.workunit.client.1.smithi119.stdout:4/551: write dd/d15/f5c [360223,96080] 0 2023-12-17T11:57:47.116 INFO:tasks.workunit.client.1.smithi119.stdout:5/562: getdents d1/da7 0 2023-12-17T11:57:47.117 INFO:tasks.workunit.client.0.smithi002.stdout:5/535: dread dc/d17/d2f/f3a [0,4194304] 0 2023-12-17T11:57:47.117 INFO:tasks.workunit.client.0.smithi002.stdout:5/536: chown dc/d17/d2f/d82 820331471 1 2023-12-17T11:57:47.117 INFO:tasks.workunit.client.0.smithi002.stdout:5/537: truncate dc/fbc 728277 0 2023-12-17T11:57:47.123 INFO:tasks.workunit.client.1.smithi119.stdout:5/563: write d1/d25/f7e [5197907,42180] 0 2023-12-17T11:57:47.125 INFO:tasks.workunit.client.0.smithi002.stdout:5/538: link dc/d1a/d53/d6f/cbd dc/d1b/d5a/cc5 0 2023-12-17T11:57:47.130 INFO:tasks.workunit.client.0.smithi002.stdout:5/539: symlink dc/d17/d2f/lc6 0 2023-12-17T11:57:47.140 INFO:tasks.workunit.client.0.smithi002.stdout:4/512: dwrite d0/d10/f25 [0,4194304] 0 2023-12-17T11:57:47.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/540: rmdir dc/d1a/d53/da9 39 2023-12-17T11:57:47.141 INFO:tasks.workunit.client.0.smithi002.stdout:3/579: dwrite d9/d1b/f7b [0,4194304] 0 2023-12-17T11:57:47.142 INFO:tasks.workunit.client.0.smithi002.stdout:9/573: write dc/d42/f57 [434556,60289] 0 2023-12-17T11:57:47.145 INFO:tasks.workunit.client.0.smithi002.stdout:7/500: dwrite d6/d17/f65 [0,4194304] 0 2023-12-17T11:57:47.147 INFO:tasks.workunit.client.0.smithi002.stdout:4/513: mkdir d0/d3e/da5 0 2023-12-17T11:57:47.150 INFO:tasks.workunit.client.1.smithi119.stdout:3/580: dread d9/f1b [0,4194304] 0 2023-12-17T11:57:47.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/580: rename d9/d1b/d35/d41/d59/d65/f74 to d9/d24/d6f/fbd 0 2023-12-17T11:57:47.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/581: dread - d9/d1b/fa7 zero size 2023-12-17T11:57:47.155 INFO:tasks.workunit.client.1.smithi119.stdout:3/581: mkdir d9/d11/d1e/d9f/dde 0 2023-12-17T11:57:47.158 INFO:tasks.workunit.client.0.smithi002.stdout:5/541: creat dc/d1b/fc7 x:0 0 0 2023-12-17T11:57:47.158 INFO:tasks.workunit.client.0.smithi002.stdout:9/574: creat dc/d1d/d25/d85/fce x:0 0 0 2023-12-17T11:57:47.158 INFO:tasks.workunit.client.0.smithi002.stdout:5/542: fsync dc/d1b/d2d/d5b/f8a 0 2023-12-17T11:57:47.158 INFO:tasks.workunit.client.0.smithi002.stdout:7/501: unlink d6/d17/dc/d8e/l97 0 2023-12-17T11:57:47.158 INFO:tasks.workunit.client.0.smithi002.stdout:7/502: fdatasync d6/d17/dc/d67/d8b/d24/f43 0 2023-12-17T11:57:47.159 INFO:tasks.workunit.client.0.smithi002.stdout:0/491: dread d0/d33/f5b [0,4194304] 0 2023-12-17T11:57:47.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/596: dwrite d3/d6/f3e [0,4194304] 0 2023-12-17T11:57:47.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/597: dread - d3/d6/d9/d37/d39/d43/f6d zero size 2023-12-17T11:57:47.161 INFO:tasks.workunit.client.0.smithi002.stdout:1/598: stat d3/d2f/d74/dbd/dc4 0 2023-12-17T11:57:47.161 INFO:tasks.workunit.client.1.smithi119.stdout:7/585: dread d2/f19 [0,4194304] 0 2023-12-17T11:57:47.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/575: symlink dc/d42/da0/d72/d93/d52/lcf 0 2023-12-17T11:57:47.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/576: readlink dc/d42/lb4 0 2023-12-17T11:57:47.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/577: write dc/d42/da0/d72/d93/f73 [3379318,93300] 0 2023-12-17T11:57:47.162 INFO:tasks.workunit.client.1.smithi119.stdout:2/594: dwrite d6/d9/d86/db0/fd2 [0,4194304] 0 2023-12-17T11:57:47.162 INFO:tasks.workunit.client.0.smithi002.stdout:9/578: write dc/d1d/d25/d85/dc2/f9b [141374,107461] 0 2023-12-17T11:57:47.165 INFO:tasks.workunit.client.1.smithi119.stdout:1/503: dwrite d3/db/d17/d24/d20/f2d [0,4194304] 0 2023-12-17T11:57:47.165 INFO:tasks.workunit.client.1.smithi119.stdout:6/488: dwrite d2/d61/f67 [4194304,4194304] 0 2023-12-17T11:57:47.165 INFO:tasks.workunit.client.1.smithi119.stdout:6/489: creat d2/d7e/f9e x:0 0 0 2023-12-17T11:57:47.165 INFO:tasks.workunit.client.0.smithi002.stdout:7/503: rename d6/d17/dc/d67/d8b/l42 to d6/d17/dc/d13/d37/d4f/l98 0 2023-12-17T11:57:47.165 INFO:tasks.workunit.client.0.smithi002.stdout:7/504: chown d6/d17/f65 0 1 2023-12-17T11:57:47.173 INFO:tasks.workunit.client.0.smithi002.stdout:0/492: symlink d0/d33/l9d 0 2023-12-17T11:57:47.178 INFO:tasks.workunit.client.1.smithi119.stdout:4/552: dread dd/d15/d16/d5a/f70 [0,4194304] 0 2023-12-17T11:57:47.178 INFO:tasks.workunit.client.1.smithi119.stdout:4/553: dread - dd/d11/d2d/d9c/d55/d81/d88/fa7 zero size 2023-12-17T11:57:47.178 INFO:tasks.workunit.client.1.smithi119.stdout:4/554: truncate f8 835636 0 2023-12-17T11:57:47.181 INFO:tasks.workunit.client.1.smithi119.stdout:7/586: symlink d2/d4/d70/lb7 0 2023-12-17T11:57:47.181 INFO:tasks.workunit.client.1.smithi119.stdout:7/587: chown d2/d5b/f65 10164025 1 2023-12-17T11:57:47.181 INFO:tasks.workunit.client.0.smithi002.stdout:4/514: rmdir d0/d10/d21 39 2023-12-17T11:57:47.183 INFO:tasks.workunit.client.0.smithi002.stdout:6/539: dwrite d0/d1/d21/d56/d8c/d93/da5/f90 [0,4194304] 0 2023-12-17T11:57:47.185 INFO:tasks.workunit.client.1.smithi119.stdout:2/595: write d6/f1f [5884661,49918] 0 2023-12-17T11:57:47.185 INFO:tasks.workunit.client.1.smithi119.stdout:2/596: fdatasync d6/d9/d13/d1d/dbf/fc4 0 2023-12-17T11:57:47.185 INFO:tasks.workunit.client.1.smithi119.stdout:2/597: chown d6/d9/d13/d34/d88/l8b 10084451 1 2023-12-17T11:57:47.187 INFO:tasks.workunit.client.0.smithi002.stdout:3/582: dread d9/d24/f81 [0,4194304] 0 2023-12-17T11:57:47.187 INFO:tasks.workunit.client.0.smithi002.stdout:3/583: readlink d9/l27 0 2023-12-17T11:57:47.188 INFO:tasks.workunit.client.1.smithi119.stdout:1/504: creat d3/db/d17/d24/d20/d40/d6d/d7e/da1/fb5 x:0 0 0 2023-12-17T11:57:47.190 INFO:tasks.workunit.client.1.smithi119.stdout:5/564: dwrite d1/da7/f5c [0,4194304] 0 2023-12-17T11:57:47.191 INFO:tasks.workunit.client.1.smithi119.stdout:8/449: dwrite d7/f35 [0,4194304] 0 2023-12-17T11:57:47.193 INFO:tasks.workunit.client.1.smithi119.stdout:5/565: creat d1/d70/d6b/faf x:0 0 0 2023-12-17T11:57:47.196 INFO:tasks.workunit.client.0.smithi002.stdout:2/533: dwrite d3/d4/d7/d14/d9b/fc1 [0,4194304] 0 2023-12-17T11:57:47.196 INFO:tasks.workunit.client.0.smithi002.stdout:2/534: write d3/d4/d17/d19/fb2 [691958,50139] 0 2023-12-17T11:57:47.196 INFO:tasks.workunit.client.0.smithi002.stdout:2/535: fsync d3/d4/d7/d14/d2e/f7b 0 2023-12-17T11:57:47.196 INFO:tasks.workunit.client.0.smithi002.stdout:9/579: mkdir dc/d42/da0/d72/d93/dd0 0 2023-12-17T11:57:47.196 INFO:tasks.workunit.client.0.smithi002.stdout:9/580: stat dc/c7b 0 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:7/588: mknod d2/cb8 0 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/490: dread d2/df/f55 [0,4194304] 0 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/491: chown d2/d61/d8a/f9a 0 1 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/492: creat d2/d7e/f9f x:0 0 0 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/493: fdatasync d2/df/f4b 0 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/494: chown d2 106899834 1 2023-12-17T11:57:47.197 INFO:tasks.workunit.client.1.smithi119.stdout:6/495: chown d2/df/d17/d79/f96 1174 1 2023-12-17T11:57:47.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/505: mkdir d6/d99 0 2023-12-17T11:57:47.199 INFO:tasks.workunit.client.0.smithi002.stdout:7/506: dread - d6/d17/dc/d67/d8b/f70 zero size 2023-12-17T11:57:47.199 INFO:tasks.workunit.client.0.smithi002.stdout:2/536: write d3/d4/d7/d14/d1b/d5b/f97 [578059,81587] 0 2023-12-17T11:57:47.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/540: symlink d0/d1/dc/d58/lb2 0 2023-12-17T11:57:47.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/541: dread - d0/d1/dc/d17/d67/f84 zero size 2023-12-17T11:57:47.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/542: creat d0/d1/dc/d17/d8f/fb3 x:0 0 0 2023-12-17T11:57:47.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/543: chown d0/d1/dc/d17/d4c/l4d 459592 1 2023-12-17T11:57:47.200 INFO:tasks.workunit.client.0.smithi002.stdout:6/544: chown d0/l61 275572409 1 2023-12-17T11:57:47.200 INFO:tasks.workunit.client.1.smithi119.stdout:1/505: write d3/db/d26/d19/f70 [311828,79778] 0 2023-12-17T11:57:47.201 INFO:tasks.workunit.client.0.smithi002.stdout:4/515: mknod d0/d3e/d56/d65/d78/d85/da3/ca6 0 2023-12-17T11:57:47.205 INFO:tasks.workunit.client.0.smithi002.stdout:9/581: mknod dc/d42/da0/d72/d93/d52/cd1 0 2023-12-17T11:57:47.205 INFO:tasks.workunit.client.0.smithi002.stdout:2/537: mkdir d3/d4/d7/d14/d42/dcb 0 2023-12-17T11:57:47.205 INFO:tasks.workunit.client.0.smithi002.stdout:4/516: symlink d0/d3e/d56/d65/d78/d85/da3/la7 0 2023-12-17T11:57:47.206 INFO:tasks.workunit.client.0.smithi002.stdout:3/584: dread d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:47.206 INFO:tasks.workunit.client.0.smithi002.stdout:4/517: write d0/d10/d14/d27/f79 [4870906,115286] 0 2023-12-17T11:57:47.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/582: mknod dc/d1d/d7c/cd2 0 2023-12-17T11:57:47.209 INFO:tasks.workunit.client.1.smithi119.stdout:6/496: unlink d2/d2b/f4f 0 2023-12-17T11:57:47.209 INFO:tasks.workunit.client.1.smithi119.stdout:6/497: readlink d2/l5b 0 2023-12-17T11:57:47.212 INFO:tasks.workunit.client.0.smithi002.stdout:2/538: rename d3/d4/d7/d14/d42/caf to d3/d4/d7/d14/d2e/d37/d3f/ccc 0 2023-12-17T11:57:47.215 INFO:tasks.workunit.client.1.smithi119.stdout:3/582: dwrite d9/da/df/d41/d33/d3a/fc8 [4194304,4194304] 0 2023-12-17T11:57:47.217 INFO:tasks.workunit.client.1.smithi119.stdout:1/506: symlink d3/db/d17/lb6 0 2023-12-17T11:57:47.217 INFO:tasks.workunit.client.1.smithi119.stdout:1/507: chown d3/db/d26/d19/d3f/f51 3294 1 2023-12-17T11:57:47.217 INFO:tasks.workunit.client.1.smithi119.stdout:2/598: dread d6/f33 [0,4194304] 0 2023-12-17T11:57:47.222 INFO:tasks.workunit.client.1.smithi119.stdout:7/589: getdents d2/d4 0 2023-12-17T11:57:47.222 INFO:tasks.workunit.client.1.smithi119.stdout:7/590: fsync d2/d4/d70/f87 0 2023-12-17T11:57:47.222 INFO:tasks.workunit.client.1.smithi119.stdout:7/591: chown d2/d4b/fb3 7640713 1 2023-12-17T11:57:47.223 INFO:tasks.workunit.client.1.smithi119.stdout:5/566: symlink d1/d25/lb0 0 2023-12-17T11:57:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:46 smithi002 ceph-mon[107131]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 180 MiB/s rd, 225 MiB/s wr, 310 op/s 2023-12-17T11:57:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:46 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:46 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:47.226 INFO:tasks.workunit.client.0.smithi002.stdout:7/507: write d6/d17/dc/d13/d37/d4f/f6d [3758676,73787] 0 2023-12-17T11:57:47.230 INFO:tasks.workunit.client.0.smithi002.stdout:3/585: dread d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:47.231 INFO:tasks.workunit.client.1.smithi119.stdout:3/583: mkdir d9/d11/d1e/d55/d65/ddf 0 2023-12-17T11:57:47.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/584: write f4 [2376850,51966] 0 2023-12-17T11:57:47.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/585: getdents d9/d59/dda 0 2023-12-17T11:57:47.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/586: chown d9/da/df/d41/d33/d3a/d90 12 1 2023-12-17T11:57:47.233 INFO:tasks.workunit.client.1.smithi119.stdout:3/587: write d9/da/df/d67/f89 [611452,126386] 0 2023-12-17T11:57:47.233 INFO:tasks.workunit.client.1.smithi119.stdout:3/588: creat d9/da/df/d41/d33/db4/fe0 x:0 0 0 2023-12-17T11:57:47.233 INFO:tasks.workunit.client.1.smithi119.stdout:3/589: fdatasync d9/d35/f48 0 2023-12-17T11:57:47.237 INFO:tasks.workunit.client.1.smithi119.stdout:5/567: read d1/d25/f7e [4628858,102811] 0 2023-12-17T11:57:47.237 INFO:tasks.workunit.client.1.smithi119.stdout:5/568: write d1/d44/d52/f78 [193826,51364] 0 2023-12-17T11:57:47.238 INFO:tasks.workunit.client.1.smithi119.stdout:1/508: mkdir d3/db/d17/d24/d20/d6c/db7 0 2023-12-17T11:57:47.241 INFO:tasks.workunit.client.1.smithi119.stdout:7/592: rmdir d2/d4/d70/d57/d56 39 2023-12-17T11:57:47.249 INFO:tasks.workunit.client.1.smithi119.stdout:8/450: truncate d7/fb 1347932 0 2023-12-17T11:57:47.251 INFO:tasks.workunit.client.0.smithi002.stdout:0/493: dread d0/d6/d26/d25/f46 [0,4194304] 0 2023-12-17T11:57:47.256 INFO:tasks.workunit.client.0.smithi002.stdout:9/583: rmdir dc/d32 39 2023-12-17T11:57:47.256 INFO:tasks.workunit.client.1.smithi119.stdout:3/590: rename d9/d44/d8d to d9/da/df/de1 0 2023-12-17T11:57:47.256 INFO:tasks.workunit.client.1.smithi119.stdout:1/509: creat d3/db/d17/d24/d20/d40/d76/d84/fb8 x:0 0 0 2023-12-17T11:57:47.256 INFO:tasks.workunit.client.1.smithi119.stdout:7/593: mknod d2/d4b/cb9 0 2023-12-17T11:57:47.259 INFO:tasks.workunit.client.0.smithi002.stdout:7/508: mknod d6/d17/dc/d67/c9a 0 2023-12-17T11:57:47.259 INFO:tasks.workunit.client.0.smithi002.stdout:7/509: truncate d6/d17/dc/d13/f57 5106942 0 2023-12-17T11:57:47.260 INFO:tasks.workunit.client.0.smithi002.stdout:7/510: write d6/d17/dc/d13/d21/f62 [117686,69440] 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/591: symlink d9/le2 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/592: truncate d9/da/df/f32 9357174 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/593: creat d9/d44/d8c/fe3 x:0 0 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/594: fdatasync d9/da/f30 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/595: stat d9/da/df/c1a 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.1.smithi119.stdout:3/596: write d9/d11/d1e/d55/f7e [4775490,44873] 0 2023-12-17T11:57:47.264 INFO:tasks.workunit.client.0.smithi002.stdout:5/543: dwrite dc/d17/d2f/d99/fba [0,4194304] 0 2023-12-17T11:57:47.267 INFO:tasks.workunit.client.1.smithi119.stdout:1/510: creat d3/d44/d89/fb9 x:0 0 0 2023-12-17T11:57:47.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/511: link d6/d17/l19 d6/d17/dc/l9b 0 2023-12-17T11:57:47.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/512: write d6/d17/dc/d67/d8b/d24/f7d [825954,69427] 0 2023-12-17T11:57:47.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/513: fsync d6/d17/dc/d8e/f96 0 2023-12-17T11:57:47.275 INFO:tasks.workunit.client.0.smithi002.stdout:6/545: dwrite d0/d1/d21/d56/d8c/d93/da5/f8d [0,4194304] 0 2023-12-17T11:57:47.275 INFO:tasks.workunit.client.0.smithi002.stdout:6/546: creat d0/d1/dc/d10/fb4 x:0 0 0 2023-12-17T11:57:47.281 INFO:tasks.workunit.client.1.smithi119.stdout:6/498: dwrite d2/f59 [0,4194304] 0 2023-12-17T11:57:47.284 INFO:tasks.workunit.client.1.smithi119.stdout:1/511: getdents d3/d44 0 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.0.smithi002.stdout:5/544: rmdir dc/d1b/d5a/d68 39 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.0.smithi002.stdout:5/545: readlink dc/d1a/d47/l73 0 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/512: chown d3/db/d26/d19/f4b 11 1 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/513: dread - d3/db/d17/d24/d20/d40/d6d/d7e/da1/fb5 zero size 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/514: dread - d3/d44/d89/fb9 zero size 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/515: write d3/db/d17/d24/d20/d40/f78 [584235,24532] 0 2023-12-17T11:57:47.285 INFO:tasks.workunit.client.1.smithi119.stdout:1/516: readlink d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/la9 0 2023-12-17T11:57:47.286 INFO:tasks.workunit.client.1.smithi119.stdout:1/517: readlink d3/db/l8c 0 2023-12-17T11:57:47.287 INFO:tasks.workunit.client.1.smithi119.stdout:7/594: rename d2/d4/d11/d2c/d68/d99/c5f to d2/cba 0 2023-12-17T11:57:47.287 INFO:tasks.workunit.client.1.smithi119.stdout:7/595: chown d2/d4/d11/d2c/d68/c95 0 1 2023-12-17T11:57:47.287 INFO:tasks.workunit.client.1.smithi119.stdout:7/596: truncate d2/d4/d11/d3c/d75/fb1 691015 0 2023-12-17T11:57:47.296 INFO:tasks.workunit.client.1.smithi119.stdout:4/555: dwrite dd/d15/d16/d3d/f7c [0,4194304] 0 2023-12-17T11:57:47.296 INFO:tasks.workunit.client.1.smithi119.stdout:4/556: dread - dd/d15/d4f/f8d zero size 2023-12-17T11:57:47.298 INFO:tasks.workunit.client.0.smithi002.stdout:4/518: dwrite d0/d3e/f86 [0,4194304] 0 2023-12-17T11:57:47.299 INFO:tasks.workunit.client.1.smithi119.stdout:6/499: symlink d2/d2b/d7f/la0 0 2023-12-17T11:57:47.299 INFO:tasks.workunit.client.1.smithi119.stdout:3/597: dread d9/f9b [0,4194304] 0 2023-12-17T11:57:47.304 INFO:tasks.workunit.client.1.smithi119.stdout:7/597: creat d2/d4/d70/d57/d56/db6/fbb x:0 0 0 2023-12-17T11:57:47.307 INFO:tasks.workunit.client.0.smithi002.stdout:5/546: rmdir dc/d17/d2f/d99/da7 0 2023-12-17T11:57:47.307 INFO:tasks.workunit.client.0.smithi002.stdout:5/547: dread - dc/d1b/d2d/f56 zero size 2023-12-17T11:57:47.315 INFO:tasks.workunit.client.0.smithi002.stdout:6/547: dread d0/d1/d21/f38 [0,4194304] 0 2023-12-17T11:57:47.321 INFO:tasks.workunit.client.1.smithi119.stdout:2/599: dwrite d6/d2b/d3f/da8/fad [0,4194304] 0 2023-12-17T11:57:47.322 INFO:tasks.workunit.client.0.smithi002.stdout:4/519: unlink d0/d3e/f86 0 2023-12-17T11:57:47.323 INFO:tasks.workunit.client.0.smithi002.stdout:4/520: write d0/d10/d14/d27/d57/f6d [816755,38476] 0 2023-12-17T11:57:47.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/539: dwrite d3/d4/d8b/da6/fbf [0,4194304] 0 2023-12-17T11:57:47.323 INFO:tasks.workunit.client.0.smithi002.stdout:2/540: chown d3/d4/d7/d14/d2e/d37 1 1 2023-12-17T11:57:47.323 INFO:tasks.workunit.client.0.smithi002.stdout:0/494: dwrite d0/d33/f8e [0,4194304] 0 2023-12-17T11:57:47.327 INFO:tasks.workunit.client.0.smithi002.stdout:3/586: dwrite d9/d15/fad [0,4194304] 0 2023-12-17T11:57:47.328 INFO:tasks.workunit.client.1.smithi119.stdout:5/569: dwrite d1/f17 [0,4194304] 0 2023-12-17T11:57:47.328 INFO:tasks.workunit.client.1.smithi119.stdout:5/570: truncate d1/d44/d52/f78 841624 0 2023-12-17T11:57:47.330 INFO:tasks.workunit.client.0.smithi002.stdout:5/548: mkdir dc/d1b/d2d/dc8 0 2023-12-17T11:57:47.344 INFO:tasks.workunit.client.1.smithi119.stdout:4/557: mknod dd/d11/d2d/d9c/d55/cb3 0 2023-12-17T11:57:47.345 INFO:tasks.workunit.client.0.smithi002.stdout:6/548: rename d0/d1/dc/d17/d4c/f8e to d0/d1/dc/d17/d3c/fb5 0 2023-12-17T11:57:47.346 INFO:tasks.workunit.client.0.smithi002.stdout:4/521: unlink d0/d10/d14/f8e 0 2023-12-17T11:57:47.346 INFO:tasks.workunit.client.1.smithi119.stdout:3/598: mkdir d9/d35/de4 0 2023-12-17T11:57:47.348 INFO:tasks.workunit.client.0.smithi002.stdout:0/495: symlink d0/l9e 0 2023-12-17T11:57:47.350 INFO:tasks.workunit.client.1.smithi119.stdout:2/600: symlink d6/d9/d13/d34/d88/ld9 0 2023-12-17T11:57:47.351 INFO:tasks.workunit.client.1.smithi119.stdout:2/601: write d6/d9/d13/d1d/f37 [4264181,106044] 0 2023-12-17T11:57:47.351 INFO:tasks.workunit.client.1.smithi119.stdout:5/571: getdents d1/da7/d71 0 2023-12-17T11:57:47.351 INFO:tasks.workunit.client.1.smithi119.stdout:5/572: chown d1/c13 1672047743 1 2023-12-17T11:57:47.353 INFO:tasks.workunit.client.1.smithi119.stdout:3/599: mkdir d9/d11/d1e/d55/d65/d84/d98/de5 0 2023-12-17T11:57:47.353 INFO:tasks.workunit.client.1.smithi119.stdout:3/600: readlink d9/da/df/l29 0 2023-12-17T11:57:47.355 INFO:tasks.workunit.client.1.smithi119.stdout:2/602: mknod d6/d9/d13/d34/dcf/cda 0 2023-12-17T11:57:47.356 INFO:tasks.workunit.client.1.smithi119.stdout:2/603: creat d6/d38/fdb x:0 0 0 2023-12-17T11:57:47.356 INFO:tasks.workunit.client.1.smithi119.stdout:2/604: write d6/d2b/d4b/d81/fc3 [120477,11365] 0 2023-12-17T11:57:47.357 INFO:tasks.workunit.client.0.smithi002.stdout:6/549: rename d0/f1a to d0/d1/dc/d10/fb6 0 2023-12-17T11:57:47.359 INFO:tasks.workunit.client.0.smithi002.stdout:0/496: creat d0/d6/d26/d14/f9f x:0 0 0 2023-12-17T11:57:47.361 INFO:tasks.workunit.client.0.smithi002.stdout:6/550: link d0/d1/d21/c72 d0/d1/cb7 0 2023-12-17T11:57:47.363 INFO:tasks.workunit.client.0.smithi002.stdout:4/522: getdents d0 0 2023-12-17T11:57:47.365 INFO:tasks.workunit.client.1.smithi119.stdout:1/518: dread d3/db/d17/d24/d20/d40/d6d/f82 [0,4194304] 0 2023-12-17T11:57:47.365 INFO:tasks.workunit.client.1.smithi119.stdout:1/519: write d3/db/d26/d19/f70 [192234,9244] 0 2023-12-17T11:57:47.366 INFO:tasks.workunit.client.1.smithi119.stdout:4/558: dread dd/d11/d2d/d9c/d55/f80 [0,4194304] 0 2023-12-17T11:57:47.377 INFO:tasks.workunit.client.1.smithi119.stdout:5/573: write d1/f1e [4219393,33408] 0 2023-12-17T11:57:47.384 INFO:tasks.workunit.client.0.smithi002.stdout:4/523: rename d0/d10/d21/l26 to d0/d3e/d56/d65/d78/d85/la8 0 2023-12-17T11:57:47.386 INFO:tasks.workunit.client.0.smithi002.stdout:7/514: dwrite d6/d17/dc/d13/d21/d6e/f7e [0,4194304] 0 2023-12-17T11:57:47.390 INFO:tasks.workunit.client.1.smithi119.stdout:0/461: sync 2023-12-17T11:57:47.390 INFO:tasks.workunit.client.1.smithi119.stdout:0/462: write d2/d66/d2e/d44/d7b/d5/d3f/f52 [1519132,78544] 0 2023-12-17T11:57:47.390 INFO:tasks.workunit.client.1.smithi119.stdout:9/559: sync 2023-12-17T11:57:47.390 INFO:tasks.workunit.client.1.smithi119.stdout:1/520: mkdir d3/db/d17/d24/d20/dba 0 2023-12-17T11:57:47.391 INFO:tasks.workunit.client.1.smithi119.stdout:1/521: write d3/db/f62 [1821357,34063] 0 2023-12-17T11:57:47.397 INFO:tasks.workunit.client.1.smithi119.stdout:9/560: read d12/d1d/f8e [804153,3236] 0 2023-12-17T11:57:47.397 INFO:tasks.workunit.client.0.smithi002.stdout:6/551: dread d0/d1/d5b/f95 [0,4194304] 0 2023-12-17T11:57:47.397 INFO:tasks.workunit.client.0.smithi002.stdout:6/552: truncate d0/d1/dc/d17/d4c/f55 864010 0 2023-12-17T11:57:47.398 INFO:tasks.workunit.client.1.smithi119.stdout:5/574: rename d1/d44/d52/c8b to d1/d70/d85/cb1 0 2023-12-17T11:57:47.400 INFO:tasks.workunit.client.0.smithi002.stdout:7/515: creat d6/d99/f9c x:0 0 0 2023-12-17T11:57:47.402 INFO:tasks.workunit.client.1.smithi119.stdout:0/463: mknod d2/d16/c8b 0 2023-12-17T11:57:47.406 INFO:tasks.workunit.client.0.smithi002.stdout:7/516: link d6/d17/dc/d13/d37/d4f/f6d d6/d17/dc/d13/d37/d4f/f9d 0 2023-12-17T11:57:47.406 INFO:tasks.workunit.client.0.smithi002.stdout:7/517: chown d6/d17/dc/d13/d21/d6e 927089 1 2023-12-17T11:57:47.407 INFO:tasks.workunit.client.1.smithi119.stdout:9/561: mkdir d12/d1d/d79/db1 0 2023-12-17T11:57:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:46 smithi119 ceph-mon[117414]: pgmap v26: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 180 MiB/s rd, 225 MiB/s wr, 310 op/s 2023-12-17T11:57:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:46 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:47.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:46 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:47.408 INFO:tasks.workunit.client.1.smithi119.stdout:0/464: truncate d2/d66/d2e/d44/f5f 2046009 0 2023-12-17T11:57:47.409 INFO:tasks.workunit.client.0.smithi002.stdout:8/547: sync 2023-12-17T11:57:47.409 INFO:tasks.workunit.client.0.smithi002.stdout:8/548: chown d3/d7/d18/d74/f82 105 1 2023-12-17T11:57:47.411 INFO:tasks.workunit.client.0.smithi002.stdout:7/518: creat d6/d17/dc/d13/d37/f9e x:0 0 0 2023-12-17T11:57:47.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/599: sync 2023-12-17T11:57:47.413 INFO:tasks.workunit.client.0.smithi002.stdout:0/497: dread d0/d6/d26/d25/f31 [0,4194304] 0 2023-12-17T11:57:47.414 INFO:tasks.workunit.client.1.smithi119.stdout:9/562: creat d12/d1d/d28/d46/d50/fb2 x:0 0 0 2023-12-17T11:57:47.417 INFO:tasks.workunit.client.0.smithi002.stdout:8/549: unlink d3/d8/da/dd/f35 0 2023-12-17T11:57:47.417 INFO:tasks.workunit.client.0.smithi002.stdout:8/550: chown d3/d7/d18/d3f/f60 228562256 1 2023-12-17T11:57:47.418 INFO:tasks.workunit.client.0.smithi002.stdout:7/519: mknod d6/d17/dc/d6c/c9f 0 2023-12-17T11:57:47.419 INFO:tasks.workunit.client.0.smithi002.stdout:7/520: write d6/d17/dc/d13/d37/d4f/f9d [416937,40031] 0 2023-12-17T11:57:47.419 INFO:tasks.workunit.client.1.smithi119.stdout:9/563: unlink d12/d1d/f51 0 2023-12-17T11:57:47.421 INFO:tasks.workunit.client.1.smithi119.stdout:7/598: dwrite d2/d4/f47 [0,4194304] 0 2023-12-17T11:57:47.421 INFO:tasks.workunit.client.1.smithi119.stdout:7/599: creat d2/d4/d11/d3c/d75/fbc x:0 0 0 2023-12-17T11:57:47.421 INFO:tasks.workunit.client.1.smithi119.stdout:7/600: chown d2/d4/d11/d2c/f3a 228090 1 2023-12-17T11:57:47.423 INFO:tasks.workunit.client.0.smithi002.stdout:1/600: rename d3/d6/d9/d30/d87/f89 to d3/d6/d9/d37/d39/fc7 0 2023-12-17T11:57:47.423 INFO:tasks.workunit.client.1.smithi119.stdout:3/601: dwrite d9/f19 [0,4194304] 0 2023-12-17T11:57:47.423 INFO:tasks.workunit.client.1.smithi119.stdout:3/602: creat d9/da/df/d41/d33/db4/fe6 x:0 0 0 2023-12-17T11:57:47.425 INFO:tasks.workunit.client.0.smithi002.stdout:3/587: dwrite d9/d40/f9a [0,4194304] 0 2023-12-17T11:57:47.425 INFO:tasks.workunit.client.0.smithi002.stdout:6/553: dread d0/d1/dc/d10/f98 [0,4194304] 0 2023-12-17T11:57:47.425 INFO:tasks.workunit.client.0.smithi002.stdout:6/554: creat d0/d1/dc/d10/fb8 x:0 0 0 2023-12-17T11:57:47.426 INFO:tasks.workunit.client.0.smithi002.stdout:0/498: creat d0/d6/d26/d14/d19/d37/d62/d77/fa0 x:0 0 0 2023-12-17T11:57:47.427 INFO:tasks.workunit.client.1.smithi119.stdout:6/500: dwrite d2/df/d17/f7c [0,4194304] 0 2023-12-17T11:57:47.427 INFO:tasks.workunit.client.1.smithi119.stdout:6/501: creat d2/fa1 x:0 0 0 2023-12-17T11:57:47.428 INFO:tasks.workunit.client.1.smithi119.stdout:1/522: dread d3/f65 [0,4194304] 0 2023-12-17T11:57:47.430 INFO:tasks.workunit.client.0.smithi002.stdout:5/549: dwrite dc/d1b/f6e [8388608,4194304] 0 2023-12-17T11:57:47.431 INFO:tasks.workunit.client.0.smithi002.stdout:3/588: write d9/d1b/d35/d41/d59/d65/f77 [962975,113666] 0 2023-12-17T11:57:47.432 INFO:tasks.workunit.client.0.smithi002.stdout:2/541: dwrite d3/d4/d7/d14/d1b/d5b/f97 [0,4194304] 0 2023-12-17T11:57:47.432 INFO:tasks.workunit.client.0.smithi002.stdout:2/542: truncate d3/d4/d7/d14/d42/d8a/fc3 704652 0 2023-12-17T11:57:47.434 INFO:tasks.workunit.client.1.smithi119.stdout:3/603: dread d9/da/df/d41/d33/d3a/d90/f94 [0,4194304] 0 2023-12-17T11:57:47.434 INFO:tasks.workunit.client.1.smithi119.stdout:9/564: creat d12/d1d/d28/d4d/fb3 x:0 0 0 2023-12-17T11:57:47.434 INFO:tasks.workunit.client.1.smithi119.stdout:9/565: write d12/d1d/f5d [1946599,49929] 0 2023-12-17T11:57:47.435 INFO:tasks.workunit.client.0.smithi002.stdout:8/551: symlink d3/d8/da/lb7 0 2023-12-17T11:57:47.435 INFO:tasks.workunit.client.0.smithi002.stdout:8/552: dread - d3/d7/d1a/f75 zero size 2023-12-17T11:57:47.437 INFO:tasks.workunit.client.0.smithi002.stdout:5/550: dread dc/d1b/d5a/d68/d97/daf/f92 [0,4194304] 0 2023-12-17T11:57:47.440 INFO:tasks.workunit.client.1.smithi119.stdout:7/601: fdatasync d2/f10 0 2023-12-17T11:57:47.442 INFO:tasks.workunit.client.0.smithi002.stdout:6/555: read d0/d1/dc/d17/f1f [100335,28588] 0 2023-12-17T11:57:47.442 INFO:tasks.workunit.client.0.smithi002.stdout:6/556: fdatasync d0/d1/dc/d10/f46 0 2023-12-17T11:57:47.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/601: mknod d3/d6/cc8 0 2023-12-17T11:57:47.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/602: write d3/d6/d16/d28/f69 [5141947,47904] 0 2023-12-17T11:57:47.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/603: write d3/d6/d9/d37/f73 [1051290,76282] 0 2023-12-17T11:57:47.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/604: readlink d3/d2f/d74/dbd/lb2 0 2023-12-17T11:57:47.445 INFO:tasks.workunit.client.1.smithi119.stdout:2/605: dwrite d6/f8a [0,4194304] 0 2023-12-17T11:57:47.445 INFO:tasks.workunit.client.0.smithi002.stdout:7/521: dread d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:57:47.445 INFO:tasks.workunit.client.0.smithi002.stdout:7/522: fdatasync d6/d17/dc/d13/d37/f3c 0 2023-12-17T11:57:47.445 INFO:tasks.workunit.client.0.smithi002.stdout:7/523: fsync d6/d17/dc/d13/d37/d4f/f80 0 2023-12-17T11:57:47.447 INFO:tasks.workunit.client.0.smithi002.stdout:0/499: symlink d0/d6/d26/d14/d19/d37/d62/d77/la1 0 2023-12-17T11:57:47.449 INFO:tasks.workunit.client.0.smithi002.stdout:4/524: dwrite d0/d10/d14/f4c [0,4194304] 0 2023-12-17T11:57:47.450 INFO:tasks.workunit.client.1.smithi119.stdout:5/575: dwrite d1/da7/d71/d97/fa0 [0,4194304] 0 2023-12-17T11:57:47.450 INFO:tasks.workunit.client.1.smithi119.stdout:5/576: dread - d1/d70/fad zero size 2023-12-17T11:57:47.450 INFO:tasks.workunit.client.1.smithi119.stdout:5/577: stat d1/d25/f38 0 2023-12-17T11:57:47.451 INFO:tasks.workunit.client.0.smithi002.stdout:3/589: rename d9/d1b/d35/d41/d43/d73/d89/lae to d9/d24/d6f/d84/lbe 0 2023-12-17T11:57:47.457 INFO:tasks.workunit.client.1.smithi119.stdout:1/523: unlink d3/db/d17/d24/d20/la0 0 2023-12-17T11:57:47.464 INFO:tasks.workunit.client.0.smithi002.stdout:2/543: dread d3/d4/d7/d14/d9b/fc1 [0,4194304] 0 2023-12-17T11:57:47.471 INFO:tasks.workunit.client.1.smithi119.stdout:6/502: dread d2/f26 [0,4194304] 0 2023-12-17T11:57:47.471 INFO:tasks.workunit.client.1.smithi119.stdout:6/503: write d2/df/d17/f34 [2593357,120247] 0 2023-12-17T11:57:47.472 INFO:tasks.workunit.client.1.smithi119.stdout:6/504: stat d2/d7e/d93 0 2023-12-17T11:57:47.474 INFO:tasks.workunit.client.1.smithi119.stdout:0/465: rmdir d2 39 2023-12-17T11:57:47.474 INFO:tasks.workunit.client.0.smithi002.stdout:5/551: mknod dc/d17/d2f/d82/cc9 0 2023-12-17T11:57:47.475 INFO:tasks.workunit.client.0.smithi002.stdout:5/552: fdatasync dc/d17/d2f/d99/f9d 0 2023-12-17T11:57:47.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.476+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5a811e170 con 0x7fb59406ae40 2023-12-17T11:57:47.478 INFO:tasks.workunit.client.1.smithi119.stdout:3/604: mknod d9/d11/d1e/d55/d77/ce7 0 2023-12-17T11:57:47.480 INFO:tasks.workunit.client.0.smithi002.stdout:6/557: unlink d0/d1/d21/c72 0 2023-12-17T11:57:47.481 INFO:tasks.workunit.client.0.smithi002.stdout:6/558: write d0/d1/dc/d10/f52 [1457940,41446] 0 2023-12-17T11:57:47.482 INFO:tasks.workunit.client.0.smithi002.stdout:1/605: creat d3/d6/d9/d37/d39/d43/d4a/fc9 x:0 0 0 2023-12-17T11:57:47.483 INFO:tasks.workunit.client.1.smithi119.stdout:7/602: creat d2/d4/d11/d2c/d68/d99/d6c/fbd x:0 0 0 2023-12-17T11:57:47.483 INFO:tasks.workunit.client.1.smithi119.stdout:7/603: write d2/d4/d70/f7a [481067,60317] 0 2023-12-17T11:57:47.483 INFO:tasks.workunit.client.1.smithi119.stdout:7/604: stat d2/d4/d70/d57 0 2023-12-17T11:57:47.483 INFO:tasks.workunit.client.1.smithi119.stdout:7/605: readlink d2/d4/d11/d2c/l82 0 2023-12-17T11:57:47.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/606: read - d3/d6/d9/d37/d39/fb3 zero size 2023-12-17T11:57:47.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/607: readlink d3/d6/l25 0 2023-12-17T11:57:47.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/608: dread - d3/d2f/d74/f9b zero size 2023-12-17T11:57:47.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/609: chown d3/d6/d16/d9f 500965239 1 2023-12-17T11:57:47.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/610: creat d3/d6/d16/d28/fca x:0 0 0 2023-12-17T11:57:47.485 INFO:tasks.workunit.client.0.smithi002.stdout:1/611: write d3/d6/d9/d37/d39/d43/d4a/f77 [820762,61916] 0 2023-12-17T11:57:47.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.482+0000 7fb59f7fe700 1 -- 172.21.15.2:0/360028570 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb5a811e170 con 0x7fb59406ae40 2023-12-17T11:57:47.486 INFO:tasks.workunit.client.0.smithi002.stdout:0/500: creat d0/d6/d26/fa2 x:0 0 0 2023-12-17T11:57:47.491 INFO:tasks.workunit.client.0.smithi002.stdout:4/525: mknod d0/d3e/d47/ca9 0 2023-12-17T11:57:47.493 INFO:tasks.workunit.client.1.smithi119.stdout:2/606: symlink d6/d9/d13/d1d/ldc 0 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fb59406ae40 msgr2=0x7fb59406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fb59406ae40 0x7fb59406d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb598013600 tx=0x7fb598009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 msgr2=0x7fb5a806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a806f280 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5900096d0 tx=0x7fb590009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 shutdown_connections 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fb59406ae40 0x7fb59406d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a8070570 0x7fb5a806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 --2- 172.21.15.2:0/360028570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5a8071bc0 0x7fb5a806f280 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.491+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 >> 172.21.15.2:0/360028570 conn(0x7fb5a80f82d0 msgr2=0x7fb5a80fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.492+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 shutdown_connections 2023-12-17T11:57:47.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.493+0000 7fb5ad3fb700 1 -- 172.21.15.2:0/360028570 wait complete. 2023-12-17T11:57:47.496 INFO:tasks.workunit.client.0.smithi002.stdout:3/590: mknod d9/d15/d52/d85/db9/cbf 0 2023-12-17T11:57:47.496 INFO:tasks.workunit.client.0.smithi002.stdout:3/591: stat d9/d1b/fa4 0 2023-12-17T11:57:47.496 INFO:tasks.workunit.client.0.smithi002.stdout:3/592: stat d9/d1b/d35/l93 0 2023-12-17T11:57:47.496 INFO:tasks.workunit.client.0.smithi002.stdout:3/593: creat d9/d24/d6f/fc0 x:0 0 0 2023-12-17T11:57:47.497 INFO:tasks.workunit.client.0.smithi002.stdout:9/584: sync 2023-12-17T11:57:47.500 INFO:tasks.workunit.client.0.smithi002.stdout:2/544: link d3/d4/d7/d14/d42/l51 d3/d4/d17/d19/d4d/d72/d83/lcd 0 2023-12-17T11:57:47.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/545: write d3/d4/d17/d19/d4d/fa2 [608958,128957] 0 2023-12-17T11:57:47.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/546: fsync d3/d4/d7/d14/d34/f6c 0 2023-12-17T11:57:47.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/547: readlink d3/d4/d7/d14/d34/lbd 0 2023-12-17T11:57:47.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/548: dread - d3/d4/d17/d19/d4d/d72/d83/d94/f9c zero size 2023-12-17T11:57:47.506 INFO:tasks.workunit.client.1.smithi119.stdout:5/578: creat d1/da7/d71/d76/d83/fb2 x:0 0 0 2023-12-17T11:57:47.508 INFO:tasks.workunit.client.1.smithi119.stdout:6/505: symlink d2/d2b/d7f/la2 0 2023-12-17T11:57:47.510 INFO:tasks.workunit.client.1.smithi119.stdout:0/466: mkdir d2/d16/d8c 0 2023-12-17T11:57:47.514 INFO:tasks.workunit.client.1.smithi119.stdout:7/606: link d2/f10 d2/d4/d11/d3c/d75/dad/fbe 0 2023-12-17T11:57:47.514 INFO:tasks.workunit.client.0.smithi002.stdout:6/559: creat d0/d1/d6d/d83/da2/fb9 x:0 0 0 2023-12-17T11:57:47.514 INFO:tasks.workunit.client.1.smithi119.stdout:7/607: creat d2/d4/d11/d3c/d75/fbf x:0 0 0 2023-12-17T11:57:47.516 INFO:tasks.workunit.client.0.smithi002.stdout:1/612: mknod d3/d6/d16/d9f/ccb 0 2023-12-17T11:57:47.516 INFO:tasks.workunit.client.0.smithi002.stdout:1/613: readlink d3/d6/d16/d61/l82 0 2023-12-17T11:57:47.517 INFO:tasks.workunit.client.1.smithi119.stdout:2/607: symlink d6/d9/d13/ldd 0 2023-12-17T11:57:47.517 INFO:tasks.workunit.client.1.smithi119.stdout:2/608: write d6/d9/d13/d34/fa0 [151033,38725] 0 2023-12-17T11:57:47.517 INFO:tasks.workunit.client.1.smithi119.stdout:2/609: chown d6/d9/d13/d1d/f24 4021736 1 2023-12-17T11:57:47.517 INFO:tasks.workunit.client.1.smithi119.stdout:2/610: dread - d6/d2b/da3/fc5 zero size 2023-12-17T11:57:47.517 INFO:tasks.workunit.client.1.smithi119.stdout:6/506: write d2/d2b/f84 [1151827,126620] 0 2023-12-17T11:57:47.517 INFO:tasks.workunit.client.1.smithi119.stdout:2/611: creat d6/d9/d52/d53/fde x:0 0 0 2023-12-17T11:57:47.522 INFO:tasks.workunit.client.0.smithi002.stdout:7/524: dwrite d6/d17/dc/d13/d21/d2e/d4a/d53/f78 [0,4194304] 0 2023-12-17T11:57:47.522 INFO:tasks.workunit.client.0.smithi002.stdout:4/526: symlink d0/d3e/d56/d65/d78/d85/da3/laa 0 2023-12-17T11:57:47.522 INFO:tasks.workunit.client.0.smithi002.stdout:4/527: getdents d0/d10/d14/d90 0 2023-12-17T11:57:47.523 INFO:tasks.workunit.client.1.smithi119.stdout:9/566: dwrite d12/d1d/d79/f80 [0,4194304] 0 2023-12-17T11:57:47.523 INFO:tasks.workunit.client.1.smithi119.stdout:5/579: mkdir d1/da7/d71/d97/db3 0 2023-12-17T11:57:47.523 INFO:tasks.workunit.client.1.smithi119.stdout:3/605: rmdir d9/d11/d1e 39 2023-12-17T11:57:47.524 INFO:tasks.workunit.client.1.smithi119.stdout:7/608: write d2/d5b/f96 [1091057,20122] 0 2023-12-17T11:57:47.526 INFO:tasks.workunit.client.1.smithi119.stdout:0/467: truncate d2/d66/d2e/d44/f5f 1903293 0 2023-12-17T11:57:47.526 INFO:tasks.workunit.client.1.smithi119.stdout:0/468: chown d2 402714 1 2023-12-17T11:57:47.527 INFO:tasks.workunit.client.1.smithi119.stdout:0/469: write d2/d16/d35/f6c [606952,120592] 0 2023-12-17T11:57:47.527 INFO:tasks.workunit.client.1.smithi119.stdout:0/470: dread - d2/f6b zero size 2023-12-17T11:57:47.527 INFO:tasks.workunit.client.0.smithi002.stdout:5/553: dread dc/d17/d2f/d99/fac [0,4194304] 0 2023-12-17T11:57:47.527 INFO:tasks.workunit.client.0.smithi002.stdout:3/594: rename d9/d15/f2b to d9/d1b/fc1 0 2023-12-17T11:57:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:2/549: dread d3/d4/f5d [0,4194304] 0 2023-12-17T11:57:47.531 INFO:tasks.workunit.client.0.smithi002.stdout:2/550: readlink d3/d4/d7/d14/d2e/l30 0 2023-12-17T11:57:47.532 INFO:tasks.workunit.client.0.smithi002.stdout:1/614: symlink d3/d2f/lcc 0 2023-12-17T11:57:47.532 INFO:tasks.workunit.client.0.smithi002.stdout:1/615: truncate d3/d6/d9/d37/d39/d43/d4a/fc9 453418 0 2023-12-17T11:57:47.532 INFO:tasks.workunit.client.0.smithi002.stdout:8/553: dwrite d3/d8/da/dd/f5f [0,4194304] 0 2023-12-17T11:57:47.534 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:57:47.534 INFO:tasks.workunit.client.1.smithi119.stdout:6/507: getdents d2/d7e/d93 0 2023-12-17T11:57:47.534 INFO:tasks.workunit.client.1.smithi119.stdout:6/508: fdatasync d2/df/d17/f2f 0 2023-12-17T11:57:47.535 INFO:tasks.workunit.client.1.smithi119.stdout:6/509: fsync d2/f26 0 2023-12-17T11:57:47.535 INFO:tasks.workunit.client.0.smithi002.stdout:1/616: chown d3/d6/d16/d61/f86 1313 1 2023-12-17T11:57:47.536 INFO:tasks.workunit.client.0.smithi002.stdout:1/617: read - d3/d2f/fb8 zero size 2023-12-17T11:57:47.538 INFO:tasks.workunit.client.1.smithi119.stdout:1/524: dwrite d3/db/d17/d24/d20/d40/f41 [0,4194304] 0 2023-12-17T11:57:47.542 INFO:tasks.workunit.client.0.smithi002.stdout:7/525: creat d6/d17/dc/d6c/d93/fa0 x:0 0 0 2023-12-17T11:57:47.542 INFO:tasks.workunit.client.0.smithi002.stdout:9/585: write dc/d1d/d25/f65 [997856,8633] 0 2023-12-17T11:57:47.543 INFO:tasks.workunit.client.0.smithi002.stdout:9/586: write dc/d42/da0/d72/d93/f29 [4808079,113665] 0 2023-12-17T11:57:47.544 INFO:tasks.workunit.client.1.smithi119.stdout:5/580: unlink d1/l75 0 2023-12-17T11:57:47.546 INFO:tasks.workunit.client.1.smithi119.stdout:3/606: symlink d9/d11/d92/le8 0 2023-12-17T11:57:47.546 INFO:tasks.workunit.client.0.smithi002.stdout:2/551: mkdir d3/d4/d7/d14/d2e/d37/dce 0 2023-12-17T11:57:47.554 INFO:tasks.workunit.client.0.smithi002.stdout:1/618: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd 0 2023-12-17T11:57:47.556 INFO:tasks.workunit.client.0.smithi002.stdout:8/554: mkdir d3/d8/d28/db8 0 2023-12-17T11:57:47.556 INFO:tasks.workunit.client.0.smithi002.stdout:8/555: chown d3/d7/d6e/l8d 33380160 1 2023-12-17T11:57:47.556 INFO:tasks.workunit.client.0.smithi002.stdout:8/556: creat d3/d8/da/fb9 x:0 0 0 2023-12-17T11:57:47.556 INFO:tasks.workunit.client.0.smithi002.stdout:8/557: dread - d3/d7/d6e/d7f/fa3 zero size 2023-12-17T11:57:47.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/558: creat d3/d8/d28/d31/d5a/d7c/fba x:0 0 0 2023-12-17T11:57:47.570 INFO:tasks.workunit.client.0.smithi002.stdout:2/552: dread d3/d4/d17/d19/f89 [0,4194304] 0 2023-12-17T11:57:47.571 INFO:tasks.workunit.client.0.smithi002.stdout:2/553: write d3/d4/d7/d14/f82 [853517,97305] 0 2023-12-17T11:57:47.572 INFO:tasks.workunit.client.1.smithi119.stdout:5/581: truncate d1/d44/f74 1172180 0 2023-12-17T11:57:47.578 INFO:tasks.workunit.client.0.smithi002.stdout:2/554: write d3/d4/d7/d14/d2e/f6d [781327,72012] 0 2023-12-17T11:57:47.578 INFO:tasks.workunit.client.0.smithi002.stdout:2/555: chown d3/d4/l93 714363217 1 2023-12-17T11:57:47.579 INFO:tasks.workunit.client.0.smithi002.stdout:1/619: rmdir d3/d6/d16/d61 39 2023-12-17T11:57:47.580 INFO:tasks.workunit.client.1.smithi119.stdout:6/510: write d2/d2b/d43/f85 [1861150,44423] 0 2023-12-17T11:57:47.580 INFO:tasks.workunit.client.1.smithi119.stdout:2/612: rmdir d6/d9/d52/d53/d55/d58/d6b 39 2023-12-17T11:57:47.580 INFO:tasks.workunit.client.1.smithi119.stdout:2/613: readlink d6/d38/d96/l97 0 2023-12-17T11:57:47.582 INFO:tasks.workunit.client.0.smithi002.stdout:1/620: mknod d3/d6/d16/d9f/d80/cce 0 2023-12-17T11:57:47.582 INFO:tasks.workunit.client.0.smithi002.stdout:2/556: truncate d3/d4/d7/d14/d42/f47 3588178 0 2023-12-17T11:57:47.587 INFO:tasks.workunit.client.1.smithi119.stdout:5/582: rename d1/da7/d71/d76/f9d to d1/da7/d71/d76/d83/fb4 0 2023-12-17T11:57:47.587 INFO:tasks.workunit.client.1.smithi119.stdout:5/583: chown d1/d36/l7f 1561925953 1 2023-12-17T11:57:47.589 INFO:tasks.workunit.client.1.smithi119.stdout:2/614: creat d6/d9/d52/d53/d55/d58/fdf x:0 0 0 2023-12-17T11:57:47.590 INFO:tasks.workunit.client.1.smithi119.stdout:2/615: write d6/d2b/f87 [4526333,120278] 0 2023-12-17T11:57:47.591 INFO:tasks.workunit.client.0.smithi002.stdout:1/621: truncate d3/d6/fa2 243490 0 2023-12-17T11:57:47.592 INFO:tasks.workunit.client.1.smithi119.stdout:5/584: rename d1/d70/d6b/d77/l9c to d1/da7/d71/d82/lb5 0 2023-12-17T11:57:47.593 INFO:tasks.workunit.client.1.smithi119.stdout:5/585: fdatasync d1/da7/d71/d82/f9f 0 2023-12-17T11:57:47.594 INFO:tasks.workunit.client.0.smithi002.stdout:2/557: mknod d3/d4/d7/d14/d42/dae/ccf 0 2023-12-17T11:57:47.595 INFO:tasks.workunit.client.0.smithi002.stdout:2/558: chown d3/d4/c6b 467 1 2023-12-17T11:57:47.595 INFO:tasks.workunit.client.0.smithi002.stdout:2/559: fdatasync d3/d4/f5d 0 2023-12-17T11:57:47.597 INFO:tasks.workunit.client.0.smithi002.stdout:1/622: mkdir d3/d6/d16/dcf 0 2023-12-17T11:57:47.599 INFO:tasks.workunit.client.1.smithi119.stdout:2/616: truncate d6/d9/d52/d53/d55/f4e 3271009 0 2023-12-17T11:57:47.599 INFO:tasks.workunit.client.1.smithi119.stdout:2/617: chown d6/d2b/d4b 3 1 2023-12-17T11:57:47.603 INFO:tasks.workunit.client.1.smithi119.stdout:5/586: link d1/da7/faa d1/d70/da3/fb6 0 2023-12-17T11:57:47.605 INFO:tasks.workunit.client.1.smithi119.stdout:5/587: mknod d1/d70/cb7 0 2023-12-17T11:57:47.609 INFO:tasks.workunit.client.1.smithi119.stdout:0/471: dwrite d2/d66/d2e/d44/f26 [0,4194304] 0 2023-12-17T11:57:47.609 INFO:tasks.workunit.client.1.smithi119.stdout:0/472: dread - d2/d66/d1f/d24/d50/d5d/f70 zero size 2023-12-17T11:57:47.609 INFO:tasks.workunit.client.0.smithi002.stdout:1/623: symlink d3/d6/d16/dcf/ld0 0 2023-12-17T11:57:47.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/526: write d6/d17/dc/d13/d21/d2e/f5a [414679,50529] 0 2023-12-17T11:57:47.614 INFO:tasks.workunit.client.0.smithi002.stdout:7/527: mkdir d6/d99/da1 0 2023-12-17T11:57:47.614 INFO:tasks.workunit.client.0.smithi002.stdout:7/528: chown d6/d17/dc/d67/f87 26299 1 2023-12-17T11:57:47.614 INFO:tasks.workunit.client.0.smithi002.stdout:7/529: write d6/d17/dc/d67/d8b/d24/f31 [4430796,16582] 0 2023-12-17T11:57:47.615 INFO:tasks.workunit.client.0.smithi002.stdout:3/595: dwrite d9/d1b/f5e [0,4194304] 0 2023-12-17T11:57:47.616 INFO:tasks.workunit.client.0.smithi002.stdout:7/530: symlink d6/d17/dc/d13/la2 0 2023-12-17T11:57:47.616 INFO:tasks.workunit.client.0.smithi002.stdout:7/531: fdatasync d6/d17/dc/d13/d37/d4f/f6d 0 2023-12-17T11:57:47.616 INFO:tasks.workunit.client.0.smithi002.stdout:7/532: getdents d6/d99/da1 0 2023-12-17T11:57:47.618 INFO:tasks.workunit.client.0.smithi002.stdout:7/533: mkdir d6/d17/dc/d67/d8b/d24/da3 0 2023-12-17T11:57:47.618 INFO:tasks.workunit.client.0.smithi002.stdout:7/534: chown d6/c2a 223265364 1 2023-12-17T11:57:47.634 INFO:tasks.workunit.client.1.smithi119.stdout:8/451: sync 2023-12-17T11:57:47.641 INFO:tasks.workunit.client.0.smithi002.stdout:1/624: dread d3/d6/d9/d37/f65 [0,4194304] 0 2023-12-17T11:57:47.665 INFO:tasks.workunit.client.1.smithi119.stdout:2/618: dwrite d6/d9/d13/d34/fa0 [0,4194304] 0 2023-12-17T11:57:47.665 INFO:tasks.workunit.client.1.smithi119.stdout:2/619: chown d6/d2b/d3f/d5b/f6f 1099751 1 2023-12-17T11:57:47.665 INFO:tasks.workunit.client.1.smithi119.stdout:2/620: fdatasync d6/d38/fc7 0 2023-12-17T11:57:47.665 INFO:tasks.workunit.client.1.smithi119.stdout:2/621: stat d6/d38/fbc 0 2023-12-17T11:57:47.667 INFO:tasks.workunit.client.1.smithi119.stdout:5/588: rename d1/da7/d71/d76/d83/fb4 to d1/da7/d71/d76/d83/fb8 0 2023-12-17T11:57:47.672 INFO:tasks.workunit.client.1.smithi119.stdout:2/622: getdents d6/d9/d13 0 2023-12-17T11:57:47.672 INFO:tasks.workunit.client.1.smithi119.stdout:2/623: write d6/d9/d13/d1d/f2d [2706414,103791] 0 2023-12-17T11:57:47.674 INFO:tasks.workunit.client.1.smithi119.stdout:5/589: unlink d1/d25/c62 0 2023-12-17T11:57:47.674 INFO:tasks.workunit.client.1.smithi119.stdout:5/590: creat d1/d70/d6b/d77/fb9 x:0 0 0 2023-12-17T11:57:47.674 INFO:tasks.workunit.client.1.smithi119.stdout:5/591: stat d1/d44/d52/c64 0 2023-12-17T11:57:47.675 INFO:tasks.workunit.client.0.smithi002.stdout:5/554: dwrite dc/d1a/d47/f4a [0,4194304] 0 2023-12-17T11:57:47.676 INFO:tasks.workunit.client.1.smithi119.stdout:2/624: mknod d6/d9/d13/d34/dcf/ce0 0 2023-12-17T11:57:47.677 INFO:tasks.workunit.client.1.smithi119.stdout:5/592: mkdir d1/d70/d6b/d77/dae/dba 0 2023-12-17T11:57:47.678 INFO:tasks.workunit.client.1.smithi119.stdout:5/593: readlink d1/l24 0 2023-12-17T11:57:47.678 INFO:tasks.workunit.client.1.smithi119.stdout:5/594: chown d1/fa 408948984 1 2023-12-17T11:57:47.678 INFO:tasks.workunit.client.1.smithi119.stdout:5/595: chown d1/d36/d3a/l3e 30 1 2023-12-17T11:57:47.682 INFO:tasks.workunit.client.0.smithi002.stdout:7/535: dread d6/d17/f61 [0,4194304] 0 2023-12-17T11:57:47.682 INFO:tasks.workunit.client.0.smithi002.stdout:5/555: symlink dc/d1b/d5a/d96/d6c/da0/lca 0 2023-12-17T11:57:47.682 INFO:tasks.workunit.client.1.smithi119.stdout:3/607: dread d9/d11/d1e/f8e [8388608,4194304] 0 2023-12-17T11:57:47.684 INFO:tasks.workunit.client.0.smithi002.stdout:5/556: stat dc/d1b/d5a/d96/d6c 0 2023-12-17T11:57:47.684 INFO:tasks.workunit.client.0.smithi002.stdout:5/557: fdatasync dc/d1a/d47/fc2 0 2023-12-17T11:57:47.684 INFO:tasks.workunit.client.0.smithi002.stdout:7/536: unlink d6/d17/dc/d13/d21/d2e/d4a/d53/l2b 0 2023-12-17T11:57:47.684 INFO:tasks.workunit.client.1.smithi119.stdout:0/473: dwrite d2/d66/f1a [0,4194304] 0 2023-12-17T11:57:47.685 INFO:tasks.workunit.client.1.smithi119.stdout:5/596: rmdir d1/d36/d3a 39 2023-12-17T11:57:47.688 INFO:tasks.workunit.client.1.smithi119.stdout:3/608: symlink d9/da/df/d41/d33/d3a/d90/le9 0 2023-12-17T11:57:47.688 INFO:tasks.workunit.client.1.smithi119.stdout:3/609: write d9/da/df/f52 [578781,129325] 0 2023-12-17T11:57:47.688 INFO:tasks.workunit.client.0.smithi002.stdout:9/587: dwrite dc/d42/d4f/d59/f4e [0,4194304] 0 2023-12-17T11:57:47.689 INFO:tasks.workunit.client.1.smithi119.stdout:3/610: truncate d9/d11/f72 3012077 0 2023-12-17T11:57:47.689 INFO:tasks.workunit.client.1.smithi119.stdout:3/611: read d9/d11/d1e/f3e [2831188,26488] 0 2023-12-17T11:57:47.690 INFO:tasks.workunit.client.0.smithi002.stdout:7/537: rename d6/c2a to d6/d17/ca4 0 2023-12-17T11:57:47.693 INFO:tasks.workunit.client.1.smithi119.stdout:0/474: symlink d2/d66/d2e/d44/d7b/d5/l8d 0 2023-12-17T11:57:47.694 INFO:tasks.workunit.client.0.smithi002.stdout:0/501: dwrite d0/d6/d26/d25/f8b [0,4194304] 0 2023-12-17T11:57:47.694 INFO:tasks.workunit.client.0.smithi002.stdout:9/588: creat dc/d1d/d25/d85/dc2/d91/fd3 x:0 0 0 2023-12-17T11:57:47.694 INFO:tasks.workunit.client.0.smithi002.stdout:9/589: stat dc/d42/da0/ccc 0 2023-12-17T11:57:47.694 INFO:tasks.workunit.client.1.smithi119.stdout:5/597: mknod d1/d36/cbb 0 2023-12-17T11:57:47.695 INFO:tasks.workunit.client.0.smithi002.stdout:9/590: write dc/d42/d4f/d59/d47/d4b/f9d [780106,124667] 0 2023-12-17T11:57:47.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/502: truncate d0/d15/f32 1779661 0 2023-12-17T11:57:47.696 INFO:tasks.workunit.client.0.smithi002.stdout:0/503: readlink d0/d15/l70 0 2023-12-17T11:57:47.696 INFO:tasks.workunit.client.1.smithi119.stdout:0/475: mknod d2/d66/d1f/d24/d50/d5d/c8e 0 2023-12-17T11:57:47.697 INFO:tasks.workunit.client.0.smithi002.stdout:2/560: dwrite d3/d4/d17/d19/d4d/d72/d83/d94/f9c [0,4194304] 0 2023-12-17T11:57:47.701 INFO:tasks.workunit.client.0.smithi002.stdout:9/591: mkdir dc/d42/da0/d72/d93/dd0/dd4 0 2023-12-17T11:57:47.701 INFO:tasks.workunit.client.0.smithi002.stdout:7/538: fsync d6/d17/dc/d67/d8b/d24/f31 0 2023-12-17T11:57:47.701 INFO:tasks.workunit.client.0.smithi002.stdout:6/560: dwrite d0/d1/dc/f34 [0,4194304] 0 2023-12-17T11:57:47.702 INFO:tasks.workunit.client.1.smithi119.stdout:0/476: rename d2/d16/d35/l46 to d2/d66/d2e/d44/l8f 0 2023-12-17T11:57:47.702 INFO:tasks.workunit.client.1.smithi119.stdout:0/477: fsync d2/d16/f17 0 2023-12-17T11:57:47.702 INFO:tasks.workunit.client.0.smithi002.stdout:2/561: mknod d3/d4/d17/d19/d4d/d72/cd0 0 2023-12-17T11:57:47.703 INFO:tasks.workunit.client.1.smithi119.stdout:7/609: dwrite d2/f76 [0,4194304] 0 2023-12-17T11:57:47.703 INFO:tasks.workunit.client.1.smithi119.stdout:7/610: stat d2/d4/d11/d3c 0 2023-12-17T11:57:47.703 INFO:tasks.workunit.client.1.smithi119.stdout:7/611: stat d2/d4/d11/d2c/d68/f85 0 2023-12-17T11:57:47.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/592: mkdir dc/d42/d4f/dd5 0 2023-12-17T11:57:47.706 INFO:tasks.workunit.client.1.smithi119.stdout:3/612: write d9/d11/d1e/f8e [7558433,78446] 0 2023-12-17T11:57:47.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/539: mknod d6/d17/dc/d13/d21/ca5 0 2023-12-17T11:57:47.709 INFO:tasks.workunit.client.0.smithi002.stdout:7/540: dread - d6/d17/dc/d8e/f96 zero size 2023-12-17T11:57:47.711 INFO:tasks.workunit.client.1.smithi119.stdout:7/612: rename d2/d4/c1b to d2/d4/d11/d2c/d68/d99/d6c/cc0 0 2023-12-17T11:57:47.716 INFO:tasks.workunit.client.1.smithi119.stdout:3/613: mkdir d9/da/df/d41/d33/dea 0 2023-12-17T11:57:47.725 INFO:tasks.workunit.client.0.smithi002.stdout:4/528: dwrite d0/d3e/d56/f7c [0,4194304] 0 2023-12-17T11:57:47.726 INFO:tasks.workunit.client.1.smithi119.stdout:3/614: symlink d9/d11/d1e/leb 0 2023-12-17T11:57:47.729 INFO:tasks.workunit.client.0.smithi002.stdout:9/593: creat dc/d1d/d25/d85/fd6 x:0 0 0 2023-12-17T11:57:47.729 INFO:tasks.workunit.client.0.smithi002.stdout:9/594: dread - dc/d42/d4f/d59/fae zero size 2023-12-17T11:57:47.733 INFO:tasks.workunit.client.0.smithi002.stdout:7/541: creat d6/fa6 x:0 0 0 2023-12-17T11:57:47.733 INFO:tasks.workunit.client.1.smithi119.stdout:8/452: dwrite d7/d18/d45/f83 [0,4194304] 0 2023-12-17T11:57:47.733 INFO:tasks.workunit.client.1.smithi119.stdout:8/453: chown d7/l48 86 1 2023-12-17T11:57:47.734 INFO:tasks.workunit.client.0.smithi002.stdout:4/529: mknod d0/cab 0 2023-12-17T11:57:47.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/595: rename dc/d42/d4f/d59/f6e to dc/d42/da0/d72/d93/dd0/fd7 0 2023-12-17T11:57:47.738 INFO:tasks.workunit.client.0.smithi002.stdout:6/561: rmdir d0/d1/d21/d56/d60 39 2023-12-17T11:57:47.738 INFO:tasks.workunit.client.0.smithi002.stdout:6/562: write d0/d1/dc/d17/d8f/f9d [37223,28521] 0 2023-12-17T11:57:47.747 INFO:tasks.workunit.client.0.smithi002.stdout:4/530: mknod d0/d3e/cac 0 2023-12-17T11:57:47.747 INFO:tasks.workunit.client.0.smithi002.stdout:4/531: getdents d0/d10/d21/d33/d96 0 2023-12-17T11:57:47.747 INFO:tasks.workunit.client.0.smithi002.stdout:4/532: readlink d0/lc 0 2023-12-17T11:57:47.748 INFO:tasks.workunit.client.0.smithi002.stdout:9/596: truncate dc/d42/da0/d72/d93/f7f 77621 0 2023-12-17T11:57:47.748 INFO:tasks.workunit.client.1.smithi119.stdout:8/454: read d7/da/f22 [2905469,8885] 0 2023-12-17T11:57:47.750 INFO:tasks.workunit.client.0.smithi002.stdout:6/563: rename d0/d1/l1c to d0/d1/dc/d58/lba 0 2023-12-17T11:57:47.750 INFO:tasks.workunit.client.0.smithi002.stdout:6/564: write d0/d1/dc/d10/fb6 [5315490,90974] 0 2023-12-17T11:57:47.751 INFO:tasks.workunit.client.1.smithi119.stdout:8/455: rename d7/da/f6c to d7/d12/d69/d67/f99 0 2023-12-17T11:57:47.751 INFO:tasks.workunit.client.1.smithi119.stdout:8/456: creat d7/d12/d69/d67/f9a x:0 0 0 2023-12-17T11:57:47.752 INFO:tasks.workunit.client.1.smithi119.stdout:0/478: dwrite d2/d16/f27 [0,4194304] 0 2023-12-17T11:57:47.752 INFO:tasks.workunit.client.0.smithi002.stdout:9/597: getdents dc 0 2023-12-17T11:57:47.753 INFO:tasks.workunit.client.1.smithi119.stdout:8/457: truncate d7/d18/f5b 860055 0 2023-12-17T11:57:47.754 INFO:tasks.workunit.client.1.smithi119.stdout:1/525: dwrite d3/f9f [0,4194304] 0 2023-12-17T11:57:47.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/598: rename dc/d1d/d7c/fb1 to dc/d42/d4f/dd5/fd8 0 2023-12-17T11:57:47.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/599: readlink dc/d42/da0/d72/d93/l2f 0 2023-12-17T11:57:47.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/600: write dc/d1d/d7c/fab [205173,67013] 0 2023-12-17T11:57:47.756 INFO:tasks.workunit.client.0.smithi002.stdout:9/601: read dc/d42/d4f/d59/d47/d4b/f9d [900278,41280] 0 2023-12-17T11:57:47.765 INFO:tasks.workunit.client.1.smithi119.stdout:0/479: mknod d2/d16/d8c/c90 0 2023-12-17T11:57:47.766 INFO:tasks.workunit.client.0.smithi002.stdout:6/565: dread d0/d1/dc/d17/f79 [0,4194304] 0 2023-12-17T11:57:47.767 INFO:tasks.workunit.client.1.smithi119.stdout:8/458: symlink d7/d12/d69/d98/l9b 0 2023-12-17T11:57:47.767 INFO:tasks.workunit.client.1.smithi119.stdout:8/459: getdents d7/da/d1a/d8a 0 2023-12-17T11:57:47.780 INFO:tasks.workunit.client.1.smithi119.stdout:2/625: dwrite d6/d2b/d3f/f98 [0,4194304] 0 2023-12-17T11:57:47.780 INFO:tasks.workunit.client.1.smithi119.stdout:2/626: write d6/d2b/d4b/d5d/fd3 [166021,2492] 0 2023-12-17T11:57:47.781 INFO:tasks.workunit.client.1.smithi119.stdout:8/460: mkdir d7/d12/d23/d9c 0 2023-12-17T11:57:47.781 INFO:tasks.workunit.client.1.smithi119.stdout:8/461: getdents d7/d18/d15/d81/d8e 0 2023-12-17T11:57:47.783 INFO:tasks.workunit.client.1.smithi119.stdout:1/526: getdents d3/db/d26 0 2023-12-17T11:57:47.784 INFO:tasks.workunit.client.1.smithi119.stdout:0/480: link d2/d66/d2e/d44/d7b/d5/dc/f7e d2/d66/d2e/d44/d7b/d5/dc/f91 0 2023-12-17T11:57:47.784 INFO:tasks.workunit.client.1.smithi119.stdout:0/481: chown d2/d66/d2e/d44/d7b/d5/l8d 14756077 1 2023-12-17T11:57:47.787 INFO:tasks.workunit.client.0.smithi002.stdout:2/562: dwrite d3/d4/d7/d14/d42/dae/fb9 [0,4194304] 0 2023-12-17T11:57:47.787 INFO:tasks.workunit.client.0.smithi002.stdout:2/563: fsync d3/d4/d7/d14/d2e/d37/d3f/fad 0 2023-12-17T11:57:47.787 INFO:tasks.workunit.client.0.smithi002.stdout:2/564: creat d3/d4/d7/d14/d9b/fd1 x:0 0 0 2023-12-17T11:57:47.788 INFO:tasks.workunit.client.0.smithi002.stdout:2/565: chown d3/d4/d7/d14/d42/f76 2 1 2023-12-17T11:57:47.788 INFO:tasks.workunit.client.0.smithi002.stdout:2/566: fdatasync d3/d4/d7/d14/d2e/d37/d3f/fad 0 2023-12-17T11:57:47.791 INFO:tasks.workunit.client.1.smithi119.stdout:8/462: link d7/d12/l30 d7/d12/d69/l9d 0 2023-12-17T11:57:47.791 INFO:tasks.workunit.client.1.smithi119.stdout:8/463: fsync d7/d18/d45/f83 0 2023-12-17T11:57:47.794 INFO:tasks.workunit.client.1.smithi119.stdout:1/527: truncate d3/db/d17/d24/d20/d40/f41 3444285 0 2023-12-17T11:57:47.794 INFO:tasks.workunit.client.1.smithi119.stdout:1/528: read - d3/d44/d89/fb9 zero size 2023-12-17T11:57:47.797 INFO:tasks.workunit.client.1.smithi119.stdout:2/627: rmdir d6/d2b/d4b/d5d 39 2023-12-17T11:57:47.798 INFO:tasks.workunit.client.1.smithi119.stdout:2/628: dread - d6/d2b/d4b/fc9 zero size 2023-12-17T11:57:47.799 INFO:tasks.workunit.client.1.smithi119.stdout:8/464: mkdir d7/d18/d45/d9e 0 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.796+0000 7fe27c2db700 1 -- 172.21.15.2:0/918159841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 msgr2=0x7fe274072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.796+0000 7fe27c2db700 1 --2- 172.21.15.2:0/918159841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe274072950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe270004940 tx=0x7fe270009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.797+0000 7fe27c2db700 1 -- 172.21.15.2:0/918159841 shutdown_connections 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.797+0000 7fe27c2db700 1 --2- 172.21.15.2:0/918159841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe274073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.797+0000 7fe27c2db700 1 --2- 172.21.15.2:0/918159841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe274072950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.797+0000 7fe27c2db700 1 -- 172.21.15.2:0/918159841 >> 172.21.15.2:0/918159841 conn(0x7fe2740fa5d0 msgr2=0x7fe2740fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.797+0000 7fe27c2db700 1 -- 172.21.15.2:0/918159841 shutdown_connections 2023-12-17T11:57:47.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.797+0000 7fe27c2db700 1 -- 172.21.15.2:0/918159841 wait complete. 2023-12-17T11:57:47.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.798+0000 7fe27c2db700 1 Processor -- start 2023-12-17T11:57:47.802 INFO:tasks.workunit.client.1.smithi119.stdout:1/529: symlink d3/db/d26/d19/d3f/d64/lbb 0 2023-12-17T11:57:47.802 INFO:tasks.workunit.client.1.smithi119.stdout:1/530: write d3/db/d26/d19/d3f/d64/fae [397245,53709] 0 2023-12-17T11:57:47.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.799+0000 7fe27c2db700 1 -- start start 2023-12-17T11:57:47.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27c2db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe27411da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27c2db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe27411dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27c2db700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27411e660 con 0x7fe2740737a0 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27c2db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27411c7d0 con 0x7fe274072540 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe279876700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe27411dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27a077700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe27411da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27a077700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe27411da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:55284/0 (socket says 172.21.15.2:55284) 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe279876700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe27411dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42768/0 (socket says 172.21.15.2:42768) 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.800+0000 7fe27a077700 1 -- 172.21.15.2:0/4191272927 learned_addr learned my addr 172.21.15.2:0/4191272927 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:47.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.801+0000 7fe27a077700 1 -- 172.21.15.2:0/4191272927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 msgr2=0x7fe27411dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.801+0000 7fe27a077700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe27411dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.801+0000 7fe27a077700 1 -- 172.21.15.2:0/4191272927 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270005040 con 0x7fe274072540 2023-12-17T11:57:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.801+0000 7fe279876700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe27411dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:57:47.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.801+0000 7fe27a077700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe27411da90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe270009360 tx=0x7fe270009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.802+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27000e040 con 0x7fe274072540 2023-12-17T11:57:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.802+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe270013420 con 0x7fe274072540 2023-12-17T11:57:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.802+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27411ca50 con 0x7fe274072540 2023-12-17T11:57:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.802+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe27001c610 con 0x7fe274072540 2023-12-17T11:57:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.802+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27411ced0 con 0x7fe274072540 2023-12-17T11:57:47.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.804+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe274069b00 con 0x7fe274072540 2023-12-17T11:57:47.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.805+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fe270013a00 con 0x7fe274072540 2023-12-17T11:57:47.808 INFO:tasks.workunit.client.1.smithi119.stdout:1/531: rename d3/db/d17/d24/d20/d40/d6d to d3/db/d17/d24/d20/dba/dbc 0 2023-12-17T11:57:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.808+0000 7fe26affd700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fe26006ae40 0x7fe26006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:47.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.808+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe27008aa90 con 0x7fe274072540 2023-12-17T11:57:47.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.809+0000 7fe279876700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fe26006ae40 0x7fe26006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:47.812 INFO:tasks.workunit.client.1.smithi119.stdout:1/532: mkdir d3/db/d17/d24/d20/dbd 0 2023-12-17T11:57:47.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.811+0000 7fe279876700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fe26006ae40 0x7fe26006d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe264009fd0 tx=0x7fe2640091a0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:47.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:47.815+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe2700587c0 con 0x7fe274072540 2023-12-17T11:57:47.818 INFO:tasks.workunit.client.1.smithi119.stdout:1/533: creat d3/db/d17/d24/d20/dba/dbc/d7e/fbe x:0 0 0 2023-12-17T11:57:47.818 INFO:tasks.workunit.client.1.smithi119.stdout:1/534: truncate d3/db/d26/d19/d3f/f73 419504 0 2023-12-17T11:57:47.818 INFO:tasks.workunit.client.1.smithi119.stdout:1/535: stat d3/db/d17/d24/f32 0 2023-12-17T11:57:47.818 INFO:tasks.workunit.client.1.smithi119.stdout:1/536: fsync d3/f65 0 2023-12-17T11:57:47.821 INFO:tasks.workunit.client.1.smithi119.stdout:8/465: dread d7/d12/d69/d67/f99 [0,4194304] 0 2023-12-17T11:57:47.821 INFO:tasks.workunit.client.1.smithi119.stdout:8/466: write d7/d12/f25 [548489,27532] 0 2023-12-17T11:57:47.822 INFO:tasks.workunit.client.0.smithi002.stdout:5/558: read dc/f83 [3063896,31730] 0 2023-12-17T11:57:47.822 INFO:tasks.workunit.client.0.smithi002.stdout:5/559: creat dc/d1b/d2d/d5b/fcb x:0 0 0 2023-12-17T11:57:47.822 INFO:tasks.workunit.client.1.smithi119.stdout:2/629: rmdir d6/d9/d52/d53/d55 39 2023-12-17T11:57:47.822 INFO:tasks.workunit.client.1.smithi119.stdout:2/630: truncate d6/d9/d52/f72 4281347 0 2023-12-17T11:57:47.825 INFO:tasks.workunit.client.1.smithi119.stdout:1/537: truncate d3/db/d26/d19/d3f/f4a 3255727 0 2023-12-17T11:57:47.827 INFO:tasks.workunit.client.1.smithi119.stdout:1/538: write d3/db/d26/fa4 [641589,52982] 0 2023-12-17T11:57:47.828 INFO:tasks.workunit.client.0.smithi002.stdout:0/504: dwrite d0/d6/d26/d14/d19/d37/d62/d77/fa0 [0,4194304] 0 2023-12-17T11:57:47.829 INFO:tasks.workunit.client.1.smithi119.stdout:6/511: dwrite d2/f11 [0,4194304] 0 2023-12-17T11:57:47.836 INFO:tasks.workunit.client.0.smithi002.stdout:4/533: dwrite d0/d10/d14/d27/d57/f7b [0,4194304] 0 2023-12-17T11:57:47.836 INFO:tasks.workunit.client.0.smithi002.stdout:4/534: getdents d0/d3e/d41 0 2023-12-17T11:57:47.843 INFO:tasks.workunit.client.1.smithi119.stdout:8/467: dread d7/d12/d23/f61 [0,4194304] 0 2023-12-17T11:57:47.843 INFO:tasks.workunit.client.1.smithi119.stdout:8/468: truncate d7/da/d11/d26/d2c/f7e 198892 0 2023-12-17T11:57:47.854 INFO:tasks.workunit.client.0.smithi002.stdout:0/505: mknod d0/d6/d26/d14/d6d/ca3 0 2023-12-17T11:57:47.856 INFO:tasks.workunit.client.1.smithi119.stdout:5/598: dwrite d1/da7/f41 [0,4194304] 0 2023-12-17T11:57:47.856 INFO:tasks.workunit.client.1.smithi119.stdout:5/599: write d1/d70/d85/d95/f8f [498373,77600] 0 2023-12-17T11:57:47.856 INFO:tasks.workunit.client.1.smithi119.stdout:5/600: chown d1/d70/d6b/f87 3 1 2023-12-17T11:57:47.861 INFO:tasks.workunit.client.1.smithi119.stdout:2/631: getdents d6/d9/d86/db0 0 2023-12-17T11:57:47.861 INFO:tasks.workunit.client.1.smithi119.stdout:2/632: read - d6/d9/d13/d1d/dbf/fc4 zero size 2023-12-17T11:57:47.861 INFO:tasks.workunit.client.1.smithi119.stdout:2/633: truncate d6/d9/d52/d53/d55/d58/da5/fc6 769380 0 2023-12-17T11:57:47.866 INFO:tasks.workunit.client.1.smithi119.stdout:5/601: mknod d1/d70/d85/cbc 0 2023-12-17T11:57:47.869 INFO:tasks.workunit.client.1.smithi119.stdout:5/602: symlink d1/da7/d71/d76/lbd 0 2023-12-17T11:57:47.870 INFO:tasks.workunit.client.1.smithi119.stdout:8/469: rename d7/da/d11/d26/d2c to d7/d18/d45/d9f 0 2023-12-17T11:57:47.871 INFO:tasks.workunit.client.1.smithi119.stdout:1/539: dread d3/db/d2a/f66 [0,4194304] 0 2023-12-17T11:57:47.872 INFO:tasks.workunit.client.0.smithi002.stdout:2/567: dwrite d3/d4/d7/d14/d1b/d5b/f97 [0,4194304] 0 2023-12-17T11:57:47.873 INFO:tasks.workunit.client.1.smithi119.stdout:2/634: rename d6/d9/d13/f4d to d6/d2b/d3f/da8/fe1 0 2023-12-17T11:57:47.876 INFO:tasks.workunit.client.1.smithi119.stdout:1/540: creat d3/db/d17/d24/fbf x:0 0 0 2023-12-17T11:57:47.879 INFO:tasks.workunit.client.0.smithi002.stdout:2/568: symlink d3/d4/d17/d19/d4d/d72/d83/ld2 0 2023-12-17T11:57:47.879 INFO:tasks.workunit.client.0.smithi002.stdout:2/569: chown d3/d4/f16 166069 1 2023-12-17T11:57:47.879 INFO:tasks.workunit.client.1.smithi119.stdout:1/541: symlink d3/db/d17/d24/d20/dbd/lc0 0 2023-12-17T11:57:47.879 INFO:tasks.workunit.client.1.smithi119.stdout:1/542: chown d3/db/f22 50036 1 2023-12-17T11:57:47.884 INFO:tasks.workunit.client.0.smithi002.stdout:6/566: dwrite d0/d1/d21/f76 [0,4194304] 0 2023-12-17T11:57:47.888 INFO:tasks.workunit.client.1.smithi119.stdout:7/613: dwrite d2/d4/d11/d3c/d75/fbc [0,4194304] 0 2023-12-17T11:57:47.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/570: mknod d3/d4/d17/d19/d8d/cd3 0 2023-12-17T11:57:47.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/571: dread - d3/d4/d7/d14/d2e/d37/f85 zero size 2023-12-17T11:57:47.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/572: chown d3/d4/d43 2 1 2023-12-17T11:57:47.893 INFO:tasks.workunit.client.0.smithi002.stdout:2/573: fdatasync d3/d4/d7/d14/d9b/fd1 0 2023-12-17T11:57:47.902 INFO:tasks.workunit.client.1.smithi119.stdout:2/635: write d6/d9/d52/d53/d55/d58/f68 [2137660,46039] 0 2023-12-17T11:57:47.902 INFO:tasks.workunit.client.1.smithi119.stdout:2/636: chown d6/d2b/da3/fc5 0 1 2023-12-17T11:57:47.904 INFO:tasks.workunit.client.1.smithi119.stdout:1/543: read d3/db/d26/f1d [5009294,87206] 0 2023-12-17T11:57:47.904 INFO:tasks.workunit.client.1.smithi119.stdout:1/544: truncate d3/db/d26/fa4 1659312 0 2023-12-17T11:57:47.904 INFO:tasks.workunit.client.0.smithi002.stdout:5/560: dwrite dc/d1a/d47/f49 [0,4194304] 0 2023-12-17T11:57:47.905 INFO:tasks.workunit.client.0.smithi002.stdout:2/574: mkdir d3/dd4 0 2023-12-17T11:57:47.905 INFO:tasks.workunit.client.0.smithi002.stdout:2/575: creat d3/d56/fd5 x:0 0 0 2023-12-17T11:57:47.905 INFO:tasks.workunit.client.1.smithi119.stdout:1/545: write d3/db/d17/d24/f32 [395918,29340] 0 2023-12-17T11:57:47.906 INFO:tasks.workunit.client.1.smithi119.stdout:3/615: dwrite d9/d11/f3f [0,4194304] 0 2023-12-17T11:57:47.912 INFO:tasks.workunit.client.0.smithi002.stdout:5/561: truncate dc/f83 3964182 0 2023-12-17T11:57:47.912 INFO:tasks.workunit.client.0.smithi002.stdout:5/562: getdents dc/d17/dc0 0 2023-12-17T11:57:47.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/506: dwrite d0/d6/d26/f35 [0,4194304] 0 2023-12-17T11:57:47.913 INFO:tasks.workunit.client.1.smithi119.stdout:7/614: dread d2/f76 [0,4194304] 0 2023-12-17T11:57:47.913 INFO:tasks.workunit.client.1.smithi119.stdout:6/512: dwrite d2/d61/f67 [0,4194304] 0 2023-12-17T11:57:47.914 INFO:tasks.workunit.client.1.smithi119.stdout:7/615: write d2/d4/d11/f3d [4364647,121068] 0 2023-12-17T11:57:47.916 INFO:tasks.workunit.client.0.smithi002.stdout:2/576: truncate d3/d50/f53 5016232 0 2023-12-17T11:57:47.919 INFO:tasks.workunit.client.1.smithi119.stdout:1/546: rename d3/db/d17/d24/d91/caf to d3/db/d26/d19/cc1 0 2023-12-17T11:57:47.921 INFO:tasks.workunit.client.1.smithi119.stdout:3/616: creat d9/d59/da6/fec x:0 0 0 2023-12-17T11:57:47.922 INFO:tasks.workunit.client.0.smithi002.stdout:5/563: dread dc/fbc [0,4194304] 0 2023-12-17T11:57:47.923 INFO:tasks.workunit.client.1.smithi119.stdout:4/559: sync 2023-12-17T11:57:47.924 INFO:tasks.workunit.client.0.smithi002.stdout:0/507: rmdir d0/d6/d26/d14/d19/d61 39 2023-12-17T11:57:47.927 INFO:tasks.workunit.client.1.smithi119.stdout:6/513: mkdir d2/da3 0 2023-12-17T11:57:47.928 INFO:tasks.workunit.client.1.smithi119.stdout:6/514: dread - d2/fa1 zero size 2023-12-17T11:57:47.928 INFO:tasks.workunit.client.1.smithi119.stdout:7/616: symlink d2/d4/d11/d2c/d68/d99/lc1 0 2023-12-17T11:57:47.933 INFO:tasks.workunit.client.1.smithi119.stdout:1/547: read d3/db/d26/d19/d3f/f4a [3172296,8802] 0 2023-12-17T11:57:47.933 INFO:tasks.workunit.client.0.smithi002.stdout:4/535: dwrite d0/d3e/f74 [0,4194304] 0 2023-12-17T11:57:47.938 INFO:tasks.workunit.client.1.smithi119.stdout:1/548: creat d3/db/d17/d24/d20/dba/dbc/d7e/fc2 x:0 0 0 2023-12-17T11:57:47.938 INFO:tasks.workunit.client.1.smithi119.stdout:1/549: write d3/db/d17/d24/d20/f7f [734483,7365] 0 2023-12-17T11:57:47.938 INFO:tasks.workunit.client.1.smithi119.stdout:1/550: read - d3/db/d26/faa zero size 2023-12-17T11:57:47.938 INFO:tasks.workunit.client.1.smithi119.stdout:1/551: truncate d3/db/d17/d24/d20/dba/dbc/d7e/da1/fb5 562481 0 2023-12-17T11:57:47.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/564: dread dc/d17/d2f/d99/fac [0,4194304] 0 2023-12-17T11:57:47.940 INFO:tasks.workunit.client.0.smithi002.stdout:4/536: mknod d0/d3e/d41/cad 0 2023-12-17T11:57:47.940 INFO:tasks.workunit.client.1.smithi119.stdout:3/617: dread d9/f19 [0,4194304] 0 2023-12-17T11:57:47.940 INFO:tasks.workunit.client.1.smithi119.stdout:3/618: readlink d9/d35/l97 0 2023-12-17T11:57:47.942 INFO:tasks.workunit.client.0.smithi002.stdout:5/565: symlink dc/d1b/d2d/dc8/lcc 0 2023-12-17T11:57:47.942 INFO:tasks.workunit.client.0.smithi002.stdout:5/566: chown dc/d1b/d5a/d68/c89 415964665 1 2023-12-17T11:57:47.944 INFO:tasks.workunit.client.1.smithi119.stdout:3/619: rename d9/da/c2e to d9/d11/d1e/d55/d77/ced 0 2023-12-17T11:57:47.945 INFO:tasks.workunit.client.0.smithi002.stdout:4/537: mkdir d0/d10/d14/dae 0 2023-12-17T11:57:47.945 INFO:tasks.workunit.client.0.smithi002.stdout:4/538: chown d0/d10/d14/d4e/f53 11 1 2023-12-17T11:57:47.946 INFO:tasks.workunit.client.0.smithi002.stdout:5/567: rmdir dc/d1b/d5a/d68/d97 39 2023-12-17T11:57:47.948 INFO:tasks.workunit.client.1.smithi119.stdout:3/620: rename d9/da/df/d41/l51 to d9/da/lee 0 2023-12-17T11:57:47.948 INFO:tasks.workunit.client.1.smithi119.stdout:3/621: fdatasync d9/d11/d1e/d55/d65/f7a 0 2023-12-17T11:57:47.956 INFO:tasks.workunit.client.1.smithi119.stdout:9/567: sync 2023-12-17T11:57:47.956 INFO:tasks.workunit.client.1.smithi119.stdout:9/568: write d12/f23 [352071,110005] 0 2023-12-17T11:57:47.965 INFO:tasks.workunit.client.1.smithi119.stdout:9/569: link ff d12/d1d/d49/fb4 0 2023-12-17T11:57:47.967 INFO:tasks.workunit.client.0.smithi002.stdout:7/542: sync 2023-12-17T11:57:47.967 INFO:tasks.workunit.client.0.smithi002.stdout:7/543: write d6/d17/dc/d13/d37/d4f/f6d [4954559,88584] 0 2023-12-17T11:57:47.968 INFO:tasks.workunit.client.0.smithi002.stdout:9/602: sync 2023-12-17T11:57:47.968 INFO:tasks.workunit.client.0.smithi002.stdout:9/603: chown dc/d32/lcd 44 1 2023-12-17T11:57:47.968 INFO:tasks.workunit.client.0.smithi002.stdout:3/596: sync 2023-12-17T11:57:47.968 INFO:tasks.workunit.client.0.smithi002.stdout:1/625: sync 2023-12-17T11:57:47.968 INFO:tasks.workunit.client.0.smithi002.stdout:8/559: sync 2023-12-17T11:57:47.969 INFO:tasks.workunit.client.0.smithi002.stdout:8/560: fsync d3/d7/d6e/fb1 0 2023-12-17T11:57:47.969 INFO:tasks.workunit.client.0.smithi002.stdout:8/561: readlink d3/d7/d1a/l1b 0 2023-12-17T11:57:47.969 INFO:tasks.workunit.client.0.smithi002.stdout:8/562: fdatasync d3/d7/f37 0 2023-12-17T11:57:47.969 INFO:tasks.workunit.client.0.smithi002.stdout:8/563: stat d3/d7/d18/d74/f82 0 2023-12-17T11:57:47.969 INFO:tasks.workunit.client.0.smithi002.stdout:8/564: chown d3/d8/d28/d31/d5a/l4c 15579 1 2023-12-17T11:57:47.971 INFO:tasks.workunit.client.0.smithi002.stdout:9/604: mkdir dc/d1d/d25/dd9 0 2023-12-17T11:57:47.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/597: rename d9/d40/l56 to d9/d15/d52/d79/lc2 0 2023-12-17T11:57:47.976 INFO:tasks.workunit.client.0.smithi002.stdout:1/626: link d3/c7 d3/d2f/cd1 0 2023-12-17T11:57:47.979 INFO:tasks.workunit.client.0.smithi002.stdout:9/605: symlink dc/d42/d4f/lda 0 2023-12-17T11:57:47.981 INFO:tasks.workunit.client.0.smithi002.stdout:4/539: write d0/d10/d14/d4e/f80 [1691854,112378] 0 2023-12-17T11:57:47.981 INFO:tasks.workunit.client.0.smithi002.stdout:7/544: rename d6/d17/dc/d13/d37/d4f/l69 to d6/d17/dc/d13/d21/d2e/d4a/d91/la7 0 2023-12-17T11:57:47.986 INFO:tasks.workunit.client.0.smithi002.stdout:4/540: mkdir d0/d3e/da5/daf 0 2023-12-17T11:57:47.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/606: symlink dc/d42/da0/d72/d93/d76/ldb 0 2023-12-17T11:57:47.987 INFO:tasks.workunit.client.0.smithi002.stdout:9/607: write dc/d42/d4f/f61 [5233775,61136] 0 2023-12-17T11:57:47.992 INFO:tasks.workunit.client.0.smithi002.stdout:1/627: dread d3/d6/d9/d37/d39/d94/fb0 [0,4194304] 0 2023-12-17T11:57:47.992 INFO:tasks.workunit.client.0.smithi002.stdout:1/628: creat d3/d6/d16/d28/fd2 x:0 0 0 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/545: rename d6/d17/dc/d13/d3e/f4b to d6/d17/dc/d13/d37/d4f/fa8 0 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/546: truncate d6/d17/dc/d13/d37/d4f/f80 467857 0 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/547: write d6/d17/dc/d67/f87 [524309,99904] 0 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/548: write d6/d17/dc/d13/d37/f3c [782763,64032] 0 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/549: truncate d6/d17/dc/d13/f14 4434222 0 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:7/550: chown d6/d17/dc/d13/d21/d2e/d4a/d53/d75/c7c 0 1 2023-12-17T11:57:47.993 INFO:tasks.workunit.client.0.smithi002.stdout:9/608: symlink dc/d1d/d25/ldc 0 2023-12-17T11:57:47.995 INFO:tasks.workunit.client.0.smithi002.stdout:3/598: rename d9/d1b/d35/d41/d59/d7c/c5b to d9/d15/d52/d79/cc3 0 2023-12-17T11:57:47.996 INFO:tasks.workunit.client.1.smithi119.stdout:4/560: dwrite dd/d11/d2d/d9c/d55/d81/d88/d91/fae [0,4194304] 0 2023-12-17T11:57:47.996 INFO:tasks.workunit.client.1.smithi119.stdout:4/561: fdatasync dd/d11/d26/f66 0 2023-12-17T11:57:47.996 INFO:tasks.workunit.client.1.smithi119.stdout:4/562: creat dd/d11/d2d/fb4 x:0 0 0 2023-12-17T11:57:47.998 INFO:tasks.workunit.client.0.smithi002.stdout:7/551: mknod d6/d17/dc/d67/d8b/ca9 0 2023-12-17T11:57:47.999 INFO:tasks.workunit.client.0.smithi002.stdout:9/609: mkdir dc/d1d/d25/d85/dc2/ddd 0 2023-12-17T11:57:48.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/599: mknod d9/d24/d6f/d84/cc4 0 2023-12-17T11:57:48.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/541: rename d0/d3e/d41/cad to d0/d10/d14/dae/cb0 0 2023-12-17T11:57:48.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/542: fsync d0/d3e/d56/d65/d78/d85/f93 0 2023-12-17T11:57:48.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/543: fdatasync d0/d10/d14/f60 0 2023-12-17T11:57:48.006 INFO:tasks.workunit.client.0.smithi002.stdout:7/552: creat d6/d17/dc/d13/d37/d4f/faa x:0 0 0 2023-12-17T11:57:48.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/600: truncate d9/d40/f6e 428766 0 2023-12-17T11:57:48.011 INFO:tasks.workunit.client.1.smithi119.stdout:7/617: dwrite d2/d4/d70/f87 [0,4194304] 0 2023-12-17T11:57:48.011 INFO:tasks.workunit.client.0.smithi002.stdout:7/553: creat d6/d17/dc/d67/d8b/fab x:0 0 0 2023-12-17T11:57:48.013 INFO:tasks.workunit.client.0.smithi002.stdout:0/508: dwrite d0/d15/d59/f6e [0,4194304] 0 2023-12-17T11:57:48.014 INFO:tasks.workunit.client.0.smithi002.stdout:0/509: fsync d0/f48 0 2023-12-17T11:57:48.015 INFO:tasks.workunit.client.0.smithi002.stdout:9/610: rmdir dc/d1d/d7c/d90/dc0 39 2023-12-17T11:57:48.015 INFO:tasks.workunit.client.0.smithi002.stdout:1/629: write d3/d6/d9/f29 [1985470,105877] 0 2023-12-17T11:57:48.015 INFO:tasks.workunit.client.0.smithi002.stdout:1/630: write d3/d6/d9/d37/d39/d43/d4a/f77 [1913045,20581] 0 2023-12-17T11:57:48.016 INFO:tasks.workunit.client.1.smithi119.stdout:9/570: dread d12/d1d/f44 [0,4194304] 0 2023-12-17T11:57:48.020 INFO:tasks.workunit.client.0.smithi002.stdout:0/510: rename d0/l1e to d0/d6/d26/d14/d19/la4 0 2023-12-17T11:57:48.020 INFO:tasks.workunit.client.0.smithi002.stdout:9/611: mknod dc/d42/da0/d72/cde 0 2023-12-17T11:57:48.021 INFO:tasks.workunit.client.1.smithi119.stdout:3/622: dread d9/fc [0,4194304] 0 2023-12-17T11:57:48.023 INFO:tasks.workunit.client.0.smithi002.stdout:9/612: rmdir dc/d42/da0/d72/d93 39 2023-12-17T11:57:48.023 INFO:tasks.workunit.client.0.smithi002.stdout:9/613: readlink dc/d42/d4f/d59/l31 0 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.0.smithi002.stdout:2/577: dwrite d3/d4/d7/d14/d2e/d37/d3f/f91 [0,4194304] 0 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.0.smithi002.stdout:2/578: dread - d3/d4/d7/d14/d2e/f69 zero size 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.0.smithi002.stdout:2/579: stat d3/d4/d7/l1c 0 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.0.smithi002.stdout:2/580: dread - d3/d4/d7/fb0 zero size 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.0.smithi002.stdout:2/581: stat d3/d4/d7/d14/d9b 0 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.1.smithi119.stdout:9/571: dread d12/d1d/f8e [0,4194304] 0 2023-12-17T11:57:48.031 INFO:tasks.workunit.client.1.smithi119.stdout:9/572: read - d12/f97 zero size 2023-12-17T11:57:48.034 INFO:tasks.workunit.client.1.smithi119.stdout:9/573: creat d12/d1d/d28/d46/d50/d92/dae/fb5 x:0 0 0 2023-12-17T11:57:48.038 INFO:tasks.workunit.client.1.smithi119.stdout:9/574: creat d12/d1d/d28/d46/d6e/fb6 x:0 0 0 2023-12-17T11:57:48.039 INFO:tasks.workunit.client.1.smithi119.stdout:9/575: chown d12/d1d/d49/f56 95220489 1 2023-12-17T11:57:48.041 INFO:tasks.workunit.client.1.smithi119.stdout:9/576: rename d12/d1d/c20 to d12/cb7 0 2023-12-17T11:57:48.044 INFO:tasks.workunit.client.0.smithi002.stdout:5/568: dwrite dc/d1a/d47/f76 [0,4194304] 0 2023-12-17T11:57:48.048 INFO:tasks.workunit.client.0.smithi002.stdout:5/569: symlink dc/d8e/lcd 0 2023-12-17T11:57:48.048 INFO:tasks.workunit.client.0.smithi002.stdout:5/570: chown dc/d1a/l41 1358379 1 2023-12-17T11:57:48.048 INFO:tasks.workunit.client.0.smithi002.stdout:5/571: fdatasync dc/d17/f55 0 2023-12-17T11:57:48.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/572: creat dc/d94/fce x:0 0 0 2023-12-17T11:57:48.052 INFO:tasks.workunit.client.0.smithi002.stdout:5/573: rename dc/d1b/d5a/d68/d97/daf to dc/d1b/d2d/dcf 0 2023-12-17T11:57:48.052 INFO:tasks.workunit.client.0.smithi002.stdout:5/574: dread - dc/d94/fce zero size 2023-12-17T11:57:48.053 INFO:tasks.workunit.client.0.smithi002.stdout:5/575: mknod dc/d17/d2f/d82/cd0 0 2023-12-17T11:57:48.053 INFO:tasks.workunit.client.0.smithi002.stdout:2/582: dread d3/d4/d7/d14/d42/f47 [0,4194304] 0 2023-12-17T11:57:48.053 INFO:tasks.workunit.client.0.smithi002.stdout:2/583: readlink d3/d4/d17/d19/d4d/d72/d83/ld2 0 2023-12-17T11:57:48.053 INFO:tasks.workunit.client.0.smithi002.stdout:5/576: creat dc/d1b/fd1 x:0 0 0 2023-12-17T11:57:48.063 INFO:tasks.workunit.client.1.smithi119.stdout:1/552: dwrite d3/db/d26/d19/f2f [0,4194304] 0 2023-12-17T11:57:48.064 INFO:tasks.workunit.client.0.smithi002.stdout:1/631: write d3/d6/d9/d37/d39/d43/fa4 [188569,45254] 0 2023-12-17T11:57:48.064 INFO:tasks.workunit.client.0.smithi002.stdout:1/632: write d3/d6/d9/d30/d9c/fa3 [724512,34559] 0 2023-12-17T11:57:48.065 INFO:tasks.workunit.client.1.smithi119.stdout:1/553: mknod d3/db/d17/d24/d20/d6c/db7/cc3 0 2023-12-17T11:57:48.066 INFO:tasks.workunit.client.1.smithi119.stdout:1/554: fdatasync d3/db/d17/d24/d20/f50 0 2023-12-17T11:57:48.066 INFO:tasks.workunit.client.1.smithi119.stdout:1/555: chown d3/db/d26/f39 917260858 1 2023-12-17T11:57:48.067 INFO:tasks.workunit.client.1.smithi119.stdout:1/556: creat d3/db/d17/d24/d20/d40/d76/d96/fc4 x:0 0 0 2023-12-17T11:57:48.068 INFO:tasks.workunit.client.0.smithi002.stdout:8/565: dwrite d3/d7/d18/d3f/d49/f4e [0,4194304] 0 2023-12-17T11:57:48.068 INFO:tasks.workunit.client.0.smithi002.stdout:2/584: unlink d3/d4/d7/d14/d34/lbd 0 2023-12-17T11:57:48.068 INFO:tasks.workunit.client.0.smithi002.stdout:2/585: fsync d3/d4/d7/d14/d1b/d5b/f63 0 2023-12-17T11:57:48.069 INFO:tasks.workunit.client.1.smithi119.stdout:1/557: creat d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/fc5 x:0 0 0 2023-12-17T11:57:48.070 INFO:tasks.workunit.client.0.smithi002.stdout:1/633: symlink d3/d2f/d4d/d95/ld3 0 2023-12-17T11:57:48.070 INFO:tasks.workunit.client.0.smithi002.stdout:5/577: rmdir dc/d1b/d5a/d96/d6c 39 2023-12-17T11:57:48.070 INFO:tasks.workunit.client.1.smithi119.stdout:1/558: symlink d3/db/d17/d24/d20/dba/dbc/d7e/da1/lc6 0 2023-12-17T11:57:48.070 INFO:tasks.workunit.client.1.smithi119.stdout:1/559: stat d3/d44/f5c 0 2023-12-17T11:57:48.071 INFO:tasks.workunit.client.1.smithi119.stdout:1/560: write d3/db/d17/f31 [532299,38208] 0 2023-12-17T11:57:48.072 INFO:tasks.workunit.client.0.smithi002.stdout:8/566: getdents d3/d7 0 2023-12-17T11:57:48.074 INFO:tasks.workunit.client.0.smithi002.stdout:1/634: link d3/d6/d16/d28/f58 d3/d6/d9/d37/d39/fd4 0 2023-12-17T11:57:48.076 INFO:tasks.workunit.client.1.smithi119.stdout:1/561: mknod d3/db/d17/d24/d20/d6c/cc7 0 2023-12-17T11:57:48.079 INFO:tasks.workunit.client.0.smithi002.stdout:5/578: rename dc/d1a/d53/d6f to dc/d17/dd2 0 2023-12-17T11:57:48.080 INFO:tasks.workunit.client.0.smithi002.stdout:8/567: link d3/d7/c8b d3/d7/d6e/daa/cbb 0 2023-12-17T11:57:48.080 INFO:tasks.workunit.client.0.smithi002.stdout:8/568: fsync d3/d8/d28/d31/d5a/d7c/f9b 0 2023-12-17T11:57:48.081 INFO:tasks.workunit.client.1.smithi119.stdout:1/562: mkdir d3/db/d26/d19/dc8 0 2023-12-17T11:57:48.081 INFO:tasks.workunit.client.1.smithi119.stdout:1/563: creat d3/db/d17/d24/d20/d40/fc9 x:0 0 0 2023-12-17T11:57:48.082 INFO:tasks.workunit.client.1.smithi119.stdout:1/564: mknod d3/db/d17/d24/d20/d6c/db7/cca 0 2023-12-17T11:57:48.083 INFO:tasks.workunit.client.0.smithi002.stdout:1/635: rmdir d3/d6/d9/d37/d39/d43/d4a/dac 39 2023-12-17T11:57:48.084 INFO:tasks.workunit.client.1.smithi119.stdout:1/565: mkdir d3/db/d17/d24/d20/dbd/dcb 0 2023-12-17T11:57:48.084 INFO:tasks.workunit.client.1.smithi119.stdout:1/566: write d3/db/d26/d19/f70 [897128,91076] 0 2023-12-17T11:57:48.085 INFO:tasks.workunit.client.1.smithi119.stdout:1/567: link d3/db/d17/d24/d20/d40/c93 d3/db/ccc 0 2023-12-17T11:57:48.086 INFO:tasks.workunit.client.1.smithi119.stdout:1/568: stat d3/db/d26/d19/d3f/d64/db2 0 2023-12-17T11:57:48.086 INFO:tasks.workunit.client.1.smithi119.stdout:1/569: chown d3/db/d17/d24/d20/dba/dbc/d7e/da1/lc6 4144 1 2023-12-17T11:57:48.086 INFO:tasks.workunit.client.1.smithi119.stdout:1/570: write d3/db/d17/d24/d20/d40/d76/d96/d99/fa6 [1031890,31625] 0 2023-12-17T11:57:48.087 INFO:tasks.workunit.client.1.smithi119.stdout:1/571: mknod d3/db/d17/d24/d20/d40/d76/d84/ccd 0 2023-12-17T11:57:48.110 INFO:tasks.workunit.client.1.smithi119.stdout:1/572: dread d3/db/d17/d24/f37 [0,4194304] 0 2023-12-17T11:57:48.112 INFO:tasks.workunit.client.1.smithi119.stdout:6/515: dwrite d2/df/d17/d79/f96 [0,4194304] 0 2023-12-17T11:57:48.116 INFO:tasks.workunit.client.0.smithi002.stdout:2/586: dread d3/d4/d7/d14/f9f [0,4194304] 0 2023-12-17T11:57:48.119 INFO:tasks.workunit.client.0.smithi002.stdout:2/587: symlink d3/d4/d8b/ld6 0 2023-12-17T11:57:48.119 INFO:tasks.workunit.client.0.smithi002.stdout:2/588: write d3/d4/d7/d14/fa8 [432573,70826] 0 2023-12-17T11:57:48.120 INFO:tasks.workunit.client.1.smithi119.stdout:7/618: dwrite d2/d4/d11/d2c/d68/d77/f79 [0,4194304] 0 2023-12-17T11:57:48.120 INFO:tasks.workunit.client.1.smithi119.stdout:7/619: fsync d2/f35 0 2023-12-17T11:57:48.122 INFO:tasks.workunit.client.0.smithi002.stdout:2/589: symlink d3/d4/d17/d19/ld7 0 2023-12-17T11:57:48.122 INFO:tasks.workunit.client.0.smithi002.stdout:2/590: write d3/d4/d7/fb0 [464690,130760] 0 2023-12-17T11:57:48.122 INFO:tasks.workunit.client.0.smithi002.stdout:2/591: dread - d3/d4/d7/d14/d34/f6c zero size 2023-12-17T11:57:48.125 INFO:tasks.workunit.client.1.smithi119.stdout:1/573: dread d3/db/d17/f30 [0,4194304] 0 2023-12-17T11:57:48.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/614: dwrite dc/d32/f53 [0,4194304] 0 2023-12-17T11:57:48.127 INFO:tasks.workunit.client.0.smithi002.stdout:9/615: stat f0 0 2023-12-17T11:57:48.128 INFO:tasks.workunit.client.0.smithi002.stdout:3/601: dwrite d9/f14 [4194304,4194304] 0 2023-12-17T11:57:48.130 INFO:tasks.workunit.client.0.smithi002.stdout:2/592: rename d3/d4/d7/d14/d42/dcb to d3/d4/d7/d14/d42/d8a/dd8 0 2023-12-17T11:57:48.131 INFO:tasks.workunit.client.0.smithi002.stdout:2/593: fsync d3/d4/f5d 0 2023-12-17T11:57:48.131 INFO:tasks.workunit.client.0.smithi002.stdout:0/511: dwrite d0/d15/f27 [0,4194304] 0 2023-12-17T11:57:48.132 INFO:tasks.workunit.client.0.smithi002.stdout:7/554: dwrite d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:57:48.132 INFO:tasks.workunit.client.0.smithi002.stdout:7/555: chown d6/d17/dc/d13/d37/d4f/f6d 4193 1 2023-12-17T11:57:48.133 INFO:tasks.workunit.client.1.smithi119.stdout:7/620: creat d2/d4/d70/dac/fc2 x:0 0 0 2023-12-17T11:57:48.137 INFO:tasks.workunit.client.1.smithi119.stdout:9/577: dwrite d12/d1d/d49/fb4 [0,4194304] 0 2023-12-17T11:57:48.137 INFO:tasks.workunit.client.1.smithi119.stdout:1/574: rename d3/db/d17/d24/l38 to d3/db/d17/d24/d20/d40/d76/d96/d99/d9d/lce 0 2023-12-17T11:57:48.140 INFO:tasks.workunit.client.0.smithi002.stdout:2/594: truncate d3/d4/d7/d14/d1b/f26 2183028 0 2023-12-17T11:57:48.140 INFO:tasks.workunit.client.0.smithi002.stdout:2/595: chown d3/d4/d17/d19/d4d/d72/d83/d94 3 1 2023-12-17T11:57:48.146 INFO:tasks.workunit.client.0.smithi002.stdout:7/556: rename d6/d17/dc/d6c/c73 to d6/d17/dc/d13/d21/d2e/d4a/d91/cac 0 2023-12-17T11:57:48.150 INFO:tasks.workunit.client.1.smithi119.stdout:7/621: rename d2/d4b to d2/d40/dc3 0 2023-12-17T11:57:48.151 INFO:tasks.workunit.client.0.smithi002.stdout:3/602: getdents d9/d15 0 2023-12-17T11:57:48.185 INFO:tasks.workunit.client.1.smithi119.stdout:6/516: dwrite d2/d61/d8a/f9a [0,4194304] 0 2023-12-17T11:57:48.185 INFO:tasks.workunit.client.0.smithi002.stdout:3/603: dread d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:48.186 INFO:tasks.workunit.client.0.smithi002.stdout:1/636: dwrite d3/d2f/fb8 [0,4194304] 0 2023-12-17T11:57:48.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/482: sync 2023-12-17T11:57:48.194 INFO:tasks.workunit.client.0.smithi002.stdout:1/637: creat d3/d5c/fd5 x:0 0 0 2023-12-17T11:57:48.194 INFO:tasks.workunit.client.0.smithi002.stdout:3/604: truncate d9/d15/f19 4767425 0 2023-12-17T11:57:48.194 INFO:tasks.workunit.client.0.smithi002.stdout:3/605: creat d9/d24/d6f/fc5 x:0 0 0 2023-12-17T11:57:48.199 INFO:tasks.workunit.client.1.smithi119.stdout:0/483: symlink d2/d66/d2e/d44/d7b/l92 0 2023-12-17T11:57:48.199 INFO:tasks.workunit.client.1.smithi119.stdout:0/484: write d2/d66/d1f/f68 [989770,61649] 0 2023-12-17T11:57:48.200 INFO:tasks.workunit.client.0.smithi002.stdout:3/606: mkdir d9/d15/d71/dbb/dc6 0 2023-12-17T11:57:48.202 INFO:tasks.workunit.client.1.smithi119.stdout:1/575: dwrite d3/db/d17/d24/d20/d6c/f86 [0,4194304] 0 2023-12-17T11:57:48.202 INFO:tasks.workunit.client.1.smithi119.stdout:1/576: stat d3/db/d17/d24/d20/f2d 0 2023-12-17T11:57:48.203 INFO:tasks.workunit.client.1.smithi119.stdout:0/485: creat d2/d66/d1f/d24/d50/d5d/f93 x:0 0 0 2023-12-17T11:57:48.207 INFO:tasks.workunit.client.1.smithi119.stdout:1/577: creat d3/fcf x:0 0 0 2023-12-17T11:57:48.209 INFO:tasks.workunit.client.0.smithi002.stdout:9/616: dread dc/d32/f7a [0,4194304] 0 2023-12-17T11:57:48.209 INFO:tasks.workunit.client.0.smithi002.stdout:3/607: creat d9/d1b/fc7 x:0 0 0 2023-12-17T11:57:48.210 INFO:tasks.workunit.client.0.smithi002.stdout:8/569: dwrite d3/f40 [0,4194304] 0 2023-12-17T11:57:48.210 INFO:tasks.workunit.client.0.smithi002.stdout:9/617: rename dc/d42/d4f/d59/d47/d4b/c66 to dc/d1d/d25/d85/dc2/d91/db2/cdf 0 2023-12-17T11:57:48.212 INFO:tasks.workunit.client.1.smithi119.stdout:9/578: dwrite ff [0,4194304] 0 2023-12-17T11:57:48.212 INFO:tasks.workunit.client.1.smithi119.stdout:1/578: mknod d3/db/d17/d24/d20/d40/d76/d84/cd0 0 2023-12-17T11:57:48.212 INFO:tasks.workunit.client.1.smithi119.stdout:1/579: truncate d3/db/d26/d5e/fb3 529900 0 2023-12-17T11:57:48.214 INFO:tasks.workunit.client.1.smithi119.stdout:0/486: symlink d2/d16/d35/l94 0 2023-12-17T11:57:48.214 INFO:tasks.workunit.client.1.smithi119.stdout:0/487: write d2/d16/d35/d39/f6e [1315161,23342] 0 2023-12-17T11:57:48.218 INFO:tasks.workunit.client.0.smithi002.stdout:3/608: creat d9/d15/d52/fc8 x:0 0 0 2023-12-17T11:57:48.218 INFO:tasks.workunit.client.0.smithi002.stdout:8/570: creat d3/d8/da/dd/db0/fbc x:0 0 0 2023-12-17T11:57:48.218 INFO:tasks.workunit.client.0.smithi002.stdout:8/571: chown d3/d8/da/dd/c6b 48755728 1 2023-12-17T11:57:48.219 INFO:tasks.workunit.client.0.smithi002.stdout:9/618: mkdir dc/d1d/d7c/d90/de0 0 2023-12-17T11:57:48.221 INFO:tasks.workunit.client.1.smithi119.stdout:9/579: creat d12/d1d/d28/d4d/d73/d78/d8b/fb8 x:0 0 0 2023-12-17T11:57:48.224 INFO:tasks.workunit.client.0.smithi002.stdout:3/609: link d9/d24/c2a d9/d15/d52/cc9 0 2023-12-17T11:57:48.225 INFO:tasks.workunit.client.1.smithi119.stdout:1/580: mkdir d3/db/d26/d8f/dd1 0 2023-12-17T11:57:48.229 INFO:tasks.workunit.client.0.smithi002.stdout:9/619: symlink dc/d42/da0/le1 0 2023-12-17T11:57:48.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/572: unlink d3/d7/d1a/l1b 0 2023-12-17T11:57:48.233 INFO:tasks.workunit.client.1.smithi119.stdout:1/581: mknod d3/cd2 0 2023-12-17T11:57:48.233 INFO:tasks.workunit.client.1.smithi119.stdout:6/517: dwrite d2/df/d17/f77 [0,4194304] 0 2023-12-17T11:57:48.233 INFO:tasks.workunit.client.1.smithi119.stdout:6/518: chown d2/d2b/d7f/l95 273 1 2023-12-17T11:57:48.234 INFO:tasks.workunit.client.1.smithi119.stdout:6/519: rmdir d2/d7e/d93 39 2023-12-17T11:57:48.234 INFO:tasks.workunit.client.0.smithi002.stdout:9/620: mkdir dc/d42/d4f/d9e/de2 0 2023-12-17T11:57:48.234 INFO:tasks.workunit.client.0.smithi002.stdout:2/596: dread d3/d4/d7/d14/d1b/f26 [0,4194304] 0 2023-12-17T11:57:48.235 INFO:tasks.workunit.client.0.smithi002.stdout:2/597: fsync d3/d4/d7/d14/d34/f46 0 2023-12-17T11:57:48.235 INFO:tasks.workunit.client.0.smithi002.stdout:8/573: unlink d3/d7/f27 0 2023-12-17T11:57:48.235 INFO:tasks.workunit.client.0.smithi002.stdout:8/574: creat d3/d8/d28/d31/d5a/d7c/fbd x:0 0 0 2023-12-17T11:57:48.238 INFO:tasks.workunit.client.1.smithi119.stdout:5/603: sync 2023-12-17T11:57:48.238 INFO:tasks.workunit.client.0.smithi002.stdout:8/575: write d3/d8/da/f8a [745548,24030] 0 2023-12-17T11:57:48.238 INFO:tasks.workunit.client.0.smithi002.stdout:8/576: stat d3/d8/da/dd/f2d 0 2023-12-17T11:57:48.238 INFO:tasks.workunit.client.0.smithi002.stdout:8/577: chown d3/d8/da/d44 83 1 2023-12-17T11:57:48.241 INFO:tasks.workunit.client.1.smithi119.stdout:5/604: unlink d1/da7/l45 0 2023-12-17T11:57:48.241 INFO:tasks.workunit.client.1.smithi119.stdout:5/605: write d1/d70/d6b/d77/fb9 [253281,3693] 0 2023-12-17T11:57:48.241 INFO:tasks.workunit.client.1.smithi119.stdout:1/582: dread d3/f65 [0,4194304] 0 2023-12-17T11:57:48.241 INFO:tasks.workunit.client.1.smithi119.stdout:1/583: getdents d3/db/d26 0 2023-12-17T11:57:48.243 INFO:tasks.workunit.client.1.smithi119.stdout:5/606: symlink d1/d70/lbe 0 2023-12-17T11:57:48.246 INFO:tasks.workunit.client.0.smithi002.stdout:0/512: dwrite d0/d6/d26/d14/d19/d2b/f42 [0,4194304] 0 2023-12-17T11:57:48.246 INFO:tasks.workunit.client.0.smithi002.stdout:0/513: read d0/d6/d26/d14/d19/d2b/f97 [996157,40494] 0 2023-12-17T11:57:48.247 INFO:tasks.workunit.client.1.smithi119.stdout:1/584: link d3/db/d17/d24/d20/dba/dbc/d7e/fbe d3/db/d17/fd3 0 2023-12-17T11:57:48.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/638: dwrite d3/d2f/d4d/f6b [0,4194304] 0 2023-12-17T11:57:48.249 INFO:tasks.workunit.client.1.smithi119.stdout:5/607: creat d1/d70/da3/fbf x:0 0 0 2023-12-17T11:57:48.252 INFO:tasks.workunit.client.0.smithi002.stdout:1/639: write d3/d6/d16/f7a [153877,2911] 0 2023-12-17T11:57:48.252 INFO:tasks.workunit.client.1.smithi119.stdout:1/585: mknod d3/db/d17/d24/d20/cd4 0 2023-12-17T11:57:48.255 INFO:tasks.workunit.client.1.smithi119.stdout:5/608: creat d1/d44/fc0 x:0 0 0 2023-12-17T11:57:48.257 INFO:tasks.workunit.client.1.smithi119.stdout:1/586: mknod d3/d44/cd5 0 2023-12-17T11:57:48.257 INFO:tasks.workunit.client.1.smithi119.stdout:1/587: write d3/db/d26/d19/d3f/d64/f98 [367429,30561] 0 2023-12-17T11:57:48.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/578: write d3/d7/d18/d3f/f60 [407854,113351] 0 2023-12-17T11:57:48.261 INFO:tasks.workunit.client.0.smithi002.stdout:8/579: write d3/d8/d28/d31/d5a/d7c/fbd [205982,49403] 0 2023-12-17T11:57:48.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/580: write d3/d8/d28/d31/d5a/f7a [414969,30868] 0 2023-12-17T11:57:48.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/581: chown d3/d7/d1a/f9c 186447857 1 2023-12-17T11:57:48.262 INFO:tasks.workunit.client.0.smithi002.stdout:8/582: chown d3/d8/d28/d31/d5a 126252668 1 2023-12-17T11:57:48.262 INFO:tasks.workunit.client.1.smithi119.stdout:5/609: mkdir d1/d36/dc1 0 2023-12-17T11:57:48.263 INFO:tasks.workunit.client.1.smithi119.stdout:4/563: sync 2023-12-17T11:57:48.263 INFO:tasks.workunit.client.1.smithi119.stdout:8/470: sync 2023-12-17T11:57:48.263 INFO:tasks.workunit.client.1.smithi119.stdout:8/471: dread - d7/f77 zero size 2023-12-17T11:57:48.263 INFO:tasks.workunit.client.1.smithi119.stdout:8/472: chown d7/da/l68 36397 1 2023-12-17T11:57:48.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/567: sync 2023-12-17T11:57:48.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.266+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe27402b180 con 0x7fe26006ae40 2023-12-17T11:57:48.268 INFO:tasks.workunit.client.0.smithi002.stdout:9/621: dread dc/d1d/d25/fa1 [0,4194304] 0 2023-12-17T11:57:48.268 INFO:tasks.workunit.client.0.smithi002.stdout:9/622: chown dc/d42/da0/d72/d93/d76/la9 812132 1 2023-12-17T11:57:48.269 INFO:tasks.workunit.client.1.smithi119.stdout:2/637: sync 2023-12-17T11:57:48.270 INFO:tasks.workunit.client.1.smithi119.stdout:0/488: dread d2/d66/f1a [0,4194304] 0 2023-12-17T11:57:48.270 INFO:tasks.workunit.client.1.smithi119.stdout:5/610: unlink d1/da7/d71/d76/d83/f9a 0 2023-12-17T11:57:48.270 INFO:tasks.workunit.client.1.smithi119.stdout:5/611: dread - d1/d70/d6b/faf zero size 2023-12-17T11:57:48.271 INFO:tasks.workunit.client.1.smithi119.stdout:3/623: sync 2023-12-17T11:57:48.271 INFO:tasks.workunit.client.1.smithi119.stdout:3/624: truncate d9/da/df/d41/d33/db4/fe0 378441 0 2023-12-17T11:57:48.271 INFO:tasks.workunit.client.1.smithi119.stdout:3/625: fdatasync d9/d11/f3f 0 2023-12-17T11:57:48.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.269+0000 7fe26affd700 1 -- 172.21.15.2:0/4191272927 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe27402b180 con 0x7fe26006ae40 2023-12-17T11:57:48.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/557: dwrite d6/d17/dc/d13/d21/d2e/f7f [0,4194304] 0 2023-12-17T11:57:48.272 INFO:tasks.workunit.client.0.smithi002.stdout:7/558: chown d6/d17/dc/d13/d21/d2e/d4a/d53 20864 1 2023-12-17T11:57:48.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fe26006ae40 msgr2=0x7fe26006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:48.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fe26006ae40 0x7fe26006d2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe264009fd0 tx=0x7fe2640091a0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 msgr2=0x7fe27411da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:48.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe27411da90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe270009360 tx=0x7fe270009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 shutdown_connections 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fe26006ae40 0x7fe26006d2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe274072540 0x7fe27411da90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 --2- 172.21.15.2:0/4191272927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2740737a0 0x7fe27411dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 >> 172.21.15.2:0/4191272927 conn(0x7fe2740fa5d0 msgr2=0x7fe2740fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 shutdown_connections 2023-12-17T11:57:48.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.272+0000 7fe27c2db700 1 -- 172.21.15.2:0/4191272927 wait complete. 2023-12-17T11:57:48.277 INFO:tasks.workunit.client.1.smithi119.stdout:8/473: unlink d7/d12/d69/d67/c94 0 2023-12-17T11:57:48.284 INFO:tasks.workunit.client.0.smithi002.stdout:8/583: dread d3/d8/d28/d31/d5a/d7c/f7d [0,4194304] 0 2023-12-17T11:57:48.284 INFO:tasks.workunit.client.1.smithi119.stdout:6/520: dread d2/df/f55 [0,4194304] 0 2023-12-17T11:57:48.285 INFO:tasks.workunit.client.1.smithi119.stdout:0/489: mknod d2/d16/d35/d39/c95 0 2023-12-17T11:57:48.293 INFO:tasks.workunit.client.1.smithi119.stdout:5/612: unlink d1/l1f 0 2023-12-17T11:57:48.294 INFO:tasks.workunit.client.0.smithi002.stdout:3/610: dwrite d9/d1b/d4f/f53 [0,4194304] 0 2023-12-17T11:57:48.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/559: dread d6/d17/dc/d13/d21/d6e/f7e [0,4194304] 0 2023-12-17T11:57:48.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/560: chown d6/d17/dc/d13/d21/c56 425 1 2023-12-17T11:57:48.295 INFO:tasks.workunit.client.0.smithi002.stdout:7/561: dread - d6/d17/dc/d13/d21/f8f zero size 2023-12-17T11:57:48.300 INFO:tasks.workunit.client.1.smithi119.stdout:0/490: link d2/d66/d2e/d44/l38 d2/d66/d1f/d24/d50/l96 0 2023-12-17T11:57:48.300 INFO:tasks.workunit.client.1.smithi119.stdout:0/491: dread - d2/d66/d2e/f6d zero size 2023-12-17T11:57:48.302 INFO:tasks.workunit.client.0.smithi002.stdout:2/598: rmdir d3/d4 39 2023-12-17T11:57:48.302 INFO:tasks.workunit.client.0.smithi002.stdout:2/599: fdatasync d3/d4/fe 0 2023-12-17T11:57:48.305 INFO:tasks.workunit.client.1.smithi119.stdout:3/626: rmdir d9/da/df/d41/d33 39 2023-12-17T11:57:48.309 INFO:tasks.workunit.client.1.smithi119.stdout:3/627: mknod d9/da/df/cef 0 2023-12-17T11:57:48.313 INFO:tasks.workunit.client.1.smithi119.stdout:3/628: rmdir d9/d44 39 2023-12-17T11:57:48.313 INFO:tasks.workunit.client.1.smithi119.stdout:3/629: chown d9/da/c4c 16 1 2023-12-17T11:57:48.314 INFO:tasks.workunit.client.0.smithi002.stdout:6/568: mknod d0/d1/dc/d10/cbb 0 2023-12-17T11:57:48.314 INFO:tasks.workunit.client.0.smithi002.stdout:9/623: mkdir dc/d1d/d25/d85/dc2/d91/de3 0 2023-12-17T11:57:48.315 INFO:tasks.workunit.client.1.smithi119.stdout:3/630: truncate d9/da/df/d41/d33/d3a/d90/f7c 910161 0 2023-12-17T11:57:48.318 INFO:tasks.workunit.client.0.smithi002.stdout:8/584: truncate d3/d7/d1a/f6a 2269774 0 2023-12-17T11:57:48.320 INFO:tasks.workunit.client.0.smithi002.stdout:3/611: symlink d9/d15/d6a/lca 0 2023-12-17T11:57:48.321 INFO:tasks.workunit.client.0.smithi002.stdout:3/612: truncate d9/d1b/d4f/fb2 780248 0 2023-12-17T11:57:48.321 INFO:tasks.workunit.client.0.smithi002.stdout:7/562: truncate d6/d17/dc/d13/d37/f3c 8282631 0 2023-12-17T11:57:48.321 INFO:tasks.workunit.client.1.smithi119.stdout:3/631: rmdir d9/da/df/d41/d33 39 2023-12-17T11:57:48.321 INFO:tasks.workunit.client.1.smithi119.stdout:3/632: readlink d9/d11/d1e/leb 0 2023-12-17T11:57:48.324 INFO:tasks.workunit.client.0.smithi002.stdout:2/600: truncate d3/d4/d7/d14/d2e/d37/f5a 6894348 0 2023-12-17T11:57:48.324 INFO:tasks.workunit.client.0.smithi002.stdout:0/514: symlink d0/d6/d26/d25/la5 0 2023-12-17T11:57:48.324 INFO:tasks.workunit.client.0.smithi002.stdout:0/515: write d0/d6/fe [5263498,130371] 0 2023-12-17T11:57:48.326 INFO:tasks.workunit.client.0.smithi002.stdout:6/569: mkdir d0/d1/d21/d56/d8c/d93/da5/dbc 0 2023-12-17T11:57:48.326 INFO:tasks.workunit.client.0.smithi002.stdout:9/624: mkdir dc/d1d/d7c/d90/de4 0 2023-12-17T11:57:48.326 INFO:tasks.workunit.client.0.smithi002.stdout:9/625: truncate dc/d42/da0/d72/d93/d76/fc1 240464 0 2023-12-17T11:57:48.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/585: rename d3/d8/da/dd/f6c to d3/d8/da/d44/da4/fbe 0 2023-12-17T11:57:48.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/586: chown d3/d8/d28/d31/d5a/la9 24936 1 2023-12-17T11:57:48.328 INFO:tasks.workunit.client.0.smithi002.stdout:8/587: chown d3/d7/l22 22 1 2023-12-17T11:57:48.329 INFO:tasks.workunit.client.0.smithi002.stdout:8/588: dread - d3/d8/da/dd/db0/fbc zero size 2023-12-17T11:57:48.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/563: mknod d6/d17/dc/d13/d3e/cad 0 2023-12-17T11:57:48.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/564: write d6/d17/dc/d13/d21/f8f [557790,76423] 0 2023-12-17T11:57:48.330 INFO:tasks.workunit.client.0.smithi002.stdout:2/601: symlink d3/d4/d7/d14/d1b/ld9 0 2023-12-17T11:57:48.330 INFO:tasks.workunit.client.0.smithi002.stdout:2/602: fsync d3/d4/ff 0 2023-12-17T11:57:48.331 INFO:tasks.workunit.client.0.smithi002.stdout:0/516: rmdir d0/d6 39 2023-12-17T11:57:48.332 INFO:tasks.workunit.client.0.smithi002.stdout:9/626: unlink dc/d32/f51 0 2023-12-17T11:57:48.334 INFO:tasks.workunit.client.0.smithi002.stdout:3/613: rename d9/d1b/d4f/f53 to d9/d1b/d35/d41/d59/d7c/db7/fcb 0 2023-12-17T11:57:48.338 INFO:tasks.workunit.client.0.smithi002.stdout:8/589: symlink d3/d7/d18/d3f/d49/lbf 0 2023-12-17T11:57:48.338 INFO:tasks.workunit.client.0.smithi002.stdout:8/590: chown d3/d7/d6e/daa/cbb 588157 1 2023-12-17T11:57:48.338 INFO:tasks.workunit.client.0.smithi002.stdout:9/627: mkdir dc/d42/d4f/dd5/de5 0 2023-12-17T11:57:48.338 INFO:tasks.workunit.client.0.smithi002.stdout:8/591: fdatasync d3/d8/da/fa6 0 2023-12-17T11:57:48.339 INFO:tasks.workunit.client.0.smithi002.stdout:2/603: rename d3/d4/d7/d14/d1b/c44 to d3/d56/cda 0 2023-12-17T11:57:48.339 INFO:tasks.workunit.client.0.smithi002.stdout:2/604: dread - d3/d56/fa0 zero size 2023-12-17T11:57:48.339 INFO:tasks.workunit.client.0.smithi002.stdout:7/565: getdents d6/d17/dc/d13 0 2023-12-17T11:57:48.343 INFO:tasks.workunit.client.0.smithi002.stdout:9/628: symlink dc/d42/da0/d72/d93/d76/le6 0 2023-12-17T11:57:48.343 INFO:tasks.workunit.client.0.smithi002.stdout:9/629: dread - dc/d42/d4f/d59/fb8 zero size 2023-12-17T11:57:48.343 INFO:tasks.workunit.client.0.smithi002.stdout:9/630: creat dc/d42/d4f/d59/d47/fe7 x:0 0 0 2023-12-17T11:57:48.343 INFO:tasks.workunit.client.0.smithi002.stdout:9/631: chown dc/d42/d4f/d59/f33 15127034 1 2023-12-17T11:57:48.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/592: write d3/d8/da/dd/f1d [1129819,31283] 0 2023-12-17T11:57:48.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/593: stat d3/d7/f73 0 2023-12-17T11:57:48.352 INFO:tasks.workunit.client.0.smithi002.stdout:6/570: write d0/d1/dc/d17/d40/f5f [585788,86333] 0 2023-12-17T11:57:48.353 INFO:tasks.workunit.client.0.smithi002.stdout:6/571: creat d0/d1/dc/d10/fbd x:0 0 0 2023-12-17T11:57:48.371 INFO:tasks.workunit.client.0.smithi002.stdout:9/632: dread dc/d42/da0/d72/d93/f29 [0,4194304] 0 2023-12-17T11:57:48.372 INFO:tasks.workunit.client.0.smithi002.stdout:9/633: truncate dc/d1d/d7c/fab 348560 0 2023-12-17T11:57:48.372 INFO:tasks.workunit.client.0.smithi002.stdout:2/605: write d3/d4/f6 [277604,130349] 0 2023-12-17T11:57:48.372 INFO:tasks.workunit.client.0.smithi002.stdout:2/606: fsync d3/d4/d7/d14/d9b/fd1 0 2023-12-17T11:57:48.373 INFO:tasks.workunit.client.0.smithi002.stdout:9/634: rename dc/d1d/f69 to dc/d1d/fe8 0 2023-12-17T11:57:48.386 INFO:tasks.workunit.client.1.smithi119.stdout:9/580: dwrite d12/d1d/d28/d4d/d73/f74 [0,4194304] 0 2023-12-17T11:57:48.386 INFO:tasks.workunit.client.1.smithi119.stdout:9/581: read - d12/d1d/d28/d4d/d73/f96 zero size 2023-12-17T11:57:48.403 INFO:tasks.workunit.client.1.smithi119.stdout:2/638: dwrite f4 [0,4194304] 0 2023-12-17T11:57:48.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/635: dread dc/d42/da0/d72/d93/f2b [0,4194304] 0 2023-12-17T11:57:48.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/636: fdatasync dc/d42/d4f/d59/d47/d4b/fa7 0 2023-12-17T11:57:48.405 INFO:tasks.workunit.client.0.smithi002.stdout:9/637: readlink dc/d42/da0/d72/d93/l2f 0 2023-12-17T11:57:48.407 INFO:tasks.workunit.client.0.smithi002.stdout:9/638: creat dc/d1d/fe9 x:0 0 0 2023-12-17T11:57:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:48 smithi119 ceph-mon[117414]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2023-12-17T11:57:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:48 smithi119 ceph-mon[117414]: Reconfiguring daemon prometheus.smithi002 on smithi002 2023-12-17T11:57:48.409 INFO:tasks.workunit.client.0.smithi002.stdout:9/639: truncate dc/d42/da0/d72/d93/dd0/fd7 1393402 0 2023-12-17T11:57:48.420 INFO:tasks.workunit.client.1.smithi119.stdout:3/633: dread d9/d11/d1e/d55/f66 [0,4194304] 0 2023-12-17T11:57:48.434 INFO:tasks.workunit.client.1.smithi119.stdout:2/639: write d6/f40 [2362848,120739] 0 2023-12-17T11:57:48.434 INFO:tasks.workunit.client.1.smithi119.stdout:4/564: dwrite dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:48.434 INFO:tasks.workunit.client.1.smithi119.stdout:0/492: dwrite d2/d66/d2e/d44/d7b/d5/d3f/f52 [0,4194304] 0 2023-12-17T11:57:48.435 INFO:tasks.workunit.client.1.smithi119.stdout:8/474: dwrite d7/d18/d45/d9f/f6a [0,4194304] 0 2023-12-17T11:57:48.436 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:48 smithi002 ceph-mon[107131]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2023-12-17T11:57:48.436 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:48 smithi002 ceph-mon[107131]: Reconfiguring daemon prometheus.smithi002 on smithi002 2023-12-17T11:57:48.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/517: dread d0/d6/d26/d14/d19/d61/f73 [0,4194304] 0 2023-12-17T11:57:48.439 INFO:tasks.workunit.client.1.smithi119.stdout:2/640: getdents d6/d9/d52/d53/d55/d58/da5 0 2023-12-17T11:57:48.440 INFO:tasks.workunit.client.1.smithi119.stdout:0/493: rename d2/d66/d2e/d44/d7b/d5/d3f/f52 to d2/d66/d2e/d44/d7b/d5/d3f/f97 0 2023-12-17T11:57:48.441 INFO:tasks.workunit.client.1.smithi119.stdout:4/565: dread dd/d4b/f54 [0,4194304] 0 2023-12-17T11:57:48.444 INFO:tasks.workunit.client.0.smithi002.stdout:0/518: symlink d0/d15/la6 0 2023-12-17T11:57:48.444 INFO:tasks.workunit.client.0.smithi002.stdout:0/519: fsync d0/f2e 0 2023-12-17T11:57:48.445 INFO:tasks.workunit.client.1.smithi119.stdout:2/641: fsync d6/d9/f8e 0 2023-12-17T11:57:48.448 INFO:tasks.workunit.client.0.smithi002.stdout:4/544: sync 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:2/642: dread - d6/d38/f94 zero size 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:2/643: fsync d6/d2b/d4b/f77 0 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:0/494: link d2/d66/d2e/d44/d7b/d5/f4f d2/d66/d2e/d44/f98 0 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:0/495: write d2/d16/f5a [4438342,10360] 0 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:0/496: write d2/d16/d35/d39/f4a [799840,42954] 0 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:0/497: write d2/d66/d2e/d44/d7b/d5/dc/f7e [879335,36633] 0 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:0/498: chown d2/d66/d2e/f6d 11886712 1 2023-12-17T11:57:48.450 INFO:tasks.workunit.client.1.smithi119.stdout:0/499: write d2/d16/d35/d74/f83 [4154593,25210] 0 2023-12-17T11:57:48.451 INFO:tasks.workunit.client.1.smithi119.stdout:6/521: dwrite d2/df/f4b [0,4194304] 0 2023-12-17T11:57:48.461 INFO:tasks.workunit.client.0.smithi002.stdout:3/614: dwrite f6 [0,4194304] 0 2023-12-17T11:57:48.461 INFO:tasks.workunit.client.1.smithi119.stdout:4/566: rename dd/d11/l13 to dd/d15/d16/d3d/dab/lb5 0 2023-12-17T11:57:48.463 INFO:tasks.workunit.client.1.smithi119.stdout:9/582: dwrite d12/d1d/d79/f80 [0,4194304] 0 2023-12-17T11:57:48.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/545: mknod d0/d10/d21/d33/d96/cb1 0 2023-12-17T11:57:48.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/546: dread - d0/d3e/d56/d65/d78/d85/f93 zero size 2023-12-17T11:57:48.466 INFO:tasks.workunit.client.0.smithi002.stdout:7/566: dwrite d6/d17/dc/d13/d37/f9e [0,4194304] 0 2023-12-17T11:57:48.468 INFO:tasks.workunit.client.1.smithi119.stdout:0/500: creat d2/d16/d35/d39/f99 x:0 0 0 2023-12-17T11:57:48.468 INFO:tasks.workunit.client.1.smithi119.stdout:0/501: fsync d2/d66/d2e/d44/d7b/d5/d3f/f5e 0 2023-12-17T11:57:48.468 INFO:tasks.workunit.client.1.smithi119.stdout:0/502: chown d2/d66 28308 1 2023-12-17T11:57:48.469 INFO:tasks.workunit.client.0.smithi002.stdout:5/579: sync 2023-12-17T11:57:48.470 INFO:tasks.workunit.client.0.smithi002.stdout:8/594: dwrite d3/d8/d28/f8f [0,4194304] 0 2023-12-17T11:57:48.472 INFO:tasks.workunit.client.0.smithi002.stdout:0/520: dread d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:48.472 INFO:tasks.workunit.client.0.smithi002.stdout:6/572: dwrite d0/d1/f96 [0,4194304] 0 2023-12-17T11:57:48.472 INFO:tasks.workunit.client.0.smithi002.stdout:3/615: dread d9/d1b/d4f/d88/fb3 [0,4194304] 0 2023-12-17T11:57:48.481 INFO:tasks.workunit.client.1.smithi119.stdout:5/613: dwrite d1/fa8 [0,4194304] 0 2023-12-17T11:57:48.481 INFO:tasks.workunit.client.1.smithi119.stdout:5/614: chown d1/d70/d6b/f7c 209 1 2023-12-17T11:57:48.485 INFO:tasks.workunit.client.1.smithi119.stdout:4/567: write dd/d15/d16/d5a/f70 [1912854,71176] 0 2023-12-17T11:57:48.485 INFO:tasks.workunit.client.1.smithi119.stdout:2/644: rename d6/d9/d13/d1d/dbf/fc4 to d6/d2b/da3/dc0/fe2 0 2023-12-17T11:57:48.485 INFO:tasks.workunit.client.1.smithi119.stdout:2/645: chown d6/d2b/d3f/d5c 99444067 1 2023-12-17T11:57:48.489 INFO:tasks.workunit.client.0.smithi002.stdout:5/580: truncate dc/d17/f26 733846 0 2023-12-17T11:57:48.493 INFO:tasks.workunit.client.1.smithi119.stdout:3/634: dwrite d9/d11/d1e/d55/d65/f99 [0,4194304] 0 2023-12-17T11:57:48.495 INFO:tasks.workunit.client.1.smithi119.stdout:2/646: dread d6/d2b/d4b/d5d/fd3 [0,4194304] 0 2023-12-17T11:57:48.499 INFO:tasks.workunit.client.1.smithi119.stdout:6/522: write d2/d61/d8a/f9a [4123631,94737] 0 2023-12-17T11:57:48.499 INFO:tasks.workunit.client.1.smithi119.stdout:9/583: write d12/d1d/d28/d4d/f6c [2893331,90556] 0 2023-12-17T11:57:48.499 INFO:tasks.workunit.client.1.smithi119.stdout:0/503: rmdir d2 39 2023-12-17T11:57:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.503+0000 7fcab758e700 1 -- 172.21.15.2:0/1584808241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 msgr2=0x7fcab0103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.503+0000 7fcab758e700 1 --2- 172.21.15.2:0/1584808241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 0x7fcab0103600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4004940 tx=0x7fcaa4009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.503+0000 7fcab758e700 1 -- 172.21.15.2:0/1584808241 shutdown_connections 2023-12-17T11:57:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.503+0000 7fcab758e700 1 --2- 172.21.15.2:0/1584808241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab0104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.503+0000 7fcab758e700 1 --2- 172.21.15.2:0/1584808241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 0x7fcab0103600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.503+0000 7fcab758e700 1 -- 172.21.15.2:0/1584808241 >> 172.21.15.2:0/1584808241 conn(0x7fcab0072480 msgr2=0x7fcab00748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:48.506 INFO:tasks.workunit.client.1.smithi119.stdout:8/475: dwrite d7/d12/d23/f7d [0,4194304] 0 2023-12-17T11:57:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.504+0000 7fcab758e700 1 -- 172.21.15.2:0/1584808241 shutdown_connections 2023-12-17T11:57:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.504+0000 7fcab758e700 1 -- 172.21.15.2:0/1584808241 wait complete. 2023-12-17T11:57:48.507 INFO:tasks.workunit.client.0.smithi002.stdout:4/547: dread d0/d10/d21/f49 [4194304,4194304] 0 2023-12-17T11:57:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.505+0000 7fcab758e700 1 Processor -- start 2023-12-17T11:57:48.508 INFO:tasks.workunit.client.0.smithi002.stdout:8/595: rename d3/d8/d28/d31/d5a/la9 to d3/d8/da/d44/lc0 0 2023-12-17T11:57:48.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.505+0000 7fcab758e700 1 -- start start 2023-12-17T11:57:48.508 INFO:tasks.workunit.client.0.smithi002.stdout:3/616: symlink d9/d1b/d4f/d88/lcc 0 2023-12-17T11:57:48.509 INFO:tasks.workunit.client.0.smithi002.stdout:4/548: chown d0/d10/d14/d27/d57/l8f 1353 1 2023-12-17T11:57:48.509 INFO:tasks.workunit.client.0.smithi002.stdout:7/567: read d6/d17/f65 [3760076,99518] 0 2023-12-17T11:57:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.508+0000 7fcab758e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 0x7fcab007da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.508+0000 7fcab758e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab007dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.508+0000 7fcab758e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab007e5c0 con 0x7fcab0104400 2023-12-17T11:57:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.508+0000 7fcab758e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab011d6a0 con 0x7fcab01031f0 2023-12-17T11:57:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.509+0000 7fcab4b29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab007dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:48.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.509+0000 7fcab4b29700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab007dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42786/0 (socket says 172.21.15.2:42786) 2023-12-17T11:57:48.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.509+0000 7fcab4b29700 1 -- 172.21.15.2:0/4500371 learned_addr learned my addr 172.21.15.2:0/4500371 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:48.512 INFO:tasks.workunit.client.1.smithi119.stdout:7/622: sync 2023-12-17T11:57:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.511+0000 7fcab4b29700 1 -- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 msgr2=0x7fcab007da80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-17T11:57:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.511+0000 7fcab4b29700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 0x7fcab007da80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.511+0000 7fcab4b29700 1 -- 172.21.15.2:0/4500371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac005040 con 0x7fcab0104400 2023-12-17T11:57:48.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.511+0000 7fcab4b29700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab007dfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0096d0 tx=0x7fcaac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:48.518 INFO:tasks.workunit.client.1.smithi119.stdout:4/568: mknod dd/d11/d2d/cb6 0 2023-12-17T11:57:48.518 INFO:tasks.workunit.client.1.smithi119.stdout:4/569: readlink dd/d15/d16/l23 0 2023-12-17T11:57:48.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.514+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac00e840 con 0x7fcab0104400 2023-12-17T11:57:48.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.514+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcaac00f040 con 0x7fcab0104400 2023-12-17T11:57:48.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.514+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaac013d70 con 0x7fcab0104400 2023-12-17T11:57:48.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.515+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa4005040 con 0x7fcab0104400 2023-12-17T11:57:48.519 INFO:tasks.workunit.client.0.smithi002.stdout:6/573: dread d0/d1/dc/f54 [0,4194304] 0 2023-12-17T11:57:48.519 INFO:tasks.workunit.client.0.smithi002.stdout:2/607: dwrite d3/d4/d7/d14/d1b/f29 [4194304,4194304] 0 2023-12-17T11:57:48.522 INFO:tasks.workunit.client.0.smithi002.stdout:8/596: stat d3/d7/d6e/daa/cbb 0 2023-12-17T11:57:48.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.517+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab011dd30 con 0x7fcab0104400 2023-12-17T11:57:48.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.520+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0075fd0 con 0x7fcab0104400 2023-12-17T11:57:48.526 INFO:tasks.workunit.client.0.smithi002.stdout:5/581: rename dc/d17/d1c/l64 to dc/d8e/ld3 0 2023-12-17T11:57:48.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.522+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fcaac01c410 con 0x7fcab0104400 2023-12-17T11:57:48.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.526+0000 7fcaa1ffb700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fca9c06af00 0x7fca9c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:48.529 INFO:tasks.workunit.client.0.smithi002.stdout:0/521: dwrite d0/d6/d26/f3b [0,4194304] 0 2023-12-17T11:57:48.529 INFO:tasks.workunit.client.1.smithi119.stdout:3/635: truncate d9/fc 715335 0 2023-12-17T11:57:48.529 INFO:tasks.workunit.client.1.smithi119.stdout:3/636: write d9/d11/d1e/d55/f6d [14212,49238] 0 2023-12-17T11:57:48.529 INFO:tasks.workunit.client.1.smithi119.stdout:3/637: chown d9/d44/db7/ldb 0 1 2023-12-17T11:57:48.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.526+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcaac089710 con 0x7fcab0104400 2023-12-17T11:57:48.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.527+0000 7fcab532a700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fca9c06af00 0x7fca9c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:48.530 INFO:tasks.workunit.client.0.smithi002.stdout:4/549: creat d0/fb2 x:0 0 0 2023-12-17T11:57:48.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.529+0000 7fcab532a700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fca9c06af00 0x7fca9c06d3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b0d0 tx=0x7fcaa4009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:48.535 INFO:tasks.workunit.client.0.smithi002.stdout:2/608: unlink d3/l35 0 2023-12-17T11:57:48.535 INFO:tasks.workunit.client.0.smithi002.stdout:2/609: read - d3/d56/fd5 zero size 2023-12-17T11:57:48.535 INFO:tasks.workunit.client.0.smithi002.stdout:2/610: chown d3/d4/d7/d14/d1b/f26 2097375 1 2023-12-17T11:57:48.537 INFO:tasks.workunit.client.1.smithi119.stdout:0/504: mknod d2/d66/d2e/d44/c9a 0 2023-12-17T11:57:48.537 INFO:tasks.workunit.client.0.smithi002.stdout:3/617: dread d9/d15/f66 [0,4194304] 0 2023-12-17T11:57:48.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:48.537+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcaac0582f0 con 0x7fcab0104400 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:9/584: getdents d12/d1d/d49 0 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:9/585: readlink d12/d1d/d40/l76 0 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:9/586: chown d12/d1d/d28/f9a 20433 1 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:0/505: write d2/d66/d1f/f68 [623126,115943] 0 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:0/506: chown d2/d66/d2e/d44/d7b/d5/dc/f7e 26616387 1 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:0/507: fdatasync d2/d66/d2e/d44/d7b/d5/d3f/f97 0 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:0/508: dread - d2/d66/d2e/d44/d7b/d5/f55 zero size 2023-12-17T11:57:48.540 INFO:tasks.workunit.client.1.smithi119.stdout:0/509: chown d2/d16/d8c/c90 143071 1 2023-12-17T11:57:48.543 INFO:tasks.workunit.client.0.smithi002.stdout:8/597: creat d3/d7/d18/fc1 x:0 0 0 2023-12-17T11:57:48.544 INFO:tasks.workunit.client.0.smithi002.stdout:8/598: write d3/d8/d28/d31/d5a/d7c/fa7 [176432,129506] 0 2023-12-17T11:57:48.545 INFO:tasks.workunit.client.0.smithi002.stdout:6/574: dread d0/d1/dc/d17/d40/f4f [0,4194304] 0 2023-12-17T11:57:48.545 INFO:tasks.workunit.client.0.smithi002.stdout:5/582: rmdir dc/d1a/d53/da9 39 2023-12-17T11:57:48.547 INFO:tasks.workunit.client.1.smithi119.stdout:8/476: mknod d7/d18/d15/d64/ca0 0 2023-12-17T11:57:48.549 INFO:tasks.workunit.client.1.smithi119.stdout:7/623: mkdir d2/d4/d70/dac/dc4 0 2023-12-17T11:57:48.549 INFO:tasks.workunit.client.1.smithi119.stdout:7/624: chown d2/d4/d11/d3c/c51 54202 1 2023-12-17T11:57:48.550 INFO:tasks.workunit.client.1.smithi119.stdout:7/625: write d2/d4/d11/d2c/d68/d99/d6c/f7c [667724,114064] 0 2023-12-17T11:57:48.550 INFO:tasks.workunit.client.1.smithi119.stdout:7/626: write d2/d4/d11/d3c/f9e [563301,129448] 0 2023-12-17T11:57:48.550 INFO:tasks.workunit.client.0.smithi002.stdout:0/522: mknod d0/d6/d26/d14/d19/d2b/ca7 0 2023-12-17T11:57:48.552 INFO:tasks.workunit.client.1.smithi119.stdout:4/570: creat dd/d11/d2d/d9c/d55/fb7 x:0 0 0 2023-12-17T11:57:48.552 INFO:tasks.workunit.client.1.smithi119.stdout:4/571: chown dd/d15/l3f 56 1 2023-12-17T11:57:48.553 INFO:tasks.workunit.client.1.smithi119.stdout:4/572: chown dd/d11/d2d/d9c/d55/d81/c90 0 1 2023-12-17T11:57:48.553 INFO:tasks.workunit.client.1.smithi119.stdout:4/573: fsync dd/d15/d16/d3d/f77 0 2023-12-17T11:57:48.553 INFO:tasks.workunit.client.0.smithi002.stdout:0/523: write d0/d6/d26/fa2 [361574,111675] 0 2023-12-17T11:57:48.554 INFO:tasks.workunit.client.0.smithi002.stdout:2/611: symlink d3/d4/d17/d19/d4d/d72/d83/ldb 0 2023-12-17T11:57:48.556 INFO:tasks.workunit.client.1.smithi119.stdout:3/638: rmdir d9/d35/de4 0 2023-12-17T11:57:48.558 INFO:tasks.workunit.client.0.smithi002.stdout:3/618: mknod d9/d1b/d35/d41/d59/d65/da9/ccd 0 2023-12-17T11:57:48.559 INFO:tasks.workunit.client.0.smithi002.stdout:3/619: chown d9/d1b/d35/d41/c4a 9812474 1 2023-12-17T11:57:48.561 INFO:tasks.workunit.client.1.smithi119.stdout:2/647: rename d6/l5e to d6/d2b/le3 0 2023-12-17T11:57:48.561 INFO:tasks.workunit.client.1.smithi119.stdout:2/648: stat d6/d9/d13/d34/dcf/ce0 0 2023-12-17T11:57:48.566 INFO:tasks.workunit.client.1.smithi119.stdout:1/588: sync 2023-12-17T11:57:48.571 INFO:tasks.workunit.client.0.smithi002.stdout:8/599: link d3/d8/d28/d31/d5a/f80 d3/d8/da/d44/da4/fc2 0 2023-12-17T11:57:48.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/575: creat d0/d1/dc/fbe x:0 0 0 2023-12-17T11:57:48.571 INFO:tasks.workunit.client.0.smithi002.stdout:6/576: write d0/d1/dc/d17/d3c/fb5 [623624,89844] 0 2023-12-17T11:57:48.572 INFO:tasks.workunit.client.1.smithi119.stdout:9/587: dread d12/d1d/f41 [0,4194304] 0 2023-12-17T11:57:48.572 INFO:tasks.workunit.client.1.smithi119.stdout:9/588: fsync fe 0 2023-12-17T11:57:48.576 INFO:tasks.workunit.client.1.smithi119.stdout:0/510: creat d2/f9b x:0 0 0 2023-12-17T11:57:48.577 INFO:tasks.workunit.client.0.smithi002.stdout:5/583: link dc/d17/d1c/l67 dc/d17/d2f/d82/ld4 0 2023-12-17T11:57:48.580 INFO:tasks.workunit.client.1.smithi119.stdout:9/589: write d12/d1d/d28/d46/d50/f5a [561478,83355] 0 2023-12-17T11:57:48.581 INFO:tasks.workunit.client.0.smithi002.stdout:3/620: unlink d9/l54 0 2023-12-17T11:57:48.585 INFO:tasks.workunit.client.1.smithi119.stdout:7/627: creat d2/d4/d11/d2c/d55/fc5 x:0 0 0 2023-12-17T11:57:48.590 INFO:tasks.workunit.client.1.smithi119.stdout:3/639: rmdir d9/da/df/d41/d33/dea 0 2023-12-17T11:57:48.591 INFO:tasks.workunit.client.0.smithi002.stdout:8/600: mknod d3/d8/da/dd/cc3 0 2023-12-17T11:57:48.596 INFO:tasks.workunit.client.0.smithi002.stdout:6/577: creat d0/d1/d21/fbf x:0 0 0 2023-12-17T11:57:48.596 INFO:tasks.workunit.client.0.smithi002.stdout:6/578: fsync d0/d1/d21/d56/d8c/d93/da5/f8d 0 2023-12-17T11:57:48.596 INFO:tasks.workunit.client.0.smithi002.stdout:6/579: fsync d0/d1/dc/d10/f98 0 2023-12-17T11:57:48.597 INFO:tasks.workunit.client.1.smithi119.stdout:2/649: symlink d6/d9/d52/d53/d55/d58/le4 0 2023-12-17T11:57:48.601 INFO:tasks.workunit.client.0.smithi002.stdout:3/621: rename d9/d1b/d35/d41/c4a to d9/d15/d52/d85/db9/cce 0 2023-12-17T11:57:48.601 INFO:tasks.workunit.client.0.smithi002.stdout:3/622: dread - d9/d1b/d35/d41/d59/d65/f87 zero size 2023-12-17T11:57:48.602 INFO:tasks.workunit.client.1.smithi119.stdout:7/628: write d2/d4/d11/f2d [2381080,58130] 0 2023-12-17T11:57:48.602 INFO:tasks.workunit.client.1.smithi119.stdout:9/590: write d12/d1d/d49/f56 [1573746,62256] 0 2023-12-17T11:57:48.603 INFO:tasks.workunit.client.1.smithi119.stdout:9/591: creat d12/d1d/d28/d46/d6e/fb9 x:0 0 0 2023-12-17T11:57:48.608 INFO:tasks.workunit.client.1.smithi119.stdout:1/589: creat d3/db/d17/d24/d20/dba/dbc/d7e/da1/fd6 x:0 0 0 2023-12-17T11:57:48.612 INFO:tasks.workunit.client.1.smithi119.stdout:8/477: getdents d7/da/d11 0 2023-12-17T11:57:48.612 INFO:tasks.workunit.client.1.smithi119.stdout:8/478: readlink d7/l48 0 2023-12-17T11:57:48.612 INFO:tasks.workunit.client.1.smithi119.stdout:8/479: fsync d7/d18/f3d 0 2023-12-17T11:57:48.613 INFO:tasks.workunit.client.1.smithi119.stdout:8/480: dread - d7/d18/d45/f76 zero size 2023-12-17T11:57:48.613 INFO:tasks.workunit.client.0.smithi002.stdout:1/640: sync 2023-12-17T11:57:48.619 INFO:tasks.workunit.client.0.smithi002.stdout:6/580: mkdir d0/d1/dc0 0 2023-12-17T11:57:48.623 INFO:tasks.workunit.client.1.smithi119.stdout:3/640: creat d9/d59/dae/ff0 x:0 0 0 2023-12-17T11:57:48.624 INFO:tasks.workunit.client.1.smithi119.stdout:2/650: mknod d6/d9/d13/d1d/dbf/ce5 0 2023-12-17T11:57:48.626 INFO:tasks.workunit.client.0.smithi002.stdout:4/550: dwrite d0/d10/d21/f49 [4194304,4194304] 0 2023-12-17T11:57:48.627 INFO:tasks.workunit.client.0.smithi002.stdout:1/641: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/cd6 0 2023-12-17T11:57:48.627 INFO:tasks.workunit.client.1.smithi119.stdout:2/651: write f4 [2189877,68702] 0 2023-12-17T11:57:48.630 INFO:tasks.workunit.client.1.smithi119.stdout:7/629: truncate d2/f35 460350 0 2023-12-17T11:57:48.630 INFO:tasks.workunit.client.1.smithi119.stdout:1/590: truncate d3/db/d17/d24/d20/dba/dbc/f82 3916170 0 2023-12-17T11:57:48.636 INFO:tasks.workunit.client.0.smithi002.stdout:4/551: mknod d0/d3e/da5/cb3 0 2023-12-17T11:57:48.636 INFO:tasks.workunit.client.0.smithi002.stdout:4/552: truncate d0/d5a/f71 1987209 0 2023-12-17T11:57:48.636 INFO:tasks.workunit.client.1.smithi119.stdout:3/641: mknod d9/d11/d1e/d55/d65/d84/d98/de5/cf1 0 2023-12-17T11:57:48.636 INFO:tasks.workunit.client.1.smithi119.stdout:3/642: stat d9/d11/d1e/d55/d65/f99 0 2023-12-17T11:57:48.637 INFO:tasks.workunit.client.0.smithi002.stdout:1/642: creat d3/d2f/d74/dbd/fd7 x:0 0 0 2023-12-17T11:57:48.639 INFO:tasks.workunit.client.1.smithi119.stdout:7/630: unlink d2/d4/l12 0 2023-12-17T11:57:48.640 INFO:tasks.workunit.client.1.smithi119.stdout:1/591: creat d3/db/d17/d24/d20/fd7 x:0 0 0 2023-12-17T11:57:48.640 INFO:tasks.workunit.client.1.smithi119.stdout:1/592: truncate d3/db/d26/faa 232200 0 2023-12-17T11:57:48.642 INFO:tasks.workunit.client.0.smithi002.stdout:1/643: truncate d3/d6/d16/d61/f6f 7129 0 2023-12-17T11:57:48.643 INFO:tasks.workunit.client.1.smithi119.stdout:3/643: link d9/fc d9/d11/d1e/d9f/dde/ff2 0 2023-12-17T11:57:48.649 INFO:tasks.workunit.client.0.smithi002.stdout:0/524: dwrite d0/d6/d26/d14/d19/d37/f99 [0,4194304] 0 2023-12-17T11:57:48.650 INFO:tasks.workunit.client.1.smithi119.stdout:6/523: dwrite d2/d41/f68 [0,4194304] 0 2023-12-17T11:57:48.654 INFO:tasks.workunit.client.1.smithi119.stdout:1/593: rename d3/db/d17/d24/d20/d40/d76/d84/fb8 to d3/db/d17/d24/d20/dbd/dcb/fd8 0 2023-12-17T11:57:48.655 INFO:tasks.workunit.client.1.smithi119.stdout:1/594: creat d3/db/d26/d5e/fd9 x:0 0 0 2023-12-17T11:57:48.655 INFO:tasks.workunit.client.1.smithi119.stdout:2/652: write d6/d2b/d3f/f98 [742192,101425] 0 2023-12-17T11:57:48.655 INFO:tasks.workunit.client.1.smithi119.stdout:2/653: readlink d6/d38/d96/la9 0 2023-12-17T11:57:48.656 INFO:tasks.workunit.client.1.smithi119.stdout:3/644: mkdir d9/d11/d1e/d55/df3 0 2023-12-17T11:57:48.656 INFO:tasks.workunit.client.1.smithi119.stdout:3/645: fsync d9/da/df/d41/d33/d3a/d90/f7c 0 2023-12-17T11:57:48.656 INFO:tasks.workunit.client.0.smithi002.stdout:0/525: truncate d0/d6/d26/d14/d19/d2b/f97 788109 0 2023-12-17T11:57:48.660 INFO:tasks.workunit.client.0.smithi002.stdout:4/553: dread d0/f8a [0,4194304] 0 2023-12-17T11:57:48.663 INFO:tasks.workunit.client.0.smithi002.stdout:1/644: rename d3/d6/d9/d37/d39/d94 to d3/d2f/d74/dbe/dd8 0 2023-12-17T11:57:48.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/554: write d0/d10/d21/f54 [432083,13339] 0 2023-12-17T11:57:48.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/555: fdatasync d0/ff 0 2023-12-17T11:57:48.665 INFO:tasks.workunit.client.0.smithi002.stdout:4/556: fsync d0/d10/d14/d27/f79 0 2023-12-17T11:57:48.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/645: mknod d3/d6/d9/d37/d39/d43/d8f/cd9 0 2023-12-17T11:57:48.667 INFO:tasks.workunit.client.0.smithi002.stdout:8/601: dwrite d3/d7/d6e/d7f/d65/f85 [0,4194304] 0 2023-12-17T11:57:48.671 INFO:tasks.workunit.client.1.smithi119.stdout:0/511: dwrite d2/d16/d35/d74/f83 [0,4194304] 0 2023-12-17T11:57:48.671 INFO:tasks.workunit.client.1.smithi119.stdout:0/512: dread - d2/d16/d35/f85 zero size 2023-12-17T11:57:48.671 INFO:tasks.workunit.client.1.smithi119.stdout:0/513: write d2/d16/d35/f85 [384250,118937] 0 2023-12-17T11:57:48.674 INFO:tasks.workunit.client.0.smithi002.stdout:2/612: dwrite d3/d4/d7/d14/d1b/d5b/f79 [0,4194304] 0 2023-12-17T11:57:48.674 INFO:tasks.workunit.client.0.smithi002.stdout:2/613: truncate d3/d4/d7/d14/d2e/d37/f7d 433842 0 2023-12-17T11:57:48.675 INFO:tasks.workunit.client.0.smithi002.stdout:8/602: rename d3/d8/d28/d31/d5a/l87 to d3/d8/da/d44/lc4 0 2023-12-17T11:57:48.680 INFO:tasks.workunit.client.0.smithi002.stdout:9/640: sync 2023-12-17T11:57:48.681 INFO:tasks.workunit.client.0.smithi002.stdout:5/584: dwrite dc/fbc [0,4194304] 0 2023-12-17T11:57:48.681 INFO:tasks.workunit.client.0.smithi002.stdout:5/585: stat dc/d17/d2f/l54 0 2023-12-17T11:57:48.682 INFO:tasks.workunit.client.1.smithi119.stdout:4/574: dwrite dd/d11/d2d/d9c/d55/fb7 [0,4194304] 0 2023-12-17T11:57:48.682 INFO:tasks.workunit.client.1.smithi119.stdout:4/575: dread - dd/d4b/f87 zero size 2023-12-17T11:57:48.682 INFO:tasks.workunit.client.1.smithi119.stdout:4/576: write dd/d15/d16/d3d/f84 [932915,123656] 0 2023-12-17T11:57:48.682 INFO:tasks.workunit.client.1.smithi119.stdout:7/631: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:48.683 INFO:tasks.workunit.client.0.smithi002.stdout:9/641: dread - dc/d1d/d25/d85/dc2/d91/db2/fb6 zero size 2023-12-17T11:57:48.695 INFO:tasks.workunit.client.1.smithi119.stdout:9/592: dwrite d12/d1d/d28/d4d/d73/f96 [0,4194304] 0 2023-12-17T11:57:48.708 INFO:tasks.workunit.client.0.smithi002.stdout:3/623: dwrite d9/f1d [0,4194304] 0 2023-12-17T11:57:48.709 INFO:tasks.workunit.client.0.smithi002.stdout:3/624: write d9/d1b/d35/d41/d43/d4b/f57 [963637,45628] 0 2023-12-17T11:57:48.709 INFO:tasks.workunit.client.1.smithi119.stdout:6/524: dwrite d2/df/d17/f77 [0,4194304] 0 2023-12-17T11:57:48.710 INFO:tasks.workunit.client.1.smithi119.stdout:6/525: stat d2/c4d 0 2023-12-17T11:57:48.717 INFO:tasks.workunit.client.1.smithi119.stdout:8/481: dwrite d7/da/d11/d26/d49/f4b [0,4194304] 0 2023-12-17T11:57:48.720 INFO:tasks.workunit.client.0.smithi002.stdout:5/586: mknod dc/d1b/cd5 0 2023-12-17T11:57:48.724 INFO:tasks.workunit.client.1.smithi119.stdout:2/654: dwrite d6/d9/d13/d34/d88/fd4 [0,4194304] 0 2023-12-17T11:57:48.725 INFO:tasks.workunit.client.0.smithi002.stdout:9/642: creat dc/d42/da0/d72/d93/dd0/dd4/fea x:0 0 0 2023-12-17T11:57:48.731 INFO:tasks.workunit.client.1.smithi119.stdout:8/482: mknod d7/da/d1a/d84/ca1 0 2023-12-17T11:57:48.731 INFO:tasks.workunit.client.1.smithi119.stdout:8/483: read - d7/d12/d69/d67/f91 zero size 2023-12-17T11:57:48.731 INFO:tasks.workunit.client.1.smithi119.stdout:8/484: fsync d7/da/f22 0 2023-12-17T11:57:48.731 INFO:tasks.workunit.client.1.smithi119.stdout:8/485: truncate d7/da/d11/d26/f32 1513359 0 2023-12-17T11:57:48.732 INFO:tasks.workunit.client.0.smithi002.stdout:1/646: dread d3/d6/d9/d37/f6c [0,4194304] 0 2023-12-17T11:57:48.733 INFO:tasks.workunit.client.0.smithi002.stdout:5/587: mkdir dc/d8e/dd6 0 2023-12-17T11:57:48.735 INFO:tasks.workunit.client.0.smithi002.stdout:1/647: symlink d3/d6/d9/d37/lda 0 2023-12-17T11:57:48.740 INFO:tasks.workunit.client.1.smithi119.stdout:2/655: mkdir d6/d2b/d3f/d5c/de6 0 2023-12-17T11:57:48.743 INFO:tasks.workunit.client.1.smithi119.stdout:1/595: rename d3/db/f62 to d3/db/d17/d24/d20/dba/fda 0 2023-12-17T11:57:48.743 INFO:tasks.workunit.client.1.smithi119.stdout:1/596: write d3/db/d26/f7b [797406,46550] 0 2023-12-17T11:57:48.745 INFO:tasks.workunit.client.1.smithi119.stdout:3/646: rename d9/da/df/lc0 to d9/d1c/lf4 0 2023-12-17T11:57:48.745 INFO:tasks.workunit.client.1.smithi119.stdout:3/647: chown d9/f50 14 1 2023-12-17T11:57:48.747 INFO:tasks.workunit.client.1.smithi119.stdout:6/526: rename d2/df/f5d to d2/df/d17/fa4 0 2023-12-17T11:57:48.747 INFO:tasks.workunit.client.1.smithi119.stdout:6/527: write d2/df/d17/f37 [5227888,48713] 0 2023-12-17T11:57:48.748 INFO:tasks.workunit.client.1.smithi119.stdout:6/528: readlink d2/d61/l8f 0 2023-12-17T11:57:48.748 INFO:tasks.workunit.client.0.smithi002.stdout:0/526: dwrite d0/d6/d26/d25/f96 [0,4194304] 0 2023-12-17T11:57:48.749 INFO:tasks.workunit.client.1.smithi119.stdout:3/648: symlink d9/da/df/lf5 0 2023-12-17T11:57:48.752 INFO:tasks.workunit.client.1.smithi119.stdout:2/656: rename d6/d9/d13/cb1 to d6/d9/d13/d34/ce7 0 2023-12-17T11:57:48.756 INFO:tasks.workunit.client.1.smithi119.stdout:6/529: rmdir d2/d7e/d93 39 2023-12-17T11:57:48.756 INFO:tasks.workunit.client.1.smithi119.stdout:6/530: chown d2/d2b/d7f 1007093741 1 2023-12-17T11:57:48.758 INFO:tasks.workunit.client.1.smithi119.stdout:6/531: getdents d2/d7e/d93 0 2023-12-17T11:57:48.758 INFO:tasks.workunit.client.1.smithi119.stdout:6/532: creat d2/fa5 x:0 0 0 2023-12-17T11:57:48.759 INFO:tasks.workunit.client.1.smithi119.stdout:3/649: symlink d9/d11/d1e/d55/d77/lf6 0 2023-12-17T11:57:48.759 INFO:tasks.workunit.client.1.smithi119.stdout:3/650: chown d9/d11/f72 1432473 1 2023-12-17T11:57:48.760 INFO:tasks.workunit.client.1.smithi119.stdout:2/657: mkdir d6/d9/d13/d1d/de8 0 2023-12-17T11:57:48.760 INFO:tasks.workunit.client.1.smithi119.stdout:2/658: fsync d6/d38/f94 0 2023-12-17T11:57:48.761 INFO:tasks.workunit.client.0.smithi002.stdout:1/648: read d3/d2f/d4d/f5e [369,39237] 0 2023-12-17T11:57:48.761 INFO:tasks.workunit.client.0.smithi002.stdout:8/603: dwrite d3/d8/f9a [0,4194304] 0 2023-12-17T11:57:48.762 INFO:tasks.workunit.client.1.smithi119.stdout:8/486: dread d7/d12/d23/f61 [0,4194304] 0 2023-12-17T11:57:48.764 INFO:tasks.workunit.client.1.smithi119.stdout:0/514: dwrite d2/d66/d1f/f69 [0,4194304] 0 2023-12-17T11:57:48.765 INFO:tasks.workunit.client.1.smithi119.stdout:0/515: read - d2/d16/f6f zero size 2023-12-17T11:57:48.768 INFO:tasks.workunit.client.0.smithi002.stdout:4/557: dwrite d0/d10/d21/f48 [0,4194304] 0 2023-12-17T11:57:48.771 INFO:tasks.workunit.client.1.smithi119.stdout:6/533: rename d2/d2b/d7f/la0 to d2/df/d17/la6 0 2023-12-17T11:57:48.771 INFO:tasks.workunit.client.1.smithi119.stdout:9/593: truncate d12/d1d/d28/d46/d50/f5a 95132 0 2023-12-17T11:57:48.771 INFO:tasks.workunit.client.1.smithi119.stdout:8/487: mkdir d7/d18/d15/d81/da2 0 2023-12-17T11:57:48.778 INFO:tasks.workunit.client.0.smithi002.stdout:8/604: symlink d3/d7/d18/d3f/d49/lc5 0 2023-12-17T11:57:48.780 INFO:tasks.workunit.client.1.smithi119.stdout:2/659: rename d6/d9/d13/cb6 to d6/d2b/d3f/d5c/de6/ce9 0 2023-12-17T11:57:48.780 INFO:tasks.workunit.client.1.smithi119.stdout:2/660: dread - d6/d2b/d3f/d5c/f79 zero size 2023-12-17T11:57:48.780 INFO:tasks.workunit.client.1.smithi119.stdout:2/661: chown d6/d2b/d3f/d5c/l7a 4474276 1 2023-12-17T11:57:48.783 INFO:tasks.workunit.client.1.smithi119.stdout:6/534: creat d2/d2b/d7f/fa7 x:0 0 0 2023-12-17T11:57:48.786 INFO:tasks.workunit.client.1.smithi119.stdout:9/594: creat d12/d1d/d49/fba x:0 0 0 2023-12-17T11:57:48.786 INFO:tasks.workunit.client.1.smithi119.stdout:9/595: read - d12/f82 zero size 2023-12-17T11:57:48.786 INFO:tasks.workunit.client.1.smithi119.stdout:9/596: write d12/d1d/d79/f99 [325688,84743] 0 2023-12-17T11:57:48.790 INFO:tasks.workunit.client.0.smithi002.stdout:8/605: stat d3/d8/da/l67 0 2023-12-17T11:57:48.791 INFO:tasks.workunit.client.1.smithi119.stdout:7/632: dwrite d2/d4/d11/d2c/d68/d77/f79 [0,4194304] 0 2023-12-17T11:57:48.793 INFO:tasks.workunit.client.1.smithi119.stdout:2/662: rename d6/d9/d52/d53/d55/c51 to d6/d2b/d3f/d5c/cea 0 2023-12-17T11:57:48.796 INFO:tasks.workunit.client.1.smithi119.stdout:6/535: mkdir d2/d2b/d43/d5e/d92/da8 0 2023-12-17T11:57:48.796 INFO:tasks.workunit.client.0.smithi002.stdout:3/625: dwrite d9/f1e [0,4194304] 0 2023-12-17T11:57:48.796 INFO:tasks.workunit.client.0.smithi002.stdout:3/626: fdatasync d9/d1b/fa7 0 2023-12-17T11:57:48.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/606: rename d3/d7/f5d to d3/d8/d28/d31/fc6 0 2023-12-17T11:57:48.803 INFO:tasks.workunit.client.0.smithi002.stdout:4/558: rmdir d0/d10/d14/d90 0 2023-12-17T11:57:48.812 INFO:tasks.workunit.client.1.smithi119.stdout:8/488: getdents d7/d18/d15/d64 0 2023-12-17T11:57:48.813 INFO:tasks.workunit.client.0.smithi002.stdout:9/643: dread dc/d42/d4f/f92 [0,4194304] 0 2023-12-17T11:57:48.813 INFO:tasks.workunit.client.0.smithi002.stdout:1/649: dwrite d3/d6/d9/d37/d39/d43/f50 [0,4194304] 0 2023-12-17T11:57:48.813 INFO:tasks.workunit.client.1.smithi119.stdout:8/489: write d7/d18/d15/d81/f8f [5291,123888] 0 2023-12-17T11:57:48.813 INFO:tasks.workunit.client.1.smithi119.stdout:8/490: fdatasync d7/f35 0 2023-12-17T11:57:48.816 INFO:tasks.workunit.client.0.smithi002.stdout:3/627: symlink d9/d1b/d35/d41/d59/d65/da9/lcf 0 2023-12-17T11:57:48.820 INFO:tasks.workunit.client.0.smithi002.stdout:8/607: mknod d3/d8/d28/d31/d5a/db4/cc7 0 2023-12-17T11:57:48.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/608: creat d3/d8/da/d44/fc8 x:0 0 0 2023-12-17T11:57:48.821 INFO:tasks.workunit.client.1.smithi119.stdout:7/633: chown d2/c89 2 1 2023-12-17T11:57:48.822 INFO:tasks.workunit.client.0.smithi002.stdout:2/614: dwrite d3/d4/d7/d14/f92 [0,4194304] 0 2023-12-17T11:57:48.824 INFO:tasks.workunit.client.1.smithi119.stdout:2/663: mkdir d6/d9/d13/d1d/dbf/deb 0 2023-12-17T11:57:48.825 INFO:tasks.workunit.client.0.smithi002.stdout:2/615: getdents d3/d4/d7/d14/d2e 0 2023-12-17T11:57:48.825 INFO:tasks.workunit.client.0.smithi002.stdout:5/588: dwrite dc/d17/f2c [0,4194304] 0 2023-12-17T11:57:48.826 INFO:tasks.workunit.client.0.smithi002.stdout:1/650: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/cdb 0 2023-12-17T11:57:48.828 INFO:tasks.workunit.client.1.smithi119.stdout:6/536: unlink d2/d2b/d7f/l95 0 2023-12-17T11:57:48.828 INFO:tasks.workunit.client.1.smithi119.stdout:6/537: chown d2/d2b/d43/f85 488065 1 2023-12-17T11:57:48.829 INFO:tasks.workunit.client.0.smithi002.stdout:7/568: sync 2023-12-17T11:57:48.831 INFO:tasks.workunit.client.1.smithi119.stdout:8/491: symlink d7/d18/d15/d81/la3 0 2023-12-17T11:57:48.833 INFO:tasks.workunit.client.1.smithi119.stdout:6/538: symlink d2/da3/la9 0 2023-12-17T11:57:48.833 INFO:tasks.workunit.client.0.smithi002.stdout:3/628: mknod d9/d15/d52/d85/db9/cd0 0 2023-12-17T11:57:48.835 INFO:tasks.workunit.client.1.smithi119.stdout:6/539: truncate d2/d2b/f3a 2173501 0 2023-12-17T11:57:48.835 INFO:tasks.workunit.client.1.smithi119.stdout:6/540: dread - d2/fa1 zero size 2023-12-17T11:57:48.836 INFO:tasks.workunit.client.0.smithi002.stdout:9/644: dread dc/f21 [0,4194304] 0 2023-12-17T11:57:48.836 INFO:tasks.workunit.client.0.smithi002.stdout:9/645: write dc/d1d/d7c/d90/dc0/fc8 [637546,108808] 0 2023-12-17T11:57:48.840 INFO:tasks.workunit.client.1.smithi119.stdout:3/651: dwrite d9/da/f83 [0,4194304] 0 2023-12-17T11:57:48.840 INFO:tasks.workunit.client.0.smithi002.stdout:5/589: mknod dc/d8e/cd7 0 2023-12-17T11:57:48.840 INFO:tasks.workunit.client.0.smithi002.stdout:5/590: write dc/d17/d2f/fb8 [796867,33185] 0 2023-12-17T11:57:48.841 INFO:tasks.workunit.client.0.smithi002.stdout:5/591: fsync dc/d94/fce 0 2023-12-17T11:57:48.842 INFO:tasks.workunit.client.0.smithi002.stdout:1/651: symlink d3/d6/d16/dcf/ldc 0 2023-12-17T11:57:48.845 INFO:tasks.workunit.client.0.smithi002.stdout:7/569: rename d6/d17/dc/d67/d8b/d24/f31 to d6/d17/dc/d13/d21/d2e/fae 0 2023-12-17T11:57:48.847 INFO:tasks.workunit.client.1.smithi119.stdout:2/664: dread d6/f73 [0,4194304] 0 2023-12-17T11:57:48.850 INFO:tasks.workunit.client.1.smithi119.stdout:3/652: rmdir d9/da/df/d41/d33/d3a 39 2023-12-17T11:57:48.851 INFO:tasks.workunit.client.0.smithi002.stdout:3/629: unlink d9/d1b/d4f/f7d 0 2023-12-17T11:57:48.854 INFO:tasks.workunit.client.1.smithi119.stdout:6/541: write d2/f11 [496494,128672] 0 2023-12-17T11:57:48.854 INFO:tasks.workunit.client.1.smithi119.stdout:6/542: read - d2/d2b/d43/f8b zero size 2023-12-17T11:57:48.855 INFO:tasks.workunit.client.0.smithi002.stdout:0/527: dwrite d0/d6/d26/d25/f8b [0,4194304] 0 2023-12-17T11:57:48.858 INFO:tasks.workunit.client.1.smithi119.stdout:2/665: unlink d6/d9/d52/d53/d55/d58/d6b/fc8 0 2023-12-17T11:57:48.863 INFO:tasks.workunit.client.1.smithi119.stdout:3/653: rename d9/d11/d92/fd7 to d9/da/df/d41/ff7 0 2023-12-17T11:57:48.863 INFO:tasks.workunit.client.1.smithi119.stdout:3/654: creat d9/d1c/ff8 x:0 0 0 2023-12-17T11:57:48.863 INFO:tasks.workunit.client.1.smithi119.stdout:5/615: sync 2023-12-17T11:57:48.863 INFO:tasks.workunit.client.1.smithi119.stdout:5/616: write d1/f30 [4428900,70130] 0 2023-12-17T11:57:48.864 INFO:tasks.workunit.client.1.smithi119.stdout:3/655: write d9/da/df/d41/d33/d3a/d90/f94 [1869102,39922] 0 2023-12-17T11:57:48.864 INFO:tasks.workunit.client.1.smithi119.stdout:3/656: write d9/d11/d1e/d55/d65/d84/dd3/fa9 [226371,55427] 0 2023-12-17T11:57:48.865 INFO:tasks.workunit.client.1.smithi119.stdout:2/666: link d6/d9/d13/d34/fa0 d6/d9/d13/fec 0 2023-12-17T11:57:48.868 INFO:tasks.workunit.client.1.smithi119.stdout:9/597: dwrite d12/d65/f72 [0,4194304] 0 2023-12-17T11:57:48.868 INFO:tasks.workunit.client.0.smithi002.stdout:5/592: dread dc/d17/f55 [0,4194304] 0 2023-12-17T11:57:48.868 INFO:tasks.workunit.client.0.smithi002.stdout:5/593: dread - dc/d1a/fa5 zero size 2023-12-17T11:57:48.868 INFO:tasks.workunit.client.0.smithi002.stdout:5/594: stat dc/d1a/d53/c58 0 2023-12-17T11:57:48.869 INFO:tasks.workunit.client.1.smithi119.stdout:5/617: rename d1/f1e to d1/d70/da3/fc2 0 2023-12-17T11:57:48.870 INFO:tasks.workunit.client.1.smithi119.stdout:0/516: dwrite d2/d66/d2e/d44/d7b/d5/dc/f91 [0,4194304] 0 2023-12-17T11:57:48.870 INFO:tasks.workunit.client.1.smithi119.stdout:0/517: fdatasync d2/d16/f6f 0 2023-12-17T11:57:48.871 INFO:tasks.workunit.client.0.smithi002.stdout:4/559: dwrite d0/d10/d21/f49 [0,4194304] 0 2023-12-17T11:57:48.871 INFO:tasks.workunit.client.0.smithi002.stdout:4/560: fsync d0/fd 0 2023-12-17T11:57:48.871 INFO:tasks.workunit.client.1.smithi119.stdout:8/492: write d7/f16 [5412702,102289] 0 2023-12-17T11:57:48.871 INFO:tasks.workunit.client.0.smithi002.stdout:2/616: getdents d3/d4/d7/d14 0 2023-12-17T11:57:48.872 INFO:tasks.workunit.client.1.smithi119.stdout:3/657: link d9/da/df/d41/d33/l57 d9/da/df/d41/d33/d3a/lf9 0 2023-12-17T11:57:48.873 INFO:tasks.workunit.client.1.smithi119.stdout:2/667: creat d6/d2b/d3f/d5c/de6/fed x:0 0 0 2023-12-17T11:57:48.873 INFO:tasks.workunit.client.1.smithi119.stdout:2/668: chown d6/d9/d13/d1d/f2d 1990 1 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:7/570: mkdir d6/d17/dc/d13/d21/d2e/d4a/daf 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:0/528: creat d0/d6/d26/d14/d19/d37/fa8 x:0 0 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:0/529: stat d0/d6/d26/d14/f5d 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:0/530: dread - d0/d6/d26/d14/d19/d37/fa8 zero size 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:3/630: truncate d9/d1b/fc1 1175123 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/652: write d3/d6/f3a [2563749,61926] 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/653: write d3/d6/d9/d37/d39/fc7 [487148,98442] 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:1/654: truncate d3/d6/f84 4231146 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:6/581: sync 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:6/582: fdatasync d0/d1/dc/d17/d3c/fa3 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:9/646: dread dc/d1d/f3b [0,4194304] 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:5/595: rename dc/d17/d2f/d82/cc9 to dc/d1a/d53/cd8 0 2023-12-17T11:57:48.876 INFO:tasks.workunit.client.0.smithi002.stdout:9/647: chown dc/d42/f55 0 1 2023-12-17T11:57:48.879 INFO:tasks.workunit.client.0.smithi002.stdout:4/561: stat d0/d3e/d56/d65/d78/d85/la8 0 2023-12-17T11:57:48.880 INFO:tasks.workunit.client.1.smithi119.stdout:9/598: mkdir d12/d1d/d28/d46/dbb 0 2023-12-17T11:57:48.885 INFO:tasks.workunit.client.1.smithi119.stdout:5/618: mkdir d1/d70/d85/d95/dc3 0 2023-12-17T11:57:48.885 INFO:tasks.workunit.client.1.smithi119.stdout:5/619: read d1/f1a [128571,90905] 0 2023-12-17T11:57:48.889 INFO:tasks.workunit.client.0.smithi002.stdout:2/617: creat d3/d4/d8b/fdc x:0 0 0 2023-12-17T11:57:48.896 INFO:tasks.workunit.client.1.smithi119.stdout:0/518: symlink d2/d66/d2e/d44/l9c 0 2023-12-17T11:57:48.899 INFO:tasks.workunit.client.1.smithi119.stdout:3/658: getdents d9/d44/d8c 0 2023-12-17T11:57:48.899 INFO:tasks.workunit.client.1.smithi119.stdout:3/659: dread - d9/d44/d8c/fad zero size 2023-12-17T11:57:48.899 INFO:tasks.workunit.client.1.smithi119.stdout:3/660: fsync f4 0 2023-12-17T11:57:48.900 INFO:tasks.workunit.client.0.smithi002.stdout:8/609: dwrite d3/d7/d18/d3f/f57 [0,4194304] 0 2023-12-17T11:57:48.902 INFO:tasks.workunit.client.1.smithi119.stdout:2/669: link d6/d9/d52/d74/cc1 d6/d9/d13/d34/dcf/cee 0 2023-12-17T11:57:48.903 INFO:tasks.workunit.client.1.smithi119.stdout:2/670: readlink d6/d2b/l80 0 2023-12-17T11:57:48.905 INFO:tasks.workunit.client.1.smithi119.stdout:9/599: symlink d12/d1d/d28/d4d/d73/d78/lbc 0 2023-12-17T11:57:48.905 INFO:tasks.workunit.client.0.smithi002.stdout:0/531: symlink d0/d6/d26/d14/d19/d37/d91/la9 0 2023-12-17T11:57:48.905 INFO:tasks.workunit.client.0.smithi002.stdout:7/571: mkdir d6/d17/dc/d13/d21/d2e/d4a/d53/d75/db0 0 2023-12-17T11:57:48.905 INFO:tasks.workunit.client.0.smithi002.stdout:6/583: mkdir d0/d1/d21/d56/d8c/d93/da5/dbc/dc1 0 2023-12-17T11:57:48.905 INFO:tasks.workunit.client.0.smithi002.stdout:9/648: mkdir dc/d1d/d25/d85/deb 0 2023-12-17T11:57:48.906 INFO:tasks.workunit.client.0.smithi002.stdout:0/532: chown d0/d6/d26/d14/d19/d2b/f5a 4450624 1 2023-12-17T11:57:48.906 INFO:tasks.workunit.client.0.smithi002.stdout:4/562: rename d0/d10/d14/d27/d57/l8f to d0/d10/d14/d4e/lb4 0 2023-12-17T11:57:48.906 INFO:tasks.workunit.client.0.smithi002.stdout:5/596: dread dc/d1a/d47/f4a [0,4194304] 0 2023-12-17T11:57:48.907 INFO:tasks.workunit.client.1.smithi119.stdout:5/620: rmdir d1/da7/d71/d76 39 2023-12-17T11:57:48.907 INFO:tasks.workunit.client.1.smithi119.stdout:5/621: creat d1/d70/d6b/fc4 x:0 0 0 2023-12-17T11:57:48.907 INFO:tasks.workunit.client.1.smithi119.stdout:5/622: creat d1/da7/d71/d76/d83/fc5 x:0 0 0 2023-12-17T11:57:48.908 INFO:tasks.workunit.client.0.smithi002.stdout:2/618: creat d3/d4/d8b/da6/fdd x:0 0 0 2023-12-17T11:57:48.909 INFO:tasks.workunit.client.0.smithi002.stdout:2/619: stat d3/d4/d17/d19/d4d/d72/d83 0 2023-12-17T11:57:48.910 INFO:tasks.workunit.client.0.smithi002.stdout:9/649: rmdir dc/d1d/d7c/d90/de0 0 2023-12-17T11:57:48.910 INFO:tasks.workunit.client.0.smithi002.stdout:9/650: chown dc/d42/da0/d72/d93/c3e 135268 1 2023-12-17T11:57:48.912 INFO:tasks.workunit.client.1.smithi119.stdout:0/519: rename d2/d66/d2e/d44/f5f to d2/d66/d1f/d24/f9d 0 2023-12-17T11:57:48.912 INFO:tasks.workunit.client.1.smithi119.stdout:0/520: creat d2/d16/d35/d39/f9e x:0 0 0 2023-12-17T11:57:48.912 INFO:tasks.workunit.client.1.smithi119.stdout:6/543: dread d2/d2b/d43/f58 [0,4194304] 0 2023-12-17T11:57:48.914 INFO:tasks.workunit.client.0.smithi002.stdout:7/572: mkdir d6/d17/dc/d13/d21/d2e/d4a/daf/db1 0 2023-12-17T11:57:48.916 INFO:tasks.workunit.client.1.smithi119.stdout:3/661: creat d9/da/dcc/ffa x:0 0 0 2023-12-17T11:57:48.919 INFO:tasks.workunit.client.1.smithi119.stdout:2/671: symlink d6/d2b/d3f/d5b/lef 0 2023-12-17T11:57:48.919 INFO:tasks.workunit.client.1.smithi119.stdout:2/672: creat d6/d9/d52/d53/ff0 x:0 0 0 2023-12-17T11:57:48.923 INFO:tasks.workunit.client.0.smithi002.stdout:4/563: symlink d0/d10/d21/d33/lb5 0 2023-12-17T11:57:48.923 INFO:tasks.workunit.client.0.smithi002.stdout:4/564: fsync d0/d10/d14/d27/d57/f7b 0 2023-12-17T11:57:48.923 INFO:tasks.workunit.client.0.smithi002.stdout:4/565: dread - d0/d5a/f76 zero size 2023-12-17T11:57:48.923 INFO:tasks.workunit.client.0.smithi002.stdout:4/566: creat d0/d3e/d56/d65/fb6 x:0 0 0 2023-12-17T11:57:48.924 INFO:tasks.workunit.client.0.smithi002.stdout:0/533: write d0/d6/d26/d14/d19/d37/f39 [4025956,56291] 0 2023-12-17T11:57:48.924 INFO:tasks.workunit.client.1.smithi119.stdout:9/600: dread d12/d1d/d49/f52 [0,4194304] 0 2023-12-17T11:57:48.927 INFO:tasks.workunit.client.0.smithi002.stdout:5/597: rename c5 to dc/d1b/d5a/d96/d6c/da0/cd9 0 2023-12-17T11:57:48.935 INFO:tasks.workunit.client.0.smithi002.stdout:2/620: getdents d3/d4/d17/d19 0 2023-12-17T11:57:48.939 INFO:tasks.workunit.client.1.smithi119.stdout:5/623: rename d1/d25/f4f to d1/d70/d6b/d77/dae/fc6 0 2023-12-17T11:57:48.943 INFO:tasks.workunit.client.0.smithi002.stdout:9/651: write dc/d32/f77 [282876,73438] 0 2023-12-17T11:57:48.943 INFO:tasks.workunit.client.0.smithi002.stdout:8/610: dread d3/d8/f42 [0,4194304] 0 2023-12-17T11:57:48.947 INFO:tasks.workunit.client.0.smithi002.stdout:4/567: creat d0/d10/d14/d27/d57/d7d/fb7 x:0 0 0 2023-12-17T11:57:48.952 INFO:tasks.workunit.client.0.smithi002.stdout:7/573: dread d6/d17/dc/d67/d8b/d24/f43 [0,4194304] 0 2023-12-17T11:57:48.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/574: read d6/d17/dc/d13/d37/d4f/f6d [1174436,104873] 0 2023-12-17T11:57:48.956 INFO:tasks.workunit.client.0.smithi002.stdout:5/598: rename dc/d17/f2c to dc/d1b/d2d/dc8/fda 0 2023-12-17T11:57:48.967 INFO:tasks.workunit.client.1.smithi119.stdout:8/493: dwrite d7/da/d1a/f1c [0,4194304] 0 2023-12-17T11:57:48.968 INFO:tasks.workunit.client.1.smithi119.stdout:0/521: rename d2/d66/d2e/d44/c9a to d2/d66/d1f/d24/d50/d5d/d80/c9f 0 2023-12-17T11:57:48.968 INFO:tasks.workunit.client.1.smithi119.stdout:0/522: write d2/d66/d2e/d44/d7b/f14 [1486449,40304] 0 2023-12-17T11:57:48.973 INFO:tasks.workunit.client.1.smithi119.stdout:5/624: link d1/d25/l27 d1/d70/d6b/d77/lc7 0 2023-12-17T11:57:48.979 INFO:tasks.workunit.client.1.smithi119.stdout:8/494: mknod d7/da/d1a/d84/ca4 0 2023-12-17T11:57:48.979 INFO:tasks.workunit.client.1.smithi119.stdout:8/495: write d7/d18/d45/f56 [2118934,60386] 0 2023-12-17T11:57:48.979 INFO:tasks.workunit.client.1.smithi119.stdout:8/496: truncate d7/d18/d45/f53 86090 0 2023-12-17T11:57:48.979 INFO:tasks.workunit.client.1.smithi119.stdout:8/497: chown d7/d18/d45/d9f/c88 86 1 2023-12-17T11:57:48.985 INFO:tasks.workunit.client.1.smithi119.stdout:5/625: creat d1/d70/d85/d95/fc8 x:0 0 0 2023-12-17T11:57:48.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/631: dwrite d9/d15/d52/fc8 [0,4194304] 0 2023-12-17T11:57:48.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/632: chown d9/d24/d6f/d84/cc4 338522275 1 2023-12-17T11:57:48.992 INFO:tasks.workunit.client.0.smithi002.stdout:5/599: dread dc/d1a/d47/d9b/f9c [0,4194304] 0 2023-12-17T11:57:48.992 INFO:tasks.workunit.client.0.smithi002.stdout:9/652: symlink dc/d1d/d25/d85/dc2/ddd/lec 0 2023-12-17T11:57:48.992 INFO:tasks.workunit.client.0.smithi002.stdout:2/621: mkdir d3/d4/d7/d14/d34/dde 0 2023-12-17T11:57:48.994 INFO:tasks.workunit.client.0.smithi002.stdout:8/611: symlink d3/d8/d28/d31/d5a/d7c/lc9 0 2023-12-17T11:57:48.995 INFO:tasks.workunit.client.0.smithi002.stdout:3/633: read d9/d40/f6e [356227,23538] 0 2023-12-17T11:57:48.995 INFO:tasks.workunit.client.0.smithi002.stdout:8/612: chown d3/d7/d18/d3f/d49/f52 256951 1 2023-12-17T11:57:48.996 INFO:tasks.workunit.client.0.smithi002.stdout:1/655: dwrite d3/d2f/fb9 [0,4194304] 0 2023-12-17T11:57:48.996 INFO:tasks.workunit.client.0.smithi002.stdout:1/656: truncate d3/d6/d9/d37/d39/d43/d4a/f77 2605908 0 2023-12-17T11:57:48.997 INFO:tasks.workunit.client.1.smithi119.stdout:5/626: truncate d1/d25/f46 2994019 0 2023-12-17T11:57:48.998 INFO:tasks.workunit.client.1.smithi119.stdout:6/544: dwrite d2/df/d17/d79/f96 [4194304,4194304] 0 2023-12-17T11:57:48.998 INFO:tasks.workunit.client.1.smithi119.stdout:3/662: rename d9/d11/d92 to d9/d35/dbd/dfb 0 2023-12-17T11:57:48.998 INFO:tasks.workunit.client.1.smithi119.stdout:3/663: creat d9/d35/ffc x:0 0 0 2023-12-17T11:57:48.998 INFO:tasks.workunit.client.1.smithi119.stdout:0/523: write d2/d66/d2e/d44/d7b/d5/d3f/f97 [785034,89592] 0 2023-12-17T11:57:48.999 INFO:tasks.workunit.client.1.smithi119.stdout:2/673: dwrite d6/d2b/d4b/d81/f82 [0,4194304] 0 2023-12-17T11:57:48.999 INFO:tasks.workunit.client.0.smithi002.stdout:7/575: mknod d6/d17/dc/d67/cb2 0 2023-12-17T11:57:49.000 INFO:tasks.workunit.client.0.smithi002.stdout:7/576: write d6/d99/f9c [274127,52172] 0 2023-12-17T11:57:49.003 INFO:tasks.workunit.client.0.smithi002.stdout:0/534: dwrite d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:49.006 INFO:tasks.workunit.client.0.smithi002.stdout:5/600: symlink dc/ldb 0 2023-12-17T11:57:49.010 INFO:tasks.workunit.client.0.smithi002.stdout:2/622: rename d3/d4/d7/d14/f9f to d3/d4/d43/fdf 0 2023-12-17T11:57:49.018 INFO:tasks.workunit.client.1.smithi119.stdout:9/601: dwrite d12/d1d/d49/fba [0,4194304] 0 2023-12-17T11:57:49.020 INFO:tasks.workunit.client.1.smithi119.stdout:5/627: dread d1/f51 [0,4194304] 0 2023-12-17T11:57:49.022 INFO:tasks.workunit.client.1.smithi119.stdout:3/664: link d9/l71 d9/da/df/d41/lfd 0 2023-12-17T11:57:49.026 INFO:tasks.workunit.client.0.smithi002.stdout:8/613: mkdir d3/dca 0 2023-12-17T11:57:49.027 INFO:tasks.workunit.client.0.smithi002.stdout:8/614: creat d3/d8/da/fcb x:0 0 0 2023-12-17T11:57:49.027 INFO:tasks.workunit.client.0.smithi002.stdout:8/615: fdatasync d3/d8/d28/d31/d5a/d7c/f9b 0 2023-12-17T11:57:49.028 INFO:tasks.workunit.client.0.smithi002.stdout:8/616: readlink d3/d8/da/d44/lc0 0 2023-12-17T11:57:49.029 INFO:tasks.workunit.client.0.smithi002.stdout:1/657: creat d3/d6/d9/d37/d39/d43/fdd x:0 0 0 2023-12-17T11:57:49.031 INFO:tasks.workunit.client.1.smithi119.stdout:0/524: creat d2/d66/d2e/d44/d7b/d5/dc/fa0 x:0 0 0 2023-12-17T11:57:49.032 INFO:tasks.workunit.client.1.smithi119.stdout:0/525: dread - d2/d16/f6f zero size 2023-12-17T11:57:49.032 INFO:tasks.workunit.client.1.smithi119.stdout:0/526: creat d2/d16/d35/d39/fa1 x:0 0 0 2023-12-17T11:57:49.033 INFO:tasks.workunit.client.0.smithi002.stdout:7/577: unlink d6/d17/dc/d67/d8b/c40 0 2023-12-17T11:57:49.033 INFO:tasks.workunit.client.0.smithi002.stdout:7/578: write d6/d17/dc/d13/f57 [411327,66687] 0 2023-12-17T11:57:49.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.032+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcab011e230 con 0x7fca9c06af00 2023-12-17T11:57:49.034 INFO:tasks.workunit.client.0.smithi002.stdout:5/601: rename dc/d1b/d2d/c4c to dc/d1b/d5a/cdc 0 2023-12-17T11:57:49.034 INFO:tasks.workunit.client.0.smithi002.stdout:5/602: chown dc/d1a/d47/fc2 7 1 2023-12-17T11:57:49.037 INFO:tasks.workunit.client.1.smithi119.stdout:2/674: symlink d6/d2b/da3/lf1 0 2023-12-17T11:57:49.041 INFO:tasks.workunit.client.0.smithi002.stdout:8/617: symlink d3/d8/lcc 0 2023-12-17T11:57:49.043 INFO:tasks.workunit.client.1.smithi119.stdout:8/498: dwrite d7/da/f3f [0,4194304] 0 2023-12-17T11:57:49.044 INFO:tasks.workunit.client.1.smithi119.stdout:8/499: fsync d7/da/d11/d26/f71 0 2023-12-17T11:57:49.046 INFO:tasks.workunit.client.0.smithi002.stdout:1/658: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/dde 0 2023-12-17T11:57:49.047 INFO:tasks.workunit.client.0.smithi002.stdout:1/659: chown d3/d6/d16/d28/l92 503984156 1 2023-12-17T11:57:49.047 INFO:tasks.workunit.client.0.smithi002.stdout:1/660: write d3/d6/d9/d37/f6c [562098,26569] 0 2023-12-17T11:57:49.054 INFO:tasks.workunit.client.0.smithi002.stdout:8/618: symlink d3/d8/da/d44/lcd 0 2023-12-17T11:57:49.054 INFO:tasks.workunit.client.0.smithi002.stdout:8/619: truncate d3/d8/d28/d31/d5a/d7c/f89 884224 0 2023-12-17T11:57:49.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/579: read d6/d17/dc/d67/d8b/f70 [2854830,103068] 0 2023-12-17T11:57:49.062 INFO:tasks.workunit.client.0.smithi002.stdout:7/580: read d6/f44 [22749,85684] 0 2023-12-17T11:57:49.062 INFO:tasks.workunit.client.0.smithi002.stdout:2/623: write d3/d4/d7/fa1 [317523,46169] 0 2023-12-17T11:57:49.062 INFO:tasks.workunit.client.0.smithi002.stdout:3/634: dread d9/d1b/d35/fa6 [0,4194304] 0 2023-12-17T11:57:49.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.060+0000 7fcaa1ffb700 1 -- 172.21.15.2:0/4500371 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fcab011e230 con 0x7fca9c06af00 2023-12-17T11:57:49.063 INFO:tasks.workunit.client.0.smithi002.stdout:3/635: write d9/d24/d6f/fbd [1806699,22264] 0 2023-12-17T11:57:49.063 INFO:tasks.workunit.client.0.smithi002.stdout:3/636: chown d9/d1b/d35/d41/d43/d4b/d92 270 1 2023-12-17T11:57:49.063 INFO:tasks.workunit.client.0.smithi002.stdout:3/637: fdatasync d9/d15/f32 0 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 starting - - - - 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (7m) 37s ago 7m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (6m) 36s ago 6m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 starting - - - - 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (2m) 37s ago 2m 1560M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (2m) 37s ago 2m 13.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (2m) 36s ago 2m 143M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (2m) 36s ago 2m 12.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:9283 running (8m) 37s ago 8m 355M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 ae71c0243acd 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283 running (59s) 36s ago 6m 495M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 22ff493c069a 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (8m) 37s ago 8m 81.3M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (6m) 36s ago 6m 56.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 starting - - - - 2023-12-17T11:57:49.064 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (6m) 36s ago 6m 8845k - 1.5.0 0da6a335fe13 db4c4aade2ec 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (5m) 37s ago 5m 137M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 37s ago 5m 143M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 37s ago 5m 120M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (4m) 36s ago 4m 139M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (4m) 36s ago 4m 119M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (3m) 36s ago 3m 132M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:57:49.065 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 37s ago 6m 49.1M - 2.43.0 a07b618ecd1d 29a015410237 2023-12-17T11:57:49.065 INFO:tasks.workunit.client.0.smithi002.stdout:1/661: mknod d3/d6/d9/d37/d39/d43/d4a/cdf 0 2023-12-17T11:57:49.066 INFO:tasks.workunit.client.0.smithi002.stdout:4/568: dwrite d0/d10/d14/d4e/f80 [0,4194304] 0 2023-12-17T11:57:49.066 INFO:tasks.workunit.client.0.smithi002.stdout:4/569: write d0/d3e/d56/d65/fb6 [1018769,72760] 0 2023-12-17T11:57:49.066 INFO:tasks.workunit.client.1.smithi119.stdout:6/545: dwrite d2/d2b/d43/f85 [0,4194304] 0 2023-12-17T11:57:49.066 INFO:tasks.workunit.client.1.smithi119.stdout:2/675: write d6/d38/f57 [3760351,130686] 0 2023-12-17T11:57:49.066 INFO:tasks.workunit.client.1.smithi119.stdout:2/676: truncate d6/d38/fbc 152936 0 2023-12-17T11:57:49.066 INFO:tasks.workunit.client.1.smithi119.stdout:2/677: dread - d6/d2b/d3f/d5c/f79 zero size 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fca9c06af00 msgr2=0x7fca9c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fca9c06af00 0x7fca9c06d3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b0d0 tx=0x7fcaa4009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 msgr2=0x7fcab007dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab007dfc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0096d0 tx=0x7fcaac009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 shutdown_connections 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fca9c06af00 0x7fca9c06d3b0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b0d0 tx=0x7fcaa4009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcab01031f0 0x7fcab007da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 --2- 172.21.15.2:0/4500371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcab0104400 0x7fcab007dfc0 secure :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0096d0 tx=0x7fcaac009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.064+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 >> 172.21.15.2:0/4500371 conn(0x7fcab0072480 msgr2=0x7fcab0107630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:49.069 INFO:tasks.workunit.client.1.smithi119.stdout:9/602: mkdir d12/d1d/d40/dbd 0 2023-12-17T11:57:49.069 INFO:tasks.workunit.client.0.smithi002.stdout:8/620: symlink d3/d7/lce 0 2023-12-17T11:57:49.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.070+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 shutdown_connections 2023-12-17T11:57:49.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.070+0000 7fcab758e700 1 -- 172.21.15.2:0/4500371 wait complete. 2023-12-17T11:57:49.073 INFO:tasks.workunit.client.1.smithi119.stdout:5/628: creat d1/da7/d71/d82/d86/fc9 x:0 0 0 2023-12-17T11:57:49.077 INFO:tasks.workunit.client.0.smithi002.stdout:7/581: unlink d6/d17/dc/d13/d37/f9e 0 2023-12-17T11:57:49.080 INFO:tasks.workunit.client.0.smithi002.stdout:0/535: dwrite d0/f13 [0,4194304] 0 2023-12-17T11:57:49.081 INFO:tasks.workunit.client.0.smithi002.stdout:2/624: getdents d3/d4/d7/d14/d9b 0 2023-12-17T11:57:49.081 INFO:tasks.workunit.client.1.smithi119.stdout:0/527: symlink d2/d66/d1f/d24/d50/la2 0 2023-12-17T11:57:49.081 INFO:tasks.workunit.client.1.smithi119.stdout:0/528: truncate d2/f67 122525 0 2023-12-17T11:57:49.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/653: dwrite dc/d42/da0/d82/fa4 [0,4194304] 0 2023-12-17T11:57:49.086 INFO:tasks.workunit.client.0.smithi002.stdout:4/570: read d0/d10/f15 [890337,118117] 0 2023-12-17T11:57:49.087 INFO:tasks.workunit.client.0.smithi002.stdout:3/638: mkdir d9/d15/d52/d79/dd1 0 2023-12-17T11:57:49.094 INFO:tasks.workunit.client.1.smithi119.stdout:5/629: dread d1/d25/f68 [0,4194304] 0 2023-12-17T11:57:49.094 INFO:tasks.workunit.client.1.smithi119.stdout:5/630: getdents d1/da7/d71 0 2023-12-17T11:57:49.095 INFO:tasks.workunit.client.0.smithi002.stdout:7/582: dread d6/d17/dc/d67/f5d [0,4194304] 0 2023-12-17T11:57:49.099 INFO:tasks.workunit.client.0.smithi002.stdout:4/571: read d0/d10/d14/f60 [118813,24216] 0 2023-12-17T11:57:49.099 INFO:tasks.workunit.client.0.smithi002.stdout:4/572: creat d0/d3e/d56/d99/fb8 x:0 0 0 2023-12-17T11:57:49.100 INFO:tasks.workunit.client.1.smithi119.stdout:6/546: symlink d2/d7e/laa 0 2023-12-17T11:57:49.100 INFO:tasks.workunit.client.1.smithi119.stdout:8/500: dwrite d7/d12/d69/f74 [0,4194304] 0 2023-12-17T11:57:49.100 INFO:tasks.workunit.client.0.smithi002.stdout:5/603: dread dc/d17/d2f/f3a [0,4194304] 0 2023-12-17T11:57:49.102 INFO:tasks.workunit.client.1.smithi119.stdout:9/603: creat d12/d1d/d28/d46/d50/d92/fbe x:0 0 0 2023-12-17T11:57:49.102 INFO:tasks.workunit.client.1.smithi119.stdout:9/604: fdatasync d12/d1d/d28/f87 0 2023-12-17T11:57:49.102 INFO:tasks.workunit.client.1.smithi119.stdout:3/665: dwrite d9/f19 [0,4194304] 0 2023-12-17T11:57:49.104 INFO:tasks.workunit.client.1.smithi119.stdout:5/631: truncate d1/d44/f56 6144858 0 2023-12-17T11:57:49.117 INFO:tasks.workunit.client.0.smithi002.stdout:5/604: write dc/d1a/d47/d9b/f9c [1000408,70202] 0 2023-12-17T11:57:49.124 INFO:tasks.workunit.client.1.smithi119.stdout:9/605: rename c1 to d12/d1d/d28/d4d/d73/d78/d8b/da0/cbf 0 2023-12-17T11:57:49.131 INFO:tasks.workunit.client.0.smithi002.stdout:2/625: dread d3/d4/d7/d14/d42/f47 [0,4194304] 0 2023-12-17T11:57:49.131 INFO:tasks.workunit.client.0.smithi002.stdout:2/626: write d3/d4/f5 [5874149,24155] 0 2023-12-17T11:57:49.134 INFO:tasks.workunit.client.0.smithi002.stdout:0/536: write d0/d6/d26/d14/f53 [880821,32083] 0 2023-12-17T11:57:49.135 INFO:tasks.workunit.client.1.smithi119.stdout:2/678: dwrite d6/d38/f94 [0,4194304] 0 2023-12-17T11:57:49.137 INFO:tasks.workunit.client.0.smithi002.stdout:1/662: dwrite d3/d6/d9/d37/d39/fb3 [0,4194304] 0 2023-12-17T11:57:49.138 INFO:tasks.workunit.client.0.smithi002.stdout:1/663: creat d3/d5c/fe0 x:0 0 0 2023-12-17T11:57:49.138 INFO:tasks.workunit.client.0.smithi002.stdout:1/664: dread - d3/d6/d9/d37/d39/d43/d4a/fa5 zero size 2023-12-17T11:57:49.139 INFO:tasks.workunit.client.0.smithi002.stdout:8/621: rename d3/d7/d18/d3f/d49/f4e to d3/d8/da/d44/fcf 0 2023-12-17T11:57:49.140 INFO:tasks.workunit.client.1.smithi119.stdout:5/632: dread d1/fa8 [0,4194304] 0 2023-12-17T11:57:49.140 INFO:tasks.workunit.client.1.smithi119.stdout:8/501: link d7/d18/d15/c50 d7/d18/d45/ca5 0 2023-12-17T11:57:49.140 INFO:tasks.workunit.client.1.smithi119.stdout:8/502: dread - d7/da/d11/d60/f8b zero size 2023-12-17T11:57:49.140 INFO:tasks.workunit.client.1.smithi119.stdout:9/606: mkdir d12/d1d/d28/d46/dc0 0 2023-12-17T11:57:49.143 INFO:tasks.workunit.client.1.smithi119.stdout:0/529: dwrite d2/d66/d2e/d44/d7b/d5/d3f/f5e [0,4194304] 0 2023-12-17T11:57:49.143 INFO:tasks.workunit.client.1.smithi119.stdout:4/577: sync 2023-12-17T11:57:49.143 INFO:tasks.workunit.client.1.smithi119.stdout:1/597: sync 2023-12-17T11:57:49.148 INFO:tasks.workunit.client.1.smithi119.stdout:2/679: mkdir d6/d2b/d4b/d81/df2 0 2023-12-17T11:57:49.148 INFO:tasks.workunit.client.1.smithi119.stdout:2/680: chown d6/d2b/d3f 7 1 2023-12-17T11:57:49.152 INFO:tasks.workunit.client.0.smithi002.stdout:9/654: unlink dc/d42/d4f/d59/f4e 0 2023-12-17T11:57:49.153 INFO:tasks.workunit.client.1.smithi119.stdout:7/634: sync 2023-12-17T11:57:49.156 INFO:tasks.workunit.client.0.smithi002.stdout:3/639: symlink d9/d24/d6f/ld2 0 2023-12-17T11:57:49.156 INFO:tasks.workunit.client.0.smithi002.stdout:7/583: mkdir d6/d17/db3 0 2023-12-17T11:57:49.156 INFO:tasks.workunit.client.0.smithi002.stdout:3/640: dread - d9/d1b/d35/d41/d59/da3/fb8 zero size 2023-12-17T11:57:49.156 INFO:tasks.workunit.client.0.smithi002.stdout:4/573: rename d0/d3e/d56/d65/l9b to d0/d3e/d56/d65/lb9 0 2023-12-17T11:57:49.156 INFO:tasks.workunit.client.0.smithi002.stdout:4/574: write d0/d10/f30 [661442,108916] 0 2023-12-17T11:57:49.160 INFO:tasks.workunit.client.0.smithi002.stdout:0/537: creat d0/d33/faa x:0 0 0 2023-12-17T11:57:49.166 INFO:tasks.workunit.client.1.smithi119.stdout:6/547: dwrite d2/df/d17/d79/f8c [0,4194304] 0 2023-12-17T11:57:49.168 INFO:tasks.workunit.client.1.smithi119.stdout:8/503: write d7/da/d1a/f1c [1285539,19557] 0 2023-12-17T11:57:49.169 INFO:tasks.workunit.client.0.smithi002.stdout:1/665: unlink d3/d6/fa 0 2023-12-17T11:57:49.170 INFO:tasks.workunit.client.0.smithi002.stdout:6/584: sync 2023-12-17T11:57:49.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/605: rename dc/d1b/d2d/dc8 to dc/d1b/d5a/d68/d97/ddd 0 2023-12-17T11:57:49.179 INFO:tasks.workunit.client.1.smithi119.stdout:3/666: rmdir d9 39 2023-12-17T11:57:49.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/641: getdents d9/d15/d71/d82 0 2023-12-17T11:57:49.181 INFO:tasks.workunit.client.1.smithi119.stdout:9/607: symlink d12/d1d/d28/lc1 0 2023-12-17T11:57:49.182 INFO:tasks.workunit.client.0.smithi002.stdout:7/584: rmdir d6/d17/dc/d13/d21/d2e 39 2023-12-17T11:57:49.184 INFO:tasks.workunit.client.1.smithi119.stdout:0/530: rename d2/d66/f41 to d2/d66/d1f/d24/d50/fa3 0 2023-12-17T11:57:49.185 INFO:tasks.workunit.client.0.smithi002.stdout:4/575: symlink d0/d3e/d56/d65/d78/d85/da3/lba 0 2023-12-17T11:57:49.186 INFO:tasks.workunit.client.1.smithi119.stdout:1/598: link d3/db/d26/d19/f1e d3/d44/fdb 0 2023-12-17T11:57:49.188 INFO:tasks.workunit.client.0.smithi002.stdout:6/585: dread d0/d1/dc/d17/f91 [0,4194304] 0 2023-12-17T11:57:49.188 INFO:tasks.workunit.client.0.smithi002.stdout:6/586: chown d0/d1/dc/d10/c22 414896 1 2023-12-17T11:57:49.189 INFO:tasks.workunit.client.0.smithi002.stdout:6/587: write d0/d1/dc/d10/f86 [196361,61106] 0 2023-12-17T11:57:49.189 INFO:tasks.workunit.client.1.smithi119.stdout:2/681: creat d6/d9/d13/d34/ff3 x:0 0 0 2023-12-17T11:57:49.189 INFO:tasks.workunit.client.1.smithi119.stdout:2/682: chown d6/d38/fa6 21843614 1 2023-12-17T11:57:49.191 INFO:tasks.workunit.client.0.smithi002.stdout:1/666: rename d3/d6/d9/d30/d87/l8a to d3/d6/d16/d9f/d80/le1 0 2023-12-17T11:57:49.191 INFO:tasks.workunit.client.0.smithi002.stdout:1/667: dread - d3/d5c/fe0 zero size 2023-12-17T11:57:49.191 INFO:tasks.workunit.client.0.smithi002.stdout:1/668: stat d3/f83 0 2023-12-17T11:57:49.193 INFO:tasks.workunit.client.0.smithi002.stdout:5/606: creat dc/d1a/d53/fde x:0 0 0 2023-12-17T11:57:49.194 INFO:tasks.workunit.client.0.smithi002.stdout:5/607: write dc/d1b/d5a/d96/f36 [4318036,5489] 0 2023-12-17T11:57:49.195 INFO:tasks.workunit.client.0.smithi002.stdout:8/622: getdents d3/d7 0 2023-12-17T11:57:49.196 INFO:tasks.workunit.client.1.smithi119.stdout:8/504: getdents d7/d18/d45/d9f/d7b 0 2023-12-17T11:57:49.196 INFO:tasks.workunit.client.0.smithi002.stdout:3/642: mknod d9/d1b/d4f/d88/cd3 0 2023-12-17T11:57:49.197 INFO:tasks.workunit.client.1.smithi119.stdout:3/667: mknod d9/d35/dbd/dfb/cfe 0 2023-12-17T11:57:49.199 INFO:tasks.workunit.client.0.smithi002.stdout:1/669: truncate d3/d2f/d4d/d95/f96 2586551 0 2023-12-17T11:57:49.200 INFO:tasks.workunit.client.1.smithi119.stdout:3/668: chown d9/d11/d1e/d55/d65 53782873 1 2023-12-17T11:57:49.200 INFO:tasks.workunit.client.1.smithi119.stdout:3/669: chown d9/d59/dae 833350 1 2023-12-17T11:57:49.201 INFO:tasks.workunit.client.0.smithi002.stdout:5/608: creat dc/d17/dc0/fdf x:0 0 0 2023-12-17T11:57:49.204 INFO:tasks.workunit.client.0.smithi002.stdout:8/623: truncate d3/d7/d18/d74/f79 54076 0 2023-12-17T11:57:49.206 INFO:tasks.workunit.client.1.smithi119.stdout:1/599: link d3/db/d17/d24/f53 d3/db/d17/d24/d20/dbd/dcb/fdc 0 2023-12-17T11:57:49.209 INFO:tasks.workunit.client.0.smithi002.stdout:1/670: creat d3/d2f/fe2 x:0 0 0 2023-12-17T11:57:49.211 INFO:tasks.workunit.client.0.smithi002.stdout:5/609: link dc/d1b/d5a/d96/d6c/la4 dc/d1b/d75/le0 0 2023-12-17T11:57:49.213 INFO:tasks.workunit.client.0.smithi002.stdout:5/610: truncate dc/d1a/d53/da9/fb9 1191 0 2023-12-17T11:57:49.214 INFO:tasks.workunit.client.0.smithi002.stdout:5/611: chown dc/d17/d2f/f34 113 1 2023-12-17T11:57:49.214 INFO:tasks.workunit.client.0.smithi002.stdout:5/612: truncate dc/d1b/d5a/f5f 338814 0 2023-12-17T11:57:49.214 INFO:tasks.workunit.client.0.smithi002.stdout:8/624: truncate d3/d8/da/f88 1636217 0 2023-12-17T11:57:49.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/643: getdents d9 0 2023-12-17T11:57:49.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/588: write d0/d1/dc/f54 [1067704,108292] 0 2023-12-17T11:57:49.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/589: fdatasync d0/d1/d21/d56/f89 0 2023-12-17T11:57:49.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/590: fsync d0/d1/dc/d17/f1e 0 2023-12-17T11:57:49.215 INFO:tasks.workunit.client.0.smithi002.stdout:1/671: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3 0 2023-12-17T11:57:49.216 INFO:tasks.workunit.client.1.smithi119.stdout:2/683: getdents d6/d9/d52/d53/d55 0 2023-12-17T11:57:49.216 INFO:tasks.workunit.client.1.smithi119.stdout:8/505: rmdir d7/da/d1a/d84 39 2023-12-17T11:57:49.216 INFO:tasks.workunit.client.1.smithi119.stdout:4/578: rename dd/d15/d16/d20/d42 to dd/d11/d2d/d9c/d55/d81/db8 0 2023-12-17T11:57:49.216 INFO:tasks.workunit.client.1.smithi119.stdout:4/579: write dd/d15/d16/f45 [277307,80992] 0 2023-12-17T11:57:49.216 INFO:tasks.workunit.client.1.smithi119.stdout:4/580: chown dd/d15/d16/f1a 16262 1 2023-12-17T11:57:49.216 INFO:tasks.workunit.client.1.smithi119.stdout:4/581: write dd/d11/f74 [397777,118304] 0 2023-12-17T11:57:49.217 INFO:tasks.workunit.client.0.smithi002.stdout:8/625: link d3/d8/d28/l45 d3/d7/d6e/d7f/d65/ld0 0 2023-12-17T11:57:49.219 INFO:tasks.workunit.client.1.smithi119.stdout:2/684: unlink d6/d2b/d4b/d81/fc3 0 2023-12-17T11:57:49.219 INFO:tasks.workunit.client.1.smithi119.stdout:2/685: write d6/d38/f57 [233935,86632] 0 2023-12-17T11:57:49.224 INFO:tasks.workunit.client.0.smithi002.stdout:6/591: rename d0/d1/dc/d17/d40/f4e to d0/d1/d21/d56/d8c/d93/da5/dbc/dc1/fc2 0 2023-12-17T11:57:49.225 INFO:tasks.workunit.client.1.smithi119.stdout:7/635: rename d2/d4/ff to d2/d40/fc6 0 2023-12-17T11:57:49.229 INFO:tasks.workunit.client.1.smithi119.stdout:2/686: symlink d6/d9/d13/d34/lf4 0 2023-12-17T11:57:49.229 INFO:tasks.workunit.client.1.smithi119.stdout:3/670: dread d9/d35/f5e [0,4194304] 0 2023-12-17T11:57:49.232 INFO:tasks.workunit.client.1.smithi119.stdout:9/608: rename d12/d1d/d49/fb4 to d12/d1d/d40/dbd/fc2 0 2023-12-17T11:57:49.232 INFO:tasks.workunit.client.1.smithi119.stdout:9/609: fsync d12/d1d/f36 0 2023-12-17T11:57:49.232 INFO:tasks.workunit.client.1.smithi119.stdout:9/610: creat d12/d1d/d28/d86/d8f/fc3 x:0 0 0 2023-12-17T11:57:49.234 INFO:tasks.workunit.client.1.smithi119.stdout:5/633: dwrite d1/f6d [0,4194304] 0 2023-12-17T11:57:49.234 INFO:tasks.workunit.client.1.smithi119.stdout:5/634: chown d1/d70/d6b/f87 460081548 1 2023-12-17T11:57:49.240 INFO:tasks.workunit.client.1.smithi119.stdout:3/671: creat d9/da/df/d41/d33/d3a/d90/fff x:0 0 0 2023-12-17T11:57:49.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/644: dread d9/f1e [0,4194304] 0 2023-12-17T11:57:49.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/645: creat d9/d1b/d35/d41/d59/da3/fd4 x:0 0 0 2023-12-17T11:57:49.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/672: write d3/d6/d16/d28/f58 [2393757,8146] 0 2023-12-17T11:57:49.247 INFO:tasks.workunit.client.0.smithi002.stdout:1/673: chown d3/d2f/d74 147 1 2023-12-17T11:57:49.248 INFO:tasks.workunit.client.0.smithi002.stdout:1/674: stat d3/d6/d9/d37/d39/d43/d4a 0 2023-12-17T11:57:49.249 INFO:tasks.workunit.client.1.smithi119.stdout:9/611: truncate d12/f23 211664 0 2023-12-17T11:57:49.250 INFO:tasks.workunit.client.1.smithi119.stdout:9/612: symlink d12/d1d/d28/d46/dbb/lc4 0 2023-12-17T11:57:49.250 INFO:tasks.workunit.client.0.smithi002.stdout:3/646: mkdir d9/d15/d52/d79/dd1/dd5 0 2023-12-17T11:57:49.256 INFO:tasks.workunit.client.1.smithi119.stdout:0/531: dwrite d2/d16/f7c [0,4194304] 0 2023-12-17T11:57:49.256 INFO:tasks.workunit.client.1.smithi119.stdout:0/532: chown d2/d16/f6f 7051 1 2023-12-17T11:57:49.256 INFO:tasks.workunit.client.1.smithi119.stdout:9/613: unlink d12/l25 0 2023-12-17T11:57:49.258 INFO:tasks.workunit.client.0.smithi002.stdout:5/613: write dc/d17/d2f/d99/fba [2997304,84786] 0 2023-12-17T11:57:49.258 INFO:tasks.workunit.client.0.smithi002.stdout:9/655: dwrite dc/d42/d4f/d59/d47/f48 [0,4194304] 0 2023-12-17T11:57:49.260 INFO:tasks.workunit.client.0.smithi002.stdout:3/647: getdents d9/d15/d71 0 2023-12-17T11:57:49.265 INFO:tasks.workunit.client.0.smithi002.stdout:1/675: write d3/d2f/d4d/f6b [278305,60307] 0 2023-12-17T11:57:49.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/576: dwrite d0/d10/d14/f70 [0,4194304] 0 2023-12-17T11:57:49.279 INFO:tasks.workunit.client.0.smithi002.stdout:5/614: unlink dc/d1b/d75/l9a 0 2023-12-17T11:57:49.284 INFO:tasks.workunit.client.1.smithi119.stdout:2/687: write d6/d9/d13/d34/d88/fd4 [2302049,5713] 0 2023-12-17T11:57:49.285 INFO:tasks.workunit.client.1.smithi119.stdout:2/688: write d6/d2b/d4b/d5d/f7e [853989,54718] 0 2023-12-17T11:57:49.285 INFO:tasks.workunit.client.1.smithi119.stdout:0/533: write d2/d66/d2e/d44/d7b/d5/dc/f7e [12691,18898] 0 2023-12-17T11:57:49.291 INFO:tasks.workunit.client.1.smithi119.stdout:4/582: dread dd/f1d [0,4194304] 0 2023-12-17T11:57:49.292 INFO:tasks.workunit.client.1.smithi119.stdout:6/548: dwrite d2/d61/f82 [0,4194304] 0 2023-12-17T11:57:49.296 INFO:tasks.workunit.client.1.smithi119.stdout:9/614: dread d12/d1d/d28/d4d/d73/f96 [0,4194304] 0 2023-12-17T11:57:49.297 INFO:tasks.workunit.client.0.smithi002.stdout:4/577: creat d0/d10/d14/d4e/fbb x:0 0 0 2023-12-17T11:57:49.297 INFO:tasks.workunit.client.0.smithi002.stdout:7/585: dwrite d6/d17/f47 [4194304,4194304] 0 2023-12-17T11:57:49.297 INFO:tasks.workunit.client.0.smithi002.stdout:7/586: chown d6/d81/c84 219 1 2023-12-17T11:57:49.298 INFO:tasks.workunit.client.0.smithi002.stdout:7/587: stat d6/d17/dc/d13/d21/d2e/d4a/c68 0 2023-12-17T11:57:49.308 INFO:tasks.workunit.client.1.smithi119.stdout:0/534: unlink d2/d16/f27 0 2023-12-17T11:57:49.308 INFO:tasks.workunit.client.1.smithi119.stdout:8/506: dwrite d7/d12/f25 [0,4194304] 0 2023-12-17T11:57:49.311 INFO:tasks.workunit.client.0.smithi002.stdout:6/592: dread d0/d1/dc/d17/d40/f5f [0,4194304] 0 2023-12-17T11:57:49.315 INFO:tasks.workunit.client.1.smithi119.stdout:9/615: rename d12/d1d/d28/d4d/fb3 to d12/d1d/fc5 0 2023-12-17T11:57:49.315 INFO:tasks.workunit.client.1.smithi119.stdout:9/616: readlink ld 0 2023-12-17T11:57:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.316+0000 7f535db24700 1 -- 172.21.15.2:0/1914866672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358071bc0 msgr2=0x7f5358070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.316+0000 7f535db24700 1 --2- 172.21.15.2:0/1914866672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358071bc0 0x7f5358070030 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f534c004940 tx=0x7f534c009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.317+0000 7f535db24700 1 -- 172.21.15.2:0/1914866672 shutdown_connections 2023-12-17T11:57:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.317+0000 7f535db24700 1 --2- 172.21.15.2:0/1914866672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5358070570 0x7f53580709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.317+0000 7f535db24700 1 --2- 172.21.15.2:0/1914866672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358071bc0 0x7f5358070030 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.317+0000 7f535db24700 1 -- 172.21.15.2:0/1914866672 >> 172.21.15.2:0/1914866672 conn(0x7f53580f82d0 msgr2=0x7f53580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.317+0000 7f535db24700 1 -- 172.21.15.2:0/1914866672 shutdown_connections 2023-12-17T11:57:49.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.317+0000 7f535db24700 1 -- 172.21.15.2:0/1914866672 wait complete. 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.319+0000 7f535db24700 1 Processor -- start 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.319+0000 7f535db24700 1 -- start start 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.319+0000 7f535db24700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 0x7f5358108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.320+0000 7f535db24700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5358071bc0 0x7f5358108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.320+0000 7f535db24700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5358108c70 con 0x7f5358070570 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.320+0000 7f535db24700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535811d700 con 0x7f5358071bc0 2023-12-17T11:57:49.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.320+0000 7f53577fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 0x7f5358108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.320+0000 7f53577fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 0x7f5358108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60146/0 (socket says 172.21.15.2:60146) 2023-12-17T11:57:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.320+0000 7f53577fe700 1 -- 172.21.15.2:0/789959935 learned_addr learned my addr 172.21.15.2:0/789959935 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.321+0000 7f53577fe700 1 -- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5358071bc0 msgr2=0x7f5358108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.321+0000 7f53577fe700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5358071bc0 0x7f5358108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.321+0000 7f53577fe700 1 -- 172.21.15.2:0/789959935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c005040 con 0x7f5358070570 2023-12-17T11:57:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.321+0000 7f53577fe700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 0x7f5358108050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f534c00b3b0 tx=0x7f534c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.322+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f534c00e040 con 0x7f5358070570 2023-12-17T11:57:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.322+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535811d980 con 0x7f5358070570 2023-12-17T11:57:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.322+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f534c00bcd0 con 0x7f5358070570 2023-12-17T11:57:49.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.322+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f534c01c630 con 0x7f5358070570 2023-12-17T11:57:49.325 INFO:tasks.workunit.client.0.smithi002.stdout:0/538: dwrite d0/d6/d26/d25/f45 [0,4194304] 0 2023-12-17T11:57:49.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.323+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535811dec0 con 0x7f5358070570 2023-12-17T11:57:49.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.325+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535804bb80 con 0x7f5358070570 2023-12-17T11:57:49.329 INFO:tasks.workunit.client.0.smithi002.stdout:7/588: creat d6/d17/dc/d13/d21/d2e/d4a/daf/db1/fb4 x:0 0 0 2023-12-17T11:57:49.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.329+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f534c013420 con 0x7f5358070570 2023-12-17T11:57:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.331+0000 7f533ffff700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f534006ae40 0x7f534006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:49.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.331+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f534c08b6d0 con 0x7f5358070570 2023-12-17T11:57:49.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.333+0000 7f5356ffd700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f534006ae40 0x7f534006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:49.335 INFO:tasks.workunit.client.1.smithi119.stdout:4/583: dread dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.333+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f534c055ab0 con 0x7f5358070570 2023-12-17T11:57:49.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.334+0000 7f5356ffd700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f534006ae40 0x7f534006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5348006fd0 tx=0x7f5348006db0 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:49.337 INFO:tasks.workunit.client.0.smithi002.stdout:0/539: mkdir d0/d6/d26/d14/d90/d64/dab 0 2023-12-17T11:57:49.339 INFO:tasks.workunit.client.1.smithi119.stdout:0/535: stat d2/d66/d2e/d44/c73 0 2023-12-17T11:57:49.344 INFO:tasks.workunit.client.1.smithi119.stdout:7/636: dwrite d2/d5b/f65 [0,4194304] 0 2023-12-17T11:57:49.348 INFO:tasks.workunit.client.1.smithi119.stdout:8/507: symlink d7/d12/d69/d98/la6 0 2023-12-17T11:57:49.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/589: dread d6/d17/dc/f89 [0,4194304] 0 2023-12-17T11:57:49.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/590: chown d6/d17/dc/d13/d21/d2e/d4a/d53/d75 0 1 2023-12-17T11:57:49.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/591: dread - d6/d17/dc/d6c/d93/fa0 zero size 2023-12-17T11:57:49.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/592: chown d6/d99 1898 1 2023-12-17T11:57:49.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/593: read d6/d17/dc/d13/d21/d2e/d4a/f92 [110769,20396] 0 2023-12-17T11:57:49.351 INFO:tasks.workunit.client.0.smithi002.stdout:7/594: chown d6/d17/l19 141774 1 2023-12-17T11:57:49.352 INFO:tasks.workunit.client.1.smithi119.stdout:1/600: dwrite d3/db/d17/d24/d20/dba/dbc/f6e [0,4194304] 0 2023-12-17T11:57:49.354 INFO:tasks.workunit.client.1.smithi119.stdout:9/617: rename d12/f19 to d12/d1d/d28/d4d/d73/d78/d8b/da0/fc6 0 2023-12-17T11:57:49.354 INFO:tasks.workunit.client.1.smithi119.stdout:1/601: creat d3/db/d17/d24/d20/d40/fdd x:0 0 0 2023-12-17T11:57:49.354 INFO:tasks.workunit.client.1.smithi119.stdout:1/602: fdatasync d3/db/d17/d24/d20/dba/dbc/d7e/fbe 0 2023-12-17T11:57:49.355 INFO:tasks.workunit.client.0.smithi002.stdout:0/540: link d0/d6/d26/d14/d19/d61/l89 d0/d6/d26/lac 0 2023-12-17T11:57:49.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/648: dwrite d9/d1b/d35/d41/d59/da3/fb8 [0,4194304] 0 2023-12-17T11:57:49.359 INFO:tasks.workunit.client.0.smithi002.stdout:7/595: creat d6/d17/dc/d13/d21/d2e/fb5 x:0 0 0 2023-12-17T11:57:49.360 INFO:tasks.workunit.client.1.smithi119.stdout:3/672: dwrite d9/da/df/f32 [8388608,4194304] 0 2023-12-17T11:57:49.365 INFO:tasks.workunit.client.1.smithi119.stdout:4/584: truncate dd/d15/d16/d3d/f7c 1870119 0 2023-12-17T11:57:49.368 INFO:tasks.workunit.client.0.smithi002.stdout:3/649: dread d9/d40/f6e [0,4194304] 0 2023-12-17T11:57:49.369 INFO:tasks.workunit.client.1.smithi119.stdout:0/536: unlink d2/d66/d1f/d24/f9d 0 2023-12-17T11:57:49.371 INFO:tasks.workunit.client.0.smithi002.stdout:7/596: creat d6/d17/dc/d67/d8b/d24/da3/fb6 x:0 0 0 2023-12-17T11:57:49.372 INFO:tasks.workunit.client.0.smithi002.stdout:9/656: dwrite dc/d42/f4a [0,4194304] 0 2023-12-17T11:57:49.373 INFO:tasks.workunit.client.0.smithi002.stdout:5/615: dwrite dc/d1b/d2d/d5b/fcb [0,4194304] 0 2023-12-17T11:57:49.373 INFO:tasks.workunit.client.0.smithi002.stdout:1/676: write d3/d6/d9/d37/d39/fb3 [2960127,29446] 0 2023-12-17T11:57:49.383 INFO:tasks.workunit.client.1.smithi119.stdout:7/637: dread d2/d4/d11/d3c/d75/f83 [0,4194304] 0 2023-12-17T11:57:49.383 INFO:tasks.workunit.client.1.smithi119.stdout:6/549: dread d2/d41/f68 [0,4194304] 0 2023-12-17T11:57:49.386 INFO:tasks.workunit.client.1.smithi119.stdout:5/635: dwrite d1/da7/d71/d82/d86/f66 [4194304,4194304] 0 2023-12-17T11:57:49.387 INFO:tasks.workunit.client.1.smithi119.stdout:5/636: read - d1/da7/d71/f73 zero size 2023-12-17T11:57:49.388 INFO:tasks.workunit.client.1.smithi119.stdout:8/508: mknod d7/d18/d15/d81/da2/ca7 0 2023-12-17T11:57:49.388 INFO:tasks.workunit.client.1.smithi119.stdout:8/509: creat d7/da/d11/d60/fa8 x:0 0 0 2023-12-17T11:57:49.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/650: truncate d9/d1b/fc1 1232403 0 2023-12-17T11:57:49.396 INFO:tasks.workunit.client.0.smithi002.stdout:9/657: dread dc/f14 [0,4194304] 0 2023-12-17T11:57:49.400 INFO:tasks.workunit.client.0.smithi002.stdout:4/578: dwrite d0/f83 [4194304,4194304] 0 2023-12-17T11:57:49.405 INFO:tasks.workunit.client.1.smithi119.stdout:6/550: dread d2/df/d17/f77 [0,4194304] 0 2023-12-17T11:57:49.406 INFO:tasks.workunit.client.1.smithi119.stdout:3/673: creat d9/d35/dbd/f100 x:0 0 0 2023-12-17T11:57:49.406 INFO:tasks.workunit.client.1.smithi119.stdout:3/674: fsync d9/d11/d1e/d55/d77/faa 0 2023-12-17T11:57:49.406 INFO:tasks.workunit.client.0.smithi002.stdout:0/541: dwrite d0/d6/fb [4194304,4194304] 0 2023-12-17T11:57:49.406 INFO:tasks.workunit.client.0.smithi002.stdout:0/542: chown d0/d6/d26/d14/d19/d2b/c95 51058 1 2023-12-17T11:57:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:49 smithi119 ceph-mon[117414]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:49 smithi119 ceph-mon[117414]: pgmap v27: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 269 MiB/s rd, 342 MiB/s wr, 470 op/s 2023-12-17T11:57:49.409 INFO:tasks.workunit.client.0.smithi002.stdout:4/579: dread d0/d3e/d56/d65/d78/f92 [0,4194304] 0 2023-12-17T11:57:49.412 INFO:tasks.workunit.client.1.smithi119.stdout:4/585: creat dd/d11/d2d/d9c/d55/d81/da1/fb9 x:0 0 0 2023-12-17T11:57:49.413 INFO:tasks.workunit.client.0.smithi002.stdout:1/677: creat d3/d6/d9/d37/fe4 x:0 0 0 2023-12-17T11:57:49.414 INFO:tasks.workunit.client.1.smithi119.stdout:0/537: unlink d2/d16/d35/l94 0 2023-12-17T11:57:49.414 INFO:tasks.workunit.client.1.smithi119.stdout:0/538: fsync d2/d66/d2e/d44/d7b/d5/d3f/f5e 0 2023-12-17T11:57:49.416 INFO:tasks.workunit.client.1.smithi119.stdout:9/618: dwrite d12/d1d/d28/d4d/d73/f96 [0,4194304] 0 2023-12-17T11:57:49.416 INFO:tasks.workunit.client.0.smithi002.stdout:3/651: creat d9/d1b/d35/d41/d43/d73/fd6 x:0 0 0 2023-12-17T11:57:49.416 INFO:tasks.workunit.client.0.smithi002.stdout:3/652: readlink d9/d15/lba 0 2023-12-17T11:57:49.419 INFO:tasks.workunit.client.0.smithi002.stdout:9/658: link dc/d1d/lc6 dc/d42/led 0 2023-12-17T11:57:49.420 INFO:tasks.workunit.client.0.smithi002.stdout:7/597: dwrite d6/d17/dc/d13/d37/d4f/f63 [0,4194304] 0 2023-12-17T11:57:49.420 INFO:tasks.workunit.client.0.smithi002.stdout:7/598: chown d6/d17/dc/d13/d21/d2e/l8c 18588 1 2023-12-17T11:57:49.420 INFO:tasks.workunit.client.0.smithi002.stdout:7/599: readlink d6/d17/dc/d13/d37/d4f/l98 0 2023-12-17T11:57:49.423 INFO:tasks.workunit.client.1.smithi119.stdout:5/637: link d1/da7/d71/d97/fa0 d1/fca 0 2023-12-17T11:57:49.423 INFO:tasks.workunit.client.1.smithi119.stdout:5/638: chown d1/d25/f38 35 1 2023-12-17T11:57:49.424 INFO:tasks.workunit.client.1.smithi119.stdout:1/603: dwrite d3/db/d26/f55 [0,4194304] 0 2023-12-17T11:57:49.424 INFO:tasks.workunit.client.1.smithi119.stdout:3/675: write d9/f1b [3029906,125652] 0 2023-12-17T11:57:49.424 INFO:tasks.workunit.client.1.smithi119.stdout:0/539: dread d2/d16/d35/d39/f76 [0,4194304] 0 2023-12-17T11:57:49.424 INFO:tasks.workunit.client.1.smithi119.stdout:0/540: truncate d2/d66/d2e/f6d 12638 0 2023-12-17T11:57:49.428 INFO:tasks.workunit.client.1.smithi119.stdout:8/510: truncate d7/da/d11/d26/f58 2931305 0 2023-12-17T11:57:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:4/580: mkdir d0/d10/d21/d33/dbc 0 2023-12-17T11:57:49.430 INFO:tasks.workunit.client.0.smithi002.stdout:0/543: write d0/d6/d26/d25/f96 [3306498,28976] 0 2023-12-17T11:57:49.430 INFO:tasks.workunit.client.0.smithi002.stdout:0/544: stat d0/d15/f6c 0 2023-12-17T11:57:49.430 INFO:tasks.workunit.client.0.smithi002.stdout:6/593: dwrite d0/d1/dc/d17/f2e [0,4194304] 0 2023-12-17T11:57:49.431 INFO:tasks.workunit.client.0.smithi002.stdout:5/616: rmdir dc/d1b/d5a 39 2023-12-17T11:57:49.431 INFO:tasks.workunit.client.0.smithi002.stdout:5/617: stat dc/d1b/d2d/d5b/cbe 0 2023-12-17T11:57:49.431 INFO:tasks.workunit.client.0.smithi002.stdout:5/618: creat dc/d17/d2f/d99/fe1 x:0 0 0 2023-12-17T11:57:49.431 INFO:tasks.workunit.client.0.smithi002.stdout:5/619: creat dc/d1b/d2d/d5b/fe2 x:0 0 0 2023-12-17T11:57:49.432 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:49 smithi002 ceph-mon[107131]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:49.433 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:49 smithi002 ceph-mon[107131]: pgmap v27: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 269 MiB/s rd, 342 MiB/s wr, 470 op/s 2023-12-17T11:57:49.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/678: creat d3/d6/d16/dcf/fe5 x:0 0 0 2023-12-17T11:57:49.434 INFO:tasks.workunit.client.0.smithi002.stdout:1/679: dread - d3/d6/d9/d37/d39/d43/fdd zero size 2023-12-17T11:57:49.440 INFO:tasks.workunit.client.0.smithi002.stdout:3/653: symlink d9/ld7 0 2023-12-17T11:57:49.445 INFO:tasks.workunit.client.0.smithi002.stdout:9/659: creat dc/fee x:0 0 0 2023-12-17T11:57:49.448 INFO:tasks.workunit.client.1.smithi119.stdout:6/551: mknod d2/d61/d8a/cab 0 2023-12-17T11:57:49.448 INFO:tasks.workunit.client.0.smithi002.stdout:0/545: creat d0/d6/d26/d14/d19/d2f/fad x:0 0 0 2023-12-17T11:57:49.449 INFO:tasks.workunit.client.0.smithi002.stdout:0/546: truncate d0/d15/d59/f6b 911421 0 2023-12-17T11:57:49.450 INFO:tasks.workunit.client.0.smithi002.stdout:6/594: mkdir d0/dc3 0 2023-12-17T11:57:49.452 INFO:tasks.workunit.client.0.smithi002.stdout:2/627: sync 2023-12-17T11:57:49.453 INFO:tasks.workunit.client.1.smithi119.stdout:9/619: symlink d12/d1d/d28/d46/dbb/lc7 0 2023-12-17T11:57:49.456 INFO:tasks.workunit.client.1.smithi119.stdout:5/639: symlink d1/d44/d52/lcb 0 2023-12-17T11:57:49.456 INFO:tasks.workunit.client.1.smithi119.stdout:5/640: chown d1/d44/f74 11359 1 2023-12-17T11:57:49.462 INFO:tasks.workunit.client.0.smithi002.stdout:9/660: mknod dc/d42/d4f/d59/d47/d4b/cef 0 2023-12-17T11:57:49.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/638: unlink d2/d4/d70/d57/lb0 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:3/654: unlink d9/d1b/d35/d41/d59/d65/da9/ccd 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:3/655: truncate d9/d15/f19 5632827 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:0/547: mkdir d0/d6/d26/d14/d19/d37/d91/dae 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:0/548: fdatasync d0/d15/f23 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:6/595: mkdir d0/d1/d21/d56/d8c/d93/da5/dbc/dc4 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/626: sync 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:2/628: link d3/d50/f53 d3/d4/d7/fe0 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:2/629: write d3/d4/f6 [3447152,99503] 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/627: dread d3/d7/d1a/fac [0,4194304] 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/628: chown d3/d7/d18/d74/f82 9811501 1 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:8/629: fsync d3/d8/d28/d31/d5a/d7c/f7e 0 2023-12-17T11:57:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:1/680: rmdir d3/d6/d9/d37/d39/d43/d8f 39 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:9/661: unlink dc/d1d/d25/d85/fce 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:2/630: dread d3/d4/d17/d19/f67 [0,4194304] 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:2/631: readlink d3/d4/d17/d19/d4d/d72/d83/lcd 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:0/549: rename d0/d6/d26/f3a to d0/d6/faf 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:7/600: dwrite d6/d17/dc/d13/d21/d6e/f7e [0,4194304] 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:2/632: dread d3/d4/d17/d19/d4d/fa2 [0,4194304] 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/630: creat d3/d7/d6e/fd1 x:0 0 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/631: mknod d3/d7/d6e/cd2 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:8/632: creat d3/d7/d18/d3f/d49/fd3 x:0 0 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.1.smithi119.stdout:0/541: mkdir d2/d66/d1f/d24/d50/da4 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.1.smithi119.stdout:8/511: link d7/da/d11/l4d d7/d18/d15/d64/la9 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.1.smithi119.stdout:8/512: chown d7/da/d11/d26 13906 1 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.1.smithi119.stdout:8/513: write d7/d18/d45/f6d [154287,21563] 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.1.smithi119.stdout:9/620: dread d12/d1d/d28/d4d/f6c [0,4194304] 0 2023-12-17T11:57:49.531 INFO:tasks.workunit.client.1.smithi119.stdout:5/641: creat d1/d36/dc1/fcc x:0 0 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:7/639: symlink d2/d40/lc7 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:7/640: chown d2/d4/d11/d2c/c3b 43826 1 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:0/542: mknod d2/d66/d2e/d44/d7b/d5/d3f/ca5 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:8/514: creat d7/da/d11/faa x:0 0 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:8/515: dread - d7/da/d11/d60/fa8 zero size 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:8/516: write d7/da/d1a/f1c [1872270,40904] 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:0/543: mknod d2/d16/d8c/ca6 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:4/586: dwrite dd/d11/d26/f9f [0,4194304] 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:9/621: write d12/d1d/d79/f80 [238084,49557] 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:7/641: dread d2/d4/d11/f43 [0,4194304] 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:4/587: rename dd/d15/l64 to dd/d15/d16/d20/lba 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:0/544: dread d2/f67 [0,4194304] 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:0/545: fsync d2/d16/d35/d39/f99 0 2023-12-17T11:57:49.532 INFO:tasks.workunit.client.1.smithi119.stdout:9/622: creat d12/d1d/d79/db1/fc8 x:0 0 0 2023-12-17T11:57:49.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/588: unlink dd/d4b/d6a/l6c 0 2023-12-17T11:57:49.533 INFO:tasks.workunit.client.1.smithi119.stdout:4/589: creat dd/d15/d4f/fbb x:0 0 0 2023-12-17T11:57:49.534 INFO:tasks.workunit.client.0.smithi002.stdout:8/633: symlink d3/d7/d6e/ld4 0 2023-12-17T11:57:49.534 INFO:tasks.workunit.client.0.smithi002.stdout:8/634: truncate d3/d8/d28/d31/d5a/d7c/fba 36180 0 2023-12-17T11:57:49.534 INFO:tasks.workunit.client.0.smithi002.stdout:8/635: dread - d3/d7/d6e/d7f/d65/da2/fb5 zero size 2023-12-17T11:57:49.534 INFO:tasks.workunit.client.1.smithi119.stdout:0/546: chown d2/d66/d2e/d44/d7b/d5/dc/c4b 1 1 2023-12-17T11:57:49.537 INFO:tasks.workunit.client.1.smithi119.stdout:1/604: dwrite d3/db/d17/d24/d20/d40/d76/d96/d99/fa6 [0,4194304] 0 2023-12-17T11:57:49.537 INFO:tasks.workunit.client.1.smithi119.stdout:1/605: read d3/db/d26/d19/d3f/f4a [1727650,107768] 0 2023-12-17T11:57:49.541 INFO:tasks.workunit.client.1.smithi119.stdout:4/590: truncate dd/d15/d16/d3d/f77 1799953 0 2023-12-17T11:57:49.542 INFO:tasks.workunit.client.1.smithi119.stdout:0/547: creat d2/d16/d35/d74/fa7 x:0 0 0 2023-12-17T11:57:49.542 INFO:tasks.workunit.client.0.smithi002.stdout:8/636: rename d3/f40 to d3/d7/d6e/d7f/d90/fd5 0 2023-12-17T11:57:49.542 INFO:tasks.workunit.client.0.smithi002.stdout:8/637: creat d3/d7/d6e/fd6 x:0 0 0 2023-12-17T11:57:49.543 INFO:tasks.workunit.client.1.smithi119.stdout:3/676: dwrite d9/d11/d1e/d55/d65/d84/dd3/fa8 [0,4194304] 0 2023-12-17T11:57:49.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/681: dread d3/d6/d9/d30/f1a [0,4194304] 0 2023-12-17T11:57:49.548 INFO:tasks.workunit.client.0.smithi002.stdout:0/550: write d0/d6/d26/f35 [1263868,16415] 0 2023-12-17T11:57:49.548 INFO:tasks.workunit.client.1.smithi119.stdout:1/606: creat d3/db/d26/d19/fde x:0 0 0 2023-12-17T11:57:49.549 INFO:tasks.workunit.client.1.smithi119.stdout:1/607: chown d3/db/d17/d24/d20/dba/dbc/d7e/da1/fd6 224 1 2023-12-17T11:57:49.550 INFO:tasks.workunit.client.1.smithi119.stdout:4/591: mkdir dd/d15/d16/d5a/dbc 0 2023-12-17T11:57:49.550 INFO:tasks.workunit.client.1.smithi119.stdout:4/592: write dd/d15/d16/f1a [1419646,81952] 0 2023-12-17T11:57:49.550 INFO:tasks.workunit.client.1.smithi119.stdout:4/593: truncate dd/d11/d2d/fb4 318139 0 2023-12-17T11:57:49.551 INFO:tasks.workunit.client.0.smithi002.stdout:2/633: dread d3/d50/f8f [0,4194304] 0 2023-12-17T11:57:49.551 INFO:tasks.workunit.client.0.smithi002.stdout:8/638: mknod d3/d8/da/dd/cd7 0 2023-12-17T11:57:49.551 INFO:tasks.workunit.client.0.smithi002.stdout:8/639: stat d3/d8/da 0 2023-12-17T11:57:49.551 INFO:tasks.workunit.client.0.smithi002.stdout:3/656: write d9/f14 [3491369,61784] 0 2023-12-17T11:57:49.552 INFO:tasks.workunit.client.0.smithi002.stdout:0/551: symlink d0/d6/d26/d14/d19/d37/d62/lb0 0 2023-12-17T11:57:49.555 INFO:tasks.workunit.client.0.smithi002.stdout:8/640: symlink d3/d7/d18/d74/d7b/ld8 0 2023-12-17T11:57:49.556 INFO:tasks.workunit.client.1.smithi119.stdout:0/548: symlink d2/d66/d2e/la8 0 2023-12-17T11:57:49.566 INFO:tasks.workunit.client.0.smithi002.stdout:3/657: creat d9/d15/d52/d85/fd8 x:0 0 0 2023-12-17T11:57:49.568 INFO:tasks.workunit.client.0.smithi002.stdout:6/596: dwrite d0/d1/dc/d10/f86 [0,4194304] 0 2023-12-17T11:57:49.568 INFO:tasks.workunit.client.0.smithi002.stdout:8/641: unlink d3/d8/d28/d31/d5a/f7a 0 2023-12-17T11:57:49.568 INFO:tasks.workunit.client.0.smithi002.stdout:8/642: fsync d3/d8/da/dd/f66 0 2023-12-17T11:57:49.569 INFO:tasks.workunit.client.0.smithi002.stdout:0/552: fsync d0/d6/d26/f35 0 2023-12-17T11:57:49.572 INFO:tasks.workunit.client.1.smithi119.stdout:5/642: dwrite d1/da7/f3b [0,4194304] 0 2023-12-17T11:57:49.572 INFO:tasks.workunit.client.1.smithi119.stdout:5/643: truncate d1/da7/d71/d76/d83/fb2 1009832 0 2023-12-17T11:57:49.572 INFO:tasks.workunit.client.1.smithi119.stdout:5/644: fsync d1/d36/f47 0 2023-12-17T11:57:49.573 INFO:tasks.workunit.client.0.smithi002.stdout:7/601: dwrite d6/d17/dc/f89 [0,4194304] 0 2023-12-17T11:57:49.574 INFO:tasks.workunit.client.0.smithi002.stdout:4/581: dwrite d0/fb2 [0,4194304] 0 2023-12-17T11:57:49.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/677: dread d9/d11/f3f [0,4194304] 0 2023-12-17T11:57:49.584 INFO:tasks.workunit.client.1.smithi119.stdout:4/594: mkdir dd/d11/d2d/d9c/d55/d81/db8/dbd 0 2023-12-17T11:57:49.586 INFO:tasks.workunit.client.0.smithi002.stdout:6/597: truncate d0/d1/d21/d56/d8c/d93/da5/f8d 554279 0 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:9/662: write dc/d42/da0/d72/d93/dd0/fd7 [2177161,81681] 0 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:9/663: creat dc/d42/da0/d72/d93/d76/ff0 x:0 0 0 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:9/664: dread - dc/d1d/fe9 zero size 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/643: rename d3/d8/d28/d31/d5a/d7c/fba to d3/d7/d1a/fd9 0 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.1.smithi119.stdout:0/549: rmdir d2/d66/d2e/d44/d7b 39 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.1.smithi119.stdout:0/550: chown d2/d66/d2e/d44/d7b/c9 6885435 1 2023-12-17T11:57:49.587 INFO:tasks.workunit.client.1.smithi119.stdout:0/551: read d2/d66/d2e/d44/d7b/d5/dc/f7e [2102845,28731] 0 2023-12-17T11:57:49.588 INFO:tasks.workunit.client.1.smithi119.stdout:5/645: symlink d1/d70/d85/d95/lcd 0 2023-12-17T11:57:49.588 INFO:tasks.workunit.client.1.smithi119.stdout:5/646: write d1/d70/d85/d95/f8f [605080,8951] 0 2023-12-17T11:57:49.590 INFO:tasks.workunit.client.0.smithi002.stdout:0/553: rmdir d0/d6/d26/d14/d19/d37/d91 39 2023-12-17T11:57:49.591 INFO:tasks.workunit.client.1.smithi119.stdout:1/608: getdents d3/db/d17/d24/d20/dba/dbc/d7e 0 2023-12-17T11:57:49.591 INFO:tasks.workunit.client.1.smithi119.stdout:1/609: fdatasync d3/db/d17/d24/d20/dbd/dcb/fd8 0 2023-12-17T11:57:49.592 INFO:tasks.workunit.client.1.smithi119.stdout:1/610: write d3/db/d17/d24/d20/d40/f41 [4161062,99898] 0 2023-12-17T11:57:49.592 INFO:tasks.workunit.client.0.smithi002.stdout:1/682: dwrite d3/d6/d9/d37/d39/d43/f50 [4194304,4194304] 0 2023-12-17T11:57:49.594 INFO:tasks.workunit.client.1.smithi119.stdout:9/623: dread d12/f2c [0,4194304] 0 2023-12-17T11:57:49.594 INFO:tasks.workunit.client.1.smithi119.stdout:8/517: dwrite d7/d18/f5b [0,4194304] 0 2023-12-17T11:57:49.595 INFO:tasks.workunit.client.1.smithi119.stdout:8/518: write d7/f77 [598117,40979] 0 2023-12-17T11:57:49.596 INFO:tasks.workunit.client.1.smithi119.stdout:3/678: creat d9/d11/f101 x:0 0 0 2023-12-17T11:57:49.599 INFO:tasks.workunit.client.1.smithi119.stdout:4/595: rename dd/d4b/d6a/l72 to dd/d15/d16/d5a/dbc/lbe 0 2023-12-17T11:57:49.602 INFO:tasks.workunit.client.1.smithi119.stdout:5/647: link d1/d44/d52/c9b d1/d70/d6b/d77/dae/dba/cce 0 2023-12-17T11:57:49.609 INFO:tasks.workunit.client.1.smithi119.stdout:1/611: creat d3/db/d17/d24/d20/dba/dbc/d7e/fdf x:0 0 0 2023-12-17T11:57:49.613 INFO:tasks.workunit.client.1.smithi119.stdout:3/679: link d9/da/f54 d9/d11/d1e/d55/d65/ddf/f102 0 2023-12-17T11:57:49.614 INFO:tasks.workunit.client.0.smithi002.stdout:6/598: mkdir d0/d1/dc/d17/d4c/dc5 0 2023-12-17T11:57:49.616 INFO:tasks.workunit.client.0.smithi002.stdout:9/665: mkdir dc/d42/da0/d72/d93/dd0/dd4/df1 0 2023-12-17T11:57:49.616 INFO:tasks.workunit.client.0.smithi002.stdout:9/666: chown dc/d1d/d25/d85/dc2/ddd/lec 142 1 2023-12-17T11:57:49.617 INFO:tasks.workunit.client.1.smithi119.stdout:8/519: rename d7/d12/f25 to d7/fab 0 2023-12-17T11:57:49.620 INFO:tasks.workunit.client.0.smithi002.stdout:8/644: rename d3/d8/da/f88 to d3/d8/d28/d31/d5a/d7c/fda 0 2023-12-17T11:57:49.620 INFO:tasks.workunit.client.0.smithi002.stdout:8/645: creat d3/d7/d18/fdb x:0 0 0 2023-12-17T11:57:49.620 INFO:tasks.workunit.client.0.smithi002.stdout:8/646: chown d3/d7/d1a 53 1 2023-12-17T11:57:49.620 INFO:tasks.workunit.client.1.smithi119.stdout:0/552: write d2/d66/d1f/f20 [264341,123107] 0 2023-12-17T11:57:49.620 INFO:tasks.workunit.client.1.smithi119.stdout:0/553: chown d2/d16/d35/d39/f4a 337895 1 2023-12-17T11:57:49.627 INFO:tasks.workunit.client.1.smithi119.stdout:5/648: dread d1/d25/f31 [0,4194304] 0 2023-12-17T11:57:49.630 INFO:tasks.workunit.client.1.smithi119.stdout:3/680: mknod d9/da/c103 0 2023-12-17T11:57:49.631 INFO:tasks.workunit.client.0.smithi002.stdout:0/554: truncate d0/d6/d26/d14/f5d 855719 0 2023-12-17T11:57:49.632 INFO:tasks.workunit.client.0.smithi002.stdout:6/599: mkdir d0/d1/dc/d8b/dc6 0 2023-12-17T11:57:49.634 INFO:tasks.workunit.client.0.smithi002.stdout:8/647: unlink d3/d7/d18/d3f/d49/f4b 0 2023-12-17T11:57:49.636 INFO:tasks.workunit.client.1.smithi119.stdout:4/596: getdents dd/d11 0 2023-12-17T11:57:49.636 INFO:tasks.workunit.client.1.smithi119.stdout:4/597: fdatasync dd/d11/f5e 0 2023-12-17T11:57:49.636 INFO:tasks.workunit.client.1.smithi119.stdout:4/598: fdatasync dd/d11/d26/f9f 0 2023-12-17T11:57:49.636 INFO:tasks.workunit.client.1.smithi119.stdout:4/599: creat dd/d15/d16/d3d/fbf x:0 0 0 2023-12-17T11:57:49.636 INFO:tasks.workunit.client.1.smithi119.stdout:4/600: write dd/d11/d2d/d9c/d55/d81/d88/fa9 [458120,91477] 0 2023-12-17T11:57:49.637 INFO:tasks.workunit.client.1.smithi119.stdout:4/601: write dd/d11/d2d/d9c/d55/d81/db8/f65 [1679706,75617] 0 2023-12-17T11:57:49.642 INFO:tasks.workunit.client.0.smithi002.stdout:8/648: unlink d3/d7/d6e/ld4 0 2023-12-17T11:57:49.642 INFO:tasks.workunit.client.0.smithi002.stdout:8/649: truncate d3/d7/d18/d74/f79 349786 0 2023-12-17T11:57:49.642 INFO:tasks.workunit.client.0.smithi002.stdout:8/650: stat d3/d8/d28/d31/d5a/f80 0 2023-12-17T11:57:49.646 INFO:tasks.workunit.client.1.smithi119.stdout:5/649: rmdir d1/da7/d71/d76 39 2023-12-17T11:57:49.646 INFO:tasks.workunit.client.1.smithi119.stdout:0/554: getdents d2/d66/d1f/d24/d50/d5d 0 2023-12-17T11:57:49.648 INFO:tasks.workunit.client.1.smithi119.stdout:2/689: sync 2023-12-17T11:57:49.648 INFO:tasks.workunit.client.1.smithi119.stdout:2/690: dread - d6/d9/d52/d53/fca zero size 2023-12-17T11:57:49.649 INFO:tasks.workunit.client.1.smithi119.stdout:4/602: truncate dd/d15/d4f/f6b 666421 0 2023-12-17T11:57:49.655 INFO:tasks.workunit.client.1.smithi119.stdout:2/691: symlink d6/d9/d52/d53/d55/d58/d6b/lf5 0 2023-12-17T11:57:49.655 INFO:tasks.workunit.client.1.smithi119.stdout:2/692: chown d6/d9/d13/d34/f64 265 1 2023-12-17T11:57:49.655 INFO:tasks.workunit.client.1.smithi119.stdout:2/693: chown d6/d2b/d3f/d5c/f79 103 1 2023-12-17T11:57:49.656 INFO:tasks.workunit.client.1.smithi119.stdout:4/603: unlink dd/d11/d2d/d9c/d55/d81/db8/f67 0 2023-12-17T11:57:49.658 INFO:tasks.workunit.client.1.smithi119.stdout:2/694: creat d6/d9/d52/d53/d55/d58/dba/ff6 x:0 0 0 2023-12-17T11:57:49.658 INFO:tasks.workunit.client.1.smithi119.stdout:2/695: creat d6/d9/d13/d1d/ff7 x:0 0 0 2023-12-17T11:57:49.659 INFO:tasks.workunit.client.1.smithi119.stdout:4/604: creat dd/d11/d26/d86/fc0 x:0 0 0 2023-12-17T11:57:49.662 INFO:tasks.workunit.client.1.smithi119.stdout:2/696: unlink d6/d9/d52/d53/d55/c4f 0 2023-12-17T11:57:49.663 INFO:tasks.workunit.client.1.smithi119.stdout:4/605: symlink dd/d4b/d6a/lc1 0 2023-12-17T11:57:49.668 INFO:tasks.workunit.client.1.smithi119.stdout:4/606: link dd/d15/d16/d20/l2c dd/d15/d16/d20/d82/lc2 0 2023-12-17T11:57:49.705 INFO:tasks.workunit.client.1.smithi119.stdout:0/555: fsync d2/d66/d1f/f20 0 2023-12-17T11:57:49.711 INFO:tasks.workunit.client.0.smithi002.stdout:4/582: dwrite d0/d3e/d56/f9e [0,4194304] 0 2023-12-17T11:57:49.712 INFO:tasks.workunit.client.0.smithi002.stdout:4/583: fsync d0/d3e/d56/d65/d78/f81 0 2023-12-17T11:57:49.715 INFO:tasks.workunit.client.0.smithi002.stdout:4/584: creat d0/d10/d14/d27/fbd x:0 0 0 2023-12-17T11:57:49.719 INFO:tasks.workunit.client.0.smithi002.stdout:0/555: write d0/d15/f27 [3234675,107301] 0 2023-12-17T11:57:49.719 INFO:tasks.workunit.client.0.smithi002.stdout:4/585: rename d0/d3e/d56/d65/d78/f92 to d0/d10/d14/d4e/fbe 0 2023-12-17T11:57:49.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/556: mkdir d0/d6/d26/d14/d19/db1 0 2023-12-17T11:57:49.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/557: dread - d0/d6/d26/d14/d19/d61/f88 zero size 2023-12-17T11:57:49.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/558: write d0/d6/f5e [2790879,120380] 0 2023-12-17T11:57:49.721 INFO:tasks.workunit.client.0.smithi002.stdout:0/559: readlink d0/d6/d26/d14/d19/d37/d91/la9 0 2023-12-17T11:57:49.722 INFO:tasks.workunit.client.0.smithi002.stdout:4/586: mknod d0/d3e/d47/cbf 0 2023-12-17T11:57:49.723 INFO:tasks.workunit.client.0.smithi002.stdout:8/651: dread d3/d8/d28/d31/fc6 [4194304,4194304] 0 2023-12-17T11:57:49.726 INFO:tasks.workunit.client.0.smithi002.stdout:9/667: dwrite dc/d42/da0/d82/fa4 [0,4194304] 0 2023-12-17T11:57:49.727 INFO:tasks.workunit.client.0.smithi002.stdout:0/560: rmdir d0/d6/d26/d25 39 2023-12-17T11:57:49.730 INFO:tasks.workunit.client.0.smithi002.stdout:9/668: link dc/d32/f7a dc/d1d/d25/d85/dc2/ff2 0 2023-12-17T11:57:49.730 INFO:tasks.workunit.client.1.smithi119.stdout:9/624: dwrite d12/f2c [4194304,4194304] 0 2023-12-17T11:57:49.731 INFO:tasks.workunit.client.0.smithi002.stdout:9/669: creat dc/d42/d4f/d59/d47/ff3 x:0 0 0 2023-12-17T11:57:49.731 INFO:tasks.workunit.client.0.smithi002.stdout:0/561: symlink d0/d33/lb2 0 2023-12-17T11:57:49.732 INFO:tasks.workunit.client.1.smithi119.stdout:9/625: mkdir d12/d1d/d28/d46/d50/d92/dae/dc9 0 2023-12-17T11:57:49.732 INFO:tasks.workunit.client.1.smithi119.stdout:9/626: chown d12/d1d/d28/d46/d50/f60 208622997 1 2023-12-17T11:57:49.733 INFO:tasks.workunit.client.1.smithi119.stdout:6/552: dwrite d2/d2b/f3a [0,4194304] 0 2023-12-17T11:57:49.733 INFO:tasks.workunit.client.1.smithi119.stdout:4/607: dread dd/d11/d26/f36 [0,4194304] 0 2023-12-17T11:57:49.733 INFO:tasks.workunit.client.1.smithi119.stdout:4/608: fsync dd/d15/d16/d3d/f4c 0 2023-12-17T11:57:49.735 INFO:tasks.workunit.client.1.smithi119.stdout:1/612: dwrite d3/db/d26/d19/d3f/f4a [0,4194304] 0 2023-12-17T11:57:49.735 INFO:tasks.workunit.client.0.smithi002.stdout:9/670: creat dc/d42/da0/d72/ff4 x:0 0 0 2023-12-17T11:57:49.735 INFO:tasks.workunit.client.0.smithi002.stdout:9/671: creat dc/d42/d4f/d59/ff5 x:0 0 0 2023-12-17T11:57:49.735 INFO:tasks.workunit.client.1.smithi119.stdout:1/613: write d3/db/d26/d19/f1e [984763,130451] 0 2023-12-17T11:57:49.739 INFO:tasks.workunit.client.0.smithi002.stdout:0/562: symlink d0/d6/d26/d14/lb3 0 2023-12-17T11:57:49.757 INFO:tasks.workunit.client.1.smithi119.stdout:6/553: dread d2/df/d17/d79/f96 [4194304,4194304] 0 2023-12-17T11:57:49.757 INFO:tasks.workunit.client.1.smithi119.stdout:6/554: fsync d2/d2b/d7f/fa7 0 2023-12-17T11:57:49.757 INFO:tasks.workunit.client.0.smithi002.stdout:6/600: write d0/d1/dc/f34 [2959835,43649] 0 2023-12-17T11:57:49.759 INFO:tasks.workunit.client.1.smithi119.stdout:6/555: mkdir d2/d9b/dac 0 2023-12-17T11:57:49.760 INFO:tasks.workunit.client.0.smithi002.stdout:1/683: write d3/d6/f2b [3571846,25733] 0 2023-12-17T11:57:49.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/652: write d3/d8/da/d44/f3b [1167497,41025] 0 2023-12-17T11:57:49.760 INFO:tasks.workunit.client.0.smithi002.stdout:8/653: write d3/d8/da/dd/f5f [4370135,48200] 0 2023-12-17T11:57:49.761 INFO:tasks.workunit.client.0.smithi002.stdout:0/563: dread d0/d15/f28 [0,4194304] 0 2023-12-17T11:57:49.761 INFO:tasks.workunit.client.0.smithi002.stdout:0/564: stat d0/f48 0 2023-12-17T11:57:49.763 INFO:tasks.workunit.client.0.smithi002.stdout:5/620: sync 2023-12-17T11:57:49.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/621: chown dc/d1b/d75/le0 2 1 2023-12-17T11:57:49.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/622: fsync dc/d1b/d2d/d5b/fa2 0 2023-12-17T11:57:49.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/623: fdatasync dc/d17/dc0/fdf 0 2023-12-17T11:57:49.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/624: write dc/d1b/d5a/d96/fc1 [838533,88983] 0 2023-12-17T11:57:49.764 INFO:tasks.workunit.client.0.smithi002.stdout:5/625: fdatasync dc/d17/d2f/fb8 0 2023-12-17T11:57:49.766 INFO:tasks.workunit.client.0.smithi002.stdout:6/601: chown d0/d1/d5b/f95 531164380 1 2023-12-17T11:57:49.766 INFO:tasks.workunit.client.1.smithi119.stdout:3/681: dwrite d9/d11/d1e/d55/f6d [0,4194304] 0 2023-12-17T11:57:49.766 INFO:tasks.workunit.client.1.smithi119.stdout:8/520: rmdir d7 39 2023-12-17T11:57:49.766 INFO:tasks.workunit.client.1.smithi119.stdout:8/521: chown d7/d18/d15/d81 51 1 2023-12-17T11:57:49.767 INFO:tasks.workunit.client.1.smithi119.stdout:5/650: dwrite d1/da7/d71/d82/f9f [0,4194304] 0 2023-12-17T11:57:49.767 INFO:tasks.workunit.client.1.smithi119.stdout:5/651: dread - d1/d36/dc1/fcc zero size 2023-12-17T11:57:49.776 INFO:tasks.workunit.client.1.smithi119.stdout:3/682: rename d9/d11/d1e/d55/d77/l8b to d9/d11/d1e/d55/d65/d84/l104 0 2023-12-17T11:57:49.776 INFO:tasks.workunit.client.1.smithi119.stdout:8/522: rename d7/d12 to d7/d12/dac 22 2023-12-17T11:57:49.781 INFO:tasks.workunit.client.0.smithi002.stdout:0/565: symlink d0/d6/d26/d14/d19/db1/lb4 0 2023-12-17T11:57:49.783 INFO:tasks.workunit.client.1.smithi119.stdout:3/683: mkdir d9/da/df/d41/d33/db4/d105 0 2023-12-17T11:57:49.787 INFO:tasks.workunit.client.0.smithi002.stdout:4/587: read d0/d10/d14/d4e/fbe [749092,62164] 0 2023-12-17T11:57:49.787 INFO:tasks.workunit.client.1.smithi119.stdout:8/523: mkdir d7/d12/d23/d9c/dad 0 2023-12-17T11:57:49.787 INFO:tasks.workunit.client.1.smithi119.stdout:1/614: write d3/db/d17/d24/d20/f7f [33547,93898] 0 2023-12-17T11:57:49.787 INFO:tasks.workunit.client.1.smithi119.stdout:1/615: dread - d3/db/d17/d24/d20/d40/fc9 zero size 2023-12-17T11:57:49.788 INFO:tasks.workunit.client.1.smithi119.stdout:1/616: creat d3/db/d26/d5e/fe0 x:0 0 0 2023-12-17T11:57:49.796 INFO:tasks.workunit.client.0.smithi002.stdout:3/658: dwrite d9/f13 [0,4194304] 0 2023-12-17T11:57:49.797 INFO:tasks.workunit.client.0.smithi002.stdout:8/654: write d3/d7/d18/d3f/d49/f52 [3295987,57419] 0 2023-12-17T11:57:49.798 INFO:tasks.workunit.client.0.smithi002.stdout:8/655: creat d3/d7/d18/d74/d7b/fdc x:0 0 0 2023-12-17T11:57:49.798 INFO:tasks.workunit.client.0.smithi002.stdout:8/656: write d3/d7/d1a/fd9 [481989,58677] 0 2023-12-17T11:57:49.798 INFO:tasks.workunit.client.1.smithi119.stdout:6/556: dread d2/df/f30 [4194304,4194304] 0 2023-12-17T11:57:49.799 INFO:tasks.workunit.client.1.smithi119.stdout:6/557: fsync d2/d61/f94 0 2023-12-17T11:57:49.801 INFO:tasks.workunit.client.0.smithi002.stdout:6/602: creat d0/d1/dc0/fc7 x:0 0 0 2023-12-17T11:57:49.801 INFO:tasks.workunit.client.0.smithi002.stdout:6/603: write d0/d1/dc/d17/f1f [1880599,3312] 0 2023-12-17T11:57:49.804 INFO:tasks.workunit.client.1.smithi119.stdout:3/684: mkdir d9/d11/d106 0 2023-12-17T11:57:49.805 INFO:tasks.workunit.client.1.smithi119.stdout:0/556: dwrite d2/d16/f7c [0,4194304] 0 2023-12-17T11:57:49.805 INFO:tasks.workunit.client.1.smithi119.stdout:0/557: stat d2/d66/d2e/d44/d7b/l92 0 2023-12-17T11:57:49.807 INFO:tasks.workunit.client.0.smithi002.stdout:3/659: rmdir d9/d15/d52/d85/db9 39 2023-12-17T11:57:49.807 INFO:tasks.workunit.client.1.smithi119.stdout:9/627: dwrite d12/d1d/d28/d46/d6e/fb6 [0,4194304] 0 2023-12-17T11:57:49.811 INFO:tasks.workunit.client.0.smithi002.stdout:6/604: truncate d0/d1/dc/d10/fb6 2166171 0 2023-12-17T11:57:49.814 INFO:tasks.workunit.client.1.smithi119.stdout:4/609: rmdir dd/d15/d4f 39 2023-12-17T11:57:49.814 INFO:tasks.workunit.client.1.smithi119.stdout:4/610: chown dd/d11/d26/f9f 0 1 2023-12-17T11:57:49.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.812+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f535811db10 con 0x7f5358070570 2023-12-17T11:57:49.817 INFO:tasks.workunit.client.1.smithi119.stdout:4/611: write dd/d11/d2d/d9c/d55/d81/db8/d78/faf [59361,106811] 0 2023-12-17T11:57:49.819 INFO:tasks.workunit.client.0.smithi002.stdout:7/602: dwrite d6/d17/f79 [0,4194304] 0 2023-12-17T11:57:49.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.818+0000 7f533ffff700 1 -- 172.21.15.2:0/789959935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f535811db10 con 0x7f5358070570 2023-12-17T11:57:49.824 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:57:49.824 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:57:49.824 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:57:49.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 13, 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:57:49.826 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:57:49.827 INFO:tasks.workunit.client.1.smithi119.stdout:8/524: symlink d7/d18/lae 0 2023-12-17T11:57:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f534006ae40 msgr2=0x7f534006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f534006ae40 0x7f534006d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5348006fd0 tx=0x7f5348006db0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 msgr2=0x7f5358108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 0x7f5358108050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f534c00b3b0 tx=0x7f534c009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 shutdown_connections 2023-12-17T11:57:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7f534006ae40 0x7f534006d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358070570 0x7f5358108050 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f534c00b3b0 tx=0x7f534c009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 --2- 172.21.15.2:0/789959935 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5358071bc0 0x7f5358108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.823+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 >> 172.21.15.2:0/789959935 conn(0x7f53580f82d0 msgr2=0x7f53580fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.824+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 shutdown_connections 2023-12-17T11:57:49.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:49.824+0000 7f535db24700 1 -- 172.21.15.2:0/789959935 wait complete. 2023-12-17T11:57:49.829 INFO:tasks.workunit.client.0.smithi002.stdout:5/626: read dc/d17/d2f/f34 [104027,41430] 0 2023-12-17T11:57:49.832 INFO:tasks.workunit.client.1.smithi119.stdout:4/612: mknod dd/d15/d16/d3d/dab/cc3 0 2023-12-17T11:57:49.834 INFO:tasks.workunit.client.0.smithi002.stdout:9/672: dwrite dc/d42/da0/d72/fbd [0,4194304] 0 2023-12-17T11:57:49.834 INFO:tasks.workunit.client.1.smithi119.stdout:0/558: dread d2/d66/d1f/f69 [0,4194304] 0 2023-12-17T11:57:49.834 INFO:tasks.workunit.client.1.smithi119.stdout:5/652: dwrite d1/da7/d71/f84 [0,4194304] 0 2023-12-17T11:57:49.838 INFO:tasks.workunit.client.1.smithi119.stdout:8/525: creat d7/d18/d15/d81/da2/faf x:0 0 0 2023-12-17T11:57:49.842 INFO:tasks.workunit.client.1.smithi119.stdout:4/613: link dd/l8a dd/d15/d16/d3d/dab/lc4 0 2023-12-17T11:57:49.846 INFO:tasks.workunit.client.1.smithi119.stdout:8/526: dread d7/d18/d45/d9f/f7e [0,4194304] 0 2023-12-17T11:57:49.846 INFO:tasks.workunit.client.1.smithi119.stdout:8/527: write d7/da/f3f [4568505,81961] 0 2023-12-17T11:57:49.847 INFO:tasks.workunit.client.0.smithi002.stdout:3/660: dread f6 [0,4194304] 0 2023-12-17T11:57:49.847 INFO:tasks.workunit.client.1.smithi119.stdout:8/528: fsync d7/da/d11/faa 0 2023-12-17T11:57:49.847 INFO:tasks.workunit.client.1.smithi119.stdout:8/529: chown d7/d18/d45/d9f/f5a 10 1 2023-12-17T11:57:49.848 INFO:tasks.workunit.client.1.smithi119.stdout:8/530: fdatasync d7/d12/d69/d67/f99 0 2023-12-17T11:57:49.848 INFO:tasks.workunit.client.1.smithi119.stdout:8/531: truncate d7/d18/f95 580669 0 2023-12-17T11:57:49.848 INFO:tasks.workunit.client.1.smithi119.stdout:8/532: readlink d7/d18/d45/d9f/d7b/l7c 0 2023-12-17T11:57:49.854 INFO:tasks.workunit.client.1.smithi119.stdout:9/628: rename d12/d1d/d40 to d12/dca 0 2023-12-17T11:57:49.854 INFO:tasks.workunit.client.1.smithi119.stdout:9/629: fdatasync d12/d1d/d79/f9b 0 2023-12-17T11:57:49.857 INFO:tasks.workunit.client.1.smithi119.stdout:5/653: unlink d1/d70/d6b/d77/dae/dba/cce 0 2023-12-17T11:57:49.857 INFO:tasks.workunit.client.1.smithi119.stdout:5/654: fdatasync d1/d36/f91 0 2023-12-17T11:57:49.861 INFO:tasks.workunit.client.0.smithi002.stdout:0/566: write d0/d15/d59/f6b [1151166,107175] 0 2023-12-17T11:57:49.863 INFO:tasks.workunit.client.0.smithi002.stdout:5/627: mknod dc/d1a/d47/ce3 0 2023-12-17T11:57:49.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/628: chown dc/d1b/d5a/d68/d97/ddd/lcc 21094417 1 2023-12-17T11:57:49.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/629: dread - dc/d94/fce zero size 2023-12-17T11:57:49.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/630: dread - dc/d1b/d2d/dcf/fab zero size 2023-12-17T11:57:49.864 INFO:tasks.workunit.client.0.smithi002.stdout:5/631: dread - dc/d1a/faa zero size 2023-12-17T11:57:49.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/673: link fb dc/d42/da0/d72/d93/dd0/ff6 0 2023-12-17T11:57:49.867 INFO:tasks.workunit.client.0.smithi002.stdout:9/674: fdatasync dc/d42/d4f/dd5/fd8 0 2023-12-17T11:57:49.868 INFO:tasks.workunit.client.1.smithi119.stdout:4/614: mknod dd/d11/d2d/d9c/d55/d81/db8/dbd/cc5 0 2023-12-17T11:57:49.868 INFO:tasks.workunit.client.1.smithi119.stdout:4/615: write dd/f18 [3208340,23539] 0 2023-12-17T11:57:49.871 INFO:tasks.workunit.client.0.smithi002.stdout:0/567: link d0/d6/d26/d14/d19/d61/f88 d0/d6/d26/d14/d19/d37/d91/dae/fb5 0 2023-12-17T11:57:49.871 INFO:tasks.workunit.client.0.smithi002.stdout:0/568: chown d0/d33/l9d 654944936 1 2023-12-17T11:57:49.871 INFO:tasks.workunit.client.1.smithi119.stdout:6/558: truncate d2/d2b/f3a 369291 0 2023-12-17T11:57:49.872 INFO:tasks.workunit.client.1.smithi119.stdout:8/533: symlink d7/d18/d45/d9f/d7b/lb0 0 2023-12-17T11:57:49.872 INFO:tasks.workunit.client.1.smithi119.stdout:8/534: fdatasync d7/da/d11/d60/fa8 0 2023-12-17T11:57:49.874 INFO:tasks.workunit.client.0.smithi002.stdout:7/603: getdents d6/d17/dc/d13/d21 0 2023-12-17T11:57:49.874 INFO:tasks.workunit.client.0.smithi002.stdout:7/604: readlink d6/l85 0 2023-12-17T11:57:49.874 INFO:tasks.workunit.client.0.smithi002.stdout:7/605: stat d6/d17/dc/d13/d21/d2e/l39 0 2023-12-17T11:57:49.875 INFO:tasks.workunit.client.1.smithi119.stdout:9/630: mknod d12/d1d/d28/d4d/d73/d78/ccb 0 2023-12-17T11:57:49.876 INFO:tasks.workunit.client.1.smithi119.stdout:9/631: write d12/d1d/d28/d4d/d73/d78/d8b/da0/fac [93636,72553] 0 2023-12-17T11:57:49.877 INFO:tasks.workunit.client.1.smithi119.stdout:5/655: read d1/d44/f56 [2900309,120889] 0 2023-12-17T11:57:49.877 INFO:tasks.workunit.client.1.smithi119.stdout:5/656: fdatasync d1/d70/d6b/d77/dae/fc6 0 2023-12-17T11:57:49.878 INFO:tasks.workunit.client.0.smithi002.stdout:0/569: mknod d0/d6/d26/d14/d19/d37/d91/dae/cb6 0 2023-12-17T11:57:49.878 INFO:tasks.workunit.client.0.smithi002.stdout:0/570: chown d0/d6/d26/d14/d19/d2f/c63 112705 1 2023-12-17T11:57:49.879 INFO:tasks.workunit.client.1.smithi119.stdout:0/559: getdents d2/d16/d35 0 2023-12-17T11:57:49.879 INFO:tasks.workunit.client.1.smithi119.stdout:0/560: truncate d2/d66/d2e/d44/d7b/d5/dc/f91 5154726 0 2023-12-17T11:57:49.879 INFO:tasks.workunit.client.1.smithi119.stdout:0/561: dread - d2/f9b zero size 2023-12-17T11:57:49.880 INFO:tasks.workunit.client.0.smithi002.stdout:7/606: mknod d6/d17/dc/d13/d21/d2e/d4a/d53/d75/cb7 0 2023-12-17T11:57:49.881 INFO:tasks.workunit.client.0.smithi002.stdout:7/607: write d6/d17/f61 [4900747,98178] 0 2023-12-17T11:57:49.883 INFO:tasks.workunit.client.1.smithi119.stdout:4/616: symlink dd/d11/d2d/lc6 0 2023-12-17T11:57:49.883 INFO:tasks.workunit.client.1.smithi119.stdout:4/617: creat dd/d15/d16/d5a/fc7 x:0 0 0 2023-12-17T11:57:49.883 INFO:tasks.workunit.client.0.smithi002.stdout:9/675: rmdir dc/d1d/d25/d85/dc2/d91 39 2023-12-17T11:57:49.884 INFO:tasks.workunit.client.1.smithi119.stdout:6/559: symlink d2/d41/lad 0 2023-12-17T11:57:49.886 INFO:tasks.workunit.client.1.smithi119.stdout:8/535: dread d7/da/f3e [0,4194304] 0 2023-12-17T11:57:49.886 INFO:tasks.workunit.client.1.smithi119.stdout:8/536: write d7/d18/f5f [2545489,114215] 0 2023-12-17T11:57:49.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/608: stat c4 0 2023-12-17T11:57:49.888 INFO:tasks.workunit.client.1.smithi119.stdout:8/537: write d7/da/f3e [1319223,51710] 0 2023-12-17T11:57:49.888 INFO:tasks.workunit.client.1.smithi119.stdout:5/657: link d1/d36/l59 d1/da7/d71/lcf 0 2023-12-17T11:57:49.891 INFO:tasks.workunit.client.1.smithi119.stdout:4/618: truncate dd/d11/f5e 3580009 0 2023-12-17T11:57:49.892 INFO:tasks.workunit.client.0.smithi002.stdout:7/609: symlink d6/d17/dc/d67/d8b/d24/da3/lb8 0 2023-12-17T11:57:49.893 INFO:tasks.workunit.client.1.smithi119.stdout:4/619: mknod dd/d11/d2d/d9c/d55/d81/d88/d91/cc8 0 2023-12-17T11:57:49.894 INFO:tasks.workunit.client.1.smithi119.stdout:4/620: mknod dd/d15/d16/d20/cc9 0 2023-12-17T11:57:49.895 INFO:tasks.workunit.client.1.smithi119.stdout:4/621: chown dd/d15/lb0 9708 1 2023-12-17T11:57:49.896 INFO:tasks.workunit.client.1.smithi119.stdout:4/622: mkdir dd/d11/d2d/d9c/d55/d81/db8/d78/dca 0 2023-12-17T11:57:49.897 INFO:tasks.workunit.client.1.smithi119.stdout:4/623: mknod dd/d11/d2d/ccb 0 2023-12-17T11:57:49.900 INFO:tasks.workunit.client.1.smithi119.stdout:5/658: read d1/d70/d6b/f87 [427882,98784] 0 2023-12-17T11:57:49.900 INFO:tasks.workunit.client.1.smithi119.stdout:5/659: dread - d1/da7/faa zero size 2023-12-17T11:57:49.903 INFO:tasks.workunit.client.1.smithi119.stdout:5/660: rename d1/d44/fc0 to d1/d70/d6b/d77/fd0 0 2023-12-17T11:57:49.903 INFO:tasks.workunit.client.1.smithi119.stdout:5/661: readlink d1/l14 0 2023-12-17T11:57:49.909 INFO:tasks.workunit.client.1.smithi119.stdout:8/538: write d7/d18/d45/d9f/f6a [3671217,23390] 0 2023-12-17T11:57:49.911 INFO:tasks.workunit.client.0.smithi002.stdout:7/610: write d6/d17/dc/d13/d37/d4f/f80 [129643,28837] 0 2023-12-17T11:57:49.911 INFO:tasks.workunit.client.1.smithi119.stdout:4/624: unlink dd/d11/d2d/fa0 0 2023-12-17T11:57:49.911 INFO:tasks.workunit.client.0.smithi002.stdout:4/588: dwrite d0/d10/d14/d4e/f9c [0,4194304] 0 2023-12-17T11:57:49.913 INFO:tasks.workunit.client.1.smithi119.stdout:4/625: readlink dd/d15/d16/d20/d82/lc2 0 2023-12-17T11:57:49.913 INFO:tasks.workunit.client.1.smithi119.stdout:1/617: dwrite d3/db/d17/d24/f53 [0,4194304] 0 2023-12-17T11:57:49.916 INFO:tasks.workunit.client.0.smithi002.stdout:7/611: read d6/d17/dc/d67/f87 [459653,51815] 0 2023-12-17T11:57:49.919 INFO:tasks.workunit.client.1.smithi119.stdout:8/539: creat d7/d12/d69/d98/fb1 x:0 0 0 2023-12-17T11:57:49.919 INFO:tasks.workunit.client.1.smithi119.stdout:8/540: chown d7/l8 1 1 2023-12-17T11:57:49.920 INFO:tasks.workunit.client.1.smithi119.stdout:1/618: truncate d3/db/d17/d24/d20/dba/dbc/f6e 801299 0 2023-12-17T11:57:49.920 INFO:tasks.workunit.client.1.smithi119.stdout:9/632: dread d12/d1d/d28/d46/f66 [0,4194304] 0 2023-12-17T11:57:49.920 INFO:tasks.workunit.client.1.smithi119.stdout:9/633: truncate d12/d1d/d28/d4d/f6c 4199406 0 2023-12-17T11:57:49.921 INFO:tasks.workunit.client.1.smithi119.stdout:8/541: truncate d7/da/d11/f59 1749872 0 2023-12-17T11:57:49.922 INFO:tasks.workunit.client.1.smithi119.stdout:1/619: unlink d3/cd2 0 2023-12-17T11:57:49.922 INFO:tasks.workunit.client.1.smithi119.stdout:1/620: creat d3/db/d26/d8f/fe1 x:0 0 0 2023-12-17T11:57:49.922 INFO:tasks.workunit.client.1.smithi119.stdout:1/621: getdents d3/db/d26/d19/dc8 0 2023-12-17T11:57:49.927 INFO:tasks.workunit.client.1.smithi119.stdout:9/634: mkdir d12/d1d/d28/d46/d50/d92/dcc 0 2023-12-17T11:57:49.928 INFO:tasks.workunit.client.1.smithi119.stdout:8/542: rmdir d7/da/d11 39 2023-12-17T11:57:49.929 INFO:tasks.workunit.client.1.smithi119.stdout:8/543: symlink d7/d12/d23/lb2 0 2023-12-17T11:57:49.930 INFO:tasks.workunit.client.0.smithi002.stdout:6/605: dwrite d0/d1/dc/f8 [0,4194304] 0 2023-12-17T11:57:49.931 INFO:tasks.workunit.client.0.smithi002.stdout:6/606: write d0/d1/d21/f76 [4560795,57095] 0 2023-12-17T11:57:49.935 INFO:tasks.workunit.client.1.smithi119.stdout:3/685: dwrite d9/d11/d1e/d55/f7e [4194304,4194304] 0 2023-12-17T11:57:49.936 INFO:tasks.workunit.client.1.smithi119.stdout:8/544: rename d7/d18/d15/d81/c89 to d7/d18/d45/d9f/d75/cb3 0 2023-12-17T11:57:49.944 INFO:tasks.workunit.client.1.smithi119.stdout:5/662: dread d1/f17 [0,4194304] 0 2023-12-17T11:57:49.948 INFO:tasks.workunit.client.1.smithi119.stdout:0/562: dwrite d2/d66/d2e/f6d [0,4194304] 0 2023-12-17T11:57:49.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/661: dwrite d9/d15/f32 [4194304,4194304] 0 2023-12-17T11:57:49.959 INFO:tasks.workunit.client.0.smithi002.stdout:0/571: truncate d0/d15/f27 3555622 0 2023-12-17T11:57:49.962 INFO:tasks.workunit.client.0.smithi002.stdout:9/676: dwrite dc/d1d/fe8 [0,4194304] 0 2023-12-17T11:57:49.963 INFO:tasks.workunit.client.0.smithi002.stdout:3/662: mkdir d9/d15/d52/d85/dd9 0 2023-12-17T11:57:49.966 INFO:tasks.workunit.client.1.smithi119.stdout:6/560: dwrite d2/d7e/f9f [0,4194304] 0 2023-12-17T11:57:49.966 INFO:tasks.workunit.client.1.smithi119.stdout:6/561: getdents d2/d9b/dac 0 2023-12-17T11:57:49.967 INFO:tasks.workunit.client.1.smithi119.stdout:9/635: write d12/d1d/d28/d46/d6e/fb6 [1330992,57978] 0 2023-12-17T11:57:49.967 INFO:tasks.workunit.client.1.smithi119.stdout:9/636: write d12/d1d/f9e [664653,119636] 0 2023-12-17T11:57:49.967 INFO:tasks.workunit.client.1.smithi119.stdout:8/545: dread d7/da/d11/d26/d49/f78 [0,4194304] 0 2023-12-17T11:57:49.969 INFO:tasks.workunit.client.0.smithi002.stdout:3/663: dread d9/d15/f19 [4194304,4194304] 0 2023-12-17T11:57:49.975 INFO:tasks.workunit.client.0.smithi002.stdout:7/612: dread d6/d17/dc/d13/d37/f3c [0,4194304] 0 2023-12-17T11:57:49.979 INFO:tasks.workunit.client.1.smithi119.stdout:3/686: getdents d9/da/df/d41/d33/d3a/d90 0 2023-12-17T11:57:49.979 INFO:tasks.workunit.client.1.smithi119.stdout:3/687: chown d9/da/df/f17 909931 1 2023-12-17T11:57:49.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/634: sync 2023-12-17T11:57:49.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/677: getdents dc/d42/da0/d72/d93/d52 0 2023-12-17T11:57:49.981 INFO:tasks.workunit.client.0.smithi002.stdout:9/678: chown dc/d42/da0/d72/d93/d52 189 1 2023-12-17T11:57:49.982 INFO:tasks.workunit.client.0.smithi002.stdout:6/607: dread d0/d1/d21/d56/d8c/d93/da5/dbc/dc1/fc2 [0,4194304] 0 2023-12-17T11:57:49.986 INFO:tasks.workunit.client.1.smithi119.stdout:9/637: rename d12/d1d/d28/d46/d6e/ca4 to d12/d1d/d28/d4d/d73/d78/d8b/ccd 0 2023-12-17T11:57:49.990 INFO:tasks.workunit.client.1.smithi119.stdout:0/563: dwrite d2/d66/f1c [0,4194304] 0 2023-12-17T11:57:49.991 INFO:tasks.workunit.client.1.smithi119.stdout:5/663: getdents d1/d25 0 2023-12-17T11:57:49.994 INFO:tasks.workunit.client.0.smithi002.stdout:3/664: mknod d9/d15/d52/d79/dd1/dd5/cda 0 2023-12-17T11:57:49.995 INFO:tasks.workunit.client.1.smithi119.stdout:8/546: rename d7/d12/d69/d67 to d7/d12/d23/db4 0 2023-12-17T11:57:49.998 INFO:tasks.workunit.client.1.smithi119.stdout:4/626: dwrite dd/d15/d16/f45 [0,4194304] 0 2023-12-17T11:57:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:0/572: link d0/d6/d26/d25/c41 d0/d6/d26/d14/d19/d37/d91/cb7 0 2023-12-17T11:57:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:0/573: readlink d0/d6/d26/l1f 0 2023-12-17T11:57:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/632: dwrite dc/d1b/d2d/d5b/fe2 [0,4194304] 0 2023-12-17T11:57:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:0/574: fsync d0/d6/fe 0 2023-12-17T11:57:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/633: creat dc/d1b/fe4 x:0 0 0 2023-12-17T11:57:49.999 INFO:tasks.workunit.client.0.smithi002.stdout:5/634: truncate dc/d17/d1c/fae 116189 0 2023-12-17T11:57:50.005 INFO:tasks.workunit.client.0.smithi002.stdout:7/613: mkdir d6/d99/da1/db9 0 2023-12-17T11:57:50.005 INFO:tasks.workunit.client.0.smithi002.stdout:7/614: stat d6/l58 0 2023-12-17T11:57:50.007 INFO:tasks.workunit.client.1.smithi119.stdout:0/564: symlink d2/d66/d1f/d24/la9 0 2023-12-17T11:57:50.009 INFO:tasks.workunit.client.0.smithi002.stdout:2/635: creat d3/d4/d17/d19/d4d/d72/d77/da7/fe1 x:0 0 0 2023-12-17T11:57:50.011 INFO:tasks.workunit.client.1.smithi119.stdout:8/547: mknod d7/d18/d45/d9f/cb5 0 2023-12-17T11:57:50.012 INFO:tasks.workunit.client.1.smithi119.stdout:6/562: dwrite d2/df/f4b [0,4194304] 0 2023-12-17T11:57:50.013 INFO:tasks.workunit.client.0.smithi002.stdout:9/679: mknod dc/d1d/d7c/d90/dc0/cf7 0 2023-12-17T11:57:50.014 INFO:tasks.workunit.client.0.smithi002.stdout:3/665: write d9/d1b/d35/d41/d59/d7c/f8b [3524274,128010] 0 2023-12-17T11:57:50.015 INFO:tasks.workunit.client.1.smithi119.stdout:3/688: rename d9/d11/d1e/d55/d65/d84 to d9/d35/dbd/dfb/d107 0 2023-12-17T11:57:50.023 INFO:tasks.workunit.client.1.smithi119.stdout:4/627: mkdir dd/d11/d2d/d9c/d55/d81/db8/d78/dcc 0 2023-12-17T11:57:50.023 INFO:tasks.workunit.client.1.smithi119.stdout:4/628: truncate dd/d4b/f54 1125458 0 2023-12-17T11:57:50.024 INFO:tasks.workunit.client.1.smithi119.stdout:5/664: dread d1/d44/f72 [0,4194304] 0 2023-12-17T11:57:50.024 INFO:tasks.workunit.client.1.smithi119.stdout:5/665: write d1/d36/f91 [959489,29832] 0 2023-12-17T11:57:50.024 INFO:tasks.workunit.client.1.smithi119.stdout:5/666: dread - d1/da7/d71/d76/d83/fb8 zero size 2023-12-17T11:57:50.024 INFO:tasks.workunit.client.1.smithi119.stdout:5/667: chown d1/l2a 31564 1 2023-12-17T11:57:50.027 INFO:tasks.workunit.client.0.smithi002.stdout:0/575: mkdir d0/d6/d26/d14/d19/d37/d62/db8 0 2023-12-17T11:57:50.027 INFO:tasks.workunit.client.0.smithi002.stdout:0/576: chown d0/d6/d26/d25/f96 558630 1 2023-12-17T11:57:50.027 INFO:tasks.workunit.client.0.smithi002.stdout:0/577: readlink d0/d15/d59/l6f 0 2023-12-17T11:57:50.029 INFO:tasks.workunit.client.1.smithi119.stdout:9/638: write d12/d1d/d28/f3d [5058015,112371] 0 2023-12-17T11:57:50.029 INFO:tasks.workunit.client.1.smithi119.stdout:9/639: dread - d12/d65/fa8 zero size 2023-12-17T11:57:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.027+0000 7fa47b2d0700 1 -- 172.21.15.2:0/3225097289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 msgr2=0x7fa474070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.027+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/3225097289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa474070030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa470004940 tx=0x7fa470009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.028+0000 7fa47b2d0700 1 -- 172.21.15.2:0/3225097289 shutdown_connections 2023-12-17T11:57:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.028+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/3225097289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 0x7fa4740709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.028+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/3225097289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa474070030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.028+0000 7fa47b2d0700 1 -- 172.21.15.2:0/3225097289 >> 172.21.15.2:0/3225097289 conn(0x7fa4740f82d0 msgr2=0x7fa4740fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.028+0000 7fa47b2d0700 1 -- 172.21.15.2:0/3225097289 shutdown_connections 2023-12-17T11:57:50.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.028+0000 7fa47b2d0700 1 -- 172.21.15.2:0/3225097289 wait complete. 2023-12-17T11:57:50.033 INFO:tasks.workunit.client.1.smithi119.stdout:8/548: creat d7/d18/d45/d9f/d7b/fb6 x:0 0 0 2023-12-17T11:57:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.029+0000 7fa47b2d0700 1 Processor -- start 2023-12-17T11:57:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.030+0000 7fa47b2d0700 1 -- start start 2023-12-17T11:57:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.031+0000 7fa47b2d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 0x7fa47410b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.031+0000 7fa47b2d0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa47410b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.031+0000 7fa47b2d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47410be80 con 0x7fa474070570 2023-12-17T11:57:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.031+0000 7fa47b2d0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47410c720 con 0x7fa474071bc0 2023-12-17T11:57:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.032+0000 7fa47886b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa47410b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:50.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.032+0000 7fa47886b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa47410b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:55220/0 (socket says 172.21.15.2:55220) 2023-12-17T11:57:50.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.032+0000 7fa47886b700 1 -- 172.21.15.2:0/1832908750 learned_addr learned my addr 172.21.15.2:0/1832908750 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:57:50.036 INFO:tasks.workunit.client.1.smithi119.stdout:0/565: write d2/d66/d1f/d24/d50/d5d/f64 [2217827,24525] 0 2023-12-17T11:57:50.037 INFO:tasks.workunit.client.0.smithi002.stdout:7/615: mknod d6/d17/dc/d13/d21/d2e/d4a/cba 0 2023-12-17T11:57:50.037 INFO:tasks.workunit.client.0.smithi002.stdout:2/636: creat d3/d4/d43/fe2 x:0 0 0 2023-12-17T11:57:50.037 INFO:tasks.workunit.client.0.smithi002.stdout:2/637: read d3/d4/f6 [360491,12677] 0 2023-12-17T11:57:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.036+0000 7fa47886b700 1 -- 172.21.15.2:0/1832908750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 msgr2=0x7fa47410b2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:57:50.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.036+0000 7fa47906c700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 0x7fa47410b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.036+0000 7fa47886b700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 0x7fa47410b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.036+0000 7fa47886b700 1 -- 172.21.15.2:0/1832908750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470005040 con 0x7fa474071bc0 2023-12-17T11:57:50.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.036+0000 7fa47906c700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 0x7fa47410b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:57:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.037+0000 7fa47886b700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa47410b830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa46400eb40 tx=0x7fa46400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.038+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa464007cc0 con 0x7fa474071bc0 2023-12-17T11:57:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.038+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa46400f040 con 0x7fa474071bc0 2023-12-17T11:57:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.038+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa464009570 con 0x7fa474071bc0 2023-12-17T11:57:50.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.038+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47410c9a0 con 0x7fa474071bc0 2023-12-17T11:57:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.038+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa47410cee0 con 0x7fa474071bc0 2023-12-17T11:57:50.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.041+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4740fbf50 con 0x7fa474071bc0 2023-12-17T11:57:50.045 INFO:tasks.workunit.client.1.smithi119.stdout:6/563: symlink d2/d7e/lae 0 2023-12-17T11:57:50.045 INFO:tasks.workunit.client.1.smithi119.stdout:6/564: chown d2/df/c91 0 1 2023-12-17T11:57:50.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.045+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fa4640096d0 con 0x7fa474071bc0 2023-12-17T11:57:50.048 INFO:tasks.workunit.client.0.smithi002.stdout:0/578: getdents d0 0 2023-12-17T11:57:50.049 INFO:tasks.workunit.client.0.smithi002.stdout:7/616: creat d6/d81/fbb x:0 0 0 2023-12-17T11:57:50.049 INFO:tasks.workunit.client.0.smithi002.stdout:0/579: chown d0/d6/d26/d14/d19/la4 1614384912 1 2023-12-17T11:57:50.049 INFO:tasks.workunit.client.0.smithi002.stdout:7/617: stat d6/d17/dc/d13/d37/d4f/f9d 0 2023-12-17T11:57:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.047+0000 7fa469ffb700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fa46006ae40 0x7fa46006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.047+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa464089850 con 0x7fa474071bc0 2023-12-17T11:57:50.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.048+0000 7fa47906c700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fa46006ae40 0x7fa46006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:50.051 INFO:tasks.workunit.client.1.smithi119.stdout:5/668: write d1/f29 [3719560,57121] 0 2023-12-17T11:57:50.051 INFO:tasks.workunit.client.1.smithi119.stdout:3/689: creat d9/d35/f108 x:0 0 0 2023-12-17T11:57:50.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.050+0000 7fa47906c700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fa46006ae40 0x7fa46006d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa470009e30 comp rx=0 tx=0).ready entity=mgr.24421 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:50.054 INFO:tasks.workunit.client.0.smithi002.stdout:6/608: dwrite d0/d1/dc/d17/d67/f9c [0,4194304] 0 2023-12-17T11:57:50.055 INFO:tasks.workunit.client.0.smithi002.stdout:6/609: chown d0/d1/dc/d10/c59 761 1 2023-12-17T11:57:50.055 INFO:tasks.workunit.client.1.smithi119.stdout:4/629: link f2 dd/d11/d2d/d9c/d55/d81/fcd 0 2023-12-17T11:57:50.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.055+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa464053c20 con 0x7fa474071bc0 2023-12-17T11:57:50.058 INFO:tasks.workunit.client.0.smithi002.stdout:2/638: mkdir d3/d4/d7/d14/d1b/d5b/de3 0 2023-12-17T11:57:50.058 INFO:tasks.workunit.client.0.smithi002.stdout:2/639: truncate d3/d4/d43/fc8 635465 0 2023-12-17T11:57:50.062 INFO:tasks.workunit.client.1.smithi119.stdout:9/640: creat d12/dca/fce x:0 0 0 2023-12-17T11:57:50.063 INFO:tasks.workunit.client.1.smithi119.stdout:9/641: readlink d12/d1d/d28/d4d/d73/d78/l81 0 2023-12-17T11:57:50.063 INFO:tasks.workunit.client.1.smithi119.stdout:9/642: fsync d12/d1d/d28/d46/d50/d92/fbe 0 2023-12-17T11:57:50.064 INFO:tasks.workunit.client.1.smithi119.stdout:8/549: creat d7/d12/d23/d9c/dad/fb7 x:0 0 0 2023-12-17T11:57:50.068 INFO:tasks.workunit.client.1.smithi119.stdout:0/566: rmdir d2/d66/d2e/d44 39 2023-12-17T11:57:50.070 INFO:tasks.workunit.client.1.smithi119.stdout:6/565: symlink d2/d61/laf 0 2023-12-17T11:57:50.071 INFO:tasks.workunit.client.1.smithi119.stdout:6/566: dread - d2/df/d17/fa4 zero size 2023-12-17T11:57:50.071 INFO:tasks.workunit.client.1.smithi119.stdout:6/567: chown d2/d2b/d43/c75 16384175 1 2023-12-17T11:57:50.071 INFO:tasks.workunit.client.1.smithi119.stdout:6/568: write d2/f38 [5167438,36775] 0 2023-12-17T11:57:50.072 INFO:tasks.workunit.client.0.smithi002.stdout:7/618: link d6/d17/dc/d67/d8b/l64 d6/d81/lbc 0 2023-12-17T11:57:50.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/680: dread dc/f1e [0,4194304] 0 2023-12-17T11:57:50.073 INFO:tasks.workunit.client.1.smithi119.stdout:2/697: sync 2023-12-17T11:57:50.073 INFO:tasks.workunit.client.1.smithi119.stdout:7/642: sync 2023-12-17T11:57:50.073 INFO:tasks.workunit.client.1.smithi119.stdout:7/643: chown d2/d4/d70/dac 30835328 1 2023-12-17T11:57:50.073 INFO:tasks.workunit.client.1.smithi119.stdout:2/698: chown d6/d9/d13/d34/l3d 1852639 1 2023-12-17T11:57:50.074 INFO:tasks.workunit.client.1.smithi119.stdout:5/669: mkdir d1/da7/d71/d76/d83/dd1 0 2023-12-17T11:57:50.074 INFO:tasks.workunit.client.1.smithi119.stdout:4/630: symlink dd/d11/d2d/d9c/d55/d81/d88/lce 0 2023-12-17T11:57:50.080 INFO:tasks.workunit.client.1.smithi119.stdout:9/643: unlink d12/d1d/d49/fa6 0 2023-12-17T11:57:50.083 INFO:tasks.workunit.client.1.smithi119.stdout:0/567: creat d2/d66/d2e/d44/d7b/d5/dc/faa x:0 0 0 2023-12-17T11:57:50.084 INFO:tasks.workunit.client.1.smithi119.stdout:2/699: rmdir d6/d9/d13/d34/dcf 39 2023-12-17T11:57:50.086 INFO:tasks.workunit.client.1.smithi119.stdout:7/644: mkdir d2/d40/dc3/dc8 0 2023-12-17T11:57:50.086 INFO:tasks.workunit.client.1.smithi119.stdout:7/645: readlink d2/d4/d1f/l93 0 2023-12-17T11:57:50.087 INFO:tasks.workunit.client.0.smithi002.stdout:3/666: dwrite d9/d24/f6d [0,4194304] 0 2023-12-17T11:57:50.087 INFO:tasks.workunit.client.0.smithi002.stdout:5/635: dwrite dc/d1b/d5a/d96/f35 [0,4194304] 0 2023-12-17T11:57:50.090 INFO:tasks.workunit.client.1.smithi119.stdout:9/644: mkdir d12/d1d/d49/d89/dcf 0 2023-12-17T11:57:50.092 INFO:tasks.workunit.client.0.smithi002.stdout:2/640: dread d3/d4/d7/d14/d1b/f29 [4194304,4194304] 0 2023-12-17T11:57:50.092 INFO:tasks.workunit.client.0.smithi002.stdout:2/641: dread - d3/d4/d8b/da6/fc4 zero size 2023-12-17T11:57:50.094 INFO:tasks.workunit.client.1.smithi119.stdout:0/568: rename d2/d66/d1f/d24/d50/d5d/f70 to d2/d16/fab 0 2023-12-17T11:57:50.101 INFO:tasks.workunit.client.0.smithi002.stdout:3/667: read d9/d24/f6d [2721394,96429] 0 2023-12-17T11:57:50.102 INFO:tasks.workunit.client.1.smithi119.stdout:2/700: link d6/d9/d52/d5a/l78 d6/d2b/d4b/d81/df2/lf8 0 2023-12-17T11:57:50.108 INFO:tasks.workunit.client.1.smithi119.stdout:7/646: mknod d2/d4/d11/d2c/d55/d67/cc9 0 2023-12-17T11:57:50.108 INFO:tasks.workunit.client.1.smithi119.stdout:7/647: chown d2/d5b/c8b 1052391736 1 2023-12-17T11:57:50.108 INFO:tasks.workunit.client.1.smithi119.stdout:7/648: chown d2/d4/d11/d2c/d68/d6a/f78 9130 1 2023-12-17T11:57:50.109 INFO:tasks.workunit.client.0.smithi002.stdout:7/619: dread d6/d17/dc/d13/d21/d2e/fae [0,4194304] 0 2023-12-17T11:57:50.115 INFO:tasks.workunit.client.0.smithi002.stdout:3/668: dread d9/d1b/fc1 [0,4194304] 0 2023-12-17T11:57:50.120 INFO:tasks.workunit.client.1.smithi119.stdout:9/645: rename d12/d1d/fc5 to d12/d1d/d28/d46/d50/d92/da1/fd0 0 2023-12-17T11:57:50.120 INFO:tasks.workunit.client.1.smithi119.stdout:9/646: write d12/d1d/f8e [208870,62932] 0 2023-12-17T11:57:50.122 INFO:tasks.workunit.client.0.smithi002.stdout:5/636: rmdir dc/d1a/d61 39 2023-12-17T11:57:50.124 INFO:tasks.workunit.client.1.smithi119.stdout:0/569: mkdir d2/dac 0 2023-12-17T11:57:50.126 INFO:tasks.workunit.client.0.smithi002.stdout:2/642: mknod d3/d4/d43/ce4 0 2023-12-17T11:57:50.130 INFO:tasks.workunit.client.1.smithi119.stdout:7/649: mkdir d2/d40/dc3/dca 0 2023-12-17T11:57:50.131 INFO:tasks.workunit.client.0.smithi002.stdout:2/643: rename d3/d4/d43/fe2 to d3/d4/d7/d14/d2e/d37/fe5 0 2023-12-17T11:57:50.134 INFO:tasks.workunit.client.0.smithi002.stdout:1/684: sync 2023-12-17T11:57:50.135 INFO:tasks.workunit.client.1.smithi119.stdout:9/647: rmdir d12/d1d/d28/d4d/d73/d78/d8b/da0 39 2023-12-17T11:57:50.138 INFO:tasks.workunit.client.1.smithi119.stdout:0/570: unlink d2/d66/d1f/d24/l2f 0 2023-12-17T11:57:50.138 INFO:tasks.workunit.client.1.smithi119.stdout:0/571: chown d2/d16/d35/d39/f99 1090377875 1 2023-12-17T11:57:50.138 INFO:tasks.workunit.client.1.smithi119.stdout:0/572: fdatasync d2/d16/d35/f6c 0 2023-12-17T11:57:50.138 INFO:tasks.workunit.client.0.smithi002.stdout:3/669: write d9/d1b/d35/d41/d59/d7c/db7/fcb [1739699,252] 0 2023-12-17T11:57:50.141 INFO:tasks.workunit.client.0.smithi002.stdout:1/685: symlink d3/d2f/d74/le6 0 2023-12-17T11:57:50.143 INFO:tasks.workunit.client.1.smithi119.stdout:9/648: rmdir d12/d65 39 2023-12-17T11:57:50.144 INFO:tasks.workunit.client.0.smithi002.stdout:6/610: dwrite d0/d1/d21/d56/d8c/d93/da5/f8d [0,4194304] 0 2023-12-17T11:57:50.144 INFO:tasks.workunit.client.0.smithi002.stdout:2/644: rmdir d3/d4/d8b/da6 39 2023-12-17T11:57:50.147 INFO:tasks.workunit.client.1.smithi119.stdout:9/649: symlink d12/d1d/d49/dad/ld1 0 2023-12-17T11:57:50.149 INFO:tasks.workunit.client.0.smithi002.stdout:3/670: creat d9/d15/d52/d79/dab/fdb x:0 0 0 2023-12-17T11:57:50.149 INFO:tasks.workunit.client.0.smithi002.stdout:3/671: fdatasync d9/d1b/d35/d41/d43/d73/fd6 0 2023-12-17T11:57:50.149 INFO:tasks.workunit.client.0.smithi002.stdout:3/672: fsync d9/d15/d52/fc8 0 2023-12-17T11:57:50.152 INFO:tasks.workunit.client.0.smithi002.stdout:1/686: creat d3/d6/d9/d37/d39/d43/d8f/fe7 x:0 0 0 2023-12-17T11:57:50.152 INFO:tasks.workunit.client.0.smithi002.stdout:6/611: truncate d0/d1/d21/d56/d60/f62 5312504 0 2023-12-17T11:57:50.152 INFO:tasks.workunit.client.0.smithi002.stdout:6/612: fsync d0/d1/d5b/f95 0 2023-12-17T11:57:50.154 INFO:tasks.workunit.client.0.smithi002.stdout:2/645: mknod d3/d4/d17/d19/d4d/ce6 0 2023-12-17T11:57:50.155 INFO:tasks.workunit.client.1.smithi119.stdout:6/569: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:57:50.155 INFO:tasks.workunit.client.0.smithi002.stdout:7/620: dread d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:50.157 INFO:tasks.workunit.client.1.smithi119.stdout:4/631: dwrite dd/d4b/f54 [0,4194304] 0 2023-12-17T11:57:50.157 INFO:tasks.workunit.client.1.smithi119.stdout:8/550: dwrite d7/d12/d23/db4/f91 [0,4194304] 0 2023-12-17T11:57:50.157 INFO:tasks.workunit.client.1.smithi119.stdout:4/632: creat dd/d15/d16/d5a/fcf x:0 0 0 2023-12-17T11:57:50.157 INFO:tasks.workunit.client.1.smithi119.stdout:8/551: write d7/d18/f95 [1091714,97736] 0 2023-12-17T11:57:50.157 INFO:tasks.workunit.client.1.smithi119.stdout:8/552: fdatasync d7/d12/d23/db4/f91 0 2023-12-17T11:57:50.159 INFO:tasks.workunit.client.1.smithi119.stdout:6/570: rename d2/fa5 to d2/d2b/d43/d76/fb0 0 2023-12-17T11:57:50.159 INFO:tasks.workunit.client.0.smithi002.stdout:1/687: link d3/d6/d9/d30/f56 d3/d6/d16/d28/fe8 0 2023-12-17T11:57:50.159 INFO:tasks.workunit.client.0.smithi002.stdout:7/621: truncate d6/d17/dc/d6c/d93/fa0 304784 0 2023-12-17T11:57:50.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/613: mknod d0/d1/dc/d10/cc8 0 2023-12-17T11:57:50.159 INFO:tasks.workunit.client.0.smithi002.stdout:6/614: chown d0/d1/dc/d10/fb6 397 1 2023-12-17T11:57:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:2/646: truncate d3/d4/d17/fa5 2088352 0 2023-12-17T11:57:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:5/637: dread dc/d1a/d47/f49 [0,4194304] 0 2023-12-17T11:57:50.160 INFO:tasks.workunit.client.0.smithi002.stdout:2/647: chown d3/d4/d43/fc8 84591984 1 2023-12-17T11:57:50.163 INFO:tasks.workunit.client.1.smithi119.stdout:9/650: dread d12/d1d/d28/d46/d50/f60 [4194304,4194304] 0 2023-12-17T11:57:50.163 INFO:tasks.workunit.client.1.smithi119.stdout:9/651: fdatasync d12/d1d/d79/f99 0 2023-12-17T11:57:50.166 INFO:tasks.workunit.client.0.smithi002.stdout:6/615: symlink d0/d1/dc/d58/dae/lc9 0 2023-12-17T11:57:50.167 INFO:tasks.workunit.client.1.smithi119.stdout:5/670: getdents d1/da7/d71/d76/d83 0 2023-12-17T11:57:50.167 INFO:tasks.workunit.client.1.smithi119.stdout:5/671: creat d1/d70/d6b/fd2 x:0 0 0 2023-12-17T11:57:50.167 INFO:tasks.workunit.client.1.smithi119.stdout:5/672: write d1/da7/d71/d82/fa1 [911156,127703] 0 2023-12-17T11:57:50.168 INFO:tasks.workunit.client.1.smithi119.stdout:5/673: write d1/d36/f47 [2217178,30404] 0 2023-12-17T11:57:50.169 INFO:tasks.workunit.client.0.smithi002.stdout:5/638: link dc/d1a/l41 dc/d1b/d2d/d5b/le5 0 2023-12-17T11:57:50.169 INFO:tasks.workunit.client.0.smithi002.stdout:5/639: rename dc/d1a/d61 to dc/d1a/d61/de6 22 2023-12-17T11:57:50.169 INFO:tasks.workunit.client.1.smithi119.stdout:2/701: dwrite f4 [0,4194304] 0 2023-12-17T11:57:50.176 INFO:tasks.workunit.client.1.smithi119.stdout:8/553: creat d7/d18/d15/d81/d8e/fb8 x:0 0 0 2023-12-17T11:57:50.176 INFO:tasks.workunit.client.1.smithi119.stdout:8/554: chown d7/d18/d45/d9f/d7b/l7c 54307347 1 2023-12-17T11:57:50.179 INFO:tasks.workunit.client.0.smithi002.stdout:0/580: dwrite d0/d6/d26/d14/d19/d37/fa8 [0,4194304] 0 2023-12-17T11:57:50.183 INFO:tasks.workunit.client.1.smithi119.stdout:9/652: unlink d12/d1d/c29 0 2023-12-17T11:57:50.189 INFO:tasks.workunit.client.1.smithi119.stdout:5/674: mknod d1/d70/d85/d95/dc3/cd3 0 2023-12-17T11:57:50.191 INFO:tasks.workunit.client.1.smithi119.stdout:2/702: rename d6/d9/d13/d34/d88/ld9 to d6/d9/d13/d34/d70/lf9 0 2023-12-17T11:57:50.193 INFO:tasks.workunit.client.1.smithi119.stdout:9/653: mkdir d12/d1d/d49/d85/dd2 0 2023-12-17T11:57:50.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/640: unlink dc/d1a/d53/cd8 0 2023-12-17T11:57:50.197 INFO:tasks.workunit.client.0.smithi002.stdout:4/589: sync 2023-12-17T11:57:50.197 INFO:tasks.workunit.client.0.smithi002.stdout:9/681: write dc/d42/da0/d72/d93/d76/fc1 [381694,88569] 0 2023-12-17T11:57:50.197 INFO:tasks.workunit.client.0.smithi002.stdout:4/590: fsync d0/f6f 0 2023-12-17T11:57:50.198 INFO:tasks.workunit.client.0.smithi002.stdout:9/682: truncate dc/d42/d4f/d59/ff5 479133 0 2023-12-17T11:57:50.198 INFO:tasks.workunit.client.0.smithi002.stdout:4/591: creat d0/fc0 x:0 0 0 2023-12-17T11:57:50.198 INFO:tasks.workunit.client.0.smithi002.stdout:8/657: sync 2023-12-17T11:57:50.199 INFO:tasks.workunit.client.1.smithi119.stdout:0/573: dwrite d2/f67 [0,4194304] 0 2023-12-17T11:57:50.202 INFO:tasks.workunit.client.1.smithi119.stdout:5/675: mknod d1/cd4 0 2023-12-17T11:57:50.207 INFO:tasks.workunit.client.1.smithi119.stdout:2/703: creat d6/d9/d13/d34/dcf/ffa x:0 0 0 2023-12-17T11:57:50.207 INFO:tasks.workunit.client.1.smithi119.stdout:2/704: chown d6/d2b/da3 3 1 2023-12-17T11:57:50.210 INFO:tasks.workunit.client.1.smithi119.stdout:7/650: dwrite d2/f74 [0,4194304] 0 2023-12-17T11:57:50.210 INFO:tasks.workunit.client.1.smithi119.stdout:7/651: fsync d2/d4/d70/f87 0 2023-12-17T11:57:50.213 INFO:tasks.workunit.client.1.smithi119.stdout:9/654: creat d12/d1d/d49/d85/dd2/fd3 x:0 0 0 2023-12-17T11:57:50.215 INFO:tasks.workunit.client.0.smithi002.stdout:4/592: link d0/d10/c32 d0/d10/d14/cc1 0 2023-12-17T11:57:50.217 INFO:tasks.workunit.client.0.smithi002.stdout:4/593: dread - d0/d10/d14/d27/d57/d7d/fb7 zero size 2023-12-17T11:57:50.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/683: mkdir dc/d1d/d25/d85/dc2/df8 0 2023-12-17T11:57:50.221 INFO:tasks.workunit.client.0.smithi002.stdout:9/684: read - dc/d42/d4f/d59/fb8 zero size 2023-12-17T11:57:50.221 INFO:tasks.workunit.client.0.smithi002.stdout:9/685: dread - dc/fbc zero size 2023-12-17T11:57:50.225 INFO:tasks.workunit.client.0.smithi002.stdout:5/641: symlink dc/d17/dd2/le7 0 2023-12-17T11:57:50.229 INFO:tasks.workunit.client.1.smithi119.stdout:2/705: symlink d6/d9/d13/d34/d70/lfb 0 2023-12-17T11:57:50.229 INFO:tasks.workunit.client.0.smithi002.stdout:8/658: mknod d3/d8/cdd 0 2023-12-17T11:57:50.231 INFO:tasks.workunit.client.1.smithi119.stdout:6/571: dwrite d2/d2b/d43/f85 [0,4194304] 0 2023-12-17T11:57:50.231 INFO:tasks.workunit.client.1.smithi119.stdout:6/572: chown d2/d9b/dac 0 1 2023-12-17T11:57:50.232 INFO:tasks.workunit.client.1.smithi119.stdout:6/573: fdatasync d2/df/d17/d79/f7d 0 2023-12-17T11:57:50.233 INFO:tasks.workunit.client.1.smithi119.stdout:6/574: fdatasync d2/d2b/f6f 0 2023-12-17T11:57:50.233 INFO:tasks.workunit.client.1.smithi119.stdout:6/575: chown d2/d9b/dac 15893 1 2023-12-17T11:57:50.237 INFO:tasks.workunit.client.1.smithi119.stdout:7/652: truncate d2/d4/d11/d2c/f3a 3450911 0 2023-12-17T11:57:50.239 INFO:tasks.workunit.client.1.smithi119.stdout:9/655: mknod d12/d1d/d49/cd4 0 2023-12-17T11:57:50.239 INFO:tasks.workunit.client.1.smithi119.stdout:9/656: dread - d12/d1d/d28/f9a zero size 2023-12-17T11:57:50.240 INFO:tasks.workunit.client.0.smithi002.stdout:4/594: mknod d0/d10/d14/cc2 0 2023-12-17T11:57:50.240 INFO:tasks.workunit.client.1.smithi119.stdout:0/574: getdents d2/d66/d2e/d44/d7b/d5/dc 0 2023-12-17T11:57:50.241 INFO:tasks.workunit.client.0.smithi002.stdout:0/581: write d0/d6/d26/d14/d19/d61/f7c [2641853,71901] 0 2023-12-17T11:57:50.242 INFO:tasks.workunit.client.0.smithi002.stdout:0/582: write d0/d6/d26/d25/f96 [3483104,111091] 0 2023-12-17T11:57:50.242 INFO:tasks.workunit.client.0.smithi002.stdout:3/673: dwrite d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:50.243 INFO:tasks.workunit.client.1.smithi119.stdout:6/576: rename d2/l45 to d2/d7e/lb1 0 2023-12-17T11:57:50.243 INFO:tasks.workunit.client.0.smithi002.stdout:6/616: dread d0/d1/fd [0,4194304] 0 2023-12-17T11:57:50.247 INFO:tasks.workunit.client.1.smithi119.stdout:9/657: creat d12/d1d/d28/d46/dbb/fd5 x:0 0 0 2023-12-17T11:57:50.251 INFO:tasks.workunit.client.1.smithi119.stdout:7/653: rmdir d2/d4/d70/dac 39 2023-12-17T11:57:50.252 INFO:tasks.workunit.client.1.smithi119.stdout:7/654: write d2/d4/d11/d3c/d75/fb1 [920531,89983] 0 2023-12-17T11:57:50.252 INFO:tasks.workunit.client.1.smithi119.stdout:7/655: chown d2/d4/d11/d3c/d75/dad 17246 1 2023-12-17T11:57:50.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/583: getdents d0/d6/d26/d14/d6d 0 2023-12-17T11:57:50.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/584: chown d0/d6/d26/c74 1930322 1 2023-12-17T11:57:50.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/585: fdatasync d0/d6/d26/d14/d19/d2b/f30 0 2023-12-17T11:57:50.254 INFO:tasks.workunit.client.1.smithi119.stdout:9/658: truncate d12/d1d/d28/d4d/d73/d78/fa9 1089754 0 2023-12-17T11:57:50.259 INFO:tasks.workunit.client.1.smithi119.stdout:7/656: mknod d2/d4/d70/d57/ccb 0 2023-12-17T11:57:50.261 INFO:tasks.workunit.client.0.smithi002.stdout:6/617: rename d0/d1/d5b/f95 to d0/d1/fca 0 2023-12-17T11:57:50.261 INFO:tasks.workunit.client.0.smithi002.stdout:6/618: fdatasync d0/d1/dc/d17/d67/f84 0 2023-12-17T11:57:50.261 INFO:tasks.workunit.client.1.smithi119.stdout:1/622: sync 2023-12-17T11:57:50.263 INFO:tasks.workunit.client.1.smithi119.stdout:7/657: getdents d2/d4/d11/d2c/d68/d6a 0 2023-12-17T11:57:50.265 INFO:tasks.workunit.client.1.smithi119.stdout:1/623: creat d3/db/d17/d24/d20/d6c/db7/fe2 x:0 0 0 2023-12-17T11:57:50.265 INFO:tasks.workunit.client.1.smithi119.stdout:1/624: fdatasync d3/f65 0 2023-12-17T11:57:50.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/642: dread dc/d1a/d53/fc3 [0,4194304] 0 2023-12-17T11:57:50.268 INFO:tasks.workunit.client.1.smithi119.stdout:7/658: rename d2/d4/l7b to d2/d4/d11/d2c/d68/d6a/lcc 0 2023-12-17T11:57:50.268 INFO:tasks.workunit.client.1.smithi119.stdout:8/555: dwrite d7/da/d11/faa [0,4194304] 0 2023-12-17T11:57:50.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/659: dread d3/d8/f42 [0,4194304] 0 2023-12-17T11:57:50.270 INFO:tasks.workunit.client.1.smithi119.stdout:1/625: link d3/db/d17/d24/d20/d40/f5a d3/db/d26/d19/d3f/d64/db2/fe3 0 2023-12-17T11:57:50.273 INFO:tasks.workunit.client.1.smithi119.stdout:1/626: mkdir d3/db/d17/d24/d20/d6c/db7/de4 0 2023-12-17T11:57:50.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/660: mkdir d3/d7/d18/dde 0 2023-12-17T11:57:50.276 INFO:tasks.workunit.client.0.smithi002.stdout:8/661: fsync d3/d7/d6e/d7f/d65/f85 0 2023-12-17T11:57:50.297 INFO:tasks.workunit.client.0.smithi002.stdout:2/648: dwrite d3/d4/d17/d19/d4d/d72/d83/d94/f9c [0,4194304] 0 2023-12-17T11:57:50.304 INFO:tasks.workunit.client.0.smithi002.stdout:2/649: creat d3/d4/d17/d19/d4d/fe7 x:0 0 0 2023-12-17T11:57:50.304 INFO:tasks.workunit.client.0.smithi002.stdout:2/650: chown d3/d4/d7/d14/d42/l51 46 1 2023-12-17T11:57:50.305 INFO:tasks.workunit.client.1.smithi119.stdout:4/633: dwrite f8 [0,4194304] 0 2023-12-17T11:57:50.307 INFO:tasks.workunit.client.1.smithi119.stdout:4/634: symlink dd/d11/d2d/d9c/d55/d81/db8/ld0 0 2023-12-17T11:57:50.309 INFO:tasks.workunit.client.1.smithi119.stdout:4/635: symlink dd/d11/d26/ld1 0 2023-12-17T11:57:50.309 INFO:tasks.workunit.client.1.smithi119.stdout:4/636: dread - dd/d15/d16/d3d/fbf zero size 2023-12-17T11:57:50.313 INFO:tasks.workunit.client.1.smithi119.stdout:4/637: truncate dd/f71 2578177 0 2023-12-17T11:57:50.315 INFO:tasks.workunit.client.1.smithi119.stdout:4/638: mknod dd/d15/cd2 0 2023-12-17T11:57:50.315 INFO:tasks.workunit.client.1.smithi119.stdout:4/639: fdatasync dd/d15/d16/f1a 0 2023-12-17T11:57:50.315 INFO:tasks.workunit.client.1.smithi119.stdout:4/640: dread - dd/d15/d16/d5a/fcf zero size 2023-12-17T11:57:50.315 INFO:tasks.workunit.client.1.smithi119.stdout:7/659: dread d2/d40/f5a [0,4194304] 0 2023-12-17T11:57:50.316 INFO:tasks.workunit.client.0.smithi002.stdout:6/619: dread d0/d1/dc/d10/f37 [4194304,4194304] 0 2023-12-17T11:57:50.316 INFO:tasks.workunit.client.0.smithi002.stdout:6/620: stat d0/d1/d21/d56/d8c 0 2023-12-17T11:57:50.317 INFO:tasks.workunit.client.1.smithi119.stdout:4/641: mkdir dd/d11/d26/dd3 0 2023-12-17T11:57:50.319 INFO:tasks.workunit.client.1.smithi119.stdout:7/660: write d2/f31 [1336487,78043] 0 2023-12-17T11:57:50.319 INFO:tasks.workunit.client.1.smithi119.stdout:7/661: fdatasync d2/f76 0 2023-12-17T11:57:50.345 INFO:tasks.workunit.client.0.smithi002.stdout:5/643: dread dc/d1a/d47/f4a [0,4194304] 0 2023-12-17T11:57:50.347 INFO:tasks.workunit.client.0.smithi002.stdout:5/644: write dc/d17/d2f/d99/f9d [476236,80599] 0 2023-12-17T11:57:50.347 INFO:tasks.workunit.client.0.smithi002.stdout:5/645: readlink dc/d1b/d2d/l7d 0 2023-12-17T11:57:50.349 INFO:tasks.workunit.client.1.smithi119.stdout:1/627: rmdir d3/db/d17/d24/d20 39 2023-12-17T11:57:50.349 INFO:tasks.workunit.client.1.smithi119.stdout:8/556: dwrite d7/da/d11/d26/f32 [0,4194304] 0 2023-12-17T11:57:50.349 INFO:tasks.workunit.client.1.smithi119.stdout:8/557: fsync d7/da/d11/faa 0 2023-12-17T11:57:50.349 INFO:tasks.workunit.client.1.smithi119.stdout:8/558: dread - d7/d12/d23/d9c/dad/fb7 zero size 2023-12-17T11:57:50.351 INFO:tasks.workunit.client.1.smithi119.stdout:1/628: mkdir d3/db/d2a/de5 0 2023-12-17T11:57:50.352 INFO:tasks.workunit.client.0.smithi002.stdout:9/686: dwrite dc/d1d/d7c/d90/dc0/fc8 [0,4194304] 0 2023-12-17T11:57:50.352 INFO:tasks.workunit.client.0.smithi002.stdout:9/687: write dc/fbc [39851,3440] 0 2023-12-17T11:57:50.357 INFO:tasks.workunit.client.1.smithi119.stdout:2/706: dwrite d6/d9/d52/d53/d55/d58/dba/ff6 [0,4194304] 0 2023-12-17T11:57:50.358 INFO:tasks.workunit.client.0.smithi002.stdout:9/688: creat dc/d42/d4f/d9e/ff9 x:0 0 0 2023-12-17T11:57:50.358 INFO:tasks.workunit.client.0.smithi002.stdout:9/689: chown dc/d1d/d25/d85/dc2/d91/db2/dbf 345911 1 2023-12-17T11:57:50.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/651: write d3/d4/d7/d14/d1b/d5b/f97 [3696174,53829] 0 2023-12-17T11:57:50.360 INFO:tasks.workunit.client.0.smithi002.stdout:9/690: getdents dc/d1d/d25/d85/dc2/d91/db2 0 2023-12-17T11:57:50.360 INFO:tasks.workunit.client.0.smithi002.stdout:1/688: dwrite d3/d5c/fe0 [0,4194304] 0 2023-12-17T11:57:50.361 INFO:tasks.workunit.client.0.smithi002.stdout:1/689: read d3/f17 [2053369,24663] 0 2023-12-17T11:57:50.361 INFO:tasks.workunit.client.0.smithi002.stdout:1/690: creat d3/d2f/d4d/d95/fe9 x:0 0 0 2023-12-17T11:57:50.362 INFO:tasks.workunit.client.1.smithi119.stdout:0/575: dwrite d2/d66/d2e/d44/d7b/d5/dc/fa0 [0,4194304] 0 2023-12-17T11:57:50.362 INFO:tasks.workunit.client.1.smithi119.stdout:0/576: chown d2/d66/d1f/d24/d50/d5d/d80 0 1 2023-12-17T11:57:50.363 INFO:tasks.workunit.client.0.smithi002.stdout:3/674: dwrite d9/d15/f22 [0,4194304] 0 2023-12-17T11:57:50.363 INFO:tasks.workunit.client.0.smithi002.stdout:3/675: write d9/d24/f81 [4369402,83782] 0 2023-12-17T11:57:50.363 INFO:tasks.workunit.client.0.smithi002.stdout:3/676: fsync d9/d1b/fc7 0 2023-12-17T11:57:50.365 INFO:tasks.workunit.client.1.smithi119.stdout:4/642: dread dd/d11/d2d/d9c/d55/d81/fcd [0,4194304] 0 2023-12-17T11:57:50.365 INFO:tasks.workunit.client.1.smithi119.stdout:4/643: write f4 [9062659,47169] 0 2023-12-17T11:57:50.366 INFO:tasks.workunit.client.1.smithi119.stdout:5/676: dwrite d1/f35 [0,4194304] 0 2023-12-17T11:57:50.366 INFO:tasks.workunit.client.1.smithi119.stdout:5/677: chown d1/d36/d3a 1354 1 2023-12-17T11:57:50.369 INFO:tasks.workunit.client.1.smithi119.stdout:1/629: dread d3/db/d17/d24/d20/dba/dbc/f6e [0,4194304] 0 2023-12-17T11:57:50.370 INFO:tasks.workunit.client.0.smithi002.stdout:1/691: mkdir d3/d6/d9/d37/d39/d43/d8f/dea 0 2023-12-17T11:57:50.376 INFO:tasks.workunit.client.1.smithi119.stdout:9/659: dwrite d12/d1d/f36 [0,4194304] 0 2023-12-17T11:57:50.377 INFO:tasks.workunit.client.1.smithi119.stdout:6/577: dwrite d2/df/d17/f34 [0,4194304] 0 2023-12-17T11:57:50.382 INFO:tasks.workunit.client.0.smithi002.stdout:5/646: write dc/d1b/d5a/d96/f35 [2987025,88384] 0 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:8/662: dwrite d3/d8/da/dd/f66 [0,4194304] 0 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:8/663: fsync d3/d7/d6e/d7f/d65/fa1 0 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/647: write dc/d17/f26 [829598,93802] 0 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/648: chown dc/d17/d2f/d82/cd0 34311 1 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/649: chown dc/d1b/d5a/d96/f36 0 1 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:5/650: dread - dc/d1a/faa zero size 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.1.smithi119.stdout:7/662: dwrite d2/d4/d1f/f4c [0,4194304] 0 2023-12-17T11:57:50.383 INFO:tasks.workunit.client.0.smithi002.stdout:2/652: dread d3/d4/d7/fa1 [4194304,4194304] 0 2023-12-17T11:57:50.389 INFO:tasks.workunit.client.0.smithi002.stdout:6/621: write d0/d1/d21/d56/d8c/d93/da5/f8d [4163325,80964] 0 2023-12-17T11:57:50.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/586: dwrite d0/d6/d26/d14/f3f [0,4194304] 0 2023-12-17T11:57:50.392 INFO:tasks.workunit.client.1.smithi119.stdout:2/707: dread f5 [0,4194304] 0 2023-12-17T11:57:50.394 INFO:tasks.workunit.client.1.smithi119.stdout:9/660: dread d12/d1d/d28/d46/d6e/fb6 [0,4194304] 0 2023-12-17T11:57:50.395 INFO:tasks.workunit.client.1.smithi119.stdout:9/661: write d12/d1d/d28/f87 [964492,74325] 0 2023-12-17T11:57:50.395 INFO:tasks.workunit.client.1.smithi119.stdout:9/662: chown d12/d1d/d28/d46/d50/d92/dae/fb5 86 1 2023-12-17T11:57:50.395 INFO:tasks.workunit.client.1.smithi119.stdout:9/663: dread - d12/d1d/d79/db1/fc8 zero size 2023-12-17T11:57:50.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:50 smithi002 ceph-mon[107131]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:50.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:50 smithi002 ceph-mon[107131]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:50.395 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:50 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/789959935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:57:50.407 INFO:tasks.workunit.client.1.smithi119.stdout:0/577: dwrite d2/d66/f1c [0,4194304] 0 2023-12-17T11:57:50.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:50 smithi119 ceph-mon[117414]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:50 smithi119 ceph-mon[117414]: from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:50 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/789959935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:57:50.408 INFO:tasks.workunit.client.1.smithi119.stdout:3/690: sync 2023-12-17T11:57:50.408 INFO:tasks.workunit.client.1.smithi119.stdout:3/691: stat d9/da/df/cef 0 2023-12-17T11:57:50.414 INFO:tasks.workunit.client.1.smithi119.stdout:5/678: mknod d1/da7/d71/d76/d83/dd1/cd5 0 2023-12-17T11:57:50.419 INFO:tasks.workunit.client.1.smithi119.stdout:4/644: rmdir dd/d11/d2d/d9c/d6e 0 2023-12-17T11:57:50.419 INFO:tasks.workunit.client.1.smithi119.stdout:5/679: write d1/d70/d6b/d77/fd0 [795931,48236] 0 2023-12-17T11:57:50.419 INFO:tasks.workunit.client.1.smithi119.stdout:1/630: symlink d3/db/d17/d24/d20/dbd/le6 0 2023-12-17T11:57:50.420 INFO:tasks.workunit.client.0.smithi002.stdout:4/595: dwrite d0/d10/d14/f98 [0,4194304] 0 2023-12-17T11:57:50.425 INFO:tasks.workunit.client.1.smithi119.stdout:6/578: link d2/d61/f94 d2/d7e/d93/fb2 0 2023-12-17T11:57:50.427 INFO:tasks.workunit.client.0.smithi002.stdout:8/664: symlink d3/dca/ldf 0 2023-12-17T11:57:50.432 INFO:tasks.workunit.client.0.smithi002.stdout:6/622: creat d0/d1/dc/d17/d3c/fcb x:0 0 0 2023-12-17T11:57:50.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/587: creat d0/fb9 x:0 0 0 2023-12-17T11:57:50.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/588: dread - d0/d6/d26/d14/d19/d2f/f8d zero size 2023-12-17T11:57:50.440 INFO:tasks.workunit.client.1.smithi119.stdout:5/680: dread d1/da7/d71/f84 [0,4194304] 0 2023-12-17T11:57:50.441 INFO:tasks.workunit.client.1.smithi119.stdout:5/681: readlink d1/l18 0 2023-12-17T11:57:50.441 INFO:tasks.workunit.client.1.smithi119.stdout:0/578: creat d2/dac/fad x:0 0 0 2023-12-17T11:57:50.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/692: mkdir d3/d6/d9/d37/d39/d43/d4a/deb 0 2023-12-17T11:57:50.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/693: creat d3/d6/d9/d30/d9c/fec x:0 0 0 2023-12-17T11:57:50.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/694: write d3/d6/d16/d61/f93 [3174467,85902] 0 2023-12-17T11:57:50.442 INFO:tasks.workunit.client.0.smithi002.stdout:1/695: readlink d3/d6/d16/l34 0 2023-12-17T11:57:50.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/696: chown d3/d6/d16/l22 1523 1 2023-12-17T11:57:50.446 INFO:tasks.workunit.client.1.smithi119.stdout:3/692: mknod d9/d1c/c109 0 2023-12-17T11:57:50.454 INFO:tasks.workunit.client.1.smithi119.stdout:1/631: truncate d3/db/d26/f55 1888160 0 2023-12-17T11:57:50.459 INFO:tasks.workunit.client.0.smithi002.stdout:3/677: dwrite d9/d1b/d35/d41/d59/da3/fb8 [0,4194304] 0 2023-12-17T11:57:50.466 INFO:tasks.workunit.client.0.smithi002.stdout:5/651: dwrite dc/d1b/d2d/dcf/f92 [0,4194304] 0 2023-12-17T11:57:50.466 INFO:tasks.workunit.client.0.smithi002.stdout:5/652: readlink dc/l23 0 2023-12-17T11:57:50.466 INFO:tasks.workunit.client.1.smithi119.stdout:6/579: truncate d2/d41/f56 415174 0 2023-12-17T11:57:50.468 INFO:tasks.workunit.client.1.smithi119.stdout:9/664: dwrite d12/d1d/d28/d46/f59 [0,4194304] 0 2023-12-17T11:57:50.469 INFO:tasks.workunit.client.0.smithi002.stdout:0/589: dread d0/d15/f23 [0,4194304] 0 2023-12-17T11:57:50.469 INFO:tasks.workunit.client.1.smithi119.stdout:2/708: getdents d6/d38 0 2023-12-17T11:57:50.477 INFO:tasks.workunit.client.1.smithi119.stdout:0/579: dread d2/f6b [0,4194304] 0 2023-12-17T11:57:50.477 INFO:tasks.workunit.client.1.smithi119.stdout:0/580: chown d2/d66/d1f/d24/d50 656947 1 2023-12-17T11:57:50.479 INFO:tasks.workunit.client.1.smithi119.stdout:4/645: dwrite f2 [0,4194304] 0 2023-12-17T11:57:50.482 INFO:tasks.workunit.client.0.smithi002.stdout:4/596: mkdir d0/d3e/d56/dc3 0 2023-12-17T11:57:50.482 INFO:tasks.workunit.client.0.smithi002.stdout:8/665: creat d3/d8/d28/d31/fe0 x:0 0 0 2023-12-17T11:57:50.482 INFO:tasks.workunit.client.0.smithi002.stdout:8/666: chown d3/d7/d6e/l8d 1466 1 2023-12-17T11:57:50.482 INFO:tasks.workunit.client.0.smithi002.stdout:9/691: dwrite dc/d42/d4f/f92 [0,4194304] 0 2023-12-17T11:57:50.485 INFO:tasks.workunit.client.1.smithi119.stdout:3/693: mknod d9/d59/dda/c10a 0 2023-12-17T11:57:50.485 INFO:tasks.workunit.client.0.smithi002.stdout:6/623: rename d0/d1/dc/d10/f82 to d0/d1/d21/d56/d8c/d93/da5/dbc/fcc 0 2023-12-17T11:57:50.487 INFO:tasks.workunit.client.0.smithi002.stdout:1/697: mkdir d3/d6/d9/ded 0 2023-12-17T11:57:50.492 INFO:tasks.workunit.client.0.smithi002.stdout:3/678: mknod d9/d15/d71/dbb/cdc 0 2023-12-17T11:57:50.492 INFO:tasks.workunit.client.1.smithi119.stdout:5/682: dwrite d1/f29 [0,4194304] 0 2023-12-17T11:57:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:9/692: dread dc/f14 [0,4194304] 0 2023-12-17T11:57:50.495 INFO:tasks.workunit.client.0.smithi002.stdout:9/693: write f1 [8361421,75472] 0 2023-12-17T11:57:50.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/622: sync 2023-12-17T11:57:50.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/623: fsync d6/d17/dc/d13/d37/d4f/faa 0 2023-12-17T11:57:50.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.497+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 --> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa47410d1c0 con 0x7fa46006ae40 2023-12-17T11:57:50.499 INFO:tasks.workunit.client.0.smithi002.stdout:5/653: mknod dc/d1b/ce8 0 2023-12-17T11:57:50.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.500+0000 7fa469ffb700 1 -- 172.21.15.2:0/1832908750 <== mgr.24421 v2:172.21.15.119:6828/3593601472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa47410d1c0 con 0x7fa46006ae40 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [], 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "1/2 daemons upgraded", 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:57:50.503 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:57:50.504 INFO:tasks.workunit.client.1.smithi119.stdout:7/663: rmdir d2/d4 39 2023-12-17T11:57:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fa46006ae40 msgr2=0x7fa46006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fa46006ae40 0x7fa46006d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa470009e30 comp rx=0 tx=0).stop 2023-12-17T11:57:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 msgr2=0x7fa47410b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa47410b830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa46400eb40 tx=0x7fa46400b040 comp rx=0 tx=0).stop 2023-12-17T11:57:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 shutdown_connections 2023-12-17T11:57:50.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:6828/3593601472,v1:172.21.15.119:6829/3593601472] conn(0x7fa46006ae40 0x7fa46006d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:50.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa474070570 0x7fa47410b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:50.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 --2- 172.21.15.2:0/1832908750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa474071bc0 0x7fa47410b830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:50.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 >> 172.21.15.2:0/1832908750 conn(0x7fa4740f82d0 msgr2=0x7fa4741009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:50.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 shutdown_connections 2023-12-17T11:57:50.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:57:50.503+0000 7fa47b2d0700 1 -- 172.21.15.2:0/1832908750 wait complete. 2023-12-17T11:57:50.510 INFO:tasks.workunit.client.0.smithi002.stdout:0/590: link d0/d6/d26/d14/l94 d0/d6/d26/d14/d19/d37/d91/lba 0 2023-12-17T11:57:50.510 INFO:tasks.workunit.client.0.smithi002.stdout:0/591: dread - d0/d33/faa zero size 2023-12-17T11:57:50.511 INFO:tasks.workunit.client.1.smithi119.stdout:1/632: creat d3/db/d17/d24/d20/dba/dbc/d7e/da1/fe7 x:0 0 0 2023-12-17T11:57:50.511 INFO:tasks.workunit.client.1.smithi119.stdout:1/633: dread - d3/db/d17/d24/d20/f50 zero size 2023-12-17T11:57:50.513 INFO:tasks.workunit.client.1.smithi119.stdout:6/580: mkdir d2/d2b/d43/d5e/db3 0 2023-12-17T11:57:50.514 INFO:tasks.workunit.client.0.smithi002.stdout:4/597: symlink d0/d3e/d41/lc4 0 2023-12-17T11:57:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:8/667: mknod d3/dca/ce1 0 2023-12-17T11:57:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:8/668: dread - d3/d7/d6e/fb1 zero size 2023-12-17T11:57:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:8/669: chown d3/d7/d6e/d7f/fa3 177 1 2023-12-17T11:57:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:4/598: write d0/d3e/d56/d65/fb6 [953564,88611] 0 2023-12-17T11:57:50.518 INFO:tasks.workunit.client.0.smithi002.stdout:4/599: readlink d0/d10/d14/l18 0 2023-12-17T11:57:50.522 INFO:tasks.workunit.client.1.smithi119.stdout:4/646: dwrite dd/d11/d2d/d9c/d55/d81/d88/fa9 [0,4194304] 0 2023-12-17T11:57:50.522 INFO:tasks.workunit.client.1.smithi119.stdout:9/665: symlink d12/d1d/d49/d85/ld6 0 2023-12-17T11:57:50.522 INFO:tasks.workunit.client.1.smithi119.stdout:9/666: creat d12/d1d/d28/d86/d8f/fd7 x:0 0 0 2023-12-17T11:57:50.522 INFO:tasks.workunit.client.1.smithi119.stdout:9/667: chown d12/dca/c93 1448 1 2023-12-17T11:57:50.523 INFO:tasks.workunit.client.1.smithi119.stdout:2/709: creat d6/d9/d13/ffc x:0 0 0 2023-12-17T11:57:50.524 INFO:tasks.workunit.client.1.smithi119.stdout:0/581: mknod d2/d66/d1f/cae 0 2023-12-17T11:57:50.526 INFO:tasks.workunit.client.0.smithi002.stdout:3/679: rename d9/d40/f6e to d9/d1b/fdd 0 2023-12-17T11:57:50.531 INFO:tasks.workunit.client.0.smithi002.stdout:5/654: symlink dc/d1a/d7c/le9 0 2023-12-17T11:57:50.535 INFO:tasks.workunit.client.0.smithi002.stdout:0/592: creat d0/d6/d26/d14/d19/d37/d91/fbb x:0 0 0 2023-12-17T11:57:50.535 INFO:tasks.workunit.client.0.smithi002.stdout:0/593: creat d0/d6/d26/d14/d19/d37/fbc x:0 0 0 2023-12-17T11:57:50.536 INFO:tasks.workunit.client.1.smithi119.stdout:5/683: creat d1/d70/d6b/d77/dae/fd6 x:0 0 0 2023-12-17T11:57:50.536 INFO:tasks.workunit.client.1.smithi119.stdout:0/582: write d2/f6b [1913586,20899] 0 2023-12-17T11:57:50.536 INFO:tasks.workunit.client.1.smithi119.stdout:0/583: readlink d2/d66/d2e/d44/d7b/d5/dc/l36 0 2023-12-17T11:57:50.537 INFO:tasks.workunit.client.1.smithi119.stdout:3/694: dwrite d9/d11/d1e/d55/d65/f99 [0,4194304] 0 2023-12-17T11:57:50.537 INFO:tasks.workunit.client.1.smithi119.stdout:6/581: write d2/f4 [3264168,11444] 0 2023-12-17T11:57:50.538 INFO:tasks.workunit.client.0.smithi002.stdout:6/624: symlink d0/d1/d6d/d83/lcd 0 2023-12-17T11:57:50.538 INFO:tasks.workunit.client.0.smithi002.stdout:6/625: chown d0/d1/dc/d10/fb4 1560330360 1 2023-12-17T11:57:50.539 INFO:tasks.workunit.client.1.smithi119.stdout:1/634: rename d3/db/d17/d24/d20/l49 to d3/db/d26/d8f/le8 0 2023-12-17T11:57:50.541 INFO:tasks.workunit.client.0.smithi002.stdout:1/698: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/cee 0 2023-12-17T11:57:50.544 INFO:tasks.workunit.client.1.smithi119.stdout:2/710: rmdir d6/d38 39 2023-12-17T11:57:50.545 INFO:tasks.workunit.client.0.smithi002.stdout:3/680: symlink d9/d15/lde 0 2023-12-17T11:57:50.545 INFO:tasks.workunit.client.0.smithi002.stdout:3/681: fsync d9/d1b/d35/d41/d59/d65/f77 0 2023-12-17T11:57:50.549 INFO:tasks.workunit.client.0.smithi002.stdout:6/626: mkdir d0/d1/d21/d56/d8c/dce 0 2023-12-17T11:57:50.551 INFO:tasks.workunit.client.1.smithi119.stdout:0/584: creat d2/d66/faf x:0 0 0 2023-12-17T11:57:50.551 INFO:tasks.workunit.client.1.smithi119.stdout:5/684: dread d1/da7/f41 [0,4194304] 0 2023-12-17T11:57:50.552 INFO:tasks.workunit.client.1.smithi119.stdout:6/582: getdents d2/d2b/d43 0 2023-12-17T11:57:50.553 INFO:tasks.workunit.client.1.smithi119.stdout:3/695: read d9/da/f83 [1551444,54133] 0 2023-12-17T11:57:50.555 INFO:tasks.workunit.client.1.smithi119.stdout:1/635: mkdir d3/db/d17/d24/d20/d40/d76/de9 0 2023-12-17T11:57:50.557 INFO:tasks.workunit.client.0.smithi002.stdout:9/694: rename dc/d42/d4f/d59 to dc/d1d/d25/d85/dc2/ddd/dfa 0 2023-12-17T11:57:50.561 INFO:tasks.workunit.client.1.smithi119.stdout:9/668: rename d12/d1d/d79/f9b to d12/d1d/d28/d4d/d73/d78/fd8 0 2023-12-17T11:57:50.567 INFO:tasks.workunit.client.1.smithi119.stdout:2/711: mkdir d6/d2b/d3f/d5b/dfd 0 2023-12-17T11:57:50.568 INFO:tasks.workunit.client.0.smithi002.stdout:3/682: dread d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:50.570 INFO:tasks.workunit.client.1.smithi119.stdout:6/583: creat d2/da3/fb4 x:0 0 0 2023-12-17T11:57:50.570 INFO:tasks.workunit.client.1.smithi119.stdout:6/584: stat d2/d2b/d43/l89 0 2023-12-17T11:57:50.572 INFO:tasks.workunit.client.1.smithi119.stdout:3/696: mknod d9/da/df/d67/c10b 0 2023-12-17T11:57:50.578 INFO:tasks.workunit.client.1.smithi119.stdout:1/636: creat d3/db/d17/d24/d20/d6c/db7/fea x:0 0 0 2023-12-17T11:57:50.580 INFO:tasks.workunit.client.0.smithi002.stdout:4/600: dwrite d0/d10/d14/d4e/fbe [0,4194304] 0 2023-12-17T11:57:50.581 INFO:tasks.workunit.client.1.smithi119.stdout:9/669: mkdir d12/d65/dd9 0 2023-12-17T11:57:50.582 INFO:tasks.workunit.client.1.smithi119.stdout:9/670: readlink d12/d65/l6d 0 2023-12-17T11:57:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/624: rename d6/d17/dc/d13/d21/d2e/d4a/d53 to d6/d17/dc/d67/d8b/dbd 0 2023-12-17T11:57:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/625: truncate d6/d17/dc/d8e/f96 174056 0 2023-12-17T11:57:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/626: readlink d6/l85 0 2023-12-17T11:57:50.591 INFO:tasks.workunit.client.0.smithi002.stdout:7/627: write d6/d17/dc/d13/d21/f62 [456662,110898] 0 2023-12-17T11:57:50.591 INFO:tasks.workunit.client.1.smithi119.stdout:2/712: write d6/d2b/d4b/f77 [3788824,57233] 0 2023-12-17T11:57:50.592 INFO:tasks.workunit.client.1.smithi119.stdout:2/713: read d6/f1f [255922,91798] 0 2023-12-17T11:57:50.594 INFO:tasks.workunit.client.1.smithi119.stdout:6/585: write d2/f38 [594393,73478] 0 2023-12-17T11:57:50.594 INFO:tasks.workunit.client.1.smithi119.stdout:5/685: rename d1/d70/da3/fb6 to d1/d36/d3a/fd7 0 2023-12-17T11:57:50.594 INFO:tasks.workunit.client.1.smithi119.stdout:6/586: creat d2/da3/fb5 x:0 0 0 2023-12-17T11:57:50.594 INFO:tasks.workunit.client.1.smithi119.stdout:6/587: creat d2/fb6 x:0 0 0 2023-12-17T11:57:50.596 INFO:tasks.workunit.client.1.smithi119.stdout:8/559: sync 2023-12-17T11:57:50.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/627: write d0/d1/fca [46523,95734] 0 2023-12-17T11:57:50.600 INFO:tasks.workunit.client.0.smithi002.stdout:8/670: rename d3/d7/d1a/l23 to d3/le2 0 2023-12-17T11:57:50.601 INFO:tasks.workunit.client.1.smithi119.stdout:3/697: symlink d9/da/dcc/db3/l10c 0 2023-12-17T11:57:50.602 INFO:tasks.workunit.client.0.smithi002.stdout:5/655: dwrite dc/f83 [0,4194304] 0 2023-12-17T11:57:50.602 INFO:tasks.workunit.client.1.smithi119.stdout:7/664: dwrite d2/d4/d1f/f4c [4194304,4194304] 0 2023-12-17T11:57:50.603 INFO:tasks.workunit.client.1.smithi119.stdout:0/585: rmdir d2/d66 39 2023-12-17T11:57:50.605 INFO:tasks.workunit.client.1.smithi119.stdout:9/671: mkdir d12/d1d/d28/d4d/d73/dda 0 2023-12-17T11:57:50.606 INFO:tasks.workunit.client.0.smithi002.stdout:0/594: dwrite d0/d6/f5e [0,4194304] 0 2023-12-17T11:57:50.610 INFO:tasks.workunit.client.1.smithi119.stdout:2/714: creat d6/d2b/d4b/ffe x:0 0 0 2023-12-17T11:57:50.611 INFO:tasks.workunit.client.0.smithi002.stdout:6/628: write d0/d1/d28/f7b [372390,37306] 0 2023-12-17T11:57:50.611 INFO:tasks.workunit.client.0.smithi002.stdout:6/629: dread - d0/d1/dc/d17/d67/f84 zero size 2023-12-17T11:57:50.612 INFO:tasks.workunit.client.0.smithi002.stdout:6/630: chown d0/d1/dc/d10/la7 338 1 2023-12-17T11:57:50.614 INFO:tasks.workunit.client.0.smithi002.stdout:9/695: rename dc/d42/f64 to dc/d1d/d7c/d90/dc0/ffb 0 2023-12-17T11:57:50.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/671: unlink d3/d7/d18/c72 0 2023-12-17T11:57:50.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/595: mknod d0/d6/d26/d14/d19/d61/cbd 0 2023-12-17T11:57:50.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/596: readlink d0/d15/l70 0 2023-12-17T11:57:50.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/597: chown d0/d6/d26/d14/d19/d61/cbd 175554 1 2023-12-17T11:57:50.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/598: dread - d0/d6/d26/d14/d19/d37/d62/f7b zero size 2023-12-17T11:57:50.622 INFO:tasks.workunit.client.0.smithi002.stdout:0/599: stat d0/d6/d26/f2d 0 2023-12-17T11:57:50.625 INFO:tasks.workunit.client.1.smithi119.stdout:6/588: rename d2/d2b/d43/c6c to d2/d9b/dac/cb7 0 2023-12-17T11:57:50.628 INFO:tasks.workunit.client.1.smithi119.stdout:8/560: truncate d7/da/d11/f1d 843715 0 2023-12-17T11:57:50.630 INFO:tasks.workunit.client.1.smithi119.stdout:3/698: creat d9/d59/da6/f10d x:0 0 0 2023-12-17T11:57:50.636 INFO:tasks.workunit.client.0.smithi002.stdout:0/600: mknod d0/d15/cbe 0 2023-12-17T11:57:50.637 INFO:tasks.workunit.client.1.smithi119.stdout:0/586: creat d2/d16/fb0 x:0 0 0 2023-12-17T11:57:50.637 INFO:tasks.workunit.client.1.smithi119.stdout:0/587: readlink d2/d66/d1f/d24/d50/l96 0 2023-12-17T11:57:50.637 INFO:tasks.workunit.client.1.smithi119.stdout:9/672: mkdir d12/d1d/d49/ddb 0 2023-12-17T11:57:50.637 INFO:tasks.workunit.client.1.smithi119.stdout:5/686: getdents d1/d36/dc1 0 2023-12-17T11:57:50.640 INFO:tasks.workunit.client.1.smithi119.stdout:8/561: symlink d7/d12/d69/lb9 0 2023-12-17T11:57:50.640 INFO:tasks.workunit.client.1.smithi119.stdout:6/589: mknod d2/df/d17/d79/cb8 0 2023-12-17T11:57:50.642 INFO:tasks.workunit.client.1.smithi119.stdout:3/699: unlink d9/d11/l12 0 2023-12-17T11:57:50.643 INFO:tasks.workunit.client.1.smithi119.stdout:9/673: creat d12/d65/dd9/fdc x:0 0 0 2023-12-17T11:57:50.643 INFO:tasks.workunit.client.1.smithi119.stdout:5/687: creat d1/da7/d71/d76/d83/dd1/fd8 x:0 0 0 2023-12-17T11:57:50.643 INFO:tasks.workunit.client.1.smithi119.stdout:5/688: fsync d1/da7/f3b 0 2023-12-17T11:57:50.643 INFO:tasks.workunit.client.1.smithi119.stdout:5/689: chown d1/d25/l61 238 1 2023-12-17T11:57:50.644 INFO:tasks.workunit.client.1.smithi119.stdout:5/690: fsync d1/f1a 0 2023-12-17T11:57:50.644 INFO:tasks.workunit.client.1.smithi119.stdout:3/700: creat d9/d35/dbd/dfb/d107/f10e x:0 0 0 2023-12-17T11:57:50.645 INFO:tasks.workunit.client.1.smithi119.stdout:3/701: fsync d9/da/fbc 0 2023-12-17T11:57:50.645 INFO:tasks.workunit.client.1.smithi119.stdout:9/674: getdents d12/d1d/d28/d4d/d73/d78 0 2023-12-17T11:57:50.645 INFO:tasks.workunit.client.1.smithi119.stdout:8/562: truncate d7/f16 3883434 0 2023-12-17T11:57:50.646 INFO:tasks.workunit.client.1.smithi119.stdout:8/563: read - d7/d12/d69/d98/fb1 zero size 2023-12-17T11:57:50.647 INFO:tasks.workunit.client.0.smithi002.stdout:0/601: write d0/d6/d26/d14/d19/d2b/f30 [2956109,17415] 0 2023-12-17T11:57:50.647 INFO:tasks.workunit.client.0.smithi002.stdout:0/602: fsync d0/d6/d26/d14/d19/d37/f39 0 2023-12-17T11:57:50.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/691: symlink d1/d36/d3a/ld9 0 2023-12-17T11:57:50.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/692: truncate d1/d25/f46 3941942 0 2023-12-17T11:57:50.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/693: fsync d1/d36/d3a/f67 0 2023-12-17T11:57:50.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/694: getdents d1/d25 0 2023-12-17T11:57:50.648 INFO:tasks.workunit.client.1.smithi119.stdout:5/695: truncate d1/da7/d71/f73 924720 0 2023-12-17T11:57:50.650 INFO:tasks.workunit.client.1.smithi119.stdout:1/637: dwrite d3/db/d17/d24/d20/f50 [0,4194304] 0 2023-12-17T11:57:50.650 INFO:tasks.workunit.client.1.smithi119.stdout:1/638: write d3/db/d26/d5e/fb3 [678628,74080] 0 2023-12-17T11:57:50.651 INFO:tasks.workunit.client.0.smithi002.stdout:0/603: mkdir d0/d6/d26/d14/d19/d61/dbf 0 2023-12-17T11:57:50.654 INFO:tasks.workunit.client.1.smithi119.stdout:3/702: link d9/l71 d9/d11/d1e/d9f/l10f 0 2023-12-17T11:57:50.654 INFO:tasks.workunit.client.1.smithi119.stdout:9/675: getdents d12/d1d/d28/d4d/d73/d78/d8b/da0 0 2023-12-17T11:57:50.654 INFO:tasks.workunit.client.1.smithi119.stdout:9/676: truncate d12/dca/f7c 860191 0 2023-12-17T11:57:50.654 INFO:tasks.workunit.client.1.smithi119.stdout:2/715: dread d6/d9/d13/d34/fa0 [0,4194304] 0 2023-12-17T11:57:50.655 INFO:tasks.workunit.client.0.smithi002.stdout:0/604: mknod d0/d33/cc0 0 2023-12-17T11:57:50.655 INFO:tasks.workunit.client.0.smithi002.stdout:0/605: write d0/d6/d26/d14/d19/d2b/f30 [2892585,43950] 0 2023-12-17T11:57:50.658 INFO:tasks.workunit.client.1.smithi119.stdout:9/677: mkdir d12/d1d/d49/ddb/ddd 0 2023-12-17T11:57:50.658 INFO:tasks.workunit.client.1.smithi119.stdout:1/639: mknod d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/ceb 0 2023-12-17T11:57:50.658 INFO:tasks.workunit.client.1.smithi119.stdout:1/640: chown d3/d44/d89/c92 120 1 2023-12-17T11:57:50.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/606: truncate d0/d6/d26/d25/f96 1104074 0 2023-12-17T11:57:50.660 INFO:tasks.workunit.client.1.smithi119.stdout:1/641: mknod d3/db/d26/cec 0 2023-12-17T11:57:50.661 INFO:tasks.workunit.client.0.smithi002.stdout:1/699: dwrite d3/d5c/fd5 [0,4194304] 0 2023-12-17T11:57:50.670 INFO:tasks.workunit.client.0.smithi002.stdout:1/700: dread d3/d6/d16/f7a [0,4194304] 0 2023-12-17T11:57:50.672 INFO:tasks.workunit.client.1.smithi119.stdout:7/665: dwrite d2/d4/d11/d2c/f3a [0,4194304] 0 2023-12-17T11:57:50.675 INFO:tasks.workunit.client.0.smithi002.stdout:5/656: dwrite fa [0,4194304] 0 2023-12-17T11:57:50.675 INFO:tasks.workunit.client.0.smithi002.stdout:5/657: stat dc/d1b/cd5 0 2023-12-17T11:57:50.675 INFO:tasks.workunit.client.0.smithi002.stdout:5/658: dread - dc/d1a/d47/fc2 zero size 2023-12-17T11:57:50.675 INFO:tasks.workunit.client.0.smithi002.stdout:5/659: write dc/d1b/fd1 [15124,90720] 0 2023-12-17T11:57:50.675 INFO:tasks.workunit.client.1.smithi119.stdout:5/696: dread d1/da7/d71/d82/d86/f66 [0,4194304] 0 2023-12-17T11:57:50.676 INFO:tasks.workunit.client.0.smithi002.stdout:7/628: write d6/f72 [777616,33575] 0 2023-12-17T11:57:50.676 INFO:tasks.workunit.client.0.smithi002.stdout:7/629: truncate d6/d17/dc/d67/d8b/d24/da3/fb6 994604 0 2023-12-17T11:57:50.677 INFO:tasks.workunit.client.0.smithi002.stdout:4/601: dwrite d0/d10/d14/d4e/f80 [0,4194304] 0 2023-12-17T11:57:50.692 INFO:tasks.workunit.client.1.smithi119.stdout:1/642: symlink d3/db/d2a/de5/led 0 2023-12-17T11:57:50.693 INFO:tasks.workunit.client.0.smithi002.stdout:8/672: getdents d3/d7/d1a 0 2023-12-17T11:57:50.693 INFO:tasks.workunit.client.0.smithi002.stdout:8/673: readlink d3/d8/da/d44/lcd 0 2023-12-17T11:57:50.695 INFO:tasks.workunit.client.1.smithi119.stdout:8/564: dread d7/d18/f4f [0,4194304] 0 2023-12-17T11:57:50.696 INFO:tasks.workunit.client.0.smithi002.stdout:6/631: dwrite d0/d1/dc/d17/d67/f84 [0,4194304] 0 2023-12-17T11:57:50.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/701: creat d3/d6/d9/d37/d39/d43/d4a/deb/fef x:0 0 0 2023-12-17T11:57:50.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/702: fdatasync d3/f17 0 2023-12-17T11:57:50.699 INFO:tasks.workunit.client.0.smithi002.stdout:1/703: fsync d3/d6/d9/d37/d39/d43/f6d 0 2023-12-17T11:57:50.699 INFO:tasks.workunit.client.0.smithi002.stdout:1/704: creat d3/d6/d16/dcf/ff0 x:0 0 0 2023-12-17T11:57:50.699 INFO:tasks.workunit.client.0.smithi002.stdout:1/705: truncate d3/d2f/fb9 4672167 0 2023-12-17T11:57:50.700 INFO:tasks.workunit.client.1.smithi119.stdout:0/588: dwrite d2/d16/f7d [0,4194304] 0 2023-12-17T11:57:50.707 INFO:tasks.workunit.client.0.smithi002.stdout:5/660: mkdir dc/d1b/d2d/dcf/dea 0 2023-12-17T11:57:50.708 INFO:tasks.workunit.client.1.smithi119.stdout:2/716: rmdir d6/d9/d13/d1d 39 2023-12-17T11:57:50.712 INFO:tasks.workunit.client.0.smithi002.stdout:7/630: read d6/d17/dc/d13/d21/d6e/f7e [60281,123810] 0 2023-12-17T11:57:50.717 INFO:tasks.workunit.client.0.smithi002.stdout:4/602: mkdir d0/d10/dc5 0 2023-12-17T11:57:50.718 INFO:tasks.workunit.client.1.smithi119.stdout:9/678: dwrite d12/d1d/d28/d4d/d73/f96 [0,4194304] 0 2023-12-17T11:57:50.719 INFO:tasks.workunit.client.0.smithi002.stdout:2/653: sync 2023-12-17T11:57:50.720 INFO:tasks.workunit.client.0.smithi002.stdout:2/654: chown d3/d4/l80 83 1 2023-12-17T11:57:50.720 INFO:tasks.workunit.client.0.smithi002.stdout:2/655: dread - d3/d4/d17/d19/d4d/d72/d77/da7/fe1 zero size 2023-12-17T11:57:50.720 INFO:tasks.workunit.client.0.smithi002.stdout:8/674: stat d3/d7/d6e/d7f/d65/ld0 0 2023-12-17T11:57:50.722 INFO:tasks.workunit.client.1.smithi119.stdout:6/590: dwrite d2/f19 [0,4194304] 0 2023-12-17T11:57:50.725 INFO:tasks.workunit.client.1.smithi119.stdout:7/666: link d2/d4/d1f/l94 d2/d40/lcd 0 2023-12-17T11:57:50.728 INFO:tasks.workunit.client.1.smithi119.stdout:5/697: mkdir d1/da7/d71/d82/d86/dda 0 2023-12-17T11:57:50.728 INFO:tasks.workunit.client.1.smithi119.stdout:0/589: dread d2/d16/f7c [0,4194304] 0 2023-12-17T11:57:50.730 INFO:tasks.workunit.client.0.smithi002.stdout:6/632: mknod d0/d1/d21/d56/d8c/d93/da5/dbc/ccf 0 2023-12-17T11:57:50.730 INFO:tasks.workunit.client.0.smithi002.stdout:6/633: dread - d0/d1/d6d/d83/da2/fb9 zero size 2023-12-17T11:57:50.730 INFO:tasks.workunit.client.0.smithi002.stdout:6/634: dread - d0/d1/dc/d17/d67/f9e zero size 2023-12-17T11:57:50.734 INFO:tasks.workunit.client.1.smithi119.stdout:3/703: dwrite d9/da/df/d41/d33/db4/f93 [0,4194304] 0 2023-12-17T11:57:50.736 INFO:tasks.workunit.client.1.smithi119.stdout:0/590: write d2/d16/d35/d39/f6e [1204529,33754] 0 2023-12-17T11:57:50.741 INFO:tasks.workunit.client.1.smithi119.stdout:0/591: creat d2/d16/d35/d39/fb1 x:0 0 0 2023-12-17T11:57:50.741 INFO:tasks.workunit.client.1.smithi119.stdout:0/592: write d2/f6b [3698155,76659] 0 2023-12-17T11:57:50.749 INFO:tasks.workunit.client.1.smithi119.stdout:9/679: mknod d12/d1d/d79/cde 0 2023-12-17T11:57:50.754 INFO:tasks.workunit.client.0.smithi002.stdout:7/631: symlink d6/d17/dc/d13/d21/d6e/lbe 0 2023-12-17T11:57:50.754 INFO:tasks.workunit.client.0.smithi002.stdout:0/607: getdents d0/d33 0 2023-12-17T11:57:50.754 INFO:tasks.workunit.client.0.smithi002.stdout:7/632: getdents d6/d99/da1/db9 0 2023-12-17T11:57:50.754 INFO:tasks.workunit.client.0.smithi002.stdout:7/633: fsync d6/d17/dc/d13/d37/d4f/f9d 0 2023-12-17T11:57:50.759 INFO:tasks.workunit.client.0.smithi002.stdout:6/635: creat d0/d1/dc/d8b/fd0 x:0 0 0 2023-12-17T11:57:50.759 INFO:tasks.workunit.client.0.smithi002.stdout:6/636: dread - d0/d1/dc0/fc7 zero size 2023-12-17T11:57:50.760 INFO:tasks.workunit.client.1.smithi119.stdout:8/565: dwrite d7/da/d11/d26/d49/f8d [0,4194304] 0 2023-12-17T11:57:50.765 INFO:tasks.workunit.client.1.smithi119.stdout:6/591: unlink d2/f71 0 2023-12-17T11:57:50.766 INFO:tasks.workunit.client.0.smithi002.stdout:2/656: unlink d3/d4/d8b/da6/fbf 0 2023-12-17T11:57:50.774 INFO:tasks.workunit.client.1.smithi119.stdout:9/680: dread d12/d1d/d28/d46/f59 [0,4194304] 0 2023-12-17T11:57:50.774 INFO:tasks.workunit.client.1.smithi119.stdout:4/647: sync 2023-12-17T11:57:50.777 INFO:tasks.workunit.client.0.smithi002.stdout:7/634: truncate d6/d17/dc/d13/f30 3761652 0 2023-12-17T11:57:50.780 INFO:tasks.workunit.client.0.smithi002.stdout:1/706: dwrite d3/d6/d16/f26 [0,4194304] 0 2023-12-17T11:57:50.781 INFO:tasks.workunit.client.1.smithi119.stdout:1/643: dwrite d3/db/d26/d19/d3f/f97 [0,4194304] 0 2023-12-17T11:57:50.784 INFO:tasks.workunit.client.1.smithi119.stdout:3/704: unlink d9/da/f83 0 2023-12-17T11:57:50.788 INFO:tasks.workunit.client.0.smithi002.stdout:0/608: dread d0/d6/f5e [0,4194304] 0 2023-12-17T11:57:50.792 INFO:tasks.workunit.client.1.smithi119.stdout:2/717: dwrite d6/d2b/da3/fc5 [0,4194304] 0 2023-12-17T11:57:50.804 INFO:tasks.workunit.client.1.smithi119.stdout:8/566: unlink d7/f77 0 2023-12-17T11:57:50.808 INFO:tasks.workunit.client.1.smithi119.stdout:9/681: truncate d12/d1d/d79/f80 80481 0 2023-12-17T11:57:50.810 INFO:tasks.workunit.client.1.smithi119.stdout:4/648: mkdir dd/d11/d2d/d9c/d55/d81/db8/dbd/dd4 0 2023-12-17T11:57:50.812 INFO:tasks.workunit.client.0.smithi002.stdout:8/675: dwrite d3/d8/da/f93 [0,4194304] 0 2023-12-17T11:57:50.815 INFO:tasks.workunit.client.0.smithi002.stdout:6/637: dread d0/d1/dc/d17/f1e [0,4194304] 0 2023-12-17T11:57:50.815 INFO:tasks.workunit.client.0.smithi002.stdout:1/707: dread d3/d6/d9/d37/d39/fa6 [0,4194304] 0 2023-12-17T11:57:50.815 INFO:tasks.workunit.client.0.smithi002.stdout:6/638: creat d0/d1/d5b/fd1 x:0 0 0 2023-12-17T11:57:50.817 INFO:tasks.workunit.client.1.smithi119.stdout:5/698: dwrite d1/d36/f47 [0,4194304] 0 2023-12-17T11:57:50.822 INFO:tasks.workunit.client.1.smithi119.stdout:3/705: write d9/d11/d1e/f1f [1005203,79916] 0 2023-12-17T11:57:50.822 INFO:tasks.workunit.client.1.smithi119.stdout:5/699: link d1/d44/f72 d1/da7/d71/d76/d83/fdb 0 2023-12-17T11:57:50.824 INFO:tasks.workunit.client.1.smithi119.stdout:5/700: mknod d1/d70/cdc 0 2023-12-17T11:57:50.824 INFO:tasks.workunit.client.1.smithi119.stdout:5/701: creat d1/fdd x:0 0 0 2023-12-17T11:57:50.832 INFO:tasks.workunit.client.1.smithi119.stdout:5/702: symlink d1/da7/d71/lde 0 2023-12-17T11:57:50.833 INFO:tasks.workunit.client.1.smithi119.stdout:6/592: rename d2/df/f24 to d2/d61/fb9 0 2023-12-17T11:57:50.834 INFO:tasks.workunit.client.1.smithi119.stdout:6/593: chown d2/c42 226537 1 2023-12-17T11:57:50.834 INFO:tasks.workunit.client.0.smithi002.stdout:2/657: dwrite d3/d4/d7/f86 [0,4194304] 0 2023-12-17T11:57:50.837 INFO:tasks.workunit.client.1.smithi119.stdout:5/703: creat d1/d36/d3a/fdf x:0 0 0 2023-12-17T11:57:50.837 INFO:tasks.workunit.client.1.smithi119.stdout:2/718: dwrite d6/d9/d52/d53/d55/d58/fbe [0,4194304] 0 2023-12-17T11:57:50.838 INFO:tasks.workunit.client.0.smithi002.stdout:7/635: dwrite d6/d17/dc/d13/d37/d4f/faa [0,4194304] 0 2023-12-17T11:57:50.839 INFO:tasks.workunit.client.0.smithi002.stdout:7/636: chown d6/d17/cf 602083716 1 2023-12-17T11:57:50.841 INFO:tasks.workunit.client.1.smithi119.stdout:9/682: rename d12/d1d/d28/f9a to d12/fdf 0 2023-12-17T11:57:50.845 INFO:tasks.workunit.client.1.smithi119.stdout:5/704: stat d1/d44/d52/l58 0 2023-12-17T11:57:50.845 INFO:tasks.workunit.client.1.smithi119.stdout:5/705: creat d1/da7/d71/d76/d83/dd1/fe0 x:0 0 0 2023-12-17T11:57:50.846 INFO:tasks.workunit.client.1.smithi119.stdout:2/719: mkdir d6/d9/d13/d34/d70/dff 0 2023-12-17T11:57:50.846 INFO:tasks.workunit.client.1.smithi119.stdout:2/720: dread - d6/d9/d13/d34/ff3 zero size 2023-12-17T11:57:50.849 INFO:tasks.workunit.client.1.smithi119.stdout:4/649: rename dd/d15/d16/d20/l48 to dd/d11/d2d/d9c/d55/d81/da1/ld5 0 2023-12-17T11:57:50.849 INFO:tasks.workunit.client.1.smithi119.stdout:4/650: write dd/d11/d2d/d9c/d55/d81/db8/d78/faf [1004093,109493] 0 2023-12-17T11:57:50.849 INFO:tasks.workunit.client.1.smithi119.stdout:4/651: chown dd/d15/d16/f1e 5262 1 2023-12-17T11:57:50.851 INFO:tasks.workunit.client.1.smithi119.stdout:9/683: link d12/d1d/d28/l83 d12/dca/dbd/le0 0 2023-12-17T11:57:50.851 INFO:tasks.workunit.client.1.smithi119.stdout:5/706: dread d1/d70/d6b/d77/dae/fc6 [0,4194304] 0 2023-12-17T11:57:50.856 INFO:tasks.workunit.client.1.smithi119.stdout:2/721: unlink d6/d9/fd1 0 2023-12-17T11:57:50.858 INFO:tasks.workunit.client.1.smithi119.stdout:5/707: creat d1/da7/fe1 x:0 0 0 2023-12-17T11:57:50.858 INFO:tasks.workunit.client.1.smithi119.stdout:5/708: fdatasync d1/d44/f72 0 2023-12-17T11:57:50.858 INFO:tasks.workunit.client.1.smithi119.stdout:5/709: chown d1/d36 2052 1 2023-12-17T11:57:50.860 INFO:tasks.workunit.client.1.smithi119.stdout:4/652: getdents dd 0 2023-12-17T11:57:50.860 INFO:tasks.workunit.client.1.smithi119.stdout:4/653: fsync dd/d11/d2d/d9c/d55/d81/d88/fa7 0 2023-12-17T11:57:50.862 INFO:tasks.workunit.client.0.smithi002.stdout:8/676: dwrite d3/d8/d28/d31/fe0 [0,4194304] 0 2023-12-17T11:57:50.862 INFO:tasks.workunit.client.0.smithi002.stdout:8/677: truncate d3/d8/da/fcb 996567 0 2023-12-17T11:57:50.862 INFO:tasks.workunit.client.0.smithi002.stdout:8/678: stat d3/d7/d6e/fd1 0 2023-12-17T11:57:50.862 INFO:tasks.workunit.client.0.smithi002.stdout:8/679: chown d3/d8 208064576 1 2023-12-17T11:57:50.876 INFO:tasks.workunit.client.0.smithi002.stdout:8/680: dread d3/d8/d28/d31/fe0 [0,4194304] 0 2023-12-17T11:57:50.876 INFO:tasks.workunit.client.1.smithi119.stdout:1/644: dwrite d3/f4 [0,4194304] 0 2023-12-17T11:57:50.877 INFO:tasks.workunit.client.1.smithi119.stdout:1/645: mknod d3/db/d17/d24/d20/d40/d76/d84/cee 0 2023-12-17T11:57:50.900 INFO:tasks.workunit.client.0.smithi002.stdout:0/609: mkdir d0/d33/dc1 0 2023-12-17T11:57:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/708: symlink d3/d6/d9/d37/d39/d43/d4a/d7b/lf1 0 2023-12-17T11:57:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:1/709: chown d3/d6/d9/f38 64498 1 2023-12-17T11:57:50.903 INFO:tasks.workunit.client.0.smithi002.stdout:3/683: sync 2023-12-17T11:57:50.903 INFO:tasks.workunit.client.0.smithi002.stdout:3/684: chown d9/f13 7 1 2023-12-17T11:57:50.904 INFO:tasks.workunit.client.1.smithi119.stdout:9/684: dwrite d12/d1d/f5d [0,4194304] 0 2023-12-17T11:57:50.905 INFO:tasks.workunit.client.0.smithi002.stdout:6/639: rename d0/d1/dc/d17/d67/f9c to d0/d1/dc0/fd2 0 2023-12-17T11:57:50.906 INFO:tasks.workunit.client.1.smithi119.stdout:9/685: symlink d12/d1d/d49/le1 0 2023-12-17T11:57:50.907 INFO:tasks.workunit.client.0.smithi002.stdout:2/658: creat d3/d4/d7/d14/d1b/d5b/de3/fe8 x:0 0 0 2023-12-17T11:57:50.909 INFO:tasks.workunit.client.0.smithi002.stdout:7/637: mkdir d6/d17/dc/d67/d86/dbf 0 2023-12-17T11:57:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:8/681: symlink d3/d8/da/le3 0 2023-12-17T11:57:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:0/610: mknod d0/d6/d26/d14/d19/d37/d62/db8/cc2 0 2023-12-17T11:57:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:1/710: symlink d3/d2f/d74/dbe/lf2 0 2023-12-17T11:57:50.913 INFO:tasks.workunit.client.0.smithi002.stdout:2/659: mknod d3/d4/d7/d14/d42/ce9 0 2023-12-17T11:57:50.915 INFO:tasks.workunit.client.1.smithi119.stdout:2/722: dwrite d6/d2b/d3f/f83 [0,4194304] 0 2023-12-17T11:57:50.915 INFO:tasks.workunit.client.0.smithi002.stdout:6/640: unlink d0/l61 0 2023-12-17T11:57:50.916 INFO:tasks.workunit.client.0.smithi002.stdout:1/711: symlink d3/d6/d16/lf3 0 2023-12-17T11:57:50.916 INFO:tasks.workunit.client.0.smithi002.stdout:1/712: write d3/d6/d9/d37/d39/d43/d4a/deb/fef [583062,42840] 0 2023-12-17T11:57:50.917 INFO:tasks.workunit.client.1.smithi119.stdout:2/723: link d6/d9/d13/d1d/dbf/ce5 d6/d9/d13/c100 0 2023-12-17T11:57:50.919 INFO:tasks.workunit.client.0.smithi002.stdout:2/660: creat d3/d4/d7/d14/d2e/d37/fea x:0 0 0 2023-12-17T11:57:50.919 INFO:tasks.workunit.client.0.smithi002.stdout:2/661: dread - d3/d4/d17/d19/d4d/d72/fa3 zero size 2023-12-17T11:57:50.919 INFO:tasks.workunit.client.0.smithi002.stdout:2/662: chown d3/d4/d17/d19/d4d/l99 115213 1 2023-12-17T11:57:50.919 INFO:tasks.workunit.client.0.smithi002.stdout:2/663: write d3/d4/d7/d14/d42/f76 [705847,110854] 0 2023-12-17T11:57:50.920 INFO:tasks.workunit.client.0.smithi002.stdout:2/664: write d3/d4/d7/d14/f92 [5016920,18220] 0 2023-12-17T11:57:50.920 INFO:tasks.workunit.client.1.smithi119.stdout:2/724: stat d6/d9/d13/d34/d88/l8b 0 2023-12-17T11:57:50.921 INFO:tasks.workunit.client.1.smithi119.stdout:4/654: dwrite dd/f1d [0,4194304] 0 2023-12-17T11:57:50.921 INFO:tasks.workunit.client.1.smithi119.stdout:4/655: fsync dd/d11/f74 0 2023-12-17T11:57:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:3/685: read d9/d1b/d35/d41/d59/f5c [1779795,64682] 0 2023-12-17T11:57:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:3/686: readlink d9/d15/d52/l76 0 2023-12-17T11:57:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:3/687: write d9/d1b/d35/d41/f42 [1835289,44405] 0 2023-12-17T11:57:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:3/688: fsync d9/d1b/f5e 0 2023-12-17T11:57:50.925 INFO:tasks.workunit.client.0.smithi002.stdout:3/689: readlink d9/d24/d6f/ld2 0 2023-12-17T11:57:50.926 INFO:tasks.workunit.client.0.smithi002.stdout:7/638: write d6/d17/dc/d13/d37/d4f/f63 [1385765,33460] 0 2023-12-17T11:57:50.932 INFO:tasks.workunit.client.0.smithi002.stdout:2/665: creat d3/feb x:0 0 0 2023-12-17T11:57:50.932 INFO:tasks.workunit.client.0.smithi002.stdout:0/611: dread d0/d6/d26/f24 [0,4194304] 0 2023-12-17T11:57:50.932 INFO:tasks.workunit.client.0.smithi002.stdout:0/612: write d0/d6/d26/d14/d19/d37/d62/f52 [2383437,114335] 0 2023-12-17T11:57:50.932 INFO:tasks.workunit.client.0.smithi002.stdout:0/613: fsync d0/d6/d26/d14/d6d/d7e/f80 0 2023-12-17T11:57:50.933 INFO:tasks.workunit.client.0.smithi002.stdout:8/682: write d3/d8/d28/d31/d5a/d7c/f89 [1200819,72894] 0 2023-12-17T11:57:50.933 INFO:tasks.workunit.client.0.smithi002.stdout:1/713: write d3/d6/d9/d37/d39/d43/f50 [2671042,65034] 0 2023-12-17T11:57:50.935 INFO:tasks.workunit.client.0.smithi002.stdout:5/661: sync 2023-12-17T11:57:50.935 INFO:tasks.workunit.client.0.smithi002.stdout:6/641: getdents d0/d1/dc/d17/d40 0 2023-12-17T11:57:50.935 INFO:tasks.workunit.client.0.smithi002.stdout:3/690: mknod d9/d24/cdf 0 2023-12-17T11:57:50.935 INFO:tasks.workunit.client.1.smithi119.stdout:4/656: dread dd/d4b/fa4 [0,4194304] 0 2023-12-17T11:57:50.936 INFO:tasks.workunit.client.0.smithi002.stdout:2/666: symlink d3/d4/d17/lec 0 2023-12-17T11:57:50.938 INFO:tasks.workunit.client.1.smithi119.stdout:4/657: mkdir dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6 0 2023-12-17T11:57:50.939 INFO:tasks.workunit.client.0.smithi002.stdout:9/696: sync 2023-12-17T11:57:50.939 INFO:tasks.workunit.client.0.smithi002.stdout:9/697: chown dc/d1d/d7c/cd2 1779 1 2023-12-17T11:57:50.939 INFO:tasks.workunit.client.0.smithi002.stdout:4/603: sync 2023-12-17T11:57:50.939 INFO:tasks.workunit.client.0.smithi002.stdout:4/604: truncate d0/d3e/d56/d99/fb8 508353 0 2023-12-17T11:57:50.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/683: symlink d3/d7/d18/d74/d7b/le4 0 2023-12-17T11:57:50.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/684: chown d3/d8/da/f8a 162376438 1 2023-12-17T11:57:50.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/685: chown d3/d8/da/l11 4789 1 2023-12-17T11:57:50.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/686: dread - d3/d8/da/fb9 zero size 2023-12-17T11:57:50.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/687: creat d3/d7/d6e/fe5 x:0 0 0 2023-12-17T11:57:50.940 INFO:tasks.workunit.client.0.smithi002.stdout:8/688: read d3/d7/d6e/d7f/f54 [405325,24939] 0 2023-12-17T11:57:50.941 INFO:tasks.workunit.client.0.smithi002.stdout:1/714: truncate d3/d5c/f5d 860011 0 2023-12-17T11:57:50.941 INFO:tasks.workunit.client.0.smithi002.stdout:1/715: chown d3/d2f/fb4 294 1 2023-12-17T11:57:50.942 INFO:tasks.workunit.client.1.smithi119.stdout:4/658: truncate dd/f71 1559233 0 2023-12-17T11:57:50.948 INFO:tasks.workunit.client.0.smithi002.stdout:2/667: getdents d3/d4/d17/d19/d4d/d72 0 2023-12-17T11:57:50.951 INFO:tasks.workunit.client.0.smithi002.stdout:9/698: mknod dc/d1d/d25/d85/deb/cfc 0 2023-12-17T11:57:50.954 INFO:tasks.workunit.client.0.smithi002.stdout:4/605: symlink d0/d3e/d56/d65/d78/d85/lc6 0 2023-12-17T11:57:50.961 INFO:tasks.workunit.client.0.smithi002.stdout:8/689: creat d3/d8/d28/d31/d5a/db4/fe6 x:0 0 0 2023-12-17T11:57:50.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/668: rmdir d3/d4/d7/d14/d42/dae 39 2023-12-17T11:57:50.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/669: write d3/d4/d7/d14/d42/dae/fc7 [280413,120188] 0 2023-12-17T11:57:50.961 INFO:tasks.workunit.client.0.smithi002.stdout:2/670: readlink d3/d4/d7/d14/d34/l49 0 2023-12-17T11:57:50.966 INFO:tasks.workunit.client.0.smithi002.stdout:8/690: creat d3/d7/d18/d74/fe7 x:0 0 0 2023-12-17T11:57:50.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/671: rmdir d3/d4/d7/d14/d1b 39 2023-12-17T11:57:50.966 INFO:tasks.workunit.client.0.smithi002.stdout:2/672: getdents d3/d4/d7 0 2023-12-17T11:57:50.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/673: symlink d3/d4/d7/led 0 2023-12-17T11:57:50.967 INFO:tasks.workunit.client.0.smithi002.stdout:2/674: symlink d3/d4/d8b/da6/lee 0 2023-12-17T11:57:50.968 INFO:tasks.workunit.client.0.smithi002.stdout:2/675: fsync d3/d4/d7/fb0 0 2023-12-17T11:57:50.968 INFO:tasks.workunit.client.0.smithi002.stdout:2/676: write d3/d4/d43/fdf [2544191,18951] 0 2023-12-17T11:57:50.968 INFO:tasks.workunit.client.0.smithi002.stdout:2/677: chown d3/dd4 61876 1 2023-12-17T11:57:50.969 INFO:tasks.workunit.client.0.smithi002.stdout:2/678: write d3/d56/fa0 [982724,46838] 0 2023-12-17T11:57:50.969 INFO:tasks.workunit.client.1.smithi119.stdout:0/593: sync 2023-12-17T11:57:50.969 INFO:tasks.workunit.client.1.smithi119.stdout:7/667: sync 2023-12-17T11:57:50.969 INFO:tasks.workunit.client.1.smithi119.stdout:0/594: readlink d2/d66/d2e/d44/d7b/l92 0 2023-12-17T11:57:50.972 INFO:tasks.workunit.client.1.smithi119.stdout:7/668: mknod d2/d4/d1f/cce 0 2023-12-17T11:57:50.973 INFO:tasks.workunit.client.0.smithi002.stdout:4/606: dread d0/d10/f30 [0,4194304] 0 2023-12-17T11:57:50.973 INFO:tasks.workunit.client.0.smithi002.stdout:4/607: write d0/d10/d14/d27/d57/d7d/fb7 [416355,42894] 0 2023-12-17T11:57:50.974 INFO:tasks.workunit.client.1.smithi119.stdout:0/595: unlink d2/d66/d2e/d44/d7b/f3d 0 2023-12-17T11:57:50.974 INFO:tasks.workunit.client.1.smithi119.stdout:7/669: creat d2/d4/d11/d2c/d68/d98/fcf x:0 0 0 2023-12-17T11:57:50.975 INFO:tasks.workunit.client.0.smithi002.stdout:4/608: rmdir d0/d10/d21/d33 39 2023-12-17T11:57:50.975 INFO:tasks.workunit.client.0.smithi002.stdout:4/609: chown d0/d10/c1c 57 1 2023-12-17T11:57:50.977 INFO:tasks.workunit.client.1.smithi119.stdout:0/596: unlink d2/f9b 0 2023-12-17T11:57:50.977 INFO:tasks.workunit.client.1.smithi119.stdout:0/597: dread - d2/d16/d35/d74/fa7 zero size 2023-12-17T11:57:50.977 INFO:tasks.workunit.client.1.smithi119.stdout:0/598: dread - d2/dac/fad zero size 2023-12-17T11:57:50.978 INFO:tasks.workunit.client.0.smithi002.stdout:4/610: mknod d0/d3e/d56/dc3/cc7 0 2023-12-17T11:57:50.978 INFO:tasks.workunit.client.1.smithi119.stdout:2/725: dwrite d6/d9/d13/d34/fa0 [4194304,4194304] 0 2023-12-17T11:57:50.982 INFO:tasks.workunit.client.0.smithi002.stdout:0/614: dwrite d0/d6/d26/d14/d19/d37/d62/f7b [0,4194304] 0 2023-12-17T11:57:50.983 INFO:tasks.workunit.client.0.smithi002.stdout:9/699: read f0 [3944570,33143] 0 2023-12-17T11:57:50.983 INFO:tasks.workunit.client.0.smithi002.stdout:6/642: dwrite d0/d1/dc0/fc7 [0,4194304] 0 2023-12-17T11:57:50.983 INFO:tasks.workunit.client.0.smithi002.stdout:6/643: fdatasync d0/d1/d21/f38 0 2023-12-17T11:57:51.004 INFO:tasks.workunit.client.1.smithi119.stdout:9/686: dwrite d12/d1d/d28/d46/d50/fb2 [0,4194304] 0 2023-12-17T11:57:51.014 INFO:tasks.workunit.client.0.smithi002.stdout:3/691: dwrite d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:51.024 INFO:tasks.workunit.client.0.smithi002.stdout:5/662: dwrite dc/d1a/d47/f4a [0,4194304] 0 2023-12-17T11:57:51.024 INFO:tasks.workunit.client.0.smithi002.stdout:5/663: truncate dc/d1b/fe4 892173 0 2023-12-17T11:57:51.026 INFO:tasks.workunit.client.0.smithi002.stdout:8/691: dwrite d3/d8/da/d44/f3b [0,4194304] 0 2023-12-17T11:57:51.034 INFO:tasks.workunit.client.1.smithi119.stdout:0/599: symlink d2/d66/d1f/d24/d50/d5d/d80/lb2 0 2023-12-17T11:57:51.035 INFO:tasks.workunit.client.1.smithi119.stdout:2/726: symlink d6/d9/d13/d34/d70/l101 0 2023-12-17T11:57:51.037 INFO:tasks.workunit.client.0.smithi002.stdout:9/700: dread dc/d38/f5e [0,4194304] 0 2023-12-17T11:57:51.039 INFO:tasks.workunit.client.0.smithi002.stdout:2/679: dwrite d3/d4/d7/fb0 [0,4194304] 0 2023-12-17T11:57:51.040 INFO:tasks.workunit.client.0.smithi002.stdout:0/615: dwrite d0/d6/fe [0,4194304] 0 2023-12-17T11:57:51.041 INFO:tasks.workunit.client.1.smithi119.stdout:9/687: stat d12/d1d/d28/d4d/d73/d78/d8b/da0/cbf 0 2023-12-17T11:57:51.041 INFO:tasks.workunit.client.1.smithi119.stdout:9/688: fdatasync d12/d1d/d28/d4d/f6c 0 2023-12-17T11:57:51.041 INFO:tasks.workunit.client.1.smithi119.stdout:9/689: dread - d12/d1d/d28/d86/d8f/fd7 zero size 2023-12-17T11:57:51.046 INFO:tasks.workunit.client.1.smithi119.stdout:0/600: getdents d2/d66/d2e/d44/d7b/d5/d3f 0 2023-12-17T11:57:51.046 INFO:tasks.workunit.client.1.smithi119.stdout:0/601: write d2/d16/f6f [798114,94627] 0 2023-12-17T11:57:51.048 INFO:tasks.workunit.client.1.smithi119.stdout:9/690: dread d12/d1d/f8e [0,4194304] 0 2023-12-17T11:57:51.048 INFO:tasks.workunit.client.1.smithi119.stdout:9/691: write d12/d1d/d28/d4d/d73/d78/d8b/fb8 [203758,2364] 0 2023-12-17T11:57:51.051 INFO:tasks.workunit.client.1.smithi119.stdout:2/727: creat d6/d9/d52/d53/d55/d58/da5/f102 x:0 0 0 2023-12-17T11:57:51.051 INFO:tasks.workunit.client.1.smithi119.stdout:2/728: chown d6/d2b/d3f/d5c/l6c 16 1 2023-12-17T11:57:51.054 INFO:tasks.workunit.client.1.smithi119.stdout:0/602: creat d2/d66/d1f/d24/d50/da4/fb3 x:0 0 0 2023-12-17T11:57:51.056 INFO:tasks.workunit.client.1.smithi119.stdout:9/692: mkdir d12/d1d/d28/d46/d6e/de2 0 2023-12-17T11:57:51.056 INFO:tasks.workunit.client.1.smithi119.stdout:9/693: fdatasync d12/d1d/d28/d4d/d73/f74 0 2023-12-17T11:57:51.056 INFO:tasks.workunit.client.1.smithi119.stdout:9/694: readlink d12/d1d/d28/d46/l61 0 2023-12-17T11:57:51.057 INFO:tasks.workunit.client.1.smithi119.stdout:9/695: creat d12/fe3 x:0 0 0 2023-12-17T11:57:51.057 INFO:tasks.workunit.client.1.smithi119.stdout:9/696: write d12/d1d/d28/d4d/d73/d78/d8b/da0/fc6 [3171821,63779] 0 2023-12-17T11:57:51.059 INFO:tasks.workunit.client.0.smithi002.stdout:3/692: dwrite d9/f13 [0,4194304] 0 2023-12-17T11:57:51.060 INFO:tasks.workunit.client.0.smithi002.stdout:5/664: link dc/d1b/d2d/d5b/f8a dc/d8e/feb 0 2023-12-17T11:57:51.060 INFO:tasks.workunit.client.0.smithi002.stdout:5/665: chown dc/d1b/d2d/c45 0 1 2023-12-17T11:57:51.061 INFO:tasks.workunit.client.1.smithi119.stdout:2/729: creat d6/d38/f103 x:0 0 0 2023-12-17T11:57:51.063 INFO:tasks.workunit.client.0.smithi002.stdout:8/692: symlink d3/d7/d6e/d7f/d90/le8 0 2023-12-17T11:57:51.065 INFO:tasks.workunit.client.1.smithi119.stdout:0/603: creat d2/d66/d1f/d24/d50/d5d/d80/fb4 x:0 0 0 2023-12-17T11:57:51.074 INFO:tasks.workunit.client.1.smithi119.stdout:2/730: getdents d6/d2b/d3f 0 2023-12-17T11:57:51.076 INFO:tasks.workunit.client.1.smithi119.stdout:9/697: dread d12/d1d/d28/d4d/f5e [0,4194304] 0 2023-12-17T11:57:51.076 INFO:tasks.workunit.client.1.smithi119.stdout:0/604: rmdir d2/d66/d2e 39 2023-12-17T11:57:51.077 INFO:tasks.workunit.client.1.smithi119.stdout:0/605: chown d2/d66/d2e 45872 1 2023-12-17T11:57:51.077 INFO:tasks.workunit.client.1.smithi119.stdout:0/606: creat d2/dac/fb5 x:0 0 0 2023-12-17T11:57:51.077 INFO:tasks.workunit.client.1.smithi119.stdout:0/607: chown d2/d66/d1f/d24/la9 11947 1 2023-12-17T11:57:51.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/701: dwrite dc/d42/da0/d72/d93/d52/f89 [0,4194304] 0 2023-12-17T11:57:51.090 INFO:tasks.workunit.client.1.smithi119.stdout:8/567: sync 2023-12-17T11:57:51.092 INFO:tasks.workunit.client.0.smithi002.stdout:8/693: unlink d3/d8/da/d44/lcd 0 2023-12-17T11:57:51.092 INFO:tasks.workunit.client.0.smithi002.stdout:8/694: truncate d3/d7/d6e/fe5 35422 0 2023-12-17T11:57:51.092 INFO:tasks.workunit.client.1.smithi119.stdout:0/608: dread d2/d66/d1f/f20 [0,4194304] 0 2023-12-17T11:57:51.093 INFO:tasks.workunit.client.0.smithi002.stdout:9/702: creat dc/d42/da0/d82/ffd x:0 0 0 2023-12-17T11:57:51.095 INFO:tasks.workunit.client.0.smithi002.stdout:3/693: rmdir d9/d1b/d35/d41/d43/d73 39 2023-12-17T11:57:51.095 INFO:tasks.workunit.client.0.smithi002.stdout:3/694: write f3 [1917461,103561] 0 2023-12-17T11:57:51.095 INFO:tasks.workunit.client.0.smithi002.stdout:3/695: truncate d9/d24/d6f/fb6 102413 0 2023-12-17T11:57:51.095 INFO:tasks.workunit.client.0.smithi002.stdout:0/616: dwrite d0/d15/f23 [4194304,4194304] 0 2023-12-17T11:57:51.096 INFO:tasks.workunit.client.0.smithi002.stdout:5/666: getdents dc/d1b 0 2023-12-17T11:57:51.097 INFO:tasks.workunit.client.0.smithi002.stdout:9/703: mkdir dc/d42/da0/d72/dfe 0 2023-12-17T11:57:51.098 INFO:tasks.workunit.client.0.smithi002.stdout:9/704: creat dc/d1d/fff x:0 0 0 2023-12-17T11:57:51.098 INFO:tasks.workunit.client.0.smithi002.stdout:0/617: truncate d0/d6/d26/d14/d19/d37/f99 673114 0 2023-12-17T11:57:51.099 INFO:tasks.workunit.client.0.smithi002.stdout:5/667: getdents dc/d17/d2f/d82 0 2023-12-17T11:57:51.099 INFO:tasks.workunit.client.0.smithi002.stdout:5/668: fdatasync dc/d1a/f46 0 2023-12-17T11:57:51.099 INFO:tasks.workunit.client.0.smithi002.stdout:5/669: stat dc/d1a/d53/c59 0 2023-12-17T11:57:51.100 INFO:tasks.workunit.client.0.smithi002.stdout:9/705: creat dc/d1d/d25/dd9/f100 x:0 0 0 2023-12-17T11:57:51.101 INFO:tasks.workunit.client.0.smithi002.stdout:0/618: symlink d0/d6/d26/d14/lc3 0 2023-12-17T11:57:51.101 INFO:tasks.workunit.client.0.smithi002.stdout:0/619: truncate d0/d6/d26/d14/d6d/d7e/f80 630299 0 2023-12-17T11:57:51.102 INFO:tasks.workunit.client.0.smithi002.stdout:5/670: creat dc/d1b/d5a/d96/fec x:0 0 0 2023-12-17T11:57:51.103 INFO:tasks.workunit.client.0.smithi002.stdout:9/706: rename dc/d1d/c20 to dc/d42/d4f/c101 0 2023-12-17T11:57:51.104 INFO:tasks.workunit.client.0.smithi002.stdout:0/620: mknod d0/d6/d26/d14/d90/d64/dab/cc4 0 2023-12-17T11:57:51.108 INFO:tasks.workunit.client.0.smithi002.stdout:3/696: dread d9/f1e [0,4194304] 0 2023-12-17T11:57:51.108 INFO:tasks.workunit.client.0.smithi002.stdout:3/697: chown d9/d24/d6f/fc5 301294 1 2023-12-17T11:57:51.108 INFO:tasks.workunit.client.0.smithi002.stdout:3/698: dread - d9/d1b/d35/d41/d59/da3/fd4 zero size 2023-12-17T11:57:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/695: write d3/d8/d28/d31/f3e [363161,90411] 0 2023-12-17T11:57:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:8/696: dread - d3/d7/d6e/d7f/fa3 zero size 2023-12-17T11:57:51.114 INFO:tasks.workunit.client.0.smithi002.stdout:9/707: truncate dc/f1e 3483386 0 2023-12-17T11:57:51.118 INFO:tasks.workunit.client.0.smithi002.stdout:3/699: getdents d9/d15/d71/dbb 0 2023-12-17T11:57:51.118 INFO:tasks.workunit.client.0.smithi002.stdout:3/700: write d9/d24/d6f/fb6 [1141517,86476] 0 2023-12-17T11:57:51.122 INFO:tasks.workunit.client.0.smithi002.stdout:8/697: mknod d3/d7/d6e/ce9 0 2023-12-17T11:57:51.122 INFO:tasks.workunit.client.0.smithi002.stdout:8/698: readlink d3/d8/d28/l45 0 2023-12-17T11:57:51.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/708: mknod dc/d1d/d25/d85/dc2/ddd/dfa/d47/c102 0 2023-12-17T11:57:51.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/709: fdatasync dc/d1d/d25/d85/dc2/f9b 0 2023-12-17T11:57:51.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/710: chown dc/d1d/d25/d85 135 1 2023-12-17T11:57:51.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/711: fsync dc/d42/d4f/f61 0 2023-12-17T11:57:51.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/712: write dc/d42/da0/d72/d93/dd0/ff6 [507113,8721] 0 2023-12-17T11:57:51.126 INFO:tasks.workunit.client.0.smithi002.stdout:9/713: chown dc/d42/da0/d72/d93/dd0/fd7 7066 1 2023-12-17T11:57:51.128 INFO:tasks.workunit.client.0.smithi002.stdout:0/621: rmdir d0/d6/d26/d14/d19/d37/d62 39 2023-12-17T11:57:51.129 INFO:tasks.workunit.client.1.smithi119.stdout:2/731: dwrite d6/d9/d13/d1d/f24 [0,4194304] 0 2023-12-17T11:57:51.129 INFO:tasks.workunit.client.1.smithi119.stdout:2/732: truncate d6/d9/d52/d5a/fce 561273 0 2023-12-17T11:57:51.134 INFO:tasks.workunit.client.0.smithi002.stdout:5/671: rename dc/d1b to dc/d94/ded 0 2023-12-17T11:57:51.134 INFO:tasks.workunit.client.0.smithi002.stdout:3/701: write d9/d40/f9a [238219,5274] 0 2023-12-17T11:57:51.146 INFO:tasks.workunit.client.0.smithi002.stdout:9/714: rename dc/d42/da0/d72/fbd to dc/d1d/d7c/d90/dc0/f103 0 2023-12-17T11:57:51.147 INFO:tasks.workunit.client.1.smithi119.stdout:2/733: rmdir d6/d9/d52/d53/d55/d58/d6b 39 2023-12-17T11:57:51.148 INFO:tasks.workunit.client.0.smithi002.stdout:3/702: symlink d9/d1b/d35/d41/d43/le0 0 2023-12-17T11:57:51.149 INFO:tasks.workunit.client.0.smithi002.stdout:9/715: mkdir dc/d42/d4f/d9e/d104 0 2023-12-17T11:57:51.150 INFO:tasks.workunit.client.0.smithi002.stdout:9/716: chown dc/d1d/d7c/d90/cb9 441739009 1 2023-12-17T11:57:51.150 INFO:tasks.workunit.client.0.smithi002.stdout:9/717: chown dc/d1d/d7c/l8b 119 1 2023-12-17T11:57:51.150 INFO:tasks.workunit.client.1.smithi119.stdout:2/734: symlink d6/d9/d52/l104 0 2023-12-17T11:57:51.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/672: getdents dc/d1a/d47 0 2023-12-17T11:57:51.151 INFO:tasks.workunit.client.0.smithi002.stdout:5/673: chown dc/f83 203826199 1 2023-12-17T11:57:51.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/703: symlink d9/d1b/d35/le1 0 2023-12-17T11:57:51.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/704: chown d9/d15/d52/d85/dd9 1072 1 2023-12-17T11:57:51.153 INFO:tasks.workunit.client.0.smithi002.stdout:3/705: fsync d9/d24/fa8 0 2023-12-17T11:57:51.155 INFO:tasks.workunit.client.1.smithi119.stdout:2/735: rename d6/d38/d96/fac to d6/d9/d86/f105 0 2023-12-17T11:57:51.155 INFO:tasks.workunit.client.1.smithi119.stdout:2/736: readlink d6/d2b/d3f/ld6 0 2023-12-17T11:57:51.155 INFO:tasks.workunit.client.1.smithi119.stdout:2/737: read d6/f73 [3147418,82873] 0 2023-12-17T11:57:51.155 INFO:tasks.workunit.client.1.smithi119.stdout:2/738: creat d6/d9/d52/d53/d55/d58/dba/f106 x:0 0 0 2023-12-17T11:57:51.156 INFO:tasks.workunit.client.0.smithi002.stdout:9/718: creat dc/d1d/d25/d85/dc2/d91/f105 x:0 0 0 2023-12-17T11:57:51.156 INFO:tasks.workunit.client.0.smithi002.stdout:9/719: write dc/d42/d4f/d9e/ff9 [597445,104279] 0 2023-12-17T11:57:51.158 INFO:tasks.workunit.client.1.smithi119.stdout:0/609: dwrite d2/d66/d1f/f20 [0,4194304] 0 2023-12-17T11:57:51.158 INFO:tasks.workunit.client.1.smithi119.stdout:8/568: dwrite d7/d12/f33 [0,4194304] 0 2023-12-17T11:57:51.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:51 smithi119 ceph-mon[117414]: pgmap v28: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 190 MiB/s rd, 235 MiB/s wr, 326 op/s 2023-12-17T11:57:51.159 INFO:tasks.workunit.client.0.smithi002.stdout:8/699: dwrite d3/d7/d1a/f75 [0,4194304] 0 2023-12-17T11:57:51.159 INFO:tasks.workunit.client.0.smithi002.stdout:8/700: creat d3/d7/d6e/d7f/d65/da2/fea x:0 0 0 2023-12-17T11:57:51.159 INFO:tasks.workunit.client.0.smithi002.stdout:8/701: truncate d3/d7/d1a/fd9 921820 0 2023-12-17T11:57:51.159 INFO:tasks.workunit.client.0.smithi002.stdout:5/674: symlink dc/d1a/d53/da9/db3/lee 0 2023-12-17T11:57:51.159 INFO:tasks.workunit.client.0.smithi002.stdout:5/675: write dc/d94/ded/d5a/d96/fec [302671,21630] 0 2023-12-17T11:57:51.161 INFO:tasks.workunit.client.0.smithi002.stdout:5/676: creat dc/d17/d2f/d99/fef x:0 0 0 2023-12-17T11:57:51.161 INFO:tasks.workunit.client.0.smithi002.stdout:9/720: rename dc/d1d/d25/l27 to dc/d42/da0/l106 0 2023-12-17T11:57:51.163 INFO:tasks.workunit.client.1.smithi119.stdout:2/739: link d6/d38/l67 d6/d9/d13/d1d/de8/l107 0 2023-12-17T11:57:51.163 INFO:tasks.workunit.client.0.smithi002.stdout:0/622: dread d0/f2e [0,4194304] 0 2023-12-17T11:57:51.165 INFO:tasks.workunit.client.0.smithi002.stdout:3/706: unlink d9/d1b/fdd 0 2023-12-17T11:57:51.169 INFO:tasks.workunit.client.1.smithi119.stdout:0/610: creat d2/d66/fb6 x:0 0 0 2023-12-17T11:57:51.170 INFO:tasks.workunit.client.1.smithi119.stdout:0/611: fdatasync d2/d16/f7d 0 2023-12-17T11:57:51.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/702: creat d3/dca/feb x:0 0 0 2023-12-17T11:57:51.175 INFO:tasks.workunit.client.0.smithi002.stdout:9/721: truncate dc/d1d/d25/fa1 109597 0 2023-12-17T11:57:51.178 INFO:tasks.workunit.client.1.smithi119.stdout:2/740: rename d6/d9/d13/d34/l3d to d6/d38/d96/l108 0 2023-12-17T11:57:51.181 INFO:tasks.workunit.client.0.smithi002.stdout:0/623: creat d0/d6/d26/fc5 x:0 0 0 2023-12-17T11:57:51.181 INFO:tasks.workunit.client.1.smithi119.stdout:0/612: unlink d2/d66/d2e/d44/d7b/d5/f55 0 2023-12-17T11:57:51.184 INFO:tasks.workunit.client.0.smithi002.stdout:3/707: rename d9/l34 to d9/d15/d52/d79/dd1/dd5/le2 0 2023-12-17T11:57:51.184 INFO:tasks.workunit.client.0.smithi002.stdout:3/708: truncate d9/d1b/d4f/fb1 367698 0 2023-12-17T11:57:51.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/639: sync 2023-12-17T11:57:51.187 INFO:tasks.workunit.client.0.smithi002.stdout:7/640: write d6/d17/dc/d13/d37/d4f/fa8 [1140575,49205] 0 2023-12-17T11:57:51.192 INFO:tasks.workunit.client.0.smithi002.stdout:9/722: creat dc/d42/f107 x:0 0 0 2023-12-17T11:57:51.193 INFO:tasks.workunit.client.0.smithi002.stdout:9/723: write dc/d1d/d25/d85/dc2/ddd/dfa/fae [85060,127614] 0 2023-12-17T11:57:51.194 INFO:tasks.workunit.client.1.smithi119.stdout:9/698: dwrite d12/d1d/d28/d46/d50/d92/fbe [0,4194304] 0 2023-12-17T11:57:51.195 INFO:tasks.workunit.client.0.smithi002.stdout:7/641: symlink d6/d17/dc/d13/d21/d2e/d4a/daf/db1/lc0 0 2023-12-17T11:57:51.195 INFO:tasks.workunit.client.0.smithi002.stdout:7/642: chown d6/d17/dc/d67/c23 0 1 2023-12-17T11:57:51.195 INFO:tasks.workunit.client.0.smithi002.stdout:7/643: stat d6/l85 0 2023-12-17T11:57:51.198 INFO:tasks.workunit.client.1.smithi119.stdout:2/741: rename d6/d9/d13/d1d/de8 to d6/d2b/d3f/d5c/d109 0 2023-12-17T11:57:51.198 INFO:tasks.workunit.client.1.smithi119.stdout:2/742: readlink d6/d38/d96/l108 0 2023-12-17T11:57:51.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/724: creat dc/d42/da0/d72/d93/dd0/dd4/df1/f108 x:0 0 0 2023-12-17T11:57:51.200 INFO:tasks.workunit.client.0.smithi002.stdout:9/725: chown dc/cca 197 1 2023-12-17T11:57:51.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/644: dread d6/d17/dc/d13/d21/f8f [0,4194304] 0 2023-12-17T11:57:51.203 INFO:tasks.workunit.client.0.smithi002.stdout:7/645: readlink d6/d17/dc/d67/d8b/dbd/l77 0 2023-12-17T11:57:51.203 INFO:tasks.workunit.client.0.smithi002.stdout:9/726: mknod dc/d1d/d25/dd9/c109 0 2023-12-17T11:57:51.208 INFO:tasks.workunit.client.0.smithi002.stdout:7/646: mknod d6/d17/dc/d13/cc1 0 2023-12-17T11:57:51.213 INFO:tasks.workunit.client.0.smithi002.stdout:9/727: mknod dc/d1d/d25/d85/dc2/c10a 0 2023-12-17T11:57:51.214 INFO:tasks.workunit.client.0.smithi002.stdout:9/728: mknod dc/d1d/d7c/d90/dc0/c10b 0 2023-12-17T11:57:51.217 INFO:tasks.workunit.client.1.smithi119.stdout:9/699: write d12/d1d/f41 [362479,9794] 0 2023-12-17T11:57:51.220 INFO:tasks.workunit.client.1.smithi119.stdout:9/700: symlink d12/d1d/d49/d85/le4 0 2023-12-17T11:57:51.221 INFO:tasks.workunit.client.1.smithi119.stdout:9/701: write d12/d1d/d28/d46/f66 [1413058,36935] 0 2023-12-17T11:57:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/729: mknod dc/d1d/d7c/c10c 0 2023-12-17T11:57:51.223 INFO:tasks.workunit.client.0.smithi002.stdout:9/730: truncate dc/d42/da0/d82/ffd 629002 0 2023-12-17T11:57:51.224 INFO:tasks.workunit.client.1.smithi119.stdout:9/702: getdents d12/d1d/d28/d46/d50/d92 0 2023-12-17T11:57:51.224 INFO:tasks.workunit.client.1.smithi119.stdout:9/703: readlink d12/d1d/d28/d4d/l75 0 2023-12-17T11:57:51.225 INFO:tasks.workunit.client.1.smithi119.stdout:9/704: truncate d12/f23 36740 0 2023-12-17T11:57:51.225 INFO:tasks.workunit.client.1.smithi119.stdout:9/705: chown d12/d1d/d49/le1 25106 1 2023-12-17T11:57:51.225 INFO:tasks.workunit.client.1.smithi119.stdout:2/743: write d6/d2b/d3f/da8/fad [386323,95292] 0 2023-12-17T11:57:51.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:51 smithi002 ceph-mon[107131]: pgmap v28: 65 pgs: 65 active+clean; 2.2 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 190 MiB/s rd, 235 MiB/s wr, 326 op/s 2023-12-17T11:57:51.231 INFO:tasks.workunit.client.1.smithi119.stdout:8/569: dwrite d7/d12/d23/f38 [0,4194304] 0 2023-12-17T11:57:51.232 INFO:tasks.workunit.client.0.smithi002.stdout:9/731: dread dc/d1d/f3b [0,4194304] 0 2023-12-17T11:57:51.232 INFO:tasks.workunit.client.1.smithi119.stdout:0/613: dwrite d2/d16/f7c [0,4194304] 0 2023-12-17T11:57:51.233 INFO:tasks.workunit.client.0.smithi002.stdout:8/703: write d3/d8/da/f93 [3744733,107559] 0 2023-12-17T11:57:51.234 INFO:tasks.workunit.client.0.smithi002.stdout:5/677: dwrite dc/d94/fce [0,4194304] 0 2023-12-17T11:57:51.234 INFO:tasks.workunit.client.0.smithi002.stdout:5/678: stat dc/d94/ded/d2d/d5b 0 2023-12-17T11:57:51.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/624: dwrite d0/d6/d26/d14/d19/d37/f99 [0,4194304] 0 2023-12-17T11:57:51.237 INFO:tasks.workunit.client.0.smithi002.stdout:0/625: chown d0/d6/d26/d14/d90/f78 44 1 2023-12-17T11:57:51.238 INFO:tasks.workunit.client.0.smithi002.stdout:8/704: mkdir d3/d8/d28/d31/d5a/db4/dec 0 2023-12-17T11:57:51.239 INFO:tasks.workunit.client.0.smithi002.stdout:9/732: truncate dc/d32/f35 747324 0 2023-12-17T11:57:51.239 INFO:tasks.workunit.client.0.smithi002.stdout:9/733: readlink dc/d42/lb4 0 2023-12-17T11:57:51.239 INFO:tasks.workunit.client.0.smithi002.stdout:8/705: read - d3/d8/da/dd/db0/fbc zero size 2023-12-17T11:57:51.239 INFO:tasks.workunit.client.0.smithi002.stdout:9/734: write dc/fee [1045829,33700] 0 2023-12-17T11:57:51.239 INFO:tasks.workunit.client.0.smithi002.stdout:9/735: write dc/d42/da0/d82/ffd [1421134,35487] 0 2023-12-17T11:57:51.240 INFO:tasks.workunit.client.1.smithi119.stdout:8/570: creat d7/d12/fba x:0 0 0 2023-12-17T11:57:51.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/626: unlink d0/d6/d26/d14/d19/d37/d91/cb7 0 2023-12-17T11:57:51.244 INFO:tasks.workunit.client.0.smithi002.stdout:7/647: dread d6/d17/dc/d13/d21/d2e/fae [0,4194304] 0 2023-12-17T11:57:51.247 INFO:tasks.workunit.client.0.smithi002.stdout:3/709: dwrite d9/d15/f32 [4194304,4194304] 0 2023-12-17T11:57:51.250 INFO:tasks.workunit.client.0.smithi002.stdout:8/706: mknod d3/d7/d18/d74/ced 0 2023-12-17T11:57:51.254 INFO:tasks.workunit.client.0.smithi002.stdout:7/648: link d6/d17/dc/d6c/d93/fa0 d6/d81/fc2 0 2023-12-17T11:57:51.254 INFO:tasks.workunit.client.0.smithi002.stdout:0/627: symlink d0/d6/d26/d25/lc6 0 2023-12-17T11:57:51.254 INFO:tasks.workunit.client.0.smithi002.stdout:0/628: chown d0/d6/d26/d14/d19/d61/cbd 1706511 1 2023-12-17T11:57:51.254 INFO:tasks.workunit.client.1.smithi119.stdout:0/614: read d2/d66/d2e/d44/d7b/d5/d3f/f5e [826060,84648] 0 2023-12-17T11:57:51.255 INFO:tasks.workunit.client.0.smithi002.stdout:7/649: creat d6/d17/dc/d67/d8b/dbd/d75/fc3 x:0 0 0 2023-12-17T11:57:51.258 INFO:tasks.workunit.client.0.smithi002.stdout:0/629: creat d0/d6/d26/d14/d19/d37/d62/fc7 x:0 0 0 2023-12-17T11:57:51.259 INFO:tasks.workunit.client.1.smithi119.stdout:8/571: getdents d7/d12 0 2023-12-17T11:57:51.262 INFO:tasks.workunit.client.1.smithi119.stdout:0/615: getdents d2/d66/d1f/d24/d50/d5d/d80 0 2023-12-17T11:57:51.264 INFO:tasks.workunit.client.0.smithi002.stdout:3/710: read d9/d15/f66 [669780,89883] 0 2023-12-17T11:57:51.264 INFO:tasks.workunit.client.0.smithi002.stdout:0/630: mkdir d0/d6/d26/d8f/dc8 0 2023-12-17T11:57:51.265 INFO:tasks.workunit.client.1.smithi119.stdout:0/616: mknod d2/d66/d1f/d24/cb7 0 2023-12-17T11:57:51.267 INFO:tasks.workunit.client.1.smithi119.stdout:0/617: mknod d2/d66/d1f/d24/cb8 0 2023-12-17T11:57:51.268 INFO:tasks.workunit.client.0.smithi002.stdout:0/631: rmdir d0/d6/d26/d14/d19/d37/d91/dae 39 2023-12-17T11:57:51.269 INFO:tasks.workunit.client.1.smithi119.stdout:3/706: sync 2023-12-17T11:57:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:0/632: symlink d0/d6/d26/d14/d19/db1/lc9 0 2023-12-17T11:57:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:0/633: dread - d0/d6/d26/d14/d19/d37/d86/f98 zero size 2023-12-17T11:57:51.271 INFO:tasks.workunit.client.0.smithi002.stdout:0/634: stat d0/d6/d26/d14/d19/d37/d62/d77 0 2023-12-17T11:57:51.272 INFO:tasks.workunit.client.1.smithi119.stdout:3/707: mknod d9/d59/dae/c110 0 2023-12-17T11:57:51.273 INFO:tasks.workunit.client.0.smithi002.stdout:0/635: getdents d0/d6/d26/d14/d19 0 2023-12-17T11:57:51.279 INFO:tasks.workunit.client.0.smithi002.stdout:0/636: mkdir d0/d6/d26/d14/d19/d37/d86/dca 0 2023-12-17T11:57:51.280 INFO:tasks.workunit.client.1.smithi119.stdout:3/708: write d9/d11/d1e/d9f/dde/ff2 [655545,70237] 0 2023-12-17T11:57:51.281 INFO:tasks.workunit.client.1.smithi119.stdout:9/706: dwrite d12/d1d/f36 [0,4194304] 0 2023-12-17T11:57:51.286 INFO:tasks.workunit.client.1.smithi119.stdout:3/709: symlink d9/d11/d1e/l111 0 2023-12-17T11:57:51.286 INFO:tasks.workunit.client.1.smithi119.stdout:3/710: readlink d9/da/l7d 0 2023-12-17T11:57:51.287 INFO:tasks.workunit.client.0.smithi002.stdout:5/679: dread dc/d94/ded/d5a/d68/d97/ddd/fda [0,4194304] 0 2023-12-17T11:57:51.290 INFO:tasks.workunit.client.1.smithi119.stdout:2/744: dwrite d6/d9/d13/d34/ff3 [0,4194304] 0 2023-12-17T11:57:51.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/707: dread d3/d7/d18/d74/d7b/f81 [0,4194304] 0 2023-12-17T11:57:51.293 INFO:tasks.workunit.client.0.smithi002.stdout:9/736: dwrite dc/d42/da0/d72/d93/d52/f8f [0,4194304] 0 2023-12-17T11:57:51.295 INFO:tasks.workunit.client.0.smithi002.stdout:0/637: rename d0/d6/d26/d25/c50 to d0/d33/ccb 0 2023-12-17T11:57:51.297 INFO:tasks.workunit.client.1.smithi119.stdout:9/707: unlink d12/d1d/d28/d86/d8f/fc3 0 2023-12-17T11:57:51.298 INFO:tasks.workunit.client.0.smithi002.stdout:5/680: mkdir dc/d94/ded/d2d/df0 0 2023-12-17T11:57:51.305 INFO:tasks.workunit.client.1.smithi119.stdout:8/572: dwrite d7/d12/d23/f38 [4194304,4194304] 0 2023-12-17T11:57:51.305 INFO:tasks.workunit.client.1.smithi119.stdout:2/745: creat d6/d9/d13/d34/d56/f10a x:0 0 0 2023-12-17T11:57:51.305 INFO:tasks.workunit.client.1.smithi119.stdout:9/708: symlink d12/d1d/d28/d46/dbb/le5 0 2023-12-17T11:57:51.306 INFO:tasks.workunit.client.0.smithi002.stdout:9/737: creat dc/d1d/d25/d85/dc2/ddd/dfa/d47/f10d x:0 0 0 2023-12-17T11:57:51.307 INFO:tasks.workunit.client.0.smithi002.stdout:9/738: creat dc/d42/f10e x:0 0 0 2023-12-17T11:57:51.307 INFO:tasks.workunit.client.0.smithi002.stdout:9/739: fsync dc/d1d/fe9 0 2023-12-17T11:57:51.307 INFO:tasks.workunit.client.0.smithi002.stdout:8/708: rename d3/d8/da/l43 to d3/d7/d18/lee 0 2023-12-17T11:57:51.307 INFO:tasks.workunit.client.0.smithi002.stdout:8/709: fsync d3/d8/da/dd/f66 0 2023-12-17T11:57:51.309 INFO:tasks.workunit.client.0.smithi002.stdout:0/638: unlink d0/d6/d26/d14/d19/d37/d91/la9 0 2023-12-17T11:57:51.311 INFO:tasks.workunit.client.0.smithi002.stdout:5/681: mkdir dc/d17/df1 0 2023-12-17T11:57:51.312 INFO:tasks.workunit.client.1.smithi119.stdout:3/711: dread d9/d1c/f49 [0,4194304] 0 2023-12-17T11:57:51.313 INFO:tasks.workunit.client.1.smithi119.stdout:3/712: write d9/d44/d8c/fad [858292,120528] 0 2023-12-17T11:57:51.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/740: symlink dc/d42/l10f 0 2023-12-17T11:57:51.318 INFO:tasks.workunit.client.0.smithi002.stdout:9/741: fdatasync dc/d42/da0/d72/d93/d52/fa5 0 2023-12-17T11:57:51.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/710: rename d3/d7/d6e/fd6 to d3/d8/da/dd/db0/fef 0 2023-12-17T11:57:51.322 INFO:tasks.workunit.client.0.smithi002.stdout:1/716: sync 2023-12-17T11:57:51.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/711: write d3/d7/d18/d3f/f60 [1967233,123361] 0 2023-12-17T11:57:51.322 INFO:tasks.workunit.client.0.smithi002.stdout:1/717: readlink d3/d6/d9/d37/lda 0 2023-12-17T11:57:51.322 INFO:tasks.workunit.client.0.smithi002.stdout:8/712: write d3/d8/da/d44/fc8 [119622,87532] 0 2023-12-17T11:57:51.323 INFO:tasks.workunit.client.0.smithi002.stdout:8/713: fsync d3/d7/d18/d3f/d49/f94 0 2023-12-17T11:57:51.323 INFO:tasks.workunit.client.0.smithi002.stdout:8/714: fdatasync d3/d8/da/f93 0 2023-12-17T11:57:51.323 INFO:tasks.workunit.client.0.smithi002.stdout:8/715: write d3/d7/d18/d74/d7b/fdc [439135,29510] 0 2023-12-17T11:57:51.324 INFO:tasks.workunit.client.0.smithi002.stdout:5/682: truncate dc/d94/fce 3577066 0 2023-12-17T11:57:51.325 INFO:tasks.workunit.client.1.smithi119.stdout:9/709: link d12/d1d/d28/d46/d50/d92/dae/fb5 d12/d1d/d28/d46/d6e/fe6 0 2023-12-17T11:57:51.327 INFO:tasks.workunit.client.0.smithi002.stdout:0/639: rename d0/d6/d26/d14/d19/d37/d62/f7b to d0/d6/d26/d14/d19/d2f/fcc 0 2023-12-17T11:57:51.328 INFO:tasks.workunit.client.0.smithi002.stdout:0/640: stat d0/d6/d26/d14/d19/d37/d62/d77/fa0 0 2023-12-17T11:57:51.332 INFO:tasks.workunit.client.1.smithi119.stdout:9/710: dread d12/d1d/d49/f57 [0,4194304] 0 2023-12-17T11:57:51.332 INFO:tasks.workunit.client.1.smithi119.stdout:9/711: creat d12/d1d/d28/d46/d50/d92/dae/fe7 x:0 0 0 2023-12-17T11:57:51.332 INFO:tasks.workunit.client.1.smithi119.stdout:9/712: chown d12/d1d/d49/le1 245902850 1 2023-12-17T11:57:51.334 INFO:tasks.workunit.client.1.smithi119.stdout:0/618: dwrite d2/d16/d35/d39/f6e [0,4194304] 0 2023-12-17T11:57:51.336 INFO:tasks.workunit.client.1.smithi119.stdout:3/713: link d9/f9b d9/d11/d1e/d55/d65/ddf/f112 0 2023-12-17T11:57:51.337 INFO:tasks.workunit.client.1.smithi119.stdout:0/619: write d2/d16/d35/d39/f76 [236040,43679] 0 2023-12-17T11:57:51.341 INFO:tasks.workunit.client.0.smithi002.stdout:0/641: symlink d0/d6/d26/d14/d19/d37/d91/dae/lcd 0 2023-12-17T11:57:51.345 INFO:tasks.workunit.client.1.smithi119.stdout:6/594: sync 2023-12-17T11:57:51.349 INFO:tasks.workunit.client.1.smithi119.stdout:8/573: dwrite d7/da/d11/d26/d49/f5e [0,4194304] 0 2023-12-17T11:57:51.354 INFO:tasks.workunit.client.0.smithi002.stdout:5/683: write dc/d94/ded/d5a/f5f [728986,129796] 0 2023-12-17T11:57:51.356 INFO:tasks.workunit.client.1.smithi119.stdout:1/646: sync 2023-12-17T11:57:51.356 INFO:tasks.workunit.client.1.smithi119.stdout:4/659: sync 2023-12-17T11:57:51.356 INFO:tasks.workunit.client.1.smithi119.stdout:3/714: readlink d9/da/df/d41/d33/d3a/la2 0 2023-12-17T11:57:51.357 INFO:tasks.workunit.client.1.smithi119.stdout:3/715: read - d9/d59/da6/f10d zero size 2023-12-17T11:57:51.357 INFO:tasks.workunit.client.1.smithi119.stdout:0/620: dread d2/d66/d2e/d44/d7b/d5/f4f [0,4194304] 0 2023-12-17T11:57:51.357 INFO:tasks.workunit.client.1.smithi119.stdout:0/621: readlink d2/d66/d2e/d44/l9c 0 2023-12-17T11:57:51.357 INFO:tasks.workunit.client.1.smithi119.stdout:3/716: write d9/d44/d8c/fe3 [423967,85810] 0 2023-12-17T11:57:51.358 INFO:tasks.workunit.client.0.smithi002.stdout:5/684: rename dc/d17/d2f/d82/cd0 to dc/d8e/cf2 0 2023-12-17T11:57:51.361 INFO:tasks.workunit.client.0.smithi002.stdout:9/742: dwrite dc/d1d/d7c/d90/fbb [0,4194304] 0 2023-12-17T11:57:51.361 INFO:tasks.workunit.client.0.smithi002.stdout:8/716: truncate d3/d7/d18/d74/d7b/fdc 99820 0 2023-12-17T11:57:51.361 INFO:tasks.workunit.client.0.smithi002.stdout:0/642: write d0/d6/d26/d14/d19/d2b/f30 [6117102,5323] 0 2023-12-17T11:57:51.362 INFO:tasks.workunit.client.0.smithi002.stdout:8/717: creat d3/d8/da/dd/db0/ff0 x:0 0 0 2023-12-17T11:57:51.362 INFO:tasks.workunit.client.0.smithi002.stdout:0/643: dread - d0/d6/d26/d14/d19/d61/f88 zero size 2023-12-17T11:57:51.362 INFO:tasks.workunit.client.0.smithi002.stdout:0/644: fdatasync d0/d33/f8e 0 2023-12-17T11:57:51.362 INFO:tasks.workunit.client.1.smithi119.stdout:5/710: sync 2023-12-17T11:57:51.362 INFO:tasks.workunit.client.1.smithi119.stdout:7/670: sync 2023-12-17T11:57:51.364 INFO:tasks.workunit.client.1.smithi119.stdout:5/711: creat d1/d70/d6b/d77/fe2 x:0 0 0 2023-12-17T11:57:51.366 INFO:tasks.workunit.client.1.smithi119.stdout:8/574: unlink d7/d12/d69/l52 0 2023-12-17T11:57:51.368 INFO:tasks.workunit.client.1.smithi119.stdout:4/660: unlink dd/d4b/d6a/c96 0 2023-12-17T11:57:51.368 INFO:tasks.workunit.client.1.smithi119.stdout:4/661: write dd/d15/d16/d5a/f99 [75354,115268] 0 2023-12-17T11:57:51.370 INFO:tasks.workunit.client.1.smithi119.stdout:1/647: mknod d3/db/d17/d24/d20/d40/d76/de9/cef 0 2023-12-17T11:57:51.373 INFO:tasks.workunit.client.1.smithi119.stdout:3/717: mkdir d9/da/df/d41/d113 0 2023-12-17T11:57:51.373 INFO:tasks.workunit.client.1.smithi119.stdout:0/622: write d2/d66/d2e/d44/f26 [3580953,34403] 0 2023-12-17T11:57:51.378 INFO:tasks.workunit.client.1.smithi119.stdout:7/671: rename d2/d4/d1f/cce to d2/d4/cd0 0 2023-12-17T11:57:51.380 INFO:tasks.workunit.client.0.smithi002.stdout:4/611: sync 2023-12-17T11:57:51.380 INFO:tasks.workunit.client.0.smithi002.stdout:6/644: sync 2023-12-17T11:57:51.385 INFO:tasks.workunit.client.1.smithi119.stdout:4/662: creat dd/d4b/fd7 x:0 0 0 2023-12-17T11:57:51.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/743: creat dc/d1d/d25/d85/dc2/df8/f110 x:0 0 0 2023-12-17T11:57:51.391 INFO:tasks.workunit.client.1.smithi119.stdout:1/648: symlink d3/db/d17/d24/d20/d6c/lf0 0 2023-12-17T11:57:51.392 INFO:tasks.workunit.client.1.smithi119.stdout:1/649: chown d3/db/d17/c56 20995 1 2023-12-17T11:57:51.398 INFO:tasks.workunit.client.1.smithi119.stdout:0/623: creat d2/d66/d2e/d44/fb9 x:0 0 0 2023-12-17T11:57:51.398 INFO:tasks.workunit.client.1.smithi119.stdout:0/624: write d2/d16/fab [125358,6129] 0 2023-12-17T11:57:51.399 INFO:tasks.workunit.client.0.smithi002.stdout:9/744: creat dc/d1d/d7c/d90/dc0/f111 x:0 0 0 2023-12-17T11:57:51.399 INFO:tasks.workunit.client.0.smithi002.stdout:9/745: stat dc/d1d/d25/d85/dc2/ddd/dfa/d47/f10d 0 2023-12-17T11:57:51.399 INFO:tasks.workunit.client.1.smithi119.stdout:7/672: stat d2/l86 0 2023-12-17T11:57:51.402 INFO:tasks.workunit.client.0.smithi002.stdout:0/645: mkdir d0/d6/d26/d25/dce 0 2023-12-17T11:57:51.407 INFO:tasks.workunit.client.1.smithi119.stdout:4/663: truncate dd/d11/d2d/d9c/d55/d81/db8/d78/faf 1069127 0 2023-12-17T11:57:51.407 INFO:tasks.workunit.client.1.smithi119.stdout:4/664: write dd/d15/d16/d3d/dab/db1/fb2 [829678,101712] 0 2023-12-17T11:57:51.407 INFO:tasks.workunit.client.1.smithi119.stdout:4/665: fdatasync dd/d15/f5c 0 2023-12-17T11:57:51.407 INFO:tasks.workunit.client.1.smithi119.stdout:4/666: fsync dd/d4b/fa4 0 2023-12-17T11:57:51.407 INFO:tasks.workunit.client.1.smithi119.stdout:0/625: truncate d2/d16/f6f 124892 0 2023-12-17T11:57:51.409 INFO:tasks.workunit.client.0.smithi002.stdout:0/646: getdents d0/d6 0 2023-12-17T11:57:51.409 INFO:tasks.workunit.client.0.smithi002.stdout:0/647: write d0/d6/d26/d25/f96 [420959,38789] 0 2023-12-17T11:57:51.410 INFO:tasks.workunit.client.1.smithi119.stdout:7/673: mkdir d2/d4/d11/d2c/d68/d98/dd1 0 2023-12-17T11:57:51.413 INFO:tasks.workunit.client.1.smithi119.stdout:4/667: creat dd/d15/d16/d5a/dbc/fd8 x:0 0 0 2023-12-17T11:57:51.413 INFO:tasks.workunit.client.0.smithi002.stdout:6/645: read d0/d1/d21/d56/d8c/d93/da5/f90 [2894533,53947] 0 2023-12-17T11:57:51.413 INFO:tasks.workunit.client.0.smithi002.stdout:6/646: fdatasync d0/d1/dc/d17/f1f 0 2023-12-17T11:57:51.415 INFO:tasks.workunit.client.1.smithi119.stdout:0/626: link d2/d16/d35/d39/f76 d2/d66/fba 0 2023-12-17T11:57:51.415 INFO:tasks.workunit.client.1.smithi119.stdout:0/627: getdents d2/d66/d1f/d24/d50/d5d/d80 0 2023-12-17T11:57:51.419 INFO:tasks.workunit.client.0.smithi002.stdout:0/648: rename d0/d33 to d0/d6/d26/d14/d19/d37/dcf 0 2023-12-17T11:57:51.420 INFO:tasks.workunit.client.1.smithi119.stdout:7/674: link d2/d4/d70/f87 d2/d4/d70/fd2 0 2023-12-17T11:57:51.421 INFO:tasks.workunit.client.1.smithi119.stdout:0/628: getdents d2/d66/d1f/d24/d50 0 2023-12-17T11:57:51.421 INFO:tasks.workunit.client.1.smithi119.stdout:0/629: read d2/d16/d35/d39/f76 [86110,122151] 0 2023-12-17T11:57:51.425 INFO:tasks.workunit.client.0.smithi002.stdout:6/647: symlink d0/d1/dc/d58/dae/ld3 0 2023-12-17T11:57:51.425 INFO:tasks.workunit.client.0.smithi002.stdout:6/648: readlink d0/d1/dc/d17/d4c/l9b 0 2023-12-17T11:57:51.425 INFO:tasks.workunit.client.0.smithi002.stdout:6/649: write d0/d1/dc/d10/fb8 [167151,52192] 0 2023-12-17T11:57:51.425 INFO:tasks.workunit.client.1.smithi119.stdout:0/630: mkdir d2/d66/dbb 0 2023-12-17T11:57:51.426 INFO:tasks.workunit.client.1.smithi119.stdout:8/575: dwrite d7/d18/d45/f83 [0,4194304] 0 2023-12-17T11:57:51.428 INFO:tasks.workunit.client.1.smithi119.stdout:7/675: link d2/d4/d70/d57/la1 d2/d4/d11/d2c/d68/d99/ld3 0 2023-12-17T11:57:51.431 INFO:tasks.workunit.client.0.smithi002.stdout:6/650: creat d0/d1/fd4 x:0 0 0 2023-12-17T11:57:51.435 INFO:tasks.workunit.client.0.smithi002.stdout:5/685: dwrite dc/d17/f87 [0,4194304] 0 2023-12-17T11:57:51.436 INFO:tasks.workunit.client.0.smithi002.stdout:6/651: rename d0/d1/d5b/c6b to d0/d1/dc/d17/d4c/cd5 0 2023-12-17T11:57:51.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/649: dread d0/f48 [0,4194304] 0 2023-12-17T11:57:51.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/650: write d0/d6/d26/d14/d90/f78 [2570386,49306] 0 2023-12-17T11:57:51.437 INFO:tasks.workunit.client.0.smithi002.stdout:0/651: chown d0/d6/d26/d14/d19/d37/d91/fbb 39819 1 2023-12-17T11:57:51.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/652: rename d0/d1/d21/d56/d8c/d93/da5/dbc/dc1 to d0/d1/dc/d17/dd6 0 2023-12-17T11:57:51.441 INFO:tasks.workunit.client.0.smithi002.stdout:6/653: readlink d0/lad 0 2023-12-17T11:57:51.443 INFO:tasks.workunit.client.0.smithi002.stdout:0/652: mknod d0/d6/d26/d14/d90/d64/cd0 0 2023-12-17T11:57:51.446 INFO:tasks.workunit.client.1.smithi119.stdout:7/676: unlink d2/d4/d11/d3c/d75/f83 0 2023-12-17T11:57:51.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/654: mkdir d0/d1/dc/d17/dd7 0 2023-12-17T11:57:51.448 INFO:tasks.workunit.client.0.smithi002.stdout:6/655: readlink d0/d1/dc/d10/l1d 0 2023-12-17T11:57:51.450 INFO:tasks.workunit.client.0.smithi002.stdout:0/653: unlink d0/d6/l81 0 2023-12-17T11:57:51.451 INFO:tasks.workunit.client.1.smithi119.stdout:8/576: mkdir d7/d18/d15/dbb 0 2023-12-17T11:57:51.454 INFO:tasks.workunit.client.0.smithi002.stdout:6/656: rename d0/d1/dc/d17/d4c/l4d to d0/dc3/ld8 0 2023-12-17T11:57:51.454 INFO:tasks.workunit.client.0.smithi002.stdout:6/657: readlink d0/d1/dc/d10/la7 0 2023-12-17T11:57:51.455 INFO:tasks.workunit.client.1.smithi119.stdout:0/631: rename d2/d66/d1f/d24/d50/da4 to d2/d66/d2e/d44/d7b/dbc 0 2023-12-17T11:57:51.455 INFO:tasks.workunit.client.1.smithi119.stdout:0/632: chown d2/d66/d2e/d44/d7b/c63 54278000 1 2023-12-17T11:57:51.456 INFO:tasks.workunit.client.0.smithi002.stdout:0/654: symlink d0/d6/d26/d14/d90/d64/ld1 0 2023-12-17T11:57:51.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/655: write d0/d6/d26/d14/d19/d37/d62/fc7 [887880,26577] 0 2023-12-17T11:57:51.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/656: chown d0/d6/d26/d14/d19/d37/f99 7 1 2023-12-17T11:57:51.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/657: write d0/d15/f27 [3067136,106866] 0 2023-12-17T11:57:51.457 INFO:tasks.workunit.client.0.smithi002.stdout:0/658: write d0/d15/f4f [792888,4089] 0 2023-12-17T11:57:51.462 INFO:tasks.workunit.client.1.smithi119.stdout:8/577: unlink d7/da/d11/d26/c3a 0 2023-12-17T11:57:51.463 INFO:tasks.workunit.client.1.smithi119.stdout:1/650: dwrite d3/db/d26/d19/d3f/d64/f7c [0,4194304] 0 2023-12-17T11:57:51.465 INFO:tasks.workunit.client.0.smithi002.stdout:0/659: mknod d0/d6/d26/cd2 0 2023-12-17T11:57:51.466 INFO:tasks.workunit.client.1.smithi119.stdout:0/633: mkdir d2/d66/d1f/d24/d50/dbd 0 2023-12-17T11:57:51.466 INFO:tasks.workunit.client.1.smithi119.stdout:7/677: link d2/c46 d2/d4/d11/d2c/cd4 0 2023-12-17T11:57:51.466 INFO:tasks.workunit.client.1.smithi119.stdout:0/634: creat d2/d66/d2e/d44/fbe x:0 0 0 2023-12-17T11:57:51.467 INFO:tasks.workunit.client.0.smithi002.stdout:0/660: mkdir d0/dd3 0 2023-12-17T11:57:51.470 INFO:tasks.workunit.client.1.smithi119.stdout:3/718: dwrite d9/da/df/d41/d33/d3a/fc8 [0,4194304] 0 2023-12-17T11:57:51.471 INFO:tasks.workunit.client.1.smithi119.stdout:5/712: dwrite d1/da7/d71/d97/fa9 [0,4194304] 0 2023-12-17T11:57:51.471 INFO:tasks.workunit.client.0.smithi002.stdout:9/746: dwrite f0 [0,4194304] 0 2023-12-17T11:57:51.471 INFO:tasks.workunit.client.0.smithi002.stdout:9/747: write dc/d1d/d25/fa1 [435836,24481] 0 2023-12-17T11:57:51.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/718: dwrite d3/d8/da/dd/f1d [0,4194304] 0 2023-12-17T11:57:51.473 INFO:tasks.workunit.client.0.smithi002.stdout:4/612: dwrite d0/d10/d21/fa2 [0,4194304] 0 2023-12-17T11:57:51.473 INFO:tasks.workunit.client.0.smithi002.stdout:8/719: write d3/d8/da/dd/f1d [4790806,62084] 0 2023-12-17T11:57:51.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/748: unlink dc/d1d/d7c/d90/dc0/f111 0 2023-12-17T11:57:51.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/749: read - dc/d1d/d25/d85/dc2/d91/db2/fb6 zero size 2023-12-17T11:57:51.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/686: dwrite dc/d94/ded/fd1 [0,4194304] 0 2023-12-17T11:57:51.484 INFO:tasks.workunit.client.1.smithi119.stdout:8/578: dread d7/f16 [0,4194304] 0 2023-12-17T11:57:51.486 INFO:tasks.workunit.client.1.smithi119.stdout:0/635: dread d2/d16/d35/f85 [0,4194304] 0 2023-12-17T11:57:51.492 INFO:tasks.workunit.client.1.smithi119.stdout:3/719: rename d9/d11/f72 to d9/d35/dbd/f114 0 2023-12-17T11:57:51.492 INFO:tasks.workunit.client.1.smithi119.stdout:3/720: fsync d9/da/df/d41/ff7 0 2023-12-17T11:57:51.492 INFO:tasks.workunit.client.1.smithi119.stdout:3/721: write d9/da/df/d41/fdd [305946,126121] 0 2023-12-17T11:57:51.492 INFO:tasks.workunit.client.1.smithi119.stdout:3/722: write d9/da/df/d41/d33/d3a/d90/fff [264955,73952] 0 2023-12-17T11:57:51.493 INFO:tasks.workunit.client.0.smithi002.stdout:4/613: mkdir d0/d3e/dc8 0 2023-12-17T11:57:51.493 INFO:tasks.workunit.client.0.smithi002.stdout:0/661: dread d0/d6/d26/d14/d19/d2b/f42 [0,4194304] 0 2023-12-17T11:57:51.495 INFO:tasks.workunit.client.0.smithi002.stdout:8/720: link d3/d8/da/dd/c3c d3/d7/d18/d74/d7b/cf1 0 2023-12-17T11:57:51.496 INFO:tasks.workunit.client.1.smithi119.stdout:8/579: symlink d7/d12/d23/d9c/dad/lbc 0 2023-12-17T11:57:51.499 INFO:tasks.workunit.client.1.smithi119.stdout:3/723: unlink d9/d35/dbd/dfb/d107/d98/cb5 0 2023-12-17T11:57:51.502 INFO:tasks.workunit.client.1.smithi119.stdout:5/713: rename d1/da7/d71/d82 to d1/d70/d6b/d77/dae/dba/de3 0 2023-12-17T11:57:51.504 INFO:tasks.workunit.client.1.smithi119.stdout:3/724: creat d9/d59/f115 x:0 0 0 2023-12-17T11:57:51.506 INFO:tasks.workunit.client.1.smithi119.stdout:5/714: link d1/da7/d71/lcf d1/d70/le4 0 2023-12-17T11:57:51.509 INFO:tasks.workunit.client.1.smithi119.stdout:3/725: creat d9/d44/db7/f116 x:0 0 0 2023-12-17T11:57:51.511 INFO:tasks.workunit.client.0.smithi002.stdout:5/687: dread dc/d1a/d47/d9b/f9c [0,4194304] 0 2023-12-17T11:57:51.514 INFO:tasks.workunit.client.1.smithi119.stdout:1/651: dwrite d3/db/d17/d24/d20/d6c/db7/fe2 [0,4194304] 0 2023-12-17T11:57:51.515 INFO:tasks.workunit.client.0.smithi002.stdout:8/721: creat d3/d7/ff2 x:0 0 0 2023-12-17T11:57:51.515 INFO:tasks.workunit.client.0.smithi002.stdout:8/722: readlink d3/d8/da/dd/l83 0 2023-12-17T11:57:51.515 INFO:tasks.workunit.client.1.smithi119.stdout:8/580: dread d7/d18/d15/f21 [0,4194304] 0 2023-12-17T11:57:51.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/614: dread d0/d3e/f74 [0,4194304] 0 2023-12-17T11:57:51.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/615: fsync d0/f8a 0 2023-12-17T11:57:51.516 INFO:tasks.workunit.client.0.smithi002.stdout:4/616: truncate d0/d10/d14/d27/d57/f97 783328 0 2023-12-17T11:57:51.516 INFO:tasks.workunit.client.0.smithi002.stdout:0/662: dread d0/d6/fb [4194304,4194304] 0 2023-12-17T11:57:51.516 INFO:tasks.workunit.client.0.smithi002.stdout:0/663: chown d0/d6 493534 1 2023-12-17T11:57:51.516 INFO:tasks.workunit.client.1.smithi119.stdout:5/715: rmdir d1/d70/d85/d95 39 2023-12-17T11:57:51.518 INFO:tasks.workunit.client.0.smithi002.stdout:5/688: mknod dc/d94/ded/cf3 0 2023-12-17T11:57:51.518 INFO:tasks.workunit.client.0.smithi002.stdout:8/723: mkdir d3/d7/d6e/d7f/d90/df3 0 2023-12-17T11:57:51.518 INFO:tasks.workunit.client.0.smithi002.stdout:5/689: write dc/d94/ded/fe4 [1645490,25484] 0 2023-12-17T11:57:51.522 INFO:tasks.workunit.client.1.smithi119.stdout:5/716: mknod d1/d70/d85/d95/dc3/ce5 0 2023-12-17T11:57:51.523 INFO:tasks.workunit.client.0.smithi002.stdout:0/664: rename d0/d15/l70 to d0/d6/d26/d14/d19/d61/dbf/ld4 0 2023-12-17T11:57:51.523 INFO:tasks.workunit.client.0.smithi002.stdout:0/665: readlink d0/d6/d26/d14/l94 0 2023-12-17T11:57:51.523 INFO:tasks.workunit.client.0.smithi002.stdout:0/666: dread - d0/d6/d26/d14/d19/d37/d86/f98 zero size 2023-12-17T11:57:51.524 INFO:tasks.workunit.client.0.smithi002.stdout:8/724: symlink d3/d7/d18/d74/d7b/lf4 0 2023-12-17T11:57:51.526 INFO:tasks.workunit.client.0.smithi002.stdout:8/725: creat d3/d7/d1a/ff5 x:0 0 0 2023-12-17T11:57:51.528 INFO:tasks.workunit.client.1.smithi119.stdout:3/726: dread d9/da/f2d [4194304,4194304] 0 2023-12-17T11:57:51.529 INFO:tasks.workunit.client.0.smithi002.stdout:8/726: rename d3/d7/d18/d74/ced to d3/d7/cf6 0 2023-12-17T11:57:51.530 INFO:tasks.workunit.client.1.smithi119.stdout:3/727: truncate d9/d1c/f4d 64126 0 2023-12-17T11:57:51.532 INFO:tasks.workunit.client.1.smithi119.stdout:3/728: symlink d9/d59/da6/l117 0 2023-12-17T11:57:51.532 INFO:tasks.workunit.client.1.smithi119.stdout:3/729: write d9/d35/f108 [857206,38127] 0 2023-12-17T11:57:51.539 INFO:tasks.workunit.client.1.smithi119.stdout:5/717: write d1/f29 [3605015,41207] 0 2023-12-17T11:57:51.539 INFO:tasks.workunit.client.1.smithi119.stdout:5/718: dread - d1/da7/fe1 zero size 2023-12-17T11:57:51.540 INFO:tasks.workunit.client.1.smithi119.stdout:5/719: mknod d1/d70/d6b/d77/dae/dba/de3/d86/dda/ce6 0 2023-12-17T11:57:51.544 INFO:tasks.workunit.client.1.smithi119.stdout:8/581: write d7/da/d11/d26/f28 [8973,10954] 0 2023-12-17T11:57:51.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/730: dread d9/d44/d8c/fad [0,4194304] 0 2023-12-17T11:57:51.545 INFO:tasks.workunit.client.1.smithi119.stdout:8/582: creat d7/d18/d45/d9e/fbd x:0 0 0 2023-12-17T11:57:51.546 INFO:tasks.workunit.client.1.smithi119.stdout:3/731: getdents d9/d11/d1e/d9f/dde 0 2023-12-17T11:57:51.547 INFO:tasks.workunit.client.1.smithi119.stdout:3/732: creat d9/da/f118 x:0 0 0 2023-12-17T11:57:51.547 INFO:tasks.workunit.client.1.smithi119.stdout:3/733: readlink d9/da/l23 0 2023-12-17T11:57:51.547 INFO:tasks.workunit.client.0.smithi002.stdout:8/727: write d3/d7/d18/d3f/f57 [2716253,51697] 0 2023-12-17T11:57:51.549 INFO:tasks.workunit.client.0.smithi002.stdout:8/728: rename d3/d7/d1a/f75 to d3/d7/d18/dde/ff7 0 2023-12-17T11:57:51.550 INFO:tasks.workunit.client.1.smithi119.stdout:3/734: creat d9/da/df/de1/f119 x:0 0 0 2023-12-17T11:57:51.553 INFO:tasks.workunit.client.1.smithi119.stdout:0/636: dwrite d2/d66/d2e/d44/d7b/d5/d3f/f97 [0,4194304] 0 2023-12-17T11:57:51.553 INFO:tasks.workunit.client.1.smithi119.stdout:0/637: creat d2/d16/fbf x:0 0 0 2023-12-17T11:57:51.553 INFO:tasks.workunit.client.1.smithi119.stdout:0/638: getdents d2/d16/d35 0 2023-12-17T11:57:51.553 INFO:tasks.workunit.client.1.smithi119.stdout:0/639: chown d2/d66/d2e/d44/d7b/d5/l1b 98665372 1 2023-12-17T11:57:51.554 INFO:tasks.workunit.client.1.smithi119.stdout:5/720: fdatasync d1/f29 0 2023-12-17T11:57:51.554 INFO:tasks.workunit.client.0.smithi002.stdout:9/750: dwrite f1 [4194304,4194304] 0 2023-12-17T11:57:51.556 INFO:tasks.workunit.client.0.smithi002.stdout:6/658: dwrite d0/d1/dc/d17/f42 [0,4194304] 0 2023-12-17T11:57:51.557 INFO:tasks.workunit.client.0.smithi002.stdout:8/729: rmdir d3/d8/d28/db8 0 2023-12-17T11:57:51.557 INFO:tasks.workunit.client.0.smithi002.stdout:0/667: dread d0/d15/f28 [0,4194304] 0 2023-12-17T11:57:51.557 INFO:tasks.workunit.client.0.smithi002.stdout:0/668: truncate d0/d6/d26/d14/d19/d37/d91/fbb 886782 0 2023-12-17T11:57:51.559 INFO:tasks.workunit.client.0.smithi002.stdout:9/751: rename dc/d1d/d7c/d90/cb9 to dc/d42/d4f/d9e/d104/c112 0 2023-12-17T11:57:51.560 INFO:tasks.workunit.client.1.smithi119.stdout:1/652: dread d3/db/f1f [0,4194304] 0 2023-12-17T11:57:51.560 INFO:tasks.workunit.client.1.smithi119.stdout:1/653: write d3/db/d26/d8f/f9e [651699,115283] 0 2023-12-17T11:57:51.560 INFO:tasks.workunit.client.1.smithi119.stdout:1/654: creat d3/db/d26/d19/ff1 x:0 0 0 2023-12-17T11:57:51.572 INFO:tasks.workunit.client.1.smithi119.stdout:0/640: truncate d2/d66/f53 96813 0 2023-12-17T11:57:51.572 INFO:tasks.workunit.client.1.smithi119.stdout:0/641: write d2/d16/fab [1171635,37407] 0 2023-12-17T11:57:51.572 INFO:tasks.workunit.client.1.smithi119.stdout:0/642: readlink d2/d66/d2e/d44/d7b/l56 0 2023-12-17T11:57:51.574 INFO:tasks.workunit.client.1.smithi119.stdout:5/721: rename d1/da7/d71/f73 to d1/d70/d6b/d77/dae/dba/de3/fe7 0 2023-12-17T11:57:51.579 INFO:tasks.workunit.client.1.smithi119.stdout:8/583: write d7/f27 [1747168,44165] 0 2023-12-17T11:57:51.579 INFO:tasks.workunit.client.1.smithi119.stdout:8/584: truncate d7/d12/d23/d9c/dad/fb7 635643 0 2023-12-17T11:57:51.583 INFO:tasks.workunit.client.0.smithi002.stdout:6/659: creat d0/d1/d21/d56/d8c/d93/da5/dbc/dc4/fd9 x:0 0 0 2023-12-17T11:57:51.584 INFO:tasks.workunit.client.1.smithi119.stdout:0/643: mkdir d2/d16/d35/dc0 0 2023-12-17T11:57:51.586 INFO:tasks.workunit.client.0.smithi002.stdout:8/730: mknod d3/d8/da/d44/cf8 0 2023-12-17T11:57:51.587 INFO:tasks.workunit.client.0.smithi002.stdout:5/690: dwrite dc/d94/ded/fc7 [0,4194304] 0 2023-12-17T11:57:51.587 INFO:tasks.workunit.client.1.smithi119.stdout:5/722: symlink d1/d44/d52/le8 0 2023-12-17T11:57:51.593 INFO:tasks.workunit.client.1.smithi119.stdout:3/735: dwrite d9/d44/d8c/fad [0,4194304] 0 2023-12-17T11:57:51.595 INFO:tasks.workunit.client.0.smithi002.stdout:0/669: symlink d0/d6/d26/d8f/ld5 0 2023-12-17T11:57:51.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/617: dwrite d0/f6f [0,4194304] 0 2023-12-17T11:57:51.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/618: chown d0/d10/d14/c82 33113614 1 2023-12-17T11:57:51.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/619: creat d0/d10/d14/fc9 x:0 0 0 2023-12-17T11:57:51.595 INFO:tasks.workunit.client.0.smithi002.stdout:4/620: write d0/fc0 [535132,38830] 0 2023-12-17T11:57:51.596 INFO:tasks.workunit.client.0.smithi002.stdout:9/752: truncate dc/d1d/d7c/d90/dc0/fc8 115055 0 2023-12-17T11:57:51.597 INFO:tasks.workunit.client.0.smithi002.stdout:6/660: mkdir d0/d1/d5b/dda 0 2023-12-17T11:57:51.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/661: truncate d0/f3a 595012 0 2023-12-17T11:57:51.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/662: write d0/d1/dc/f34 [1776012,67360] 0 2023-12-17T11:57:51.599 INFO:tasks.workunit.client.1.smithi119.stdout:5/723: unlink d1/da7/d71/d76/l9e 0 2023-12-17T11:57:51.599 INFO:tasks.workunit.client.1.smithi119.stdout:5/724: read - d1/d36/dc1/fcc zero size 2023-12-17T11:57:51.599 INFO:tasks.workunit.client.1.smithi119.stdout:5/725: fsync d1/da7/d71/d76/d83/fc5 0 2023-12-17T11:57:51.600 INFO:tasks.workunit.client.0.smithi002.stdout:8/731: rename d3/d8/d28/d31/d5a/d7c/fda to d3/d7/d1a/ff9 0 2023-12-17T11:57:51.605 INFO:tasks.workunit.client.0.smithi002.stdout:5/691: truncate fb 3821908 0 2023-12-17T11:57:51.605 INFO:tasks.workunit.client.1.smithi119.stdout:5/726: mknod d1/d70/d85/d95/dc3/ce9 0 2023-12-17T11:57:51.608 INFO:tasks.workunit.client.1.smithi119.stdout:5/727: symlink d1/d70/d6b/lea 0 2023-12-17T11:57:51.609 INFO:tasks.workunit.client.1.smithi119.stdout:5/728: dread - d1/da7/d71/d76/d83/dd1/fd8 zero size 2023-12-17T11:57:51.609 INFO:tasks.workunit.client.1.smithi119.stdout:5/729: readlink d1/d70/d6b/d77/dae/dba/de3/d86/l92 0 2023-12-17T11:57:51.609 INFO:tasks.workunit.client.0.smithi002.stdout:4/621: read d0/d10/d21/f49 [2010463,831] 0 2023-12-17T11:57:51.613 INFO:tasks.workunit.client.1.smithi119.stdout:3/736: read d9/d11/f3f [3158960,22066] 0 2023-12-17T11:57:51.614 INFO:tasks.workunit.client.0.smithi002.stdout:9/753: creat dc/d1d/d25/d85/f113 x:0 0 0 2023-12-17T11:57:51.614 INFO:tasks.workunit.client.0.smithi002.stdout:9/754: chown dc/d1d/d25/d85/dc2/ddd/dfa/d47 295041 1 2023-12-17T11:57:51.617 INFO:tasks.workunit.client.1.smithi119.stdout:3/737: symlink d9/d59/dae/l11a 0 2023-12-17T11:57:51.617 INFO:tasks.workunit.client.0.smithi002.stdout:2/680: sync 2023-12-17T11:57:51.620 INFO:tasks.workunit.client.1.smithi119.stdout:5/730: creat d1/d25/feb x:0 0 0 2023-12-17T11:57:51.621 INFO:tasks.workunit.client.0.smithi002.stdout:8/732: dread d3/d7/f58 [0,4194304] 0 2023-12-17T11:57:51.622 INFO:tasks.workunit.client.1.smithi119.stdout:3/738: getdents d9/d11/d1e/d9f 0 2023-12-17T11:57:51.622 INFO:tasks.workunit.client.1.smithi119.stdout:3/739: readlink d9/da/df/d41/d33/d3a/d90/le9 0 2023-12-17T11:57:51.624 INFO:tasks.workunit.client.1.smithi119.stdout:5/731: symlink d1/lec 0 2023-12-17T11:57:51.626 INFO:tasks.workunit.client.0.smithi002.stdout:4/622: fsync d0/d10/d21/f5d 0 2023-12-17T11:57:51.628 INFO:tasks.workunit.client.1.smithi119.stdout:5/732: symlink d1/d70/d6b/d77/dae/dba/de3/led 0 2023-12-17T11:57:51.631 INFO:tasks.workunit.client.1.smithi119.stdout:3/740: truncate d9/d11/d1e/d55/d65/f99 581591 0 2023-12-17T11:57:51.631 INFO:tasks.workunit.client.1.smithi119.stdout:3/741: stat d9/le2 0 2023-12-17T11:57:51.633 INFO:tasks.workunit.client.1.smithi119.stdout:5/733: creat d1/da7/d71/d76/fee x:0 0 0 2023-12-17T11:57:51.633 INFO:tasks.workunit.client.1.smithi119.stdout:5/734: readlink d1/l14 0 2023-12-17T11:57:51.633 INFO:tasks.workunit.client.1.smithi119.stdout:5/735: chown d1/f6d 3021142 1 2023-12-17T11:57:51.633 INFO:tasks.workunit.client.1.smithi119.stdout:5/736: write d1/da7/d71/d76/d83/fb8 [1012031,3566] 0 2023-12-17T11:57:51.637 INFO:tasks.workunit.client.0.smithi002.stdout:5/692: getdents dc/d17/d2f 0 2023-12-17T11:57:51.640 INFO:tasks.workunit.client.1.smithi119.stdout:3/742: mkdir d9/da/df/d41/d33/d3a/d90/d11b 0 2023-12-17T11:57:51.640 INFO:tasks.workunit.client.1.smithi119.stdout:0/644: dwrite d2/d66/d2e/f6d [0,4194304] 0 2023-12-17T11:57:51.640 INFO:tasks.workunit.client.1.smithi119.stdout:0/645: write d2/d66/d2e/d44/d7b/f14 [4205728,116004] 0 2023-12-17T11:57:51.640 INFO:tasks.workunit.client.1.smithi119.stdout:0/646: truncate d2/d16/fab 1422461 0 2023-12-17T11:57:51.640 INFO:tasks.workunit.client.0.smithi002.stdout:2/681: mknod d3/d4/d7/d14/d2e/cef 0 2023-12-17T11:57:51.641 INFO:tasks.workunit.client.1.smithi119.stdout:9/713: sync 2023-12-17T11:57:51.644 INFO:tasks.workunit.client.0.smithi002.stdout:6/663: rename d0/d1/dc/d8b to d0/d1/dc/d58/dae/ddb 0 2023-12-17T11:57:51.644 INFO:tasks.workunit.client.1.smithi119.stdout:2/746: sync 2023-12-17T11:57:51.644 INFO:tasks.workunit.client.1.smithi119.stdout:6/595: sync 2023-12-17T11:57:51.645 INFO:tasks.workunit.client.1.smithi119.stdout:3/743: chown d9/da/df/c1a 258 1 2023-12-17T11:57:51.645 INFO:tasks.workunit.client.1.smithi119.stdout:3/744: read d9/d11/d1e/f3e [1206159,101141] 0 2023-12-17T11:57:51.645 INFO:tasks.workunit.client.1.smithi119.stdout:3/745: chown d9/d1c/f49 790621331 1 2023-12-17T11:57:51.646 INFO:tasks.workunit.client.0.smithi002.stdout:3/711: sync 2023-12-17T11:57:51.647 INFO:tasks.workunit.client.0.smithi002.stdout:7/650: sync 2023-12-17T11:57:51.647 INFO:tasks.workunit.client.0.smithi002.stdout:1/718: sync 2023-12-17T11:57:51.647 INFO:tasks.workunit.client.0.smithi002.stdout:1/719: dread - d3/d2f/fe2 zero size 2023-12-17T11:57:51.648 INFO:tasks.workunit.client.0.smithi002.stdout:4/623: dread d0/f83 [0,4194304] 0 2023-12-17T11:57:51.649 INFO:tasks.workunit.client.1.smithi119.stdout:0/647: unlink d2/d66/d2e/d44/d7b/d5/dc/fa0 0 2023-12-17T11:57:51.651 INFO:tasks.workunit.client.1.smithi119.stdout:9/714: mknod d12/dca/dbd/ce8 0 2023-12-17T11:57:51.655 INFO:tasks.workunit.client.1.smithi119.stdout:2/747: rename d6/d9/d52/d53/d55/d58/fbe to d6/d9/d13/d1d/dbf/f10b 0 2023-12-17T11:57:51.658 INFO:tasks.workunit.client.0.smithi002.stdout:2/682: creat d3/d4/d17/d19/d4d/d72/d77/ff0 x:0 0 0 2023-12-17T11:57:51.659 INFO:tasks.workunit.client.0.smithi002.stdout:0/670: dwrite d0/f44 [0,4194304] 0 2023-12-17T11:57:51.666 INFO:tasks.workunit.client.0.smithi002.stdout:5/693: rename dc/d17/d1c/c62 to dc/d94/cf4 0 2023-12-17T11:57:51.666 INFO:tasks.workunit.client.1.smithi119.stdout:9/715: symlink d12/d1d/d28/d46/d50/da3/le9 0 2023-12-17T11:57:51.667 INFO:tasks.workunit.client.1.smithi119.stdout:9/716: chown d12/f82 1604 1 2023-12-17T11:57:51.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/664: symlink d0/d1/dc/d17/d67/ldc 0 2023-12-17T11:57:51.669 INFO:tasks.workunit.client.1.smithi119.stdout:9/717: write d12/d1d/d28/f87 [119987,53246] 0 2023-12-17T11:57:51.673 INFO:tasks.workunit.client.0.smithi002.stdout:9/755: dwrite dc/d1d/d25/d85/dc2/ddd/dfa/d47/f10d [0,4194304] 0 2023-12-17T11:57:51.674 INFO:tasks.workunit.client.1.smithi119.stdout:0/648: rename d2/d66/d2e/d44/d7b/dbc/fb3 to d2/dac/fc1 0 2023-12-17T11:57:51.675 INFO:tasks.workunit.client.0.smithi002.stdout:3/712: mknod d9/d15/d71/dbb/dc6/ce3 0 2023-12-17T11:57:51.680 INFO:tasks.workunit.client.0.smithi002.stdout:7/651: mknod d6/d17/dc/d13/d3e/cc4 0 2023-12-17T11:57:51.680 INFO:tasks.workunit.client.0.smithi002.stdout:7/652: chown d6/d99 869644 1 2023-12-17T11:57:51.681 INFO:tasks.workunit.client.0.smithi002.stdout:8/733: rmdir d3/d8/d28 39 2023-12-17T11:57:51.681 INFO:tasks.workunit.client.0.smithi002.stdout:8/734: chown d3/d8/d28/d31/d5a/d7c/fa7 166 1 2023-12-17T11:57:51.686 INFO:tasks.workunit.client.1.smithi119.stdout:0/649: mknod d2/d66/dbb/cc2 0 2023-12-17T11:57:51.688 INFO:tasks.workunit.client.0.smithi002.stdout:0/671: mknod d0/d6/d26/d14/d19/d37/dcf/dc1/cd6 0 2023-12-17T11:57:51.688 INFO:tasks.workunit.client.0.smithi002.stdout:5/694: rmdir dc/d94/ded/d75 39 2023-12-17T11:57:51.688 INFO:tasks.workunit.client.0.smithi002.stdout:5/695: readlink dc/d94/ded/d2d/d5b/le5 0 2023-12-17T11:57:51.691 INFO:tasks.workunit.client.0.smithi002.stdout:5/696: truncate dc/d17/d2f/d99/fe1 169165 0 2023-12-17T11:57:51.691 INFO:tasks.workunit.client.0.smithi002.stdout:0/672: write d0/d6/d26/d14/d19/d2b/f9c [1017453,121056] 0 2023-12-17T11:57:51.692 INFO:tasks.workunit.client.0.smithi002.stdout:4/624: rename d0/d3e/d56/dc3 to d0/d3e/dc8/dca 0 2023-12-17T11:57:51.696 INFO:tasks.workunit.client.0.smithi002.stdout:6/665: creat d0/d1/d21/d56/d8c/fdd x:0 0 0 2023-12-17T11:57:51.698 INFO:tasks.workunit.client.1.smithi119.stdout:6/596: dwrite d2/df/f30 [8388608,4194304] 0 2023-12-17T11:57:51.698 INFO:tasks.workunit.client.1.smithi119.stdout:6/597: chown d2/d2b/d43/d76 930 1 2023-12-17T11:57:51.703 INFO:tasks.workunit.client.0.smithi002.stdout:8/735: dread d3/d8/da/dd/f66 [0,4194304] 0 2023-12-17T11:57:51.704 INFO:tasks.workunit.client.0.smithi002.stdout:9/756: unlink dc/d1d/d25/d85/dc2/d91/db2/cdf 0 2023-12-17T11:57:51.704 INFO:tasks.workunit.client.0.smithi002.stdout:8/736: creat d3/d8/da/d44/ffa x:0 0 0 2023-12-17T11:57:51.706 INFO:tasks.workunit.client.1.smithi119.stdout:3/746: dwrite d9/da/df/d41/fdd [0,4194304] 0 2023-12-17T11:57:51.707 INFO:tasks.workunit.client.1.smithi119.stdout:9/718: dread d12/f2c [0,4194304] 0 2023-12-17T11:57:51.708 INFO:tasks.workunit.client.0.smithi002.stdout:7/653: symlink d6/d17/dc/d67/d8b/d24/da3/lc5 0 2023-12-17T11:57:51.708 INFO:tasks.workunit.client.0.smithi002.stdout:7/654: creat d6/d17/dc/d13/d21/d2e/fc6 x:0 0 0 2023-12-17T11:57:51.708 INFO:tasks.workunit.client.0.smithi002.stdout:7/655: fsync d6/d17/dc/d13/d37/d4f/f9d 0 2023-12-17T11:57:51.712 INFO:tasks.workunit.client.0.smithi002.stdout:4/625: rename d0/d3e/f74 to d0/d3e/d41/fcb 0 2023-12-17T11:57:51.713 INFO:tasks.workunit.client.1.smithi119.stdout:0/650: mkdir d2/d16/d35/d74/dc3 0 2023-12-17T11:57:51.713 INFO:tasks.workunit.client.1.smithi119.stdout:8/585: dwrite d7/da/d11/f13 [0,4194304] 0 2023-12-17T11:57:51.717 INFO:tasks.workunit.client.0.smithi002.stdout:1/720: dwrite d3/d6/d9/d30/f1a [4194304,4194304] 0 2023-12-17T11:57:51.717 INFO:tasks.workunit.client.0.smithi002.stdout:1/721: write d3/d2f/fe2 [511107,35624] 0 2023-12-17T11:57:51.720 INFO:tasks.workunit.client.0.smithi002.stdout:0/673: dread d0/d6/d26/d14/d19/d2b/f9c [0,4194304] 0 2023-12-17T11:57:51.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/757: dread dc/d38/f5b [0,4194304] 0 2023-12-17T11:57:51.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/758: chown dc/d38/f5e 124886 1 2023-12-17T11:57:51.722 INFO:tasks.workunit.client.0.smithi002.stdout:9/759: chown dc/d1d/lc6 7218962 1 2023-12-17T11:57:51.722 INFO:tasks.workunit.client.0.smithi002.stdout:6/666: mkdir d0/d1/d28/dde 0 2023-12-17T11:57:51.722 INFO:tasks.workunit.client.0.smithi002.stdout:6/667: write d0/d1/d28/f7b [1093299,8327] 0 2023-12-17T11:57:51.722 INFO:tasks.workunit.client.0.smithi002.stdout:6/668: fsync d0/d1/d21/d56/d60/f6e 0 2023-12-17T11:57:51.726 INFO:tasks.workunit.client.1.smithi119.stdout:9/719: truncate d12/d1d/d28/d46/d50/f60 1587647 0 2023-12-17T11:57:51.726 INFO:tasks.workunit.client.1.smithi119.stdout:9/720: fdatasync d12/d1d/d28/d46/d50/d92/dae/fb5 0 2023-12-17T11:57:51.726 INFO:tasks.workunit.client.1.smithi119.stdout:9/721: chown d12/d1d/f36 458420 1 2023-12-17T11:57:51.726 INFO:tasks.workunit.client.1.smithi119.stdout:9/722: readlink d12/d1d/d28/d46/d50/da3/le9 0 2023-12-17T11:57:51.728 INFO:tasks.workunit.client.0.smithi002.stdout:5/697: read dc/d94/ded/d5a/d96/f65 [2308506,88533] 0 2023-12-17T11:57:51.735 INFO:tasks.workunit.client.0.smithi002.stdout:7/656: creat d6/d17/dc/d6c/fc7 x:0 0 0 2023-12-17T11:57:51.738 INFO:tasks.workunit.client.0.smithi002.stdout:3/713: rename d9/d15/d52/d79/dd1/dd5/le2 to d9/d1b/d35/d41/d59/da3/le4 0 2023-12-17T11:57:51.738 INFO:tasks.workunit.client.0.smithi002.stdout:3/714: stat d9/d1b/l9c 0 2023-12-17T11:57:51.739 INFO:tasks.workunit.client.1.smithi119.stdout:3/747: dread d9/d11/d1e/f3e [0,4194304] 0 2023-12-17T11:57:51.740 INFO:tasks.workunit.client.1.smithi119.stdout:9/723: rename d12/d1d/d49/d89 to d12/d1d/d28/d46/dea 0 2023-12-17T11:57:51.742 INFO:tasks.workunit.client.1.smithi119.stdout:0/651: write d2/d66/d1f/f22 [976868,2090] 0 2023-12-17T11:57:51.742 INFO:tasks.workunit.client.1.smithi119.stdout:3/748: write d9/d11/d1e/d55/d65/fc5 [1128399,44525] 0 2023-12-17T11:57:51.742 INFO:tasks.workunit.client.1.smithi119.stdout:3/749: chown d9/d1c/f7b 1696 1 2023-12-17T11:57:51.742 INFO:tasks.workunit.client.0.smithi002.stdout:6/669: dread d0/d1/dc/d10/f86 [0,4194304] 0 2023-12-17T11:57:51.744 INFO:tasks.workunit.client.0.smithi002.stdout:1/722: symlink d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3/lf4 0 2023-12-17T11:57:51.748 INFO:tasks.workunit.client.0.smithi002.stdout:0/674: creat d0/d15/d59/fd7 x:0 0 0 2023-12-17T11:57:51.749 INFO:tasks.workunit.client.1.smithi119.stdout:2/748: dwrite d6/f33 [4194304,4194304] 0 2023-12-17T11:57:51.749 INFO:tasks.workunit.client.1.smithi119.stdout:2/749: write d6/d9/d86/f105 [814593,32519] 0 2023-12-17T11:57:51.749 INFO:tasks.workunit.client.1.smithi119.stdout:0/652: truncate d2/d66/d2e/f6d 3330529 0 2023-12-17T11:57:51.749 INFO:tasks.workunit.client.1.smithi119.stdout:0/653: stat d2/d66/d2e/d44/d7b/d5/dc/f7e 0 2023-12-17T11:57:51.751 INFO:tasks.workunit.client.0.smithi002.stdout:9/760: rmdir dc/d38 39 2023-12-17T11:57:51.752 INFO:tasks.workunit.client.0.smithi002.stdout:2/683: dwrite d3/d50/f8f [0,4194304] 0 2023-12-17T11:57:51.752 INFO:tasks.workunit.client.0.smithi002.stdout:9/761: creat dc/f114 x:0 0 0 2023-12-17T11:57:51.753 INFO:tasks.workunit.client.1.smithi119.stdout:3/750: rmdir d9/d11/d106 0 2023-12-17T11:57:51.753 INFO:tasks.workunit.client.1.smithi119.stdout:3/751: chown d9/d11/d1e/f37 0 1 2023-12-17T11:57:51.755 INFO:tasks.workunit.client.0.smithi002.stdout:8/737: rmdir d3/dca 39 2023-12-17T11:57:51.756 INFO:tasks.workunit.client.0.smithi002.stdout:8/738: dread - d3/d8/d28/d31/d5a/d7c/f9b zero size 2023-12-17T11:57:51.756 INFO:tasks.workunit.client.0.smithi002.stdout:8/739: readlink d3/d7/d18/d3f/d49/lbf 0 2023-12-17T11:57:51.759 INFO:tasks.workunit.client.1.smithi119.stdout:9/724: dread d12/d1d/f27 [0,4194304] 0 2023-12-17T11:57:51.760 INFO:tasks.workunit.client.0.smithi002.stdout:5/698: creat dc/d94/ded/d5a/d96/ff5 x:0 0 0 2023-12-17T11:57:51.762 INFO:tasks.workunit.client.0.smithi002.stdout:7/657: getdents d6/d17/dc/d13/d21/d2e/d4a/d91 0 2023-12-17T11:57:51.763 INFO:tasks.workunit.client.1.smithi119.stdout:8/586: dwrite d7/d18/d45/f53 [0,4194304] 0 2023-12-17T11:57:51.766 INFO:tasks.workunit.client.0.smithi002.stdout:4/626: rename d0/d10/d14/d27/d57/f97 to d0/d10/d21/d33/dbc/fcc 0 2023-12-17T11:57:51.766 INFO:tasks.workunit.client.1.smithi119.stdout:2/750: mkdir d6/d9/d52/d53/d55/d58/d10c 0 2023-12-17T11:57:51.766 INFO:tasks.workunit.client.1.smithi119.stdout:6/598: dwrite d2/d9b/f9c [0,4194304] 0 2023-12-17T11:57:51.766 INFO:tasks.workunit.client.1.smithi119.stdout:6/599: read - d2/df/f6d zero size 2023-12-17T11:57:51.767 INFO:tasks.workunit.client.1.smithi119.stdout:0/654: creat d2/d66/d2e/d44/d7b/d5/dc/d7f/fc4 x:0 0 0 2023-12-17T11:57:51.769 INFO:tasks.workunit.client.0.smithi002.stdout:3/715: link d9/d1b/fa7 d9/d1b/fe5 0 2023-12-17T11:57:51.769 INFO:tasks.workunit.client.0.smithi002.stdout:3/716: chown d9/d1b/d35/d41/d43/d73/fd6 46270 1 2023-12-17T11:57:51.771 INFO:tasks.workunit.client.0.smithi002.stdout:4/627: dread d0/d3e/d56/d99/fb8 [0,4194304] 0 2023-12-17T11:57:51.771 INFO:tasks.workunit.client.0.smithi002.stdout:4/628: fsync d0/d10/d14/d4e/f9c 0 2023-12-17T11:57:51.771 INFO:tasks.workunit.client.0.smithi002.stdout:4/629: chown d0/d10/d14/d27/d57/d7d 7099131 1 2023-12-17T11:57:51.771 INFO:tasks.workunit.client.0.smithi002.stdout:4/630: chown d0/d10/d14/c20 22 1 2023-12-17T11:57:51.772 INFO:tasks.workunit.client.0.smithi002.stdout:6/670: mknod d0/d1/d5b/dda/cdf 0 2023-12-17T11:57:51.773 INFO:tasks.workunit.client.1.smithi119.stdout:2/751: dread d6/d2b/d4b/f77 [0,4194304] 0 2023-12-17T11:57:51.774 INFO:tasks.workunit.client.0.smithi002.stdout:1/723: symlink d3/d2f/d74/dbe/lf5 0 2023-12-17T11:57:51.780 INFO:tasks.workunit.client.1.smithi119.stdout:9/725: dread d12/dca/f7c [0,4194304] 0 2023-12-17T11:57:51.785 INFO:tasks.workunit.client.1.smithi119.stdout:8/587: creat d7/d12/fbe x:0 0 0 2023-12-17T11:57:51.785 INFO:tasks.workunit.client.0.smithi002.stdout:9/762: mknod dc/d42/d4f/d9e/c115 0 2023-12-17T11:57:51.787 INFO:tasks.workunit.client.0.smithi002.stdout:8/740: symlink d3/d7/lfb 0 2023-12-17T11:57:51.789 INFO:tasks.workunit.client.0.smithi002.stdout:4/631: dread d0/d10/d14/d4e/fbe [0,4194304] 0 2023-12-17T11:57:51.789 INFO:tasks.workunit.client.0.smithi002.stdout:4/632: dread - d0/d10/d14/d4e/fbb zero size 2023-12-17T11:57:51.789 INFO:tasks.workunit.client.0.smithi002.stdout:4/633: chown d0/d10/d14/d27/d57/f7b 18218349 1 2023-12-17T11:57:51.789 INFO:tasks.workunit.client.0.smithi002.stdout:4/634: chown d0/d3e/d41 831 1 2023-12-17T11:57:51.792 INFO:tasks.workunit.client.1.smithi119.stdout:6/600: write d2/df/d17/f34 [3572688,29203] 0 2023-12-17T11:57:51.793 INFO:tasks.workunit.client.1.smithi119.stdout:6/601: truncate d2/d2b/d7f/fa7 272180 0 2023-12-17T11:57:51.793 INFO:tasks.workunit.client.1.smithi119.stdout:4/668: sync 2023-12-17T11:57:51.794 INFO:tasks.workunit.client.0.smithi002.stdout:5/699: creat dc/d8e/ff6 x:0 0 0 2023-12-17T11:57:51.797 INFO:tasks.workunit.client.1.smithi119.stdout:3/752: rename d9/d59/dae/cc3 to d9/da/df/d67/c11c 0 2023-12-17T11:57:51.797 INFO:tasks.workunit.client.1.smithi119.stdout:3/753: stat d9/d44/d8c 0 2023-12-17T11:57:51.798 INFO:tasks.workunit.client.0.smithi002.stdout:7/658: creat d6/d17/dc/d13/d21/d2e/d4a/daf/fc8 x:0 0 0 2023-12-17T11:57:51.813 INFO:tasks.workunit.client.1.smithi119.stdout:2/752: mkdir d6/d2b/db9/d10d 0 2023-12-17T11:57:51.815 INFO:tasks.workunit.client.1.smithi119.stdout:9/726: mkdir d12/d1d/d28/d46/d50/d92/daf/deb 0 2023-12-17T11:57:51.816 INFO:tasks.workunit.client.1.smithi119.stdout:9/727: dread - d12/d1d/d28/d46/d50/d92/dae/fe7 zero size 2023-12-17T11:57:51.816 INFO:tasks.workunit.client.1.smithi119.stdout:9/728: dread - d12/d1d/d79/db1/fc8 zero size 2023-12-17T11:57:51.819 INFO:tasks.workunit.client.1.smithi119.stdout:8/588: rmdir d7/da/d11/d60 39 2023-12-17T11:57:51.821 INFO:tasks.workunit.client.1.smithi119.stdout:6/602: mkdir d2/dba 0 2023-12-17T11:57:51.822 INFO:tasks.workunit.client.1.smithi119.stdout:6/603: write d2/da3/fb4 [18678,43257] 0 2023-12-17T11:57:51.822 INFO:tasks.workunit.client.1.smithi119.stdout:6/604: read - d2/d7e/f9d zero size 2023-12-17T11:57:51.822 INFO:tasks.workunit.client.1.smithi119.stdout:6/605: fdatasync d2/df/d17/d79/f96 0 2023-12-17T11:57:51.823 INFO:tasks.workunit.client.0.smithi002.stdout:3/717: link d9/f1e d9/d1b/d35/d41/d43/d73/fe6 0 2023-12-17T11:57:51.826 INFO:tasks.workunit.client.1.smithi119.stdout:4/669: mkdir dd/d15/d16/d3d/dab/dd9 0 2023-12-17T11:57:51.830 INFO:tasks.workunit.client.1.smithi119.stdout:3/754: symlink d9/da/df/d41/l11d 0 2023-12-17T11:57:51.836 INFO:tasks.workunit.client.0.smithi002.stdout:9/763: getdents dc/d1d/d25/d85/dc2/ddd/dfa/d47/d4b 0 2023-12-17T11:57:51.836 INFO:tasks.workunit.client.1.smithi119.stdout:0/655: dwrite d2/d66/d2e/d44/d7b/d5/d3f/f5e [0,4194304] 0 2023-12-17T11:57:51.837 INFO:tasks.workunit.client.1.smithi119.stdout:0/656: read - d2/d66/d2e/d44/d7b/d5/dc/d7f/fc4 zero size 2023-12-17T11:57:51.838 INFO:tasks.workunit.client.1.smithi119.stdout:6/606: symlink d2/da3/lbb 0 2023-12-17T11:57:51.851 INFO:tasks.workunit.client.0.smithi002.stdout:6/671: dwrite d0/d1/d21/d56/d8c/d93/da5/f8d [0,4194304] 0 2023-12-17T11:57:51.851 INFO:tasks.workunit.client.0.smithi002.stdout:6/672: fdatasync d0/d1/dc/d17/d3c/fcb 0 2023-12-17T11:57:51.851 INFO:tasks.workunit.client.0.smithi002.stdout:5/700: creat dc/d94/ded/ff7 x:0 0 0 2023-12-17T11:57:51.854 INFO:tasks.workunit.client.0.smithi002.stdout:8/741: unlink d3/d7/lfb 0 2023-12-17T11:57:51.854 INFO:tasks.workunit.client.0.smithi002.stdout:8/742: truncate d3/d8/da/d44/fc8 497600 0 2023-12-17T11:57:51.860 INFO:tasks.workunit.client.1.smithi119.stdout:3/755: creat d9/d35/dbd/dfb/d107/d98/f11e x:0 0 0 2023-12-17T11:57:51.863 INFO:tasks.workunit.client.0.smithi002.stdout:1/724: getdents d3/d5c 0 2023-12-17T11:57:51.864 INFO:tasks.workunit.client.1.smithi119.stdout:6/607: dread d2/d61/d8a/f9a [0,4194304] 0 2023-12-17T11:57:51.864 INFO:tasks.workunit.client.1.smithi119.stdout:6/608: dread - d2/d2b/d43/f8b zero size 2023-12-17T11:57:51.871 INFO:tasks.workunit.client.1.smithi119.stdout:0/657: truncate d2/d66/d2e/d44/d7b/d5/dc/f91 2316296 0 2023-12-17T11:57:51.893 INFO:tasks.workunit.client.0.smithi002.stdout:4/635: dwrite d0/d10/d14/f52 [0,4194304] 0 2023-12-17T11:57:51.893 INFO:tasks.workunit.client.0.smithi002.stdout:4/636: stat d0/d3e/d41/l4d 0 2023-12-17T11:57:51.894 INFO:tasks.workunit.client.0.smithi002.stdout:7/659: dwrite d6/d17/dc/d13/f14 [4194304,4194304] 0 2023-12-17T11:57:51.906 INFO:tasks.workunit.client.1.smithi119.stdout:9/729: dwrite d12/d1d/d49/fba [0,4194304] 0 2023-12-17T11:57:51.908 INFO:tasks.workunit.client.1.smithi119.stdout:2/753: dwrite d6/d9/d52/d53/d55/fbb [0,4194304] 0 2023-12-17T11:57:51.908 INFO:tasks.workunit.client.1.smithi119.stdout:2/754: dread - d6/d2b/da3/fd5 zero size 2023-12-17T11:57:51.908 INFO:tasks.workunit.client.1.smithi119.stdout:0/658: write d2/d16/f5a [745811,98496] 0 2023-12-17T11:57:51.909 INFO:tasks.workunit.client.1.smithi119.stdout:8/589: dwrite d7/d12/fba [0,4194304] 0 2023-12-17T11:57:51.909 INFO:tasks.workunit.client.1.smithi119.stdout:8/590: fsync d7/d18/d15/d81/f8f 0 2023-12-17T11:57:51.913 INFO:tasks.workunit.client.0.smithi002.stdout:6/673: dwrite d0/d1/dc/d17/f1e [0,4194304] 0 2023-12-17T11:57:51.913 INFO:tasks.workunit.client.0.smithi002.stdout:6/674: truncate d0/d1/dc/d17/f79 1077003 0 2023-12-17T11:57:51.914 INFO:tasks.workunit.client.0.smithi002.stdout:6/675: truncate d0/d1/f96 5416848 0 2023-12-17T11:57:51.922 INFO:tasks.workunit.client.1.smithi119.stdout:3/756: dwrite d9/d35/dbd/dfb/d107/dd3/fa8 [0,4194304] 0 2023-12-17T11:57:51.924 INFO:tasks.workunit.client.0.smithi002.stdout:9/764: creat dc/d42/d4f/dd5/f116 x:0 0 0 2023-12-17T11:57:51.926 INFO:tasks.workunit.client.1.smithi119.stdout:6/609: truncate d2/df/d17/d79/f8c 3337224 0 2023-12-17T11:57:51.927 INFO:tasks.workunit.client.1.smithi119.stdout:6/610: write d2/d2b/f3d [267371,77582] 0 2023-12-17T11:57:51.930 INFO:tasks.workunit.client.0.smithi002.stdout:5/701: creat dc/d1a/d7c/ff8 x:0 0 0 2023-12-17T11:57:51.930 INFO:tasks.workunit.client.0.smithi002.stdout:5/702: creat dc/d94/ff9 x:0 0 0 2023-12-17T11:57:51.932 INFO:tasks.workunit.client.1.smithi119.stdout:1/655: sync 2023-12-17T11:57:51.932 INFO:tasks.workunit.client.1.smithi119.stdout:5/737: sync 2023-12-17T11:57:51.932 INFO:tasks.workunit.client.1.smithi119.stdout:7/678: sync 2023-12-17T11:57:51.932 INFO:tasks.workunit.client.1.smithi119.stdout:1/656: write d3/db/d17/d24/d20/dbd/dcb/fd8 [158711,50720] 0 2023-12-17T11:57:51.951 INFO:tasks.workunit.client.0.smithi002.stdout:7/660: dwrite d6/d17/dc/d13/d37/d4f/f63 [0,4194304] 0 2023-12-17T11:57:51.952 INFO:tasks.workunit.client.0.smithi002.stdout:7/661: stat d6/d17/dc/d13/f57 0 2023-12-17T11:57:51.969 INFO:tasks.workunit.client.1.smithi119.stdout:2/755: dwrite f4 [0,4194304] 0 2023-12-17T11:57:51.969 INFO:tasks.workunit.client.1.smithi119.stdout:2/756: creat d6/d9/d13/d34/d56/f10e x:0 0 0 2023-12-17T11:57:51.972 INFO:tasks.workunit.client.1.smithi119.stdout:4/670: write dd/f71 [1640181,44158] 0 2023-12-17T11:57:51.980 INFO:tasks.workunit.client.0.smithi002.stdout:9/765: dwrite dc/f21 [4194304,4194304] 0 2023-12-17T11:57:52.008 INFO:tasks.workunit.client.1.smithi119.stdout:7/679: dwrite d2/f10 [0,4194304] 0 2023-12-17T11:57:52.008 INFO:tasks.workunit.client.1.smithi119.stdout:7/680: readlink d2/d5b/l73 0 2023-12-17T11:57:52.011 INFO:tasks.workunit.client.1.smithi119.stdout:7/681: write d2/d4/d11/d2c/d68/d99/d6c/f7c [439429,123143] 0 2023-12-17T11:57:52.011 INFO:tasks.workunit.client.1.smithi119.stdout:7/682: fsync d2/d4/d11/d2c/d68/d99/f4a 0 2023-12-17T11:57:52.016 INFO:tasks.workunit.client.0.smithi002.stdout:7/662: dwrite d6/d17/dc/d13/d21/d2e/d4a/daf/fc8 [0,4194304] 0 2023-12-17T11:57:52.017 INFO:tasks.workunit.client.1.smithi119.stdout:2/757: dwrite d6/d9/d13/d34/f99 [0,4194304] 0 2023-12-17T11:57:52.017 INFO:tasks.workunit.client.1.smithi119.stdout:2/758: write d6/f40 [4958108,45514] 0 2023-12-17T11:57:52.025 INFO:tasks.workunit.client.1.smithi119.stdout:9/730: mkdir d12/d1d/d28/d4d/d73/d78/d8b/dec 0 2023-12-17T11:57:52.028 INFO:tasks.workunit.client.1.smithi119.stdout:7/683: read d2/d4/d11/d3c/d75/fbc [3940646,106113] 0 2023-12-17T11:57:52.028 INFO:tasks.workunit.client.1.smithi119.stdout:7/684: fdatasync d2/d4/d11/d2c/d68/d99/f4a 0 2023-12-17T11:57:52.036 INFO:tasks.workunit.client.0.smithi002.stdout:7/663: read d6/d17/dc/f8d [1708868,116240] 0 2023-12-17T11:57:52.037 INFO:tasks.workunit.client.0.smithi002.stdout:7/664: fdatasync d6/d17/dc/d13/f30 0 2023-12-17T11:57:52.037 INFO:tasks.workunit.client.0.smithi002.stdout:7/665: dread - d6/d81/fbb zero size 2023-12-17T11:57:52.048 INFO:tasks.workunit.client.1.smithi119.stdout:0/659: rename d2/d16/d35/l62 to d2/d66/d1f/d24/d50/d5d/lc5 0 2023-12-17T11:57:52.048 INFO:tasks.workunit.client.1.smithi119.stdout:0/660: chown d2/d66/d1f/d24/c2a 106 1 2023-12-17T11:57:52.048 INFO:tasks.workunit.client.1.smithi119.stdout:0/661: creat d2/dac/fc6 x:0 0 0 2023-12-17T11:57:52.052 INFO:tasks.workunit.client.1.smithi119.stdout:8/591: mkdir d7/d18/d15/d81/da2/dbf 0 2023-12-17T11:57:52.068 INFO:tasks.workunit.client.1.smithi119.stdout:2/759: dwrite d6/d2b/d4b/f77 [4194304,4194304] 0 2023-12-17T11:57:52.068 INFO:tasks.workunit.client.1.smithi119.stdout:8/592: write d7/f16 [1196125,85048] 0 2023-12-17T11:57:52.076 INFO:tasks.workunit.client.1.smithi119.stdout:8/593: dread d7/d18/d15/f21 [0,4194304] 0 2023-12-17T11:57:52.076 INFO:tasks.workunit.client.1.smithi119.stdout:8/594: fdatasync d7/d18/d15/d81/f62 0 2023-12-17T11:57:52.091 INFO:tasks.workunit.client.1.smithi119.stdout:2/760: dread d6/d9/d52/d53/d55/d58/d6b/f9f [0,4194304] 0 2023-12-17T11:57:52.095 INFO:tasks.workunit.client.1.smithi119.stdout:0/662: dwrite d2/d66/d1f/d24/d50/d5d/f64 [4194304,4194304] 0 2023-12-17T11:57:52.096 INFO:tasks.workunit.client.1.smithi119.stdout:0/663: truncate d2/d16/d35/d39/fb1 333355 0 2023-12-17T11:57:52.097 INFO:tasks.workunit.client.1.smithi119.stdout:0/664: dread - d2/d66/d2e/d44/fbe zero size 2023-12-17T11:57:52.107 INFO:tasks.workunit.client.1.smithi119.stdout:3/757: link d9/d1c/ff8 d9/d11/d1e/d55/d65/ddf/f11f 0 2023-12-17T11:57:52.107 INFO:tasks.workunit.client.1.smithi119.stdout:3/758: readlink d9/d1c/lf4 0 2023-12-17T11:57:52.113 INFO:tasks.workunit.client.0.smithi002.stdout:4/637: mkdir d0/d3e/dc8/dcd 0 2023-12-17T11:57:52.113 INFO:tasks.workunit.client.0.smithi002.stdout:4/638: stat d0/d10/d14/d27/d57 0 2023-12-17T11:57:52.114 INFO:tasks.workunit.client.1.smithi119.stdout:5/738: creat d1/d70/fef x:0 0 0 2023-12-17T11:57:52.114 INFO:tasks.workunit.client.1.smithi119.stdout:5/739: truncate d1/d70/d6b/d77/dae/dba/de3/d86/fc9 750450 0 2023-12-17T11:57:52.128 INFO:tasks.workunit.client.1.smithi119.stdout:0/665: write d2/f67 [1512973,126701] 0 2023-12-17T11:57:52.136 INFO:tasks.workunit.client.1.smithi119.stdout:9/731: creat d12/d1d/d28/d46/dea/fed x:0 0 0 2023-12-17T11:57:52.141 INFO:tasks.workunit.client.1.smithi119.stdout:7/685: symlink d2/d4/d11/d2c/d68/d98/dd1/ld5 0 2023-12-17T11:57:52.153 INFO:tasks.workunit.client.1.smithi119.stdout:4/671: rename dd/d15/c39 to dd/d15/d16/d3d/dab/db1/cda 0 2023-12-17T11:57:52.153 INFO:tasks.workunit.client.1.smithi119.stdout:4/672: readlink dd/d15/d16/d3d/dab/lc4 0 2023-12-17T11:57:52.153 INFO:tasks.workunit.client.1.smithi119.stdout:4/673: chown dd/d4b/l8b 115 1 2023-12-17T11:57:52.167 INFO:tasks.workunit.client.1.smithi119.stdout:2/761: dwrite d6/d9/d52/d5a/f65 [0,4194304] 0 2023-12-17T11:57:52.167 INFO:tasks.workunit.client.1.smithi119.stdout:2/762: fsync d6/d9/d52/d53/d55/d58/d6b/f9f 0 2023-12-17T11:57:52.171 INFO:tasks.workunit.client.1.smithi119.stdout:5/740: mkdir d1/da7/d71/d97/df0 0 2023-12-17T11:57:52.175 INFO:tasks.workunit.client.1.smithi119.stdout:9/732: mkdir d12/d1d/d28/d46/d50/d92/daf/deb/dee 0 2023-12-17T11:57:52.175 INFO:tasks.workunit.client.1.smithi119.stdout:9/733: stat d12/d1d/d28/d4d/d73/l95 0 2023-12-17T11:57:52.175 INFO:tasks.workunit.client.1.smithi119.stdout:9/734: read - d12/dca/fce zero size 2023-12-17T11:57:52.175 INFO:tasks.workunit.client.1.smithi119.stdout:9/735: fsync d12/d1d/f9e 0 2023-12-17T11:57:52.175 INFO:tasks.workunit.client.1.smithi119.stdout:9/736: chown d12/dca/l64 139614915 1 2023-12-17T11:57:52.180 INFO:tasks.workunit.client.1.smithi119.stdout:4/674: symlink dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/ldb 0 2023-12-17T11:57:52.180 INFO:tasks.workunit.client.1.smithi119.stdout:4/675: write dd/d15/f95 [765419,90254] 0 2023-12-17T11:57:52.184 INFO:tasks.workunit.client.1.smithi119.stdout:3/759: rename d9/d11/d1e/f8e to d9/d35/dca/f120 0 2023-12-17T11:57:52.189 INFO:tasks.workunit.client.1.smithi119.stdout:4/676: symlink dd/d15/ldc 0 2023-12-17T11:57:52.189 INFO:tasks.workunit.client.1.smithi119.stdout:4/677: write dd/f18 [7154327,27362] 0 2023-12-17T11:57:52.189 INFO:tasks.workunit.client.1.smithi119.stdout:4/678: fsync dd/d11/d2d/d9c/d55/d81/d88/d91/fae 0 2023-12-17T11:57:52.189 INFO:tasks.workunit.client.1.smithi119.stdout:4/679: chown dd/d15/c83 52765 1 2023-12-17T11:57:52.190 INFO:tasks.workunit.client.1.smithi119.stdout:9/737: read d12/d65/f7d [140219,16254] 0 2023-12-17T11:57:52.190 INFO:tasks.workunit.client.1.smithi119.stdout:9/738: dread - d12/d1d/d28/d46/d50/d92/da1/fd0 zero size 2023-12-17T11:57:52.196 INFO:tasks.workunit.client.1.smithi119.stdout:4/680: dread dd/d15/f5c [0,4194304] 0 2023-12-17T11:57:52.198 INFO:tasks.workunit.client.0.smithi002.stdout:5/703: rmdir dc/d94/ded/d2d/df0 0 2023-12-17T11:57:52.202 INFO:tasks.workunit.client.0.smithi002.stdout:9/766: creat dc/d1d/d25/d85/dc2/d91/db2/f117 x:0 0 0 2023-12-17T11:57:52.202 INFO:tasks.workunit.client.0.smithi002.stdout:9/767: chown dc/d42/d4f/f98 0 1 2023-12-17T11:57:52.206 INFO:tasks.workunit.client.1.smithi119.stdout:7/686: rename d2/d5b/f7e to d2/d40/dc3/dc8/fd6 0 2023-12-17T11:57:52.208 INFO:tasks.workunit.client.0.smithi002.stdout:7/666: symlink d6/d17/dc/d13/d21/d2e/lc9 0 2023-12-17T11:57:52.209 INFO:tasks.workunit.client.0.smithi002.stdout:7/667: write d6/d17/dc/f76 [120883,52375] 0 2023-12-17T11:57:52.209 INFO:tasks.workunit.client.0.smithi002.stdout:7/668: chown d6/d17/dc/d13/c83 18113 1 2023-12-17T11:57:52.210 INFO:tasks.workunit.client.1.smithi119.stdout:9/739: truncate d12/f2c 553758 0 2023-12-17T11:57:52.214 INFO:tasks.workunit.client.1.smithi119.stdout:6/611: mkdir d2/d7e/dbc 0 2023-12-17T11:57:52.215 INFO:tasks.workunit.client.0.smithi002.stdout:5/704: stat dc/d8e/cf2 0 2023-12-17T11:57:52.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/687: creat d2/d4/d70/dac/dc4/fd7 x:0 0 0 2023-12-17T11:57:52.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/688: fdatasync d2/d4/d11/d3c/d75/f7f 0 2023-12-17T11:57:52.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/689: readlink d2/d5b/l63 0 2023-12-17T11:57:52.220 INFO:tasks.workunit.client.1.smithi119.stdout:7/690: chown d2/d4/c8 752 1 2023-12-17T11:57:52.222 INFO:tasks.workunit.client.1.smithi119.stdout:4/681: getdents dd/d11/d2d/d9c/d55/d81/d88/d91 0 2023-12-17T11:57:52.223 INFO:tasks.workunit.client.1.smithi119.stdout:4/682: write dd/d15/d16/d3d/f7c [2164066,105841] 0 2023-12-17T11:57:52.223 INFO:tasks.workunit.client.1.smithi119.stdout:4/683: chown dd/f32 607647 1 2023-12-17T11:57:52.226 INFO:tasks.workunit.client.0.smithi002.stdout:9/768: mkdir dc/d42/da0/d82/d118 0 2023-12-17T11:57:52.226 INFO:tasks.workunit.client.0.smithi002.stdout:6/676: rename d0/c9a to d0/d1/dc/d58/dae/ddb/dc6/ce0 0 2023-12-17T11:57:52.226 INFO:tasks.workunit.client.1.smithi119.stdout:9/740: dread d12/d1d/f2f [0,4194304] 0 2023-12-17T11:57:52.226 INFO:tasks.workunit.client.0.smithi002.stdout:6/677: fdatasync d0/d1/dc/d17/d3c/f47 0 2023-12-17T11:57:52.227 INFO:tasks.workunit.client.0.smithi002.stdout:6/678: creat d0/d1/d21/fe1 x:0 0 0 2023-12-17T11:57:52.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/741: write d12/d1d/d28/d46/d6e/f6f [615539,36497] 0 2023-12-17T11:57:52.229 INFO:tasks.workunit.client.1.smithi119.stdout:7/691: link d2/d4/d11/d2c/d68/d6a/f78 d2/d4/d11/d2c/d55/d67/fd8 0 2023-12-17T11:57:52.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/743: unlink d3/d8/f3d 0 2023-12-17T11:57:52.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/744: stat d3/d8/l4d 0 2023-12-17T11:57:52.234 INFO:tasks.workunit.client.1.smithi119.stdout:7/692: rmdir d2/d40/dc3 39 2023-12-17T11:57:52.234 INFO:tasks.workunit.client.1.smithi119.stdout:7/693: chown d2/d4/d11/d2c/d68/d99/d6c/fa5 815184 1 2023-12-17T11:57:52.236 INFO:tasks.workunit.client.0.smithi002.stdout:6/679: mknod d0/ce2 0 2023-12-17T11:57:52.242 INFO:tasks.workunit.client.0.smithi002.stdout:8/745: truncate d3/d8/d28/d31/d5a/d7c/f7d 1534945 0 2023-12-17T11:57:52.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/769: creat dc/d42/da0/f119 x:0 0 0 2023-12-17T11:57:52.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/770: fsync dc/d42/d4f/f92 0 2023-12-17T11:57:52.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/771: truncate dc/d1d/d25/d85/fd6 280437 0 2023-12-17T11:57:52.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/772: dread - dc/d1d/d25/d85/dc2/d91/db2/f117 zero size 2023-12-17T11:57:52.242 INFO:tasks.workunit.client.0.smithi002.stdout:9/773: truncate dc/d42/da0/f119 371987 0 2023-12-17T11:57:52.244 INFO:tasks.workunit.client.1.smithi119.stdout:2/763: rename f5 to d6/d9/d13/d1d/f10f 0 2023-12-17T11:57:52.252 INFO:tasks.workunit.client.0.smithi002.stdout:9/774: getdents dc/d42/da0/d72/d93/dd0/dd4/df1 0 2023-12-17T11:57:52.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/775: write dc/d42/da0/d72/d93/d76/ff0 [195966,7695] 0 2023-12-17T11:57:52.253 INFO:tasks.workunit.client.0.smithi002.stdout:9/776: truncate dc/d42/f10e 632082 0 2023-12-17T11:57:52.258 INFO:tasks.workunit.client.1.smithi119.stdout:7/694: write d2/d4/d11/d3c/d75/dad/fbe [3731433,120521] 0 2023-12-17T11:57:52.259 INFO:tasks.workunit.client.1.smithi119.stdout:2/764: truncate d6/d9/f2a 1602115 0 2023-12-17T11:57:52.261 INFO:tasks.workunit.client.1.smithi119.stdout:2/765: readlink d6/d9/l59 0 2023-12-17T11:57:52.263 INFO:tasks.workunit.client.0.smithi002.stdout:9/777: creat dc/d42/da0/d72/d93/dd0/f11a x:0 0 0 2023-12-17T11:57:52.270 INFO:tasks.workunit.client.1.smithi119.stdout:3/760: rename d9/d11/d1e/d55/f7e to d9/d35/dbd/dfb/d107/f121 0 2023-12-17T11:57:52.270 INFO:tasks.workunit.client.1.smithi119.stdout:3/761: truncate d9/d44/d8c/fe3 987138 0 2023-12-17T11:57:52.271 INFO:tasks.workunit.client.0.smithi002.stdout:9/778: rmdir dc/d42/d4f/dd5/de5 0 2023-12-17T11:57:52.272 INFO:tasks.workunit.client.1.smithi119.stdout:3/762: truncate d9/da/df/f32 2279811 0 2023-12-17T11:57:52.272 INFO:tasks.workunit.client.1.smithi119.stdout:7/695: dread d2/d40/dc3/f52 [0,4194304] 0 2023-12-17T11:57:52.274 INFO:tasks.workunit.client.1.smithi119.stdout:4/684: mknod dd/d11/d2d/d9c/d55/cdd 0 2023-12-17T11:57:52.276 INFO:tasks.workunit.client.1.smithi119.stdout:4/685: truncate dd/d11/d26/f66 532269 0 2023-12-17T11:57:52.279 INFO:tasks.workunit.client.0.smithi002.stdout:1/725: rmdir d3/d6/d9/d37/d39 39 2023-12-17T11:57:52.279 INFO:tasks.workunit.client.0.smithi002.stdout:1/726: chown d3/d2f/d74/dbd/fd7 132795940 1 2023-12-17T11:57:52.280 INFO:tasks.workunit.client.1.smithi119.stdout:2/766: write d6/d9/d13/d1d/f24 [1565085,60960] 0 2023-12-17T11:57:52.282 INFO:tasks.workunit.client.0.smithi002.stdout:1/727: unlink d3/f49 0 2023-12-17T11:57:52.287 INFO:tasks.workunit.client.1.smithi119.stdout:2/767: link d6/d9/d52/d53/d55/f7d d6/d9/d13/d1d/dbf/deb/f110 0 2023-12-17T11:57:52.287 INFO:tasks.workunit.client.1.smithi119.stdout:2/768: truncate f4 5753587 0 2023-12-17T11:57:52.287 INFO:tasks.workunit.client.1.smithi119.stdout:2/769: chown d6/d38/f103 10806818 1 2023-12-17T11:57:52.287 INFO:tasks.workunit.client.1.smithi119.stdout:9/742: dwrite d12/d1d/d28/d86/d8f/fa5 [0,4194304] 0 2023-12-17T11:57:52.288 INFO:tasks.workunit.client.0.smithi002.stdout:1/728: creat d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3/ff6 x:0 0 0 2023-12-17T11:57:52.293 INFO:tasks.workunit.client.1.smithi119.stdout:2/770: truncate d6/f33 5482423 0 2023-12-17T11:57:52.296 INFO:tasks.workunit.client.1.smithi119.stdout:9/743: symlink d12/d1d/d49/ddb/lef 0 2023-12-17T11:57:52.296 INFO:tasks.workunit.client.1.smithi119.stdout:9/744: chown d12/l1a 11 1 2023-12-17T11:57:52.298 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:52 smithi002 ceph-mon[107131]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:52.298 INFO:tasks.workunit.client.1.smithi119.stdout:7/696: dread d2/d4/f16 [0,4194304] 0 2023-12-17T11:57:52.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/771: unlink d6/d2b/l89 0 2023-12-17T11:57:52.299 INFO:tasks.workunit.client.1.smithi119.stdout:2/772: stat d6/d9/d13/d1d/l1a 0 2023-12-17T11:57:52.311 INFO:tasks.workunit.client.1.smithi119.stdout:0/666: unlink d2/d66/d2e/d44/f98 0 2023-12-17T11:57:52.313 INFO:tasks.workunit.client.0.smithi002.stdout:9/779: dwrite dc/d1d/d25/d85/dc2/d91/db2/dbf/fc5 [0,4194304] 0 2023-12-17T11:57:52.313 INFO:tasks.workunit.client.1.smithi119.stdout:0/667: mknod d2/d66/cc7 0 2023-12-17T11:57:52.313 INFO:tasks.workunit.client.1.smithi119.stdout:0/668: chown d2/d16/d35/dc0 222 1 2023-12-17T11:57:52.315 INFO:tasks.workunit.client.1.smithi119.stdout:0/669: rmdir d2/d16/d35/dc0 0 2023-12-17T11:57:52.315 INFO:tasks.workunit.client.1.smithi119.stdout:0/670: creat d2/fc8 x:0 0 0 2023-12-17T11:57:52.317 INFO:tasks.workunit.client.1.smithi119.stdout:0/671: mkdir d2/d66/d1f/d24/dc9 0 2023-12-17T11:57:52.322 INFO:tasks.workunit.client.1.smithi119.stdout:0/672: rename d2/d16/c8b to d2/d66/d1f/d24/dc9/cca 0 2023-12-17T11:57:52.331 INFO:tasks.workunit.client.1.smithi119.stdout:7/697: write d2/d40/dc3/f52 [4157473,83311] 0 2023-12-17T11:57:52.333 INFO:tasks.workunit.client.1.smithi119.stdout:7/698: mkdir d2/d40/dc3/dca/dd9 0 2023-12-17T11:57:52.333 INFO:tasks.workunit.client.1.smithi119.stdout:0/673: dread d2/d16/d35/d39/f4a [0,4194304] 0 2023-12-17T11:57:52.334 INFO:tasks.workunit.client.0.smithi002.stdout:6/680: rmdir d0/d1/dc/d17 39 2023-12-17T11:57:52.335 INFO:tasks.workunit.client.0.smithi002.stdout:6/681: creat d0/d1/d28/dab/fe3 x:0 0 0 2023-12-17T11:57:52.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/639: unlink d0/d3e/d56/d65/fb6 0 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.0.smithi002.stdout:2/684: sync 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.0.smithi002.stdout:0/675: sync 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.0.smithi002.stdout:3/718: sync 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.0.smithi002.stdout:3/719: truncate d9/d1b/d35/d41/d43/f50 661005 0 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.0.smithi002.stdout:3/720: fsync d9/d40/f9a 0 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/699: mkdir d2/d4/d11/d3c/d75/dda 0 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/700: stat d2/d4/d70/d57/ccb 0 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.1.smithi119.stdout:7/701: chown d2/d4/c14 1759912792 1 2023-12-17T11:57:52.338 INFO:tasks.workunit.client.1.smithi119.stdout:0/674: rmdir d2/d66/d2e/d44/d7b/d5 39 2023-12-17T11:57:52.341 INFO:tasks.workunit.client.1.smithi119.stdout:7/702: creat d2/d4/d11/d3c/fdb x:0 0 0 2023-12-17T11:57:52.343 INFO:tasks.workunit.client.1.smithi119.stdout:3/763: dread d9/da/df/fce [0,4194304] 0 2023-12-17T11:57:52.343 INFO:tasks.workunit.client.0.smithi002.stdout:2/685: mkdir d3/d4/d7/d14/d2e/d37/dce/df1 0 2023-12-17T11:57:52.343 INFO:tasks.workunit.client.0.smithi002.stdout:2/686: write d3/d4/d17/d19/d4d/d72/d83/fb3 [841990,84388] 0 2023-12-17T11:57:52.343 INFO:tasks.workunit.client.0.smithi002.stdout:2/687: stat d3/d4/d7/d14/d1b/ld9 0 2023-12-17T11:57:52.345 INFO:tasks.workunit.client.1.smithi119.stdout:0/675: truncate d2/d66/d1f/f69 4153040 0 2023-12-17T11:57:52.345 INFO:tasks.workunit.client.1.smithi119.stdout:0/676: stat d2/d66/d1f/f68 0 2023-12-17T11:57:52.345 INFO:tasks.workunit.client.1.smithi119.stdout:0/677: dread - d2/d16/fbf zero size 2023-12-17T11:57:52.345 INFO:tasks.workunit.client.1.smithi119.stdout:0/678: stat d2/d66/d1f/d24/d50/d5d 0 2023-12-17T11:57:52.346 INFO:tasks.workunit.client.0.smithi002.stdout:8/746: write d3/d8/da/dd/f5f [3771372,84248] 0 2023-12-17T11:57:52.349 INFO:tasks.workunit.client.1.smithi119.stdout:3/764: mknod d9/d11/d87/c122 0 2023-12-17T11:57:52.350 INFO:tasks.workunit.client.0.smithi002.stdout:7/669: dwrite d6/f3b [0,4194304] 0 2023-12-17T11:57:52.350 INFO:tasks.workunit.client.0.smithi002.stdout:7/670: chown d6/f3b 456879557 1 2023-12-17T11:57:52.350 INFO:tasks.workunit.client.0.smithi002.stdout:7/671: chown d6 98526003 1 2023-12-17T11:57:52.350 INFO:tasks.workunit.client.0.smithi002.stdout:7/672: fdatasync d6/d17/dc/d13/d37/d4f/faa 0 2023-12-17T11:57:52.350 INFO:tasks.workunit.client.0.smithi002.stdout:7/673: write d6/d17/dc/d67/d8b/d24/da3/fb6 [1362628,54622] 0 2023-12-17T11:57:52.355 INFO:tasks.workunit.client.0.smithi002.stdout:2/688: rename d3/d4/d17/d19/d8d/cd3 to d3/d4/d7/d14/d34/dde/cf2 0 2023-12-17T11:57:52.362 INFO:tasks.workunit.client.1.smithi119.stdout:3/765: rename d9/da/df/d41/ff7 to d9/d11/d1e/f123 0 2023-12-17T11:57:52.364 INFO:tasks.workunit.client.1.smithi119.stdout:7/703: dread d2/d4/d70/f64 [0,4194304] 0 2023-12-17T11:57:52.365 INFO:tasks.workunit.client.0.smithi002.stdout:5/705: dwrite dc/d17/dc0/fdf [0,4194304] 0 2023-12-17T11:57:52.368 INFO:tasks.workunit.client.1.smithi119.stdout:6/612: dwrite d2/d2b/d43/f4a [0,4194304] 0 2023-12-17T11:57:52.368 INFO:tasks.workunit.client.1.smithi119.stdout:6/613: truncate d2/df/d17/d79/f7d 402383 0 2023-12-17T11:57:52.371 INFO:tasks.workunit.client.1.smithi119.stdout:3/766: creat d9/d11/d1e/d55/d77/dcd/f124 x:0 0 0 2023-12-17T11:57:52.375 INFO:tasks.workunit.client.1.smithi119.stdout:7/704: getdents d2/d4/d11/d2c/d68/d98/dd1 0 2023-12-17T11:57:52.375 INFO:tasks.workunit.client.1.smithi119.stdout:7/705: chown d2/d40/dc3/dc8 53358126 1 2023-12-17T11:57:52.377 INFO:tasks.workunit.client.1.smithi119.stdout:4/686: write dd/d15/f53 [121804,95063] 0 2023-12-17T11:57:52.381 INFO:tasks.workunit.client.0.smithi002.stdout:2/689: link d3/d4/d17/d19/d4d/d72/d83/ld2 d3/d4/d7/d14/d1b/lf3 0 2023-12-17T11:57:52.383 INFO:tasks.workunit.client.0.smithi002.stdout:8/747: getdents d3/d8 0 2023-12-17T11:57:52.384 INFO:tasks.workunit.client.0.smithi002.stdout:1/729: dwrite d3/d2f/f79 [0,4194304] 0 2023-12-17T11:57:52.388 INFO:tasks.workunit.client.1.smithi119.stdout:7/706: mknod d2/d5b/cdc 0 2023-12-17T11:57:52.390 INFO:tasks.workunit.client.1.smithi119.stdout:9/745: dwrite d12/f23 [0,4194304] 0 2023-12-17T11:57:52.392 INFO:tasks.workunit.client.1.smithi119.stdout:2/773: dwrite d6/d9/d13/d34/d56/f10e [0,4194304] 0 2023-12-17T11:57:52.392 INFO:tasks.workunit.client.1.smithi119.stdout:2/774: write d6/d9/d52/d53/d55/d58/dba/f106 [762477,92966] 0 2023-12-17T11:57:52.393 INFO:tasks.workunit.client.1.smithi119.stdout:2/775: chown d6/d9/d52/d53/d55/d58/da5/f102 1647 1 2023-12-17T11:57:52.393 INFO:tasks.workunit.client.1.smithi119.stdout:0/679: dwrite d2/dac/fb5 [0,4194304] 0 2023-12-17T11:57:52.394 INFO:tasks.workunit.client.1.smithi119.stdout:0/680: truncate d2/d66/d1f/f68 1568624 0 2023-12-17T11:57:52.394 INFO:tasks.workunit.client.1.smithi119.stdout:0/681: dread - d2/dac/fc1 zero size 2023-12-17T11:57:52.394 INFO:tasks.workunit.client.1.smithi119.stdout:0/682: chown d2/d16/d35/d39/f9e 78852 1 2023-12-17T11:57:52.395 INFO:tasks.workunit.client.1.smithi119.stdout:4/687: unlink dd/d4b/f54 0 2023-12-17T11:57:52.395 INFO:tasks.workunit.client.1.smithi119.stdout:6/614: rmdir d2/df/d17 39 2023-12-17T11:57:52.395 INFO:tasks.workunit.client.1.smithi119.stdout:6/615: write d2/d2b/d43/d5e/f69 [10239,6965] 0 2023-12-17T11:57:52.395 INFO:tasks.workunit.client.0.smithi002.stdout:5/706: creat dc/d1a/d53/ffa x:0 0 0 2023-12-17T11:57:52.398 INFO:tasks.workunit.client.1.smithi119.stdout:1/657: sync 2023-12-17T11:57:52.401 INFO:tasks.workunit.client.1.smithi119.stdout:3/767: dread d9/da/f30 [0,4194304] 0 2023-12-17T11:57:52.401 INFO:tasks.workunit.client.1.smithi119.stdout:3/768: creat d9/d44/db7/f125 x:0 0 0 2023-12-17T11:57:52.401 INFO:tasks.workunit.client.1.smithi119.stdout:3/769: chown d9/d11/d1e/d55/f6d 15817 1 2023-12-17T11:57:52.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/658: write d3/db/d17/f63 [415103,74791] 0 2023-12-17T11:57:52.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/659: chown d3/db/d17/d24/d20/d40/f78 16620 1 2023-12-17T11:57:52.403 INFO:tasks.workunit.client.1.smithi119.stdout:1/660: read d3/db/d17/d24/f3c [354034,92896] 0 2023-12-17T11:57:52.404 INFO:tasks.workunit.client.1.smithi119.stdout:9/746: read d12/d1d/d49/f5b [441395,69184] 0 2023-12-17T11:57:52.404 INFO:tasks.workunit.client.1.smithi119.stdout:9/747: stat d12/d1d/d28/d4d/d73 0 2023-12-17T11:57:52.404 INFO:tasks.workunit.client.1.smithi119.stdout:9/748: truncate d12/d65/f6a 940643 0 2023-12-17T11:57:52.406 INFO:tasks.workunit.client.0.smithi002.stdout:7/674: rmdir d6/d17/dc/d13/d21/d2e 39 2023-12-17T11:57:52.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:52 smithi119 ceph-mon[117414]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:52.413 INFO:tasks.workunit.client.0.smithi002.stdout:6/682: dwrite d0/d1/dc/f34 [0,4194304] 0 2023-12-17T11:57:52.413 INFO:tasks.workunit.client.0.smithi002.stdout:9/780: dwrite dc/f1b [0,4194304] 0 2023-12-17T11:57:52.413 INFO:tasks.workunit.client.0.smithi002.stdout:9/781: creat dc/d42/da0/d72/d93/dd0/dd4/f11b x:0 0 0 2023-12-17T11:57:52.413 INFO:tasks.workunit.client.0.smithi002.stdout:9/782: write dc/fee [1082370,129941] 0 2023-12-17T11:57:52.415 INFO:tasks.workunit.client.0.smithi002.stdout:2/690: mknod d3/d4/d7/d14/d42/dae/cf4 0 2023-12-17T11:57:52.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/707: dread dc/d94/ded/d5a/d96/fec [0,4194304] 0 2023-12-17T11:57:52.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/708: creat dc/d1a/d53/ffb x:0 0 0 2023-12-17T11:57:52.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/709: fsync dc/d1a/f46 0 2023-12-17T11:57:52.423 INFO:tasks.workunit.client.1.smithi119.stdout:7/707: dread d2/d4/d70/d57/d56/f59 [0,4194304] 0 2023-12-17T11:57:52.423 INFO:tasks.workunit.client.1.smithi119.stdout:7/708: chown d2/d4/d11/f3d 1 1 2023-12-17T11:57:52.423 INFO:tasks.workunit.client.1.smithi119.stdout:7/709: write d2/f10 [2754030,68712] 0 2023-12-17T11:57:52.423 INFO:tasks.workunit.client.1.smithi119.stdout:7/710: write d2/d4/d11/d2c/d68/d98/fcf [26634,60583] 0 2023-12-17T11:57:52.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/730: symlink d3/d2f/d4d/lf7 0 2023-12-17T11:57:52.427 INFO:tasks.workunit.client.0.smithi002.stdout:7/675: dread d6/d17/dc/d13/d37/d4f/faa [0,4194304] 0 2023-12-17T11:57:52.428 INFO:tasks.workunit.client.0.smithi002.stdout:6/683: symlink d0/d1/dc/d17/d4c/dc5/le4 0 2023-12-17T11:57:52.435 INFO:tasks.workunit.client.1.smithi119.stdout:0/683: write d2/d66/d2e/d44/d7b/f14 [2101490,38410] 0 2023-12-17T11:57:52.435 INFO:tasks.workunit.client.1.smithi119.stdout:0/684: write d2/d16/d35/d39/f9e [697521,127312] 0 2023-12-17T11:57:52.435 INFO:tasks.workunit.client.1.smithi119.stdout:0/685: write d2/d66/d2e/d44/fb9 [280155,69742] 0 2023-12-17T11:57:52.435 INFO:tasks.workunit.client.1.smithi119.stdout:2/776: creat d6/d9/d52/d53/d55/d58/d6b/f111 x:0 0 0 2023-12-17T11:57:52.440 INFO:tasks.workunit.client.0.smithi002.stdout:0/676: dwrite d0/d6/d26/f35 [0,4194304] 0 2023-12-17T11:57:52.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/677: write d0/d6/d26/d14/d19/d37/f39 [4265316,70274] 0 2023-12-17T11:57:52.442 INFO:tasks.workunit.client.0.smithi002.stdout:0/678: chown d0/d15/d59/f6b 857788196 1 2023-12-17T11:57:52.442 INFO:tasks.workunit.client.0.smithi002.stdout:8/748: dwrite d3/d8/da/f46 [0,4194304] 0 2023-12-17T11:57:52.442 INFO:tasks.workunit.client.0.smithi002.stdout:3/721: dwrite d9/d1b/fc1 [0,4194304] 0 2023-12-17T11:57:52.442 INFO:tasks.workunit.client.0.smithi002.stdout:3/722: write d9/d24/d6f/fc5 [120724,40551] 0 2023-12-17T11:57:52.442 INFO:tasks.workunit.client.0.smithi002.stdout:3/723: chown d9/d1b/d4f 2623 1 2023-12-17T11:57:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/731: symlink d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/lf8 0 2023-12-17T11:57:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:1/732: dread - d3/d2f/d74/dbd/fd7 zero size 2023-12-17T11:57:52.443 INFO:tasks.workunit.client.0.smithi002.stdout:5/710: truncate dc/f3e 3409034 0 2023-12-17T11:57:52.444 INFO:tasks.workunit.client.1.smithi119.stdout:4/688: symlink dd/d11/d2d/lde 0 2023-12-17T11:57:52.445 INFO:tasks.workunit.client.0.smithi002.stdout:7/676: creat d6/d17/dc/d67/d8b/d24/fca x:0 0 0 2023-12-17T11:57:52.447 INFO:tasks.workunit.client.0.smithi002.stdout:2/691: dread d3/d4/d7/d14/d34/f5e [0,4194304] 0 2023-12-17T11:57:52.448 INFO:tasks.workunit.client.0.smithi002.stdout:2/692: readlink d3/d4/d17/lb6 0 2023-12-17T11:57:52.448 INFO:tasks.workunit.client.0.smithi002.stdout:2/693: write d3/d4/d7/d14/d2e/d37/f7d [460590,60327] 0 2023-12-17T11:57:52.448 INFO:tasks.workunit.client.0.smithi002.stdout:2/694: fsync d3/d4/d7/d14/d42/d8a/fc3 0 2023-12-17T11:57:52.448 INFO:tasks.workunit.client.1.smithi119.stdout:6/616: mkdir d2/d2b/d43/d76/dbd 0 2023-12-17T11:57:52.449 INFO:tasks.workunit.client.0.smithi002.stdout:4/640: dwrite d0/d3e/d56/d99/fb8 [0,4194304] 0 2023-12-17T11:57:52.449 INFO:tasks.workunit.client.0.smithi002.stdout:4/641: stat d0/d3e/d47/cbf 0 2023-12-17T11:57:52.452 INFO:tasks.workunit.client.1.smithi119.stdout:1/661: creat d3/db/d17/d24/d20/d40/d76/ff2 x:0 0 0 2023-12-17T11:57:52.452 INFO:tasks.workunit.client.1.smithi119.stdout:1/662: write d3/db/d17/d24/d20/d40/fdd [627881,25705] 0 2023-12-17T11:57:52.456 INFO:tasks.workunit.client.1.smithi119.stdout:9/749: mknod d12/d1d/d28/d4d/d73/d78/d8b/cf0 0 2023-12-17T11:57:52.456 INFO:tasks.workunit.client.1.smithi119.stdout:9/750: dread - d12/d1d/d28/d46/d6e/fb9 zero size 2023-12-17T11:57:52.456 INFO:tasks.workunit.client.1.smithi119.stdout:2/777: write d6/f40 [3801895,6813] 0 2023-12-17T11:57:52.458 INFO:tasks.workunit.client.1.smithi119.stdout:7/711: mknod d2/d4/d70/d57/d56/db6/cdd 0 2023-12-17T11:57:52.461 INFO:tasks.workunit.client.0.smithi002.stdout:8/749: truncate d3/d7/d1a/f5c 2577580 0 2023-12-17T11:57:52.462 INFO:tasks.workunit.client.1.smithi119.stdout:0/686: mknod d2/d66/d2e/d44/d7b/d5/dc/d7f/ccb 0 2023-12-17T11:57:52.464 INFO:tasks.workunit.client.0.smithi002.stdout:3/724: creat d9/d15/d52/d79/dd1/fe7 x:0 0 0 2023-12-17T11:57:52.466 INFO:tasks.workunit.client.1.smithi119.stdout:4/689: creat dd/fdf x:0 0 0 2023-12-17T11:57:52.469 INFO:tasks.workunit.client.0.smithi002.stdout:2/695: creat d3/d4/d7/d14/d42/ff5 x:0 0 0 2023-12-17T11:57:52.469 INFO:tasks.workunit.client.0.smithi002.stdout:2/696: write d3/d4/d7/d14/d1b/d5b/f97 [4867956,39714] 0 2023-12-17T11:57:52.470 INFO:tasks.workunit.client.1.smithi119.stdout:6/617: symlink d2/d61/lbe 0 2023-12-17T11:57:52.479 INFO:tasks.workunit.client.1.smithi119.stdout:3/770: dwrite d9/da/df/d41/fdd [0,4194304] 0 2023-12-17T11:57:52.479 INFO:tasks.workunit.client.1.smithi119.stdout:1/663: creat d3/db/d17/d24/d20/dbd/dcb/ff3 x:0 0 0 2023-12-17T11:57:52.481 INFO:tasks.workunit.client.1.smithi119.stdout:2/778: write d6/d9/d86/db0/fd2 [2595301,122601] 0 2023-12-17T11:57:52.481 INFO:tasks.workunit.client.1.smithi119.stdout:9/751: creat d12/d1d/d28/d86/ff1 x:0 0 0 2023-12-17T11:57:52.481 INFO:tasks.workunit.client.1.smithi119.stdout:8/595: sync 2023-12-17T11:57:52.481 INFO:tasks.workunit.client.1.smithi119.stdout:2/779: creat d6/d9/d52/d53/f112 x:0 0 0 2023-12-17T11:57:52.482 INFO:tasks.workunit.client.0.smithi002.stdout:4/642: rename d0/c2e to d0/d10/d14/d27/d69/cce 0 2023-12-17T11:57:52.482 INFO:tasks.workunit.client.0.smithi002.stdout:4/643: fsync d0/d10/d14/d27/fbd 0 2023-12-17T11:57:52.482 INFO:tasks.workunit.client.1.smithi119.stdout:5/741: sync 2023-12-17T11:57:52.482 INFO:tasks.workunit.client.1.smithi119.stdout:2/780: write d6/fbd [5041764,88931] 0 2023-12-17T11:57:52.482 INFO:tasks.workunit.client.1.smithi119.stdout:5/742: write d1/da7/fe1 [849411,102397] 0 2023-12-17T11:57:52.482 INFO:tasks.workunit.client.1.smithi119.stdout:5/743: write d1/d70/da3/fbf [524299,19060] 0 2023-12-17T11:57:52.484 INFO:tasks.workunit.client.1.smithi119.stdout:0/687: mkdir d2/dcc 0 2023-12-17T11:57:52.484 INFO:tasks.workunit.client.1.smithi119.stdout:0/688: stat d2/d66/d1f/d24/la9 0 2023-12-17T11:57:52.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/664: rename d3/db/ccc to d3/db/d2a/de5/cf4 0 2023-12-17T11:57:52.487 INFO:tasks.workunit.client.0.smithi002.stdout:1/733: dwrite d3/d6/d16/dcf/ff0 [0,4194304] 0 2023-12-17T11:57:52.489 INFO:tasks.workunit.client.1.smithi119.stdout:3/771: creat d9/da/dcc/db8/f126 x:0 0 0 2023-12-17T11:57:52.489 INFO:tasks.workunit.client.1.smithi119.stdout:3/772: creat d9/d44/db7/f127 x:0 0 0 2023-12-17T11:57:52.489 INFO:tasks.workunit.client.1.smithi119.stdout:3/773: fsync d9/da/fa7 0 2023-12-17T11:57:52.489 INFO:tasks.workunit.client.1.smithi119.stdout:3/774: fdatasync d9/d35/f48 0 2023-12-17T11:57:52.490 INFO:tasks.workunit.client.0.smithi002.stdout:7/677: write d6/d17/f47 [5543029,96145] 0 2023-12-17T11:57:52.490 INFO:tasks.workunit.client.0.smithi002.stdout:8/750: symlink d3/d7/d18/dde/lfc 0 2023-12-17T11:57:52.490 INFO:tasks.workunit.client.0.smithi002.stdout:8/751: read - d3/d8/da/dd/db0/fef zero size 2023-12-17T11:57:52.492 INFO:tasks.workunit.client.0.smithi002.stdout:3/725: mknod d9/d15/d52/d79/dd1/ce8 0 2023-12-17T11:57:52.497 INFO:tasks.workunit.client.0.smithi002.stdout:9/783: dwrite dc/d32/faa [0,4194304] 0 2023-12-17T11:57:52.497 INFO:tasks.workunit.client.0.smithi002.stdout:5/711: dread dc/f83 [0,4194304] 0 2023-12-17T11:57:52.498 INFO:tasks.workunit.client.0.smithi002.stdout:9/784: fdatasync dc/d1d/d7c/d90/fbb 0 2023-12-17T11:57:52.499 INFO:tasks.workunit.client.1.smithi119.stdout:6/618: write d2/f9 [2789762,97283] 0 2023-12-17T11:57:52.499 INFO:tasks.workunit.client.1.smithi119.stdout:6/619: stat d2/fa1 0 2023-12-17T11:57:52.500 INFO:tasks.workunit.client.1.smithi119.stdout:8/596: mknod d7/d18/d15/d81/da2/dbf/cc0 0 2023-12-17T11:57:52.503 INFO:tasks.workunit.client.0.smithi002.stdout:6/684: dwrite d0/d1/dc/d17/f79 [0,4194304] 0 2023-12-17T11:57:52.503 INFO:tasks.workunit.client.0.smithi002.stdout:2/697: getdents d3/d4/d7/d14/d2e/d37 0 2023-12-17T11:57:52.510 INFO:tasks.workunit.client.1.smithi119.stdout:9/752: truncate d12/d1d/d28/d4d/d73/f74 3526595 0 2023-12-17T11:57:52.514 INFO:tasks.workunit.client.0.smithi002.stdout:1/734: symlink d3/d6/d9/ded/lf9 0 2023-12-17T11:57:52.515 INFO:tasks.workunit.client.1.smithi119.stdout:1/665: dread d3/f12 [0,4194304] 0 2023-12-17T11:57:52.515 INFO:tasks.workunit.client.1.smithi119.stdout:5/744: mkdir d1/d70/d6b/df1 0 2023-12-17T11:57:52.516 INFO:tasks.workunit.client.1.smithi119.stdout:0/689: mkdir d2/d66/dbb/dcd 0 2023-12-17T11:57:52.533 INFO:tasks.workunit.client.0.smithi002.stdout:7/678: mkdir d6/d17/dc/d6c/dcb 0 2023-12-17T11:57:52.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/735: dread d3/d6/d16/dcf/ff0 [0,4194304] 0 2023-12-17T11:57:52.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/736: truncate d3/d2f/d4d/d95/fe9 1030801 0 2023-12-17T11:57:52.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/737: write d3/d6/d9/d37/d39/fd4 [555239,127964] 0 2023-12-17T11:57:52.537 INFO:tasks.workunit.client.0.smithi002.stdout:8/752: symlink d3/lfd 0 2023-12-17T11:57:52.537 INFO:tasks.workunit.client.0.smithi002.stdout:8/753: write d3/d7/ff2 [887886,105320] 0 2023-12-17T11:57:52.538 INFO:tasks.workunit.client.0.smithi002.stdout:3/726: truncate f3 1756924 0 2023-12-17T11:57:52.538 INFO:tasks.workunit.client.0.smithi002.stdout:3/727: chown d9/d15/d52/d85/db9/cd0 62652 1 2023-12-17T11:57:52.542 INFO:tasks.workunit.client.0.smithi002.stdout:5/712: mknod dc/d94/ded/d5a/d96/d6c/cfc 0 2023-12-17T11:57:52.543 INFO:tasks.workunit.client.1.smithi119.stdout:3/775: creat d9/da/df/f128 x:0 0 0 2023-12-17T11:57:52.549 INFO:tasks.workunit.client.0.smithi002.stdout:6/685: rename d0/d1/dc/d10/f52 to d0/d1/dc/d17/d3c/fe5 0 2023-12-17T11:57:52.553 INFO:tasks.workunit.client.1.smithi119.stdout:6/620: mknod d2/d2b/cbf 0 2023-12-17T11:57:52.553 INFO:tasks.workunit.client.1.smithi119.stdout:6/621: readlink d2/d61/l8f 0 2023-12-17T11:57:52.553 INFO:tasks.workunit.client.1.smithi119.stdout:6/622: fdatasync d2/d2b/d43/d76/fb0 0 2023-12-17T11:57:52.555 INFO:tasks.workunit.client.1.smithi119.stdout:9/753: symlink d12/d1d/d79/lf2 0 2023-12-17T11:57:52.556 INFO:tasks.workunit.client.1.smithi119.stdout:5/745: unlink d1/d70/d6b/d77/dae/fc6 0 2023-12-17T11:57:52.556 INFO:tasks.workunit.client.1.smithi119.stdout:5/746: chown d1/f6d 541893 1 2023-12-17T11:57:52.556 INFO:tasks.workunit.client.1.smithi119.stdout:0/690: dread - d2/d16/d35/d74/fa7 zero size 2023-12-17T11:57:52.557 INFO:tasks.workunit.client.0.smithi002.stdout:2/698: mkdir d3/d50/df6 0 2023-12-17T11:57:52.557 INFO:tasks.workunit.client.1.smithi119.stdout:9/754: mkdir d12/d1d/d49/ddb/df3 0 2023-12-17T11:57:52.557 INFO:tasks.workunit.client.1.smithi119.stdout:9/755: truncate d12/d1d/d28/d46/d50/fb0 833703 0 2023-12-17T11:57:52.557 INFO:tasks.workunit.client.1.smithi119.stdout:9/756: write d12/d1d/f31 [2686721,112663] 0 2023-12-17T11:57:52.557 INFO:tasks.workunit.client.1.smithi119.stdout:5/747: symlink d1/d44/lf2 0 2023-12-17T11:57:52.558 INFO:tasks.workunit.client.0.smithi002.stdout:4/644: dwrite d0/d10/d14/f60 [0,4194304] 0 2023-12-17T11:57:52.559 INFO:tasks.workunit.client.1.smithi119.stdout:0/691: link d2/d66/f1c d2/dcc/fce 0 2023-12-17T11:57:52.561 INFO:tasks.workunit.client.0.smithi002.stdout:6/686: mknod d0/d1/dc/d17/d8f/ce6 0 2023-12-17T11:57:52.561 INFO:tasks.workunit.client.0.smithi002.stdout:3/728: write d9/d1b/d35/d41/d59/d65/da9/d8f/f90 [670842,22850] 0 2023-12-17T11:57:52.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/738: rmdir d3/d2f/d4d/d95 39 2023-12-17T11:57:52.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/739: write d3/d6/d9/d37/d39/d43/d8f/fe7 [726281,75185] 0 2023-12-17T11:57:52.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/740: truncate d3/d6/d9/d37/d39/d43/fa4 1082794 0 2023-12-17T11:57:52.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/741: stat d3/d2f/d74/dbe/dd8/fb0 0 2023-12-17T11:57:52.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/742: truncate d3/d6/d9/d30/d9c/fec 733211 0 2023-12-17T11:57:52.569 INFO:tasks.workunit.client.0.smithi002.stdout:0/679: dwrite d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:52.571 INFO:tasks.workunit.client.1.smithi119.stdout:8/597: dwrite d7/d12/fba [0,4194304] 0 2023-12-17T11:57:52.571 INFO:tasks.workunit.client.1.smithi119.stdout:8/598: fsync d7/d12/d69/d98/fb1 0 2023-12-17T11:57:52.571 INFO:tasks.workunit.client.1.smithi119.stdout:8/599: readlink d7/d12/d23/d9c/dad/lbc 0 2023-12-17T11:57:52.572 INFO:tasks.workunit.client.1.smithi119.stdout:9/757: rename d12/d1d/d28/d86/d8f/fa5 to d12/d1d/d49/ddb/df3/ff4 0 2023-12-17T11:57:52.573 INFO:tasks.workunit.client.1.smithi119.stdout:6/623: dread d2/df/f30 [4194304,4194304] 0 2023-12-17T11:57:52.573 INFO:tasks.workunit.client.0.smithi002.stdout:2/699: creat d3/d4/d7/d14/d34/dde/ff7 x:0 0 0 2023-12-17T11:57:52.577 INFO:tasks.workunit.client.0.smithi002.stdout:9/785: dwrite dc/d1d/d25/d85/dc2/ddd/dfa/ff5 [0,4194304] 0 2023-12-17T11:57:52.578 INFO:tasks.workunit.client.1.smithi119.stdout:2/781: dwrite d6/f33 [4194304,4194304] 0 2023-12-17T11:57:52.580 INFO:tasks.workunit.client.0.smithi002.stdout:6/687: unlink d0/d1/dc/d17/d3c/fcb 0 2023-12-17T11:57:52.580 INFO:tasks.workunit.client.0.smithi002.stdout:6/688: getdents d0/d1/d28/dde 0 2023-12-17T11:57:52.580 INFO:tasks.workunit.client.1.smithi119.stdout:0/692: dread d2/d66/d2e/d44/f26 [4194304,4194304] 0 2023-12-17T11:57:52.581 INFO:tasks.workunit.client.0.smithi002.stdout:4/645: link d0/d10/d21/d33/d96/cb1 d0/d10/d14/d27/d69/ccf 0 2023-12-17T11:57:52.584 INFO:tasks.workunit.client.1.smithi119.stdout:9/758: mkdir d12/d1d/d28/d46/d6e/df5 0 2023-12-17T11:57:52.590 INFO:tasks.workunit.client.1.smithi119.stdout:6/624: symlink d2/d2b/d43/d76/d8d/lc0 0 2023-12-17T11:57:52.592 INFO:tasks.workunit.client.0.smithi002.stdout:7/679: dwrite d6/d17/dc/f8d [0,4194304] 0 2023-12-17T11:57:52.600 INFO:tasks.workunit.client.1.smithi119.stdout:1/666: dwrite d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/fc5 [0,4194304] 0 2023-12-17T11:57:52.600 INFO:tasks.workunit.client.1.smithi119.stdout:1/667: fsync d3/db/d26/f55 0 2023-12-17T11:57:52.600 INFO:tasks.workunit.client.1.smithi119.stdout:8/600: write d7/da/f41 [6295597,62394] 0 2023-12-17T11:57:52.602 INFO:tasks.workunit.client.1.smithi119.stdout:0/693: mkdir d2/dac/dcf 0 2023-12-17T11:57:52.602 INFO:tasks.workunit.client.1.smithi119.stdout:5/748: write d1/d25/f38 [759038,95205] 0 2023-12-17T11:57:52.604 INFO:tasks.workunit.client.0.smithi002.stdout:0/680: truncate d0/d6/d26/d25/f45 3261472 0 2023-12-17T11:57:52.607 INFO:tasks.workunit.client.0.smithi002.stdout:3/729: truncate f3 2473227 0 2023-12-17T11:57:52.608 INFO:tasks.workunit.client.0.smithi002.stdout:2/700: truncate d3/d4/d7/d14/d1b/d5b/f79 3094067 0 2023-12-17T11:57:52.611 INFO:tasks.workunit.client.1.smithi119.stdout:6/625: rmdir d2/d2b/d43/d76/d8d 39 2023-12-17T11:57:52.615 INFO:tasks.workunit.client.1.smithi119.stdout:0/694: dread d2/d16/d35/d39/f76 [0,4194304] 0 2023-12-17T11:57:52.621 INFO:tasks.workunit.client.0.smithi002.stdout:5/713: dwrite dc/d1a/fa5 [0,4194304] 0 2023-12-17T11:57:52.625 INFO:tasks.workunit.client.0.smithi002.stdout:9/786: mkdir dc/d1d/d7c/d90/d11c 0 2023-12-17T11:57:52.625 INFO:tasks.workunit.client.0.smithi002.stdout:9/787: readlink dc/d42/da0/d72/d93/l2f 0 2023-12-17T11:57:52.625 INFO:tasks.workunit.client.0.smithi002.stdout:9/788: stat dc/d42/d4f/d9e/d104 0 2023-12-17T11:57:52.626 INFO:tasks.workunit.client.1.smithi119.stdout:8/601: write d7/da/d11/d26/f32 [2090182,34525] 0 2023-12-17T11:57:52.632 INFO:tasks.workunit.client.1.smithi119.stdout:3/776: dwrite d9/da/fd4 [0,4194304] 0 2023-12-17T11:57:52.633 INFO:tasks.workunit.client.1.smithi119.stdout:3/777: chown d9/d1c/f49 870 1 2023-12-17T11:57:52.633 INFO:tasks.workunit.client.1.smithi119.stdout:3/778: dread - d9/d11/d1e/d55/d77/faa zero size 2023-12-17T11:57:52.644 INFO:tasks.workunit.client.1.smithi119.stdout:2/782: dwrite d6/d2b/d3f/da8/fe1 [0,4194304] 0 2023-12-17T11:57:52.646 INFO:tasks.workunit.client.0.smithi002.stdout:6/689: rename d0/d1/dc/d10/fb8 to d0/d1/dc/d17/fe7 0 2023-12-17T11:57:52.647 INFO:tasks.workunit.client.0.smithi002.stdout:6/690: write d0/d1/dc/d17/d8f/fb3 [634788,29516] 0 2023-12-17T11:57:52.647 INFO:tasks.workunit.client.0.smithi002.stdout:6/691: write d0/d1/dc/d17/d3c/fa3 [707336,68290] 0 2023-12-17T11:57:52.648 INFO:tasks.workunit.client.1.smithi119.stdout:1/668: truncate d3/f12 4056870 0 2023-12-17T11:57:52.653 INFO:tasks.workunit.client.0.smithi002.stdout:4/646: symlink d0/d10/d14/ld0 0 2023-12-17T11:57:52.655 INFO:tasks.workunit.client.1.smithi119.stdout:6/626: creat d2/d2b/d43/d76/dbd/fc1 x:0 0 0 2023-12-17T11:57:52.656 INFO:tasks.workunit.client.0.smithi002.stdout:6/692: dread d0/d1/dc/d17/d8f/f9d [0,4194304] 0 2023-12-17T11:57:52.656 INFO:tasks.workunit.client.0.smithi002.stdout:6/693: truncate d0/d1/d21/d56/d8c/d93/da5/dbc/dc4/fd9 266332 0 2023-12-17T11:57:52.658 INFO:tasks.workunit.client.0.smithi002.stdout:7/680: symlink d6/d17/dc/d67/d86/lcc 0 2023-12-17T11:57:52.659 INFO:tasks.workunit.client.1.smithi119.stdout:8/602: creat d7/d18/d15/fc1 x:0 0 0 2023-12-17T11:57:52.659 INFO:tasks.workunit.client.1.smithi119.stdout:8/603: fdatasync d7/da/d11/f1d 0 2023-12-17T11:57:52.661 INFO:tasks.workunit.client.1.smithi119.stdout:5/749: dread d1/f51 [0,4194304] 0 2023-12-17T11:57:52.662 INFO:tasks.workunit.client.0.smithi002.stdout:1/743: getdents d3/d6/d16/dcf 0 2023-12-17T11:57:52.663 INFO:tasks.workunit.client.0.smithi002.stdout:4/647: dread d0/d10/d14/d27/d57/d7d/fb7 [0,4194304] 0 2023-12-17T11:57:52.664 INFO:tasks.workunit.client.1.smithi119.stdout:0/695: dwrite d2/d66/d2e/d44/fbe [0,4194304] 0 2023-12-17T11:57:52.667 INFO:tasks.workunit.client.0.smithi002.stdout:0/681: mknod d0/d6/d26/d14/d19/d37/d86/dca/cd8 0 2023-12-17T11:57:52.667 INFO:tasks.workunit.client.0.smithi002.stdout:0/682: fsync d0/d6/d26/d25/f46 0 2023-12-17T11:57:52.667 INFO:tasks.workunit.client.1.smithi119.stdout:2/783: mknod d6/d2b/db9/c113 0 2023-12-17T11:57:52.671 INFO:tasks.workunit.client.1.smithi119.stdout:9/759: dwrite d12/d1d/d49/f77 [4194304,4194304] 0 2023-12-17T11:57:52.671 INFO:tasks.workunit.client.1.smithi119.stdout:3/779: dread d9/d11/f3f [0,4194304] 0 2023-12-17T11:57:52.672 INFO:tasks.workunit.client.1.smithi119.stdout:3/780: read - d9/d11/d1e/d55/d65/ddf/f102 zero size 2023-12-17T11:57:52.682 INFO:tasks.workunit.client.1.smithi119.stdout:8/604: dread d7/d12/d23/f38 [4194304,4194304] 0 2023-12-17T11:57:52.683 INFO:tasks.workunit.client.1.smithi119.stdout:1/669: rename d3/d44/f5c to d3/db/d17/d24/d20/dba/dbc/d7e/da1/ff5 0 2023-12-17T11:57:52.684 INFO:tasks.workunit.client.1.smithi119.stdout:3/781: write d9/da/df/d41/d33/d3a/f40 [1847097,116681] 0 2023-12-17T11:57:52.684 INFO:tasks.workunit.client.1.smithi119.stdout:3/782: dread - d9/d59/f115 zero size 2023-12-17T11:57:52.687 INFO:tasks.workunit.client.1.smithi119.stdout:6/627: mkdir d2/d2b/d43/d76/d8d/dc2 0 2023-12-17T11:57:52.696 INFO:tasks.workunit.client.1.smithi119.stdout:9/760: dread d12/d1d/d49/f52 [0,4194304] 0 2023-12-17T11:57:52.706 INFO:tasks.workunit.client.1.smithi119.stdout:0/696: symlink d2/d66/d2e/d44/d7b/ld0 0 2023-12-17T11:57:52.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/628: write d2/df/d17/d79/f96 [1995047,96328] 0 2023-12-17T11:57:52.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/629: dread - d2/fa1 zero size 2023-12-17T11:57:52.720 INFO:tasks.workunit.client.1.smithi119.stdout:9/761: rmdir d12/d1d/d28/d4d/d73/d78/d8b/dec 0 2023-12-17T11:57:52.727 INFO:tasks.workunit.client.1.smithi119.stdout:1/670: getdents d3/db/d26/d8f 0 2023-12-17T11:57:52.727 INFO:tasks.workunit.client.1.smithi119.stdout:1/671: readlink d3/db/d26/d8f/le8 0 2023-12-17T11:57:52.727 INFO:tasks.workunit.client.1.smithi119.stdout:9/762: rename d12/d1d/d28/d46/d6e/de2 to d12/d1d/d49/d85/df6 0 2023-12-17T11:57:52.728 INFO:tasks.workunit.client.1.smithi119.stdout:9/763: write d12/d1d/f41 [3183124,78066] 0 2023-12-17T11:57:52.730 INFO:tasks.workunit.client.1.smithi119.stdout:6/630: link d2/df/d17/c32 d2/d2b/cc3 0 2023-12-17T11:57:52.730 INFO:tasks.workunit.client.0.smithi002.stdout:2/701: creat d3/d4/d17/d19/d8d/ff8 x:0 0 0 2023-12-17T11:57:52.733 INFO:tasks.workunit.client.1.smithi119.stdout:3/783: rmdir d9/d11 39 2023-12-17T11:57:52.736 INFO:tasks.workunit.client.1.smithi119.stdout:1/672: truncate d3/db/d17/f63 466686 0 2023-12-17T11:57:52.737 INFO:tasks.workunit.client.0.smithi002.stdout:5/714: mknod dc/d17/dd2/cfd 0 2023-12-17T11:57:52.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/789: creat dc/d42/da0/d72/dfe/f11d x:0 0 0 2023-12-17T11:57:52.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/790: creat dc/d42/da0/d72/d93/dd0/dd4/f11e x:0 0 0 2023-12-17T11:57:52.739 INFO:tasks.workunit.client.1.smithi119.stdout:0/697: dread d2/d66/f1a [0,4194304] 0 2023-12-17T11:57:52.739 INFO:tasks.workunit.client.1.smithi119.stdout:0/698: write d2/d66/fba [1985584,17383] 0 2023-12-17T11:57:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:6/694: mkdir d0/d1/dc/d58/de8 0 2023-12-17T11:57:52.742 INFO:tasks.workunit.client.0.smithi002.stdout:6/695: read - d0/d1/d21/d56/d8c/fdd zero size 2023-12-17T11:57:52.744 INFO:tasks.workunit.client.1.smithi119.stdout:9/764: mknod d12/d1d/d28/d46/d50/d92/dae/cf7 0 2023-12-17T11:57:52.744 INFO:tasks.workunit.client.1.smithi119.stdout:9/765: chown d12/dca/dbd/ce8 0 1 2023-12-17T11:57:52.744 INFO:tasks.workunit.client.1.smithi119.stdout:5/750: dwrite d1/f2e [0,4194304] 0 2023-12-17T11:57:52.746 INFO:tasks.workunit.client.0.smithi002.stdout:7/681: creat d6/d17/dc/d13/d21/d6e/fcd x:0 0 0 2023-12-17T11:57:52.748 INFO:tasks.workunit.client.1.smithi119.stdout:8/605: dwrite d7/d12/fbe [0,4194304] 0 2023-12-17T11:57:52.748 INFO:tasks.workunit.client.1.smithi119.stdout:2/784: dwrite d6/d9/d52/d53/ff0 [0,4194304] 0 2023-12-17T11:57:52.748 INFO:tasks.workunit.client.1.smithi119.stdout:2/785: chown d6/d9/d52/d5a/fce 5567575 1 2023-12-17T11:57:52.748 INFO:tasks.workunit.client.1.smithi119.stdout:3/784: mkdir d9/d11/d1e/d55/df3/d129 0 2023-12-17T11:57:52.748 INFO:tasks.workunit.client.1.smithi119.stdout:3/785: read d9/da/f30 [3740416,48129] 0 2023-12-17T11:57:52.749 INFO:tasks.workunit.client.0.smithi002.stdout:4/648: mkdir d0/d3e/dd1 0 2023-12-17T11:57:52.754 INFO:tasks.workunit.client.1.smithi119.stdout:1/673: creat d3/db/d17/d24/d20/dba/dbc/d7e/ff6 x:0 0 0 2023-12-17T11:57:52.763 INFO:tasks.workunit.client.0.smithi002.stdout:0/683: link d0/d6/d26/d14/d19/d37/dcf/cc0 d0/d6/d26/d14/d19/d61/dbf/cd9 0 2023-12-17T11:57:52.766 INFO:tasks.workunit.client.1.smithi119.stdout:2/786: write d6/d9/d52/d53/d55/d58/dba/ff6 [860081,120660] 0 2023-12-17T11:57:52.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/730: rmdir d9/d15/d52/d85 39 2023-12-17T11:57:52.776 INFO:tasks.workunit.client.0.smithi002.stdout:3/731: fdatasync d9/d1b/d4f/fb1 0 2023-12-17T11:57:52.777 INFO:tasks.workunit.client.0.smithi002.stdout:2/702: mknod d3/d4/d7/d14/d42/d8a/dd8/cf9 0 2023-12-17T11:57:52.780 INFO:tasks.workunit.client.1.smithi119.stdout:5/751: creat d1/d70/d6b/df1/ff3 x:0 0 0 2023-12-17T11:57:52.783 INFO:tasks.workunit.client.0.smithi002.stdout:5/715: symlink dc/d94/ded/dad/lfe 0 2023-12-17T11:57:52.785 INFO:tasks.workunit.client.0.smithi002.stdout:9/791: creat dc/d1d/d25/d85/dc2/ddd/dfa/f11f x:0 0 0 2023-12-17T11:57:52.787 INFO:tasks.workunit.client.0.smithi002.stdout:6/696: truncate d0/d1/dc/d10/f86 3391328 0 2023-12-17T11:57:52.790 INFO:tasks.workunit.client.0.smithi002.stdout:7/682: mkdir d6/d17/dc/d67/d8b/dbd/dce 0 2023-12-17T11:57:52.790 INFO:tasks.workunit.client.0.smithi002.stdout:7/683: chown d6/d17/dc/d13/d21/f62 205338 1 2023-12-17T11:57:52.792 INFO:tasks.workunit.client.1.smithi119.stdout:8/606: truncate d7/fb 669292 0 2023-12-17T11:57:52.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/649: unlink d0/l13 0 2023-12-17T11:57:52.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/650: chown d0/d10/d14/cc1 10601915 1 2023-12-17T11:57:52.797 INFO:tasks.workunit.client.1.smithi119.stdout:3/786: stat d9/da/df/f15 0 2023-12-17T11:57:52.799 INFO:tasks.workunit.client.0.smithi002.stdout:0/684: link d0/d6/d26/f35 d0/d6/d26/d14/d19/d37/fda 0 2023-12-17T11:57:52.801 INFO:tasks.workunit.client.1.smithi119.stdout:1/674: symlink d3/lf7 0 2023-12-17T11:57:52.801 INFO:tasks.workunit.client.1.smithi119.stdout:1/675: dread - d3/db/d17/d24/d20/dba/dbc/d7e/da1/fe7 zero size 2023-12-17T11:57:52.801 INFO:tasks.workunit.client.1.smithi119.stdout:1/676: dread - d3/db/d17/d24/d20/dba/dbc/d7e/da1/fe7 zero size 2023-12-17T11:57:52.802 INFO:tasks.workunit.client.0.smithi002.stdout:3/732: link d9/d1b/l9c d9/d24/le9 0 2023-12-17T11:57:52.805 INFO:tasks.workunit.client.1.smithi119.stdout:5/752: creat d1/d70/d85/d95/ff4 x:0 0 0 2023-12-17T11:57:52.807 INFO:tasks.workunit.client.1.smithi119.stdout:0/699: dwrite d2/d16/d35/d39/fb1 [0,4194304] 0 2023-12-17T11:57:52.811 INFO:tasks.workunit.client.1.smithi119.stdout:5/753: mknod d1/da7/d71/d76/d83/dd1/cf5 0 2023-12-17T11:57:52.814 INFO:tasks.workunit.client.0.smithi002.stdout:2/703: mknod d3/d4/d7/d14/d1b/d5b/de3/cfa 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.0.smithi002.stdout:9/792: mknod dc/d42/d4f/d9e/de2/c120 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.0.smithi002.stdout:5/716: write dc/d1a/d47/f4a [1492930,22930] 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.0.smithi002.stdout:2/704: fdatasync d3/d4/d7/d14/d2e/d37/d3f/fad 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/651: getdents d0/d3e 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/652: fsync d0/d3e/d56/f7c 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.0.smithi002.stdout:6/697: unlink d0/d1/dc/d10/f46 0 2023-12-17T11:57:52.815 INFO:tasks.workunit.client.1.smithi119.stdout:8/607: dread d7/da/d11/f1d [0,4194304] 0 2023-12-17T11:57:52.818 INFO:tasks.workunit.client.1.smithi119.stdout:0/700: creat d2/d16/fd1 x:0 0 0 2023-12-17T11:57:52.818 INFO:tasks.workunit.client.1.smithi119.stdout:0/701: chown d2/d66/d2e/d44/f26 51815 1 2023-12-17T11:57:52.819 INFO:tasks.workunit.client.0.smithi002.stdout:0/685: symlink d0/d6/d26/d14/d19/d37/ldb 0 2023-12-17T11:57:52.819 INFO:tasks.workunit.client.0.smithi002.stdout:0/686: stat d0/d6/d26/d14/d19/d37/d91/fbb 0 2023-12-17T11:57:52.819 INFO:tasks.workunit.client.0.smithi002.stdout:0/687: chown d0/d15/f6c 568268364 1 2023-12-17T11:57:52.820 INFO:tasks.workunit.client.1.smithi119.stdout:5/754: creat d1/d70/d6b/d77/dae/dba/ff6 x:0 0 0 2023-12-17T11:57:52.820 INFO:tasks.workunit.client.1.smithi119.stdout:5/755: write d1/d70/d6b/d77/dae/dba/ff6 [271395,34426] 0 2023-12-17T11:57:52.820 INFO:tasks.workunit.client.0.smithi002.stdout:3/733: symlink d9/d40/lea 0 2023-12-17T11:57:52.820 INFO:tasks.workunit.client.0.smithi002.stdout:3/734: write d9/d1b/d35/d41/f42 [219057,784] 0 2023-12-17T11:57:52.821 INFO:tasks.workunit.client.0.smithi002.stdout:8/754: sync 2023-12-17T11:57:52.825 INFO:tasks.workunit.client.1.smithi119.stdout:0/702: link d2/d66/d2e/c84 d2/d66/d1f/cd2 0 2023-12-17T11:57:52.826 INFO:tasks.workunit.client.0.smithi002.stdout:9/793: unlink dc/d42/da0/d72/d93/d76/f86 0 2023-12-17T11:57:52.826 INFO:tasks.workunit.client.0.smithi002.stdout:9/794: stat dc/d42/da0/d72/d93/d52/la8 0 2023-12-17T11:57:52.826 INFO:tasks.workunit.client.0.smithi002.stdout:9/795: chown dc/d1d/fff 30 1 2023-12-17T11:57:52.827 INFO:tasks.workunit.client.1.smithi119.stdout:2/787: dwrite d6/d2b/d3f/d5b/f6f [0,4194304] 0 2023-12-17T11:57:52.828 INFO:tasks.workunit.client.1.smithi119.stdout:9/766: dwrite d12/d1d/d28/d4d/f6c [0,4194304] 0 2023-12-17T11:57:52.828 INFO:tasks.workunit.client.1.smithi119.stdout:9/767: chown d12/d1d/d49/dad 870507 1 2023-12-17T11:57:52.828 INFO:tasks.workunit.client.0.smithi002.stdout:4/653: creat d0/d10/d14/d27/d69/fd2 x:0 0 0 2023-12-17T11:57:52.829 INFO:tasks.workunit.client.1.smithi119.stdout:5/756: creat d1/da7/d71/d97/db3/ff7 x:0 0 0 2023-12-17T11:57:52.830 INFO:tasks.workunit.client.1.smithi119.stdout:4/690: sync 2023-12-17T11:57:52.830 INFO:tasks.workunit.client.1.smithi119.stdout:4/691: fdatasync dd/f18 0 2023-12-17T11:57:52.830 INFO:tasks.workunit.client.1.smithi119.stdout:7/712: sync 2023-12-17T11:57:52.833 INFO:tasks.workunit.client.0.smithi002.stdout:3/735: symlink d9/d15/leb 0 2023-12-17T11:57:52.836 INFO:tasks.workunit.client.1.smithi119.stdout:0/703: mkdir d2/d66/dbb/dcd/dd3 0 2023-12-17T11:57:52.836 INFO:tasks.workunit.client.1.smithi119.stdout:0/704: chown d2/d16 765090650 1 2023-12-17T11:57:52.836 INFO:tasks.workunit.client.1.smithi119.stdout:0/705: dread - d2/d16/fd1 zero size 2023-12-17T11:57:52.836 INFO:tasks.workunit.client.1.smithi119.stdout:0/706: getdents d2/d66/d1f/d24/d50/d5d/d80 0 2023-12-17T11:57:52.837 INFO:tasks.workunit.client.0.smithi002.stdout:1/744: sync 2023-12-17T11:57:52.837 INFO:tasks.workunit.client.0.smithi002.stdout:1/745: readlink d3/d2f/d74/le6 0 2023-12-17T11:57:52.839 INFO:tasks.workunit.client.0.smithi002.stdout:3/736: mknod d9/d1b/cec 0 2023-12-17T11:57:52.840 INFO:tasks.workunit.client.1.smithi119.stdout:9/768: truncate d12/d1d/f31 6930209 0 2023-12-17T11:57:52.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/698: read d0/d1/f96 [1627600,11837] 0 2023-12-17T11:57:52.840 INFO:tasks.workunit.client.0.smithi002.stdout:6/699: dread - d0/d1/dc/d58/dae/ddb/fd0 zero size 2023-12-17T11:57:52.841 INFO:tasks.workunit.client.0.smithi002.stdout:4/654: rmdir d0/d3e/d47 39 2023-12-17T11:57:52.844 INFO:tasks.workunit.client.1.smithi119.stdout:5/757: creat d1/da7/d71/ff8 x:0 0 0 2023-12-17T11:57:52.847 INFO:tasks.workunit.client.0.smithi002.stdout:6/700: creat d0/d1/d28/fe9 x:0 0 0 2023-12-17T11:57:52.847 INFO:tasks.workunit.client.0.smithi002.stdout:6/701: fsync d0/d1/dc/d17/f79 0 2023-12-17T11:57:52.850 INFO:tasks.workunit.client.1.smithi119.stdout:4/692: mknod dd/d15/d16/d3d/dab/ce0 0 2023-12-17T11:57:52.853 INFO:tasks.workunit.client.0.smithi002.stdout:6/702: rename d0/d1/dc/d17/d67/d6c to d0/d1/dc/d17/d67/d6c/dea 22 2023-12-17T11:57:52.853 INFO:tasks.workunit.client.0.smithi002.stdout:6/703: chown d0/d1/dc/d17/d3c/f47 1531607098 1 2023-12-17T11:57:52.853 INFO:tasks.workunit.client.0.smithi002.stdout:4/655: rename d0/d3e/d47/ca9 to d0/d3e/d56/d65/cd3 0 2023-12-17T11:57:52.855 INFO:tasks.workunit.client.1.smithi119.stdout:7/713: link d2/d4/d11/d2c/f3a d2/d4/d11/d3c/fde 0 2023-12-17T11:57:52.855 INFO:tasks.workunit.client.0.smithi002.stdout:8/755: read d3/d8/f42 [587985,59140] 0 2023-12-17T11:57:52.857 INFO:tasks.workunit.client.1.smithi119.stdout:0/707: rmdir d2/d66/d2e/d44/d7b 39 2023-12-17T11:57:52.863 INFO:tasks.workunit.client.0.smithi002.stdout:6/704: getdents d0/d1/dc/d17/d67/d6c 0 2023-12-17T11:57:52.863 INFO:tasks.workunit.client.0.smithi002.stdout:6/705: chown d0/d1/dc/f8 4357 1 2023-12-17T11:57:52.865 INFO:tasks.workunit.client.1.smithi119.stdout:2/788: rename d6/d9/d52/d53/d55/d58/dba/ff6 to d6/f114 0 2023-12-17T11:57:52.869 INFO:tasks.workunit.client.0.smithi002.stdout:0/688: write d0/d6/d26/f35 [1512712,122635] 0 2023-12-17T11:57:52.869 INFO:tasks.workunit.client.0.smithi002.stdout:0/689: creat d0/d6/d26/d14/d6d/d7e/fdc x:0 0 0 2023-12-17T11:57:52.869 INFO:tasks.workunit.client.0.smithi002.stdout:4/656: unlink d0/d3e/d56/d65/d78/d85/la8 0 2023-12-17T11:57:52.870 INFO:tasks.workunit.client.1.smithi119.stdout:4/693: truncate dd/f94 4024313 0 2023-12-17T11:57:52.873 INFO:tasks.workunit.client.1.smithi119.stdout:1/677: dwrite d3/db/d26/fa4 [0,4194304] 0 2023-12-17T11:57:52.874 INFO:tasks.workunit.client.0.smithi002.stdout:8/756: creat d3/ffe x:0 0 0 2023-12-17T11:57:52.876 INFO:tasks.workunit.client.0.smithi002.stdout:9/796: dread dc/d1d/d25/d85/dc2/ddd/dfa/ff5 [0,4194304] 0 2023-12-17T11:57:52.876 INFO:tasks.workunit.client.0.smithi002.stdout:6/706: rmdir d0/d1/d21/d56/d60 39 2023-12-17T11:57:52.877 INFO:tasks.workunit.client.1.smithi119.stdout:7/714: symlink d2/d4/d11/d2c/d68/d99/d6c/ldf 0 2023-12-17T11:57:52.877 INFO:tasks.workunit.client.1.smithi119.stdout:5/758: getdents d1/da7/d71/d76/d83/dd1 0 2023-12-17T11:57:52.882 INFO:tasks.workunit.client.1.smithi119.stdout:0/708: rename d2/d16/d35/d39/f99 to d2/d66/d2e/d44/d7b/fd4 0 2023-12-17T11:57:52.883 INFO:tasks.workunit.client.1.smithi119.stdout:0/709: chown d2/d16/d35/d39/c95 1240 1 2023-12-17T11:57:52.883 INFO:tasks.workunit.client.1.smithi119.stdout:0/710: write d2/d66/fba [2455442,128922] 0 2023-12-17T11:57:52.885 INFO:tasks.workunit.client.0.smithi002.stdout:0/690: mkdir d0/d6/d26/d14/d19/d37/d62/db8/ddd 0 2023-12-17T11:57:52.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/657: mkdir d0/d10/d14/d27/d57/dd4 0 2023-12-17T11:57:52.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/658: readlink d0/d10/d14/d27/d57/l58 0 2023-12-17T11:57:52.886 INFO:tasks.workunit.client.0.smithi002.stdout:4/659: write d0/d3e/d56/d65/d78/f81 [386070,102566] 0 2023-12-17T11:57:52.888 INFO:tasks.workunit.client.1.smithi119.stdout:4/694: link dd/d15/d16/d5a/dbc/lbe dd/d15/d4f/le1 0 2023-12-17T11:57:52.889 INFO:tasks.workunit.client.0.smithi002.stdout:9/797: getdents dc/d1d/d25/d85/dc2/ddd/dfa/d47 0 2023-12-17T11:57:52.893 INFO:tasks.workunit.client.0.smithi002.stdout:6/707: truncate d0/d1/dc/d17/d67/f84 1007468 0 2023-12-17T11:57:52.894 INFO:tasks.workunit.client.0.smithi002.stdout:6/708: truncate d0/d1/d21/d56/d60/f6e 32518 0 2023-12-17T11:57:52.894 INFO:tasks.workunit.client.0.smithi002.stdout:3/737: dread d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:52.895 INFO:tasks.workunit.client.0.smithi002.stdout:4/660: mkdir d0/d3e/dc8/dcd/dd5 0 2023-12-17T11:57:52.896 INFO:tasks.workunit.client.1.smithi119.stdout:3/787: dwrite d9/da/df/d41/d33/f62 [0,4194304] 0 2023-12-17T11:57:52.899 INFO:tasks.workunit.client.0.smithi002.stdout:7/684: dwrite d6/d17/dc/f89 [0,4194304] 0 2023-12-17T11:57:52.902 INFO:tasks.workunit.client.1.smithi119.stdout:1/678: symlink d3/db/lf8 0 2023-12-17T11:57:52.908 INFO:tasks.workunit.client.1.smithi119.stdout:9/769: dwrite d12/d1d/d28/d46/d50/f5a [0,4194304] 0 2023-12-17T11:57:52.909 INFO:tasks.workunit.client.1.smithi119.stdout:8/608: dwrite d7/da/d11/faa [0,4194304] 0 2023-12-17T11:57:52.909 INFO:tasks.workunit.client.1.smithi119.stdout:9/770: creat d12/dca/ff8 x:0 0 0 2023-12-17T11:57:52.909 INFO:tasks.workunit.client.1.smithi119.stdout:9/771: fdatasync d12/fdf 0 2023-12-17T11:57:52.911 INFO:tasks.workunit.client.0.smithi002.stdout:6/709: dread d0/d1/dc/d17/d3c/fe5 [0,4194304] 0 2023-12-17T11:57:52.912 INFO:tasks.workunit.client.1.smithi119.stdout:5/759: mknod d1/da7/d71/d76/d83/cf9 0 2023-12-17T11:57:52.913 INFO:tasks.workunit.client.0.smithi002.stdout:3/738: creat d9/d1b/d35/d41/d59/d7c/fed x:0 0 0 2023-12-17T11:57:52.920 INFO:tasks.workunit.client.1.smithi119.stdout:0/711: symlink d2/d66/d2e/d44/d7b/d5/d3f/ld5 0 2023-12-17T11:57:52.920 INFO:tasks.workunit.client.0.smithi002.stdout:5/717: dwrite dc/d94/ded/d2d/dcf/f92 [0,4194304] 0 2023-12-17T11:57:52.920 INFO:tasks.workunit.client.0.smithi002.stdout:5/718: write dc/d17/d2f/d99/fba [3048475,101575] 0 2023-12-17T11:57:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/746: dwrite d3/d6/d9/d37/f65 [0,4194304] 0 2023-12-17T11:57:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/747: chown d3/d2f/d74/dbd/lb2 8073941 1 2023-12-17T11:57:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:1/748: chown d3/d6/d16/d28/fe8 29073748 1 2023-12-17T11:57:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:7/685: unlink d6/d81/c84 0 2023-12-17T11:57:52.921 INFO:tasks.workunit.client.0.smithi002.stdout:7/686: readlink d6/d17/dc/d13/d21/d2e/l55 0 2023-12-17T11:57:52.923 INFO:tasks.workunit.client.1.smithi119.stdout:4/695: symlink dd/d11/d26/d86/le2 0 2023-12-17T11:57:52.923 INFO:tasks.workunit.client.1.smithi119.stdout:2/789: dwrite d6/d9/d13/f32 [0,4194304] 0 2023-12-17T11:57:52.923 INFO:tasks.workunit.client.1.smithi119.stdout:2/790: dread - d6/d9/d52/d53/d55/d58/da5/f102 zero size 2023-12-17T11:57:52.928 INFO:tasks.workunit.client.0.smithi002.stdout:8/757: write d3/d8/d28/d31/d5a/f80 [4219702,108989] 0 2023-12-17T11:57:52.928 INFO:tasks.workunit.client.0.smithi002.stdout:6/710: creat d0/d1/dc/d17/dd6/feb x:0 0 0 2023-12-17T11:57:52.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/661: read d0/d10/d21/f2f [182333,14814] 0 2023-12-17T11:57:52.929 INFO:tasks.workunit.client.0.smithi002.stdout:4/662: creat d0/d5a/fd6 x:0 0 0 2023-12-17T11:57:52.930 INFO:tasks.workunit.client.1.smithi119.stdout:7/715: dwrite d2/d4/f47 [0,4194304] 0 2023-12-17T11:57:52.930 INFO:tasks.workunit.client.1.smithi119.stdout:7/716: write d2/d4/d11/d2c/d68/d98/fae [529111,70943] 0 2023-12-17T11:57:52.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/687: rename d6/d17/dc/d67/c23 to d6/d17/dc/d67/d8b/dbd/ccf 0 2023-12-17T11:57:52.934 INFO:tasks.workunit.client.0.smithi002.stdout:3/739: dread d9/d1b/d35/d41/d43/d4b/f57 [0,4194304] 0 2023-12-17T11:57:52.941 INFO:tasks.workunit.client.0.smithi002.stdout:8/758: mkdir d3/d7/d18/d74/dff 0 2023-12-17T11:57:52.941 INFO:tasks.workunit.client.0.smithi002.stdout:8/759: truncate d3/d7/d18/d74/d7b/fdc 612538 0 2023-12-17T11:57:52.950 INFO:tasks.workunit.client.0.smithi002.stdout:4/663: dread d0/d10/d14/f70 [0,4194304] 0 2023-12-17T11:57:52.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/688: dread d6/d17/dc/d8e/f96 [0,4194304] 0 2023-12-17T11:57:52.953 INFO:tasks.workunit.client.0.smithi002.stdout:3/740: creat d9/d15/d71/fee x:0 0 0 2023-12-17T11:57:52.958 INFO:tasks.workunit.client.1.smithi119.stdout:8/609: symlink d7/d18/d45/lc2 0 2023-12-17T11:57:52.968 INFO:tasks.workunit.client.1.smithi119.stdout:8/610: read d7/d18/f95 [996162,127122] 0 2023-12-17T11:57:52.972 INFO:tasks.workunit.client.0.smithi002.stdout:8/760: mkdir d3/dca/d100 0 2023-12-17T11:57:52.972 INFO:tasks.workunit.client.0.smithi002.stdout:8/761: dread - d3/d7/d18/d74/f82 zero size 2023-12-17T11:57:52.972 INFO:tasks.workunit.client.0.smithi002.stdout:1/749: dread d3/d6/d9/d30/f56 [0,4194304] 0 2023-12-17T11:57:52.976 INFO:tasks.workunit.client.1.smithi119.stdout:4/696: symlink dd/d11/d2d/d9c/d55/d81/da1/le3 0 2023-12-17T11:57:52.977 INFO:tasks.workunit.client.1.smithi119.stdout:2/791: link d6/d2b/d4b/ffe d6/d9/d13/d34/d70/dff/f115 0 2023-12-17T11:57:52.978 INFO:tasks.workunit.client.1.smithi119.stdout:2/792: stat d6/d2b/f87 0 2023-12-17T11:57:52.983 INFO:tasks.workunit.client.0.smithi002.stdout:9/798: dwrite dc/d32/faa [0,4194304] 0 2023-12-17T11:57:52.986 INFO:tasks.workunit.client.1.smithi119.stdout:9/772: dwrite d12/d1d/d28/d4d/d73/f74 [0,4194304] 0 2023-12-17T11:57:52.986 INFO:tasks.workunit.client.1.smithi119.stdout:5/760: rmdir d1/d70/d6b 39 2023-12-17T11:57:52.988 INFO:tasks.workunit.client.1.smithi119.stdout:0/712: dwrite d2/d16/d35/d74/fa7 [0,4194304] 0 2023-12-17T11:57:52.988 INFO:tasks.workunit.client.0.smithi002.stdout:7/689: mkdir d6/d17/dc/d67/d8b/dbd/d75/dd0 0 2023-12-17T11:57:52.989 INFO:tasks.workunit.client.0.smithi002.stdout:7/690: creat d6/d81/fd1 x:0 0 0 2023-12-17T11:57:52.989 INFO:tasks.workunit.client.1.smithi119.stdout:8/611: creat d7/d12/d23/d9c/fc3 x:0 0 0 2023-12-17T11:57:52.990 INFO:tasks.workunit.client.0.smithi002.stdout:8/762: creat d3/d7/d18/d3f/f101 x:0 0 0 2023-12-17T11:57:52.990 INFO:tasks.workunit.client.0.smithi002.stdout:8/763: write d3/d7/d18/d74/f79 [1055838,27808] 0 2023-12-17T11:57:52.990 INFO:tasks.workunit.client.0.smithi002.stdout:8/764: chown d3/d8/d28/d31/d5a 5216 1 2023-12-17T11:57:52.990 INFO:tasks.workunit.client.0.smithi002.stdout:8/765: creat d3/d8/da/d44/f102 x:0 0 0 2023-12-17T11:57:52.991 INFO:tasks.workunit.client.1.smithi119.stdout:1/679: dwrite d3/db/d26/fa4 [0,4194304] 0 2023-12-17T11:57:52.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/741: dread d9/d24/f51 [0,4194304] 0 2023-12-17T11:57:52.991 INFO:tasks.workunit.client.0.smithi002.stdout:3/742: chown d9/d1b/fe5 1655809 1 2023-12-17T11:57:52.995 INFO:tasks.workunit.client.1.smithi119.stdout:2/793: link d6/d2b/d3f/d5c/la4 d6/d2b/d4b/d5d/l116 0 2023-12-17T11:57:52.996 INFO:tasks.workunit.client.1.smithi119.stdout:3/788: dwrite d9/da/df/d41/d33/d3a/fc8 [4194304,4194304] 0 2023-12-17T11:57:52.997 INFO:tasks.workunit.client.1.smithi119.stdout:6/631: sync 2023-12-17T11:57:52.998 INFO:tasks.workunit.client.1.smithi119.stdout:1/680: dread d3/db/d17/d24/d20/dba/dbc/d7e/da1/fb5 [0,4194304] 0 2023-12-17T11:57:52.998 INFO:tasks.workunit.client.1.smithi119.stdout:1/681: creat d3/db/d26/d19/ff9 x:0 0 0 2023-12-17T11:57:53.000 INFO:tasks.workunit.client.0.smithi002.stdout:7/691: rmdir d6/d17/dc/d67/d8b/dbd 39 2023-12-17T11:57:53.000 INFO:tasks.workunit.client.0.smithi002.stdout:7/692: fsync d6/d17/dc/d13/f30 0 2023-12-17T11:57:53.000 INFO:tasks.workunit.client.0.smithi002.stdout:7/693: write d6/d17/dc/f76 [264939,50213] 0 2023-12-17T11:57:53.000 INFO:tasks.workunit.client.1.smithi119.stdout:9/773: rmdir d12/d1d/d28/d4d/d73/d78 39 2023-12-17T11:57:53.000 INFO:tasks.workunit.client.1.smithi119.stdout:9/774: write d12/d1d/d28/f87 [1488085,97177] 0 2023-12-17T11:57:53.002 INFO:tasks.workunit.client.1.smithi119.stdout:5/761: creat d1/d70/d6b/d77/dae/dba/de3/d86/dda/ffa x:0 0 0 2023-12-17T11:57:53.002 INFO:tasks.workunit.client.1.smithi119.stdout:5/762: truncate d1/d70/d6b/d77/dae/fd6 933191 0 2023-12-17T11:57:53.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/743: link d9/d1b/d4f/d88/fb3 d9/d1b/d35/d41/d59/fef 0 2023-12-17T11:57:53.009 INFO:tasks.workunit.client.0.smithi002.stdout:5/719: dwrite dc/d1a/d47/f4a [0,4194304] 0 2023-12-17T11:57:53.009 INFO:tasks.workunit.client.0.smithi002.stdout:5/720: fdatasync f8 0 2023-12-17T11:57:53.010 INFO:tasks.workunit.client.1.smithi119.stdout:0/713: mknod d2/d66/cd6 0 2023-12-17T11:57:53.010 INFO:tasks.workunit.client.1.smithi119.stdout:0/714: chown d2/d66/d1f/d24/d50/d5d/d80/c9f 145949110 1 2023-12-17T11:57:53.017 INFO:tasks.workunit.client.1.smithi119.stdout:4/697: getdents dd/d15/d16/d5a/dbc 0 2023-12-17T11:57:53.017 INFO:tasks.workunit.client.1.smithi119.stdout:4/698: read - dd/d15/d16/d5a/fcf zero size 2023-12-17T11:57:53.026 INFO:tasks.workunit.client.1.smithi119.stdout:8/612: rmdir d7/d18 39 2023-12-17T11:57:53.028 INFO:tasks.workunit.client.1.smithi119.stdout:2/794: creat d6/d2b/f117 x:0 0 0 2023-12-17T11:57:53.028 INFO:tasks.workunit.client.1.smithi119.stdout:2/795: creat d6/d2b/da3/f118 x:0 0 0 2023-12-17T11:57:53.030 INFO:tasks.workunit.client.1.smithi119.stdout:3/789: rename d9/d11/d1e/d55/d77/faa to d9/d11/d1e/d9f/f12a 0 2023-12-17T11:57:53.034 INFO:tasks.workunit.client.1.smithi119.stdout:1/682: symlink d3/db/d17/d24/d20/dbd/dcb/lfa 0 2023-12-17T11:57:53.038 INFO:tasks.workunit.client.1.smithi119.stdout:9/775: symlink d12/d1d/d28/d86/d8f/lf9 0 2023-12-17T11:57:53.046 INFO:tasks.workunit.client.1.smithi119.stdout:5/763: symlink d1/d70/da3/lfb 0 2023-12-17T11:57:53.046 INFO:tasks.workunit.client.1.smithi119.stdout:0/715: link d2/d66/l29 d2/d66/d1f/d24/ld7 0 2023-12-17T11:57:53.048 INFO:tasks.workunit.client.1.smithi119.stdout:4/699: mknod dd/d11/d2d/d9c/d55/d81/db8/dbd/dd4/ce4 0 2023-12-17T11:57:53.049 INFO:tasks.workunit.client.0.smithi002.stdout:5/721: dread f8 [4194304,4194304] 0 2023-12-17T11:57:53.053 INFO:tasks.workunit.client.1.smithi119.stdout:6/632: dwrite d2/df/d17/f64 [0,4194304] 0 2023-12-17T11:57:53.054 INFO:tasks.workunit.client.0.smithi002.stdout:9/799: dwrite dc/d1d/d7c/d90/dc0/fc8 [0,4194304] 0 2023-12-17T11:57:53.054 INFO:tasks.workunit.client.0.smithi002.stdout:9/800: write dc/d42/f107 [999150,68234] 0 2023-12-17T11:57:53.056 INFO:tasks.workunit.client.0.smithi002.stdout:5/722: creat dc/d94/ded/d75/fff x:0 0 0 2023-12-17T11:57:53.062 INFO:tasks.workunit.client.0.smithi002.stdout:6/711: dwrite d0/d1/dc/d10/f98 [0,4194304] 0 2023-12-17T11:57:53.063 INFO:tasks.workunit.client.1.smithi119.stdout:8/613: link d7/da/d11/l4d d7/d18/d15/d81/da2/lc4 0 2023-12-17T11:57:53.063 INFO:tasks.workunit.client.1.smithi119.stdout:8/614: truncate d7/da/d1a/f66 671795 0 2023-12-17T11:57:53.064 INFO:tasks.workunit.client.1.smithi119.stdout:8/615: chown d7/d18/d45/d9f 109 1 2023-12-17T11:57:53.064 INFO:tasks.workunit.client.0.smithi002.stdout:9/801: mknod dc/d42/d4f/d9e/d104/c121 0 2023-12-17T11:57:53.066 INFO:tasks.workunit.client.1.smithi119.stdout:2/796: creat d6/d9/d86/f119 x:0 0 0 2023-12-17T11:57:53.066 INFO:tasks.workunit.client.0.smithi002.stdout:5/723: truncate dc/d17/d2f/d99/fba 2104359 0 2023-12-17T11:57:53.067 INFO:tasks.workunit.client.1.smithi119.stdout:1/683: creat d3/db/d17/d24/d20/d40/d76/d84/ffb x:0 0 0 2023-12-17T11:57:53.067 INFO:tasks.workunit.client.1.smithi119.stdout:0/716: creat d2/d66/fd8 x:0 0 0 2023-12-17T11:57:53.068 INFO:tasks.workunit.client.1.smithi119.stdout:9/776: write ff [172231,50166] 0 2023-12-17T11:57:53.068 INFO:tasks.workunit.client.1.smithi119.stdout:9/777: chown d12/d1d/d28/f3a 4806 1 2023-12-17T11:57:53.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/802: dread dc/d42/da0/f119 [0,4194304] 0 2023-12-17T11:57:53.072 INFO:tasks.workunit.client.0.smithi002.stdout:9/803: write dc/d1d/d25/d85/dc2/ddd/dfa/f11f [945798,36409] 0 2023-12-17T11:57:53.075 INFO:tasks.workunit.client.0.smithi002.stdout:3/744: write d9/f1e [2879638,30862] 0 2023-12-17T11:57:53.077 INFO:tasks.workunit.client.1.smithi119.stdout:8/616: mkdir d7/d18/d15/d64/dc5 0 2023-12-17T11:57:53.080 INFO:tasks.workunit.client.1.smithi119.stdout:2/797: rename d6/d9/d13/d34/d88/c8f to d6/d9/d52/d74/c11a 0 2023-12-17T11:57:53.080 INFO:tasks.workunit.client.1.smithi119.stdout:2/798: chown d6/d2b/d3f/d5c/l6c 901580362 1 2023-12-17T11:57:53.081 INFO:tasks.workunit.client.1.smithi119.stdout:1/684: truncate d3/db/d17/d24/d20/d40/f5a 3092614 0 2023-12-17T11:57:53.083 INFO:tasks.workunit.client.0.smithi002.stdout:1/750: dwrite d3/d2f/f48 [0,4194304] 0 2023-12-17T11:57:53.083 INFO:tasks.workunit.client.1.smithi119.stdout:6/633: dread d2/df/d17/d79/f8c [0,4194304] 0 2023-12-17T11:57:53.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/766: dwrite d3/d8/da/f46 [0,4194304] 0 2023-12-17T11:57:53.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/767: truncate d3/d8/da/fa6 294512 0 2023-12-17T11:57:53.086 INFO:tasks.workunit.client.0.smithi002.stdout:8/768: write d3/d7/d18/fdb [277834,51083] 0 2023-12-17T11:57:53.087 INFO:tasks.workunit.client.0.smithi002.stdout:8/769: truncate d3/d7/d6e/fd1 18868 0 2023-12-17T11:57:53.087 INFO:tasks.workunit.client.0.smithi002.stdout:8/770: write d3/d7/d1a/f6a [3255061,50243] 0 2023-12-17T11:57:53.087 INFO:tasks.workunit.client.0.smithi002.stdout:9/804: truncate dc/d32/f35 612052 0 2023-12-17T11:57:53.088 INFO:tasks.workunit.client.0.smithi002.stdout:3/745: symlink d9/d24/d6f/lf0 0 2023-12-17T11:57:53.089 INFO:tasks.workunit.client.0.smithi002.stdout:3/746: write d9/d1b/fe5 [738372,129392] 0 2023-12-17T11:57:53.089 INFO:tasks.workunit.client.0.smithi002.stdout:3/747: fdatasync d9/d15/d52/d79/dab/fdb 0 2023-12-17T11:57:53.090 INFO:tasks.workunit.client.0.smithi002.stdout:7/694: dwrite d6/d99/f9c [0,4194304] 0 2023-12-17T11:57:53.090 INFO:tasks.workunit.client.0.smithi002.stdout:7/695: write d6/d17/f65 [4775794,117798] 0 2023-12-17T11:57:53.091 INFO:tasks.workunit.client.0.smithi002.stdout:7/696: readlink d6/d81/lbc 0 2023-12-17T11:57:53.091 INFO:tasks.workunit.client.0.smithi002.stdout:8/771: creat d3/d8/da/dd/f103 x:0 0 0 2023-12-17T11:57:53.092 INFO:tasks.workunit.client.1.smithi119.stdout:9/778: unlink d12/d1d/d28/d46/d50/f5a 0 2023-12-17T11:57:53.092 INFO:tasks.workunit.client.1.smithi119.stdout:3/790: dwrite d9/da/df/d67/f89 [0,4194304] 0 2023-12-17T11:57:53.092 INFO:tasks.workunit.client.1.smithi119.stdout:2/799: mkdir d6/d2b/d4b/d11b 0 2023-12-17T11:57:53.092 INFO:tasks.workunit.client.1.smithi119.stdout:2/800: truncate d6/d9/d13/d1d/f10f 4221629 0 2023-12-17T11:57:53.092 INFO:tasks.workunit.client.1.smithi119.stdout:1/685: stat d3/db/d26/d19/cc1 0 2023-12-17T11:57:53.095 INFO:tasks.workunit.client.1.smithi119.stdout:6/634: rename d2/d7e/lae to d2/d2b/d43/d5e/db3/lc4 0 2023-12-17T11:57:53.095 INFO:tasks.workunit.client.1.smithi119.stdout:6/635: creat d2/df/d17/d79/fc5 x:0 0 0 2023-12-17T11:57:53.095 INFO:tasks.workunit.client.1.smithi119.stdout:6/636: chown d2/d61/f94 29 1 2023-12-17T11:57:53.100 INFO:tasks.workunit.client.0.smithi002.stdout:7/697: mkdir d6/d17/dc/d67/d8b/dbd/d75/dd0/dd2 0 2023-12-17T11:57:53.100 INFO:tasks.workunit.client.0.smithi002.stdout:7/698: getdents d6/d17/dc/d67/d8b/dbd/dce 0 2023-12-17T11:57:53.103 INFO:tasks.workunit.client.0.smithi002.stdout:8/772: unlink d3/d8/d28/d31/fc6 0 2023-12-17T11:57:53.103 INFO:tasks.workunit.client.0.smithi002.stdout:8/773: dread - d3/d7/d18/d3f/f86 zero size 2023-12-17T11:57:53.103 INFO:tasks.workunit.client.1.smithi119.stdout:3/791: unlink d9/d11/c36 0 2023-12-17T11:57:53.103 INFO:tasks.workunit.client.1.smithi119.stdout:3/792: truncate d9/d59/f115 86546 0 2023-12-17T11:57:53.105 INFO:tasks.workunit.client.0.smithi002.stdout:4/664: dwrite d0/d5a/f76 [0,4194304] 0 2023-12-17T11:57:53.107 INFO:tasks.workunit.client.1.smithi119.stdout:3/793: write d9/da/df/f15 [8329273,117000] 0 2023-12-17T11:57:53.107 INFO:tasks.workunit.client.1.smithi119.stdout:4/700: dread dd/d11/d26/f9f [0,4194304] 0 2023-12-17T11:57:53.107 INFO:tasks.workunit.client.1.smithi119.stdout:4/701: write dd/d15/d16/d20/d82/fa5 [515052,90688] 0 2023-12-17T11:57:53.107 INFO:tasks.workunit.client.1.smithi119.stdout:4/702: chown dd/d11/d2d/lc6 239213 1 2023-12-17T11:57:53.107 INFO:tasks.workunit.client.1.smithi119.stdout:5/764: dwrite d1/d25/f7e [4194304,4194304] 0 2023-12-17T11:57:53.109 INFO:tasks.workunit.client.0.smithi002.stdout:3/748: write d9/d1b/d35/d41/d59/d65/f69 [1736710,82384] 0 2023-12-17T11:57:53.110 INFO:tasks.workunit.client.0.smithi002.stdout:7/699: unlink d6/d17/dc/c32 0 2023-12-17T11:57:53.110 INFO:tasks.workunit.client.0.smithi002.stdout:7/700: dread - d6/d17/dc/d13/d21/d2e/d4a/daf/db1/fb4 zero size 2023-12-17T11:57:53.110 INFO:tasks.workunit.client.0.smithi002.stdout:7/701: creat d6/d17/dc/d13/d37/fd3 x:0 0 0 2023-12-17T11:57:53.110 INFO:tasks.workunit.client.1.smithi119.stdout:1/686: unlink d3/db/d17/d24/d20/d40/c93 0 2023-12-17T11:57:53.112 INFO:tasks.workunit.client.0.smithi002.stdout:8/774: rename d3/d7/d18/fdb to d3/d7/d18/d74/d7b/f104 0 2023-12-17T11:57:53.118 INFO:tasks.workunit.client.1.smithi119.stdout:2/801: rename d6/d9/d13/d1d/dbf to d6/d2b/d4b/d5d/d11c 0 2023-12-17T11:57:53.118 INFO:tasks.workunit.client.1.smithi119.stdout:2/802: readlink d6/d2b/l80 0 2023-12-17T11:57:53.118 INFO:tasks.workunit.client.1.smithi119.stdout:2/803: chown d6/d9/d13/d34/c9e 0 1 2023-12-17T11:57:53.118 INFO:tasks.workunit.client.1.smithi119.stdout:2/804: fdatasync d6/d9/d13/d34/f64 0 2023-12-17T11:57:53.119 INFO:tasks.workunit.client.0.smithi002.stdout:9/805: dread dc/d1d/d7c/fab [0,4194304] 0 2023-12-17T11:57:53.119 INFO:tasks.workunit.client.0.smithi002.stdout:9/806: dread - dc/d42/f8c zero size 2023-12-17T11:57:53.119 INFO:tasks.workunit.client.0.smithi002.stdout:9/807: chown dc/d42/da0/d72/d93/f2e 978181812 1 2023-12-17T11:57:53.120 INFO:tasks.workunit.client.0.smithi002.stdout:9/808: readlink dc/d1d/d25/l87 0 2023-12-17T11:57:53.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/805: creat d6/d2b/da3/f11d x:0 0 0 2023-12-17T11:57:53.120 INFO:tasks.workunit.client.1.smithi119.stdout:2/806: truncate d6/d9/d13/d34/ff3 4606230 0 2023-12-17T11:57:53.122 INFO:tasks.workunit.client.0.smithi002.stdout:6/712: dwrite d0/d1/dc/d17/f91 [0,4194304] 0 2023-12-17T11:57:53.123 INFO:tasks.workunit.client.1.smithi119.stdout:4/703: mknod dd/d15/d16/d20/ce5 0 2023-12-17T11:57:53.130 INFO:tasks.workunit.client.1.smithi119.stdout:9/779: write d12/d1d/d49/ddb/df3/ff4 [1625633,99911] 0 2023-12-17T11:57:53.135 INFO:tasks.workunit.client.1.smithi119.stdout:5/765: unlink d1/da7/d71/d97/fa9 0 2023-12-17T11:57:53.135 INFO:tasks.workunit.client.1.smithi119.stdout:5/766: fsync d1/d25/f46 0 2023-12-17T11:57:53.135 INFO:tasks.workunit.client.1.smithi119.stdout:5/767: fsync d1/d70/d6b/fd2 0 2023-12-17T11:57:53.142 INFO:tasks.workunit.client.1.smithi119.stdout:2/807: symlink d6/d2b/d3f/d5c/l11e 0 2023-12-17T11:57:53.142 INFO:tasks.workunit.client.1.smithi119.stdout:2/808: chown d6/d9/d13/d34/d88 99865 1 2023-12-17T11:57:53.142 INFO:tasks.workunit.client.1.smithi119.stdout:4/704: dread dd/d15/d16/f1a [0,4194304] 0 2023-12-17T11:57:53.142 INFO:tasks.workunit.client.1.smithi119.stdout:4/705: chown dd/d15/d16/d3d/f7c 148795 1 2023-12-17T11:57:53.144 INFO:tasks.workunit.client.0.smithi002.stdout:5/724: dwrite dc/d1a/d53/da9/fb9 [0,4194304] 0 2023-12-17T11:57:53.147 INFO:tasks.workunit.client.1.smithi119.stdout:4/706: read dd/d11/d2d/fb4 [125793,81413] 0 2023-12-17T11:57:53.148 INFO:tasks.workunit.client.1.smithi119.stdout:3/794: dread d9/d35/dbd/dfb/d107/f121 [0,4194304] 0 2023-12-17T11:57:53.148 INFO:tasks.workunit.client.1.smithi119.stdout:3/795: write d9/d11/d1e/d55/d77/dcd/f124 [866370,92002] 0 2023-12-17T11:57:53.150 INFO:tasks.workunit.client.0.smithi002.stdout:2/705: sync 2023-12-17T11:57:53.152 INFO:tasks.workunit.client.0.smithi002.stdout:1/751: dwrite d3/d6/d9/d37/fe4 [0,4194304] 0 2023-12-17T11:57:53.153 INFO:tasks.workunit.client.1.smithi119.stdout:0/717: dwrite d2/d16/d35/d39/f9e [0,4194304] 0 2023-12-17T11:57:53.153 INFO:tasks.workunit.client.1.smithi119.stdout:6/637: dwrite d2/df/d17/f77 [0,4194304] 0 2023-12-17T11:57:53.154 INFO:tasks.workunit.client.0.smithi002.stdout:4/665: link d0/d10/d14/ld0 d0/d3e/d56/ld7 0 2023-12-17T11:57:53.158 INFO:tasks.workunit.client.0.smithi002.stdout:3/749: creat d9/d1b/d35/d41/d59/d65/da9/ff1 x:0 0 0 2023-12-17T11:57:53.158 INFO:tasks.workunit.client.0.smithi002.stdout:3/750: creat d9/d15/d52/ff2 x:0 0 0 2023-12-17T11:57:53.159 INFO:tasks.workunit.client.1.smithi119.stdout:5/768: dread d1/d36/f47 [4194304,4194304] 0 2023-12-17T11:57:53.161 INFO:tasks.workunit.client.1.smithi119.stdout:9/780: unlink d12/d1d/d28/d46/d50/c53 0 2023-12-17T11:57:53.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/702: creat d6/d17/dc/d13/d3e/fd4 x:0 0 0 2023-12-17T11:57:53.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/703: write d6/d17/f65 [3215158,32334] 0 2023-12-17T11:57:53.169 INFO:tasks.workunit.client.0.smithi002.stdout:8/775: rename d3/d8/da/dd/cd7 to d3/d8/da/dd/db0/c105 0 2023-12-17T11:57:53.169 INFO:tasks.workunit.client.0.smithi002.stdout:8/776: write d3/d8/d28/d31/d5a/d7c/f7e [757297,39175] 0 2023-12-17T11:57:53.171 INFO:tasks.workunit.client.1.smithi119.stdout:2/809: creat d6/d9/f11f x:0 0 0 2023-12-17T11:57:53.172 INFO:tasks.workunit.client.0.smithi002.stdout:2/706: dread d3/d4/d7/d14/d42/f47 [0,4194304] 0 2023-12-17T11:57:53.173 INFO:tasks.workunit.client.1.smithi119.stdout:6/638: dread d2/f2e [0,4194304] 0 2023-12-17T11:57:53.174 INFO:tasks.workunit.client.0.smithi002.stdout:9/809: mknod dc/d1d/d25/d85/dc2/ddd/dfa/d47/c122 0 2023-12-17T11:57:53.176 INFO:tasks.workunit.client.0.smithi002.stdout:6/713: link d0/d1/d6d/l6f d0/d1/dc/lec 0 2023-12-17T11:57:53.182 INFO:tasks.workunit.client.1.smithi119.stdout:3/796: rename d9/d11/d1e/d55/d65/f99 to d9/d35/dbd/dfb/d107/dd3/f12b 0 2023-12-17T11:57:53.182 INFO:tasks.workunit.client.1.smithi119.stdout:3/797: readlink d9/da/df/d41/l47 0 2023-12-17T11:57:53.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/725: symlink dc/l100 0 2023-12-17T11:57:53.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/726: fsync dc/d94/ded/d5a/d96/d6c/fb5 0 2023-12-17T11:57:53.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/727: creat dc/d94/f101 x:0 0 0 2023-12-17T11:57:53.190 INFO:tasks.workunit.client.0.smithi002.stdout:5/728: stat dc/l8f 0 2023-12-17T11:57:53.191 INFO:tasks.workunit.client.0.smithi002.stdout:5/729: readlink dc/d1a/d47/l7f 0 2023-12-17T11:57:53.191 INFO:tasks.workunit.client.1.smithi119.stdout:2/810: dread d6/d2b/d4b/f77 [4194304,4194304] 0 2023-12-17T11:57:53.205 INFO:tasks.workunit.client.1.smithi119.stdout:0/718: creat d2/d16/d35/d74/fd9 x:0 0 0 2023-12-17T11:57:53.205 INFO:tasks.workunit.client.1.smithi119.stdout:0/719: fdatasync d2/d66/fb6 0 2023-12-17T11:57:53.206 INFO:tasks.workunit.client.0.smithi002.stdout:1/752: truncate d3/d5c/fd5 2930818 0 2023-12-17T11:57:53.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/707: dwrite dd/f18 [0,4194304] 0 2023-12-17T11:57:53.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/708: chown dd/d11/d2d/d9c/d55/d81/da1/lad 7186563 1 2023-12-17T11:57:53.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/709: readlink dd/d11/d2d/d9c/d55/d81/da1/le3 0 2023-12-17T11:57:53.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/710: dread - dd/d15/d16/d5a/fcf zero size 2023-12-17T11:57:53.209 INFO:tasks.workunit.client.1.smithi119.stdout:5/769: creat d1/da7/d71/d97/ffc x:0 0 0 2023-12-17T11:57:53.209 INFO:tasks.workunit.client.1.smithi119.stdout:5/770: fdatasync d1/d36/f4e 0 2023-12-17T11:57:53.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/751: dwrite d9/d15/d52/ff2 [0,4194304] 0 2023-12-17T11:57:53.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/752: write d9/d1b/d35/d41/d59/d7c/fed [19020,105901] 0 2023-12-17T11:57:53.210 INFO:tasks.workunit.client.0.smithi002.stdout:3/753: chown d9/d1b/f5e 708 1 2023-12-17T11:57:53.213 INFO:tasks.workunit.client.1.smithi119.stdout:9/781: symlink d12/d1d/d28/d46/d50/d92/daf/lfa 0 2023-12-17T11:57:53.213 INFO:tasks.workunit.client.1.smithi119.stdout:9/782: dread - d12/f97 zero size 2023-12-17T11:57:53.216 INFO:tasks.workunit.client.1.smithi119.stdout:6/639: creat d2/d2b/d43/d76/d8d/dc2/fc6 x:0 0 0 2023-12-17T11:57:53.218 INFO:tasks.workunit.client.0.smithi002.stdout:7/704: mkdir d6/d17/dc/d13/d21/d2e/dd5 0 2023-12-17T11:57:53.218 INFO:tasks.workunit.client.0.smithi002.stdout:7/705: chown d6/d17/dc/d67 26831034 1 2023-12-17T11:57:53.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/753: dread d3/d6/d9/d30/f41 [0,4194304] 0 2023-12-17T11:57:53.218 INFO:tasks.workunit.client.0.smithi002.stdout:1/754: getdents d3/d6/d9/d37/d39/d43/d8f/dea 0 2023-12-17T11:57:53.220 INFO:tasks.workunit.client.1.smithi119.stdout:3/798: truncate d9/d35/f5e 832572 0 2023-12-17T11:57:53.220 INFO:tasks.workunit.client.0.smithi002.stdout:3/754: dread d9/d24/d6f/fb6 [0,4194304] 0 2023-12-17T11:57:53.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:53 smithi002 ceph-mon[107131]: pgmap v29: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 278 MiB/s rd, 349 MiB/s wr, 479 op/s 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/783: dread d12/dca/dbd/fc2 [0,4194304] 0 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/784: chown d12/d1d/d28/d86/d8f 22019597 1 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/785: chown d12/d1d/d28/d4d/d73/d78 0 1 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/786: write d12/d1d/d28/d4d/f7a [394942,12761] 0 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/787: dread - d12/f82 zero size 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:9/788: truncate d12/d1d/d28/d46/d50/d92/dae/fe7 157519 0 2023-12-17T11:57:53.229 INFO:tasks.workunit.client.1.smithi119.stdout:6/640: write d2/df/d17/d79/f8c [810321,23414] 0 2023-12-17T11:57:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/777: mkdir d3/d8/d28/d31/d5a/d106 0 2023-12-17T11:57:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/778: fdatasync d3/d7/d6e/d7f/f54 0 2023-12-17T11:57:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/779: dread - d3/d8/da/fb9 zero size 2023-12-17T11:57:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:8/780: write d3/d7/d18/d3f/d49/f52 [3825416,106527] 0 2023-12-17T11:57:53.230 INFO:tasks.workunit.client.0.smithi002.stdout:0/691: sync 2023-12-17T11:57:53.232 INFO:tasks.workunit.client.0.smithi002.stdout:9/810: rename dc/d42/da0/f58 to dc/d42/d4f/dd5/f123 0 2023-12-17T11:57:53.233 INFO:tasks.workunit.client.1.smithi119.stdout:4/711: rmdir dd/d4b/d6a 39 2023-12-17T11:57:53.233 INFO:tasks.workunit.client.1.smithi119.stdout:4/712: write dd/d4b/f87 [306382,6437] 0 2023-12-17T11:57:53.233 INFO:tasks.workunit.client.1.smithi119.stdout:4/713: read - dd/d15/d16/d5a/fcf zero size 2023-12-17T11:57:53.234 INFO:tasks.workunit.client.0.smithi002.stdout:6/714: creat d0/d1/dc/fed x:0 0 0 2023-12-17T11:57:53.235 INFO:tasks.workunit.client.1.smithi119.stdout:5/771: mkdir d1/d70/d85/d95/dc3/dfd 0 2023-12-17T11:57:53.238 INFO:tasks.workunit.client.1.smithi119.stdout:3/799: write d9/da/f18 [684798,92510] 0 2023-12-17T11:57:53.242 INFO:tasks.workunit.client.0.smithi002.stdout:5/730: creat dc/d94/ded/dad/f102 x:0 0 0 2023-12-17T11:57:53.243 INFO:tasks.workunit.client.1.smithi119.stdout:9/789: rmdir d12/d65 39 2023-12-17T11:57:53.243 INFO:tasks.workunit.client.1.smithi119.stdout:5/772: write d1/da7/d71/d76/d83/fb8 [365099,83596] 0 2023-12-17T11:57:53.243 INFO:tasks.workunit.client.1.smithi119.stdout:5/773: dread - d1/d36/d3a/fd7 zero size 2023-12-17T11:57:53.243 INFO:tasks.workunit.client.1.smithi119.stdout:5/774: fdatasync d1/f1a 0 2023-12-17T11:57:53.243 INFO:tasks.workunit.client.1.smithi119.stdout:6/641: write d2/d2b/d43/d5e/f70 [3880226,106424] 0 2023-12-17T11:57:53.250 INFO:tasks.workunit.client.1.smithi119.stdout:4/714: creat dd/d11/d2d/d9c/d55/d81/d88/d91/fe6 x:0 0 0 2023-12-17T11:57:53.251 INFO:tasks.workunit.client.0.smithi002.stdout:7/706: mknod d6/d17/dc/cd6 0 2023-12-17T11:57:53.255 INFO:tasks.workunit.client.1.smithi119.stdout:3/800: write d9/d44/fc1 [1469263,42441] 0 2023-12-17T11:57:53.256 INFO:tasks.workunit.client.0.smithi002.stdout:1/755: mknod d3/d6/d16/d9f/cfa 0 2023-12-17T11:57:53.259 INFO:tasks.workunit.client.1.smithi119.stdout:5/775: write d1/d36/f3d [2804275,21985] 0 2023-12-17T11:57:53.260 INFO:tasks.workunit.client.1.smithi119.stdout:9/790: link d12/d1d/d28/f87 d12/d1d/d28/d4d/d73/d78/d8b/ffb 0 2023-12-17T11:57:53.266 INFO:tasks.workunit.client.0.smithi002.stdout:3/755: mkdir d9/d1b/d35/df3 0 2023-12-17T11:57:53.266 INFO:tasks.workunit.client.0.smithi002.stdout:8/781: rmdir d3/d8/d28/d31/d5a/d7c 39 2023-12-17T11:57:53.266 INFO:tasks.workunit.client.0.smithi002.stdout:8/782: write d3/d8/da/dd/f5f [4398759,50814] 0 2023-12-17T11:57:53.267 INFO:tasks.workunit.client.1.smithi119.stdout:7/717: sync 2023-12-17T11:57:53.267 INFO:tasks.workunit.client.1.smithi119.stdout:7/718: chown d2/d4/c44 67 1 2023-12-17T11:57:53.267 INFO:tasks.workunit.client.1.smithi119.stdout:7/719: readlink d2/d40/lcd 0 2023-12-17T11:57:53.267 INFO:tasks.workunit.client.1.smithi119.stdout:0/720: dwrite d2/d66/d2e/f75 [0,4194304] 0 2023-12-17T11:57:53.269 INFO:tasks.workunit.client.1.smithi119.stdout:5/776: getdents d1/d70/d6b/d77/dae 0 2023-12-17T11:57:53.270 INFO:tasks.workunit.client.0.smithi002.stdout:0/692: link d0/d6/d26/d8f/ld5 d0/d6/d26/d14/d90/d64/lde 0 2023-12-17T11:57:53.272 INFO:tasks.workunit.client.1.smithi119.stdout:9/791: rename d12/d1d/d28/d4d/d73/d78/d8b/ffb to d12/d1d/d79/ffc 0 2023-12-17T11:57:53.272 INFO:tasks.workunit.client.1.smithi119.stdout:7/720: dread d2/d4/d11/d2c/d68/f85 [0,4194304] 0 2023-12-17T11:57:53.276 INFO:tasks.workunit.client.0.smithi002.stdout:9/811: rename dc/d1d/fe8 to dc/d1d/d25/f124 0 2023-12-17T11:57:53.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/812: fdatasync dc/d42/da0/d72/d93/dd0/dd4/f11e 0 2023-12-17T11:57:53.277 INFO:tasks.workunit.client.0.smithi002.stdout:8/783: rename d3/d8/d28/d31/d5a/d106 to d3/d8/d28/d31/d5a/d106/d107 22 2023-12-17T11:57:53.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/813: creat dc/d1d/d7c/d90/dc0/f125 x:0 0 0 2023-12-17T11:57:53.281 INFO:tasks.workunit.client.1.smithi119.stdout:8/617: sync 2023-12-17T11:57:53.281 INFO:tasks.workunit.client.1.smithi119.stdout:8/618: readlink d7/d12/l2d 0 2023-12-17T11:57:53.281 INFO:tasks.workunit.client.1.smithi119.stdout:8/619: readlink d7/d18/lae 0 2023-12-17T11:57:53.284 INFO:tasks.workunit.client.1.smithi119.stdout:3/801: truncate d9/da/df/d41/d33/d3a/f40 1668798 0 2023-12-17T11:57:53.287 INFO:tasks.workunit.client.0.smithi002.stdout:6/715: creat d0/d1/dc/d17/d67/d6c/d7f/fee x:0 0 0 2023-12-17T11:57:53.287 INFO:tasks.workunit.client.1.smithi119.stdout:6/642: dwrite d2/df/d17/d79/f96 [0,4194304] 0 2023-12-17T11:57:53.288 INFO:tasks.workunit.client.1.smithi119.stdout:4/715: dread dd/f28 [0,4194304] 0 2023-12-17T11:57:53.291 INFO:tasks.workunit.client.1.smithi119.stdout:0/721: mknod d2/d66/dbb/cda 0 2023-12-17T11:57:53.295 INFO:tasks.workunit.client.1.smithi119.stdout:7/721: mknod d2/d4/d11/d2c/d68/d98/ce0 0 2023-12-17T11:57:53.295 INFO:tasks.workunit.client.1.smithi119.stdout:7/722: write d2/f10 [4773541,114159] 0 2023-12-17T11:57:53.296 INFO:tasks.workunit.client.1.smithi119.stdout:7/723: write d2/d4/d11/d2c/d68/d99/f37 [5901093,11141] 0 2023-12-17T11:57:53.296 INFO:tasks.workunit.client.1.smithi119.stdout:7/724: chown d2/d40/dc3/f52 11848527 1 2023-12-17T11:57:53.296 INFO:tasks.workunit.client.0.smithi002.stdout:5/731: getdents dc/d17/d2f/d82 0 2023-12-17T11:57:53.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/756: dwrite d3/d6/d16/d61/f93 [4194304,4194304] 0 2023-12-17T11:57:53.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/757: write d3/d6/d9/d37/d39/d43/fdd [101620,113716] 0 2023-12-17T11:57:53.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/758: chown d3/d2f/d4d/f6b 11381 1 2023-12-17T11:57:53.297 INFO:tasks.workunit.client.0.smithi002.stdout:1/759: stat d3/d6/d16/d28/fd2 0 2023-12-17T11:57:53.297 INFO:tasks.workunit.client.1.smithi119.stdout:8/620: dread d7/da/f3e [0,4194304] 0 2023-12-17T11:57:53.298 INFO:tasks.workunit.client.1.smithi119.stdout:1/687: sync 2023-12-17T11:57:53.298 INFO:tasks.workunit.client.1.smithi119.stdout:1/688: fsync d3/db/d26/f11 0 2023-12-17T11:57:53.299 INFO:tasks.workunit.client.1.smithi119.stdout:5/777: dread d1/d44/f4c [0,4194304] 0 2023-12-17T11:57:53.299 INFO:tasks.workunit.client.1.smithi119.stdout:5/778: chown d1/da7/d71/d76/d83/dd1/cf5 236 1 2023-12-17T11:57:53.305 INFO:tasks.workunit.client.0.smithi002.stdout:7/707: rmdir d6/d17/dc/d13/d21/d2e 39 2023-12-17T11:57:53.305 INFO:tasks.workunit.client.0.smithi002.stdout:7/708: write d6/d17/dc/d13/d37/d4f/f63 [4686943,100384] 0 2023-12-17T11:57:53.306 INFO:tasks.workunit.client.1.smithi119.stdout:6/643: mknod d2/dba/cc7 0 2023-12-17T11:57:53.309 INFO:tasks.workunit.client.0.smithi002.stdout:0/693: unlink d0/d6/faf 0 2023-12-17T11:57:53.312 INFO:tasks.workunit.client.0.smithi002.stdout:4/666: write d0/d10/d21/d33/dbc/fcc [1152940,114084] 0 2023-12-17T11:57:53.312 INFO:tasks.workunit.client.0.smithi002.stdout:4/667: truncate d0/d3e/d56/d65/f67 296065 0 2023-12-17T11:57:53.312 INFO:tasks.workunit.client.1.smithi119.stdout:5/779: dread d1/d44/f4c [0,4194304] 0 2023-12-17T11:57:53.313 INFO:tasks.workunit.client.1.smithi119.stdout:5/780: readlink d1/da7/d71/d76/lbd 0 2023-12-17T11:57:53.316 INFO:tasks.workunit.client.1.smithi119.stdout:0/722: symlink d2/d66/d2e/d44/d7b/dbc/ldb 0 2023-12-17T11:57:53.316 INFO:tasks.workunit.client.1.smithi119.stdout:0/723: read d2/f67 [1909982,4181] 0 2023-12-17T11:57:53.316 INFO:tasks.workunit.client.1.smithi119.stdout:0/724: chown d2/d16/f6f 10654522 1 2023-12-17T11:57:53.317 INFO:tasks.workunit.client.0.smithi002.stdout:6/716: truncate d0/d1/dc/d17/dd6/fc2 4064018 0 2023-12-17T11:57:53.317 INFO:tasks.workunit.client.0.smithi002.stdout:6/717: chown d0/d1/dc/d17/d4c/c53 7 1 2023-12-17T11:57:53.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/814: link dc/d1d/f78 dc/d1d/d7c/d90/de4/f126 0 2023-12-17T11:57:53.317 INFO:tasks.workunit.client.0.smithi002.stdout:9/815: fsync dc/d1d/d25/d85/dc2/ddd/dfa/d47/fc7 0 2023-12-17T11:57:53.323 INFO:tasks.workunit.client.1.smithi119.stdout:9/792: dwrite d12/d1d/d28/f3d [0,4194304] 0 2023-12-17T11:57:53.326 INFO:tasks.workunit.client.1.smithi119.stdout:7/725: mknod d2/d4/ce1 0 2023-12-17T11:57:53.327 INFO:tasks.workunit.client.1.smithi119.stdout:9/793: write d12/d1d/d28/d46/d50/f60 [1795484,62456] 0 2023-12-17T11:57:53.327 INFO:tasks.workunit.client.1.smithi119.stdout:7/726: fdatasync d2/d4/d11/d3c/f9c 0 2023-12-17T11:57:53.327 INFO:tasks.workunit.client.1.smithi119.stdout:9/794: write d12/d1d/d79/f80 [936873,114099] 0 2023-12-17T11:57:53.327 INFO:tasks.workunit.client.1.smithi119.stdout:6/644: write d2/d2b/f6f [1285306,43744] 0 2023-12-17T11:57:53.329 INFO:tasks.workunit.client.1.smithi119.stdout:8/621: creat d7/da/fc6 x:0 0 0 2023-12-17T11:57:53.329 INFO:tasks.workunit.client.1.smithi119.stdout:8/622: creat d7/d18/d45/d9e/fc7 x:0 0 0 2023-12-17T11:57:53.330 INFO:tasks.workunit.client.0.smithi002.stdout:5/732: rename dc/d1a/d53/fc3 to dc/d94/f103 0 2023-12-17T11:57:53.330 INFO:tasks.workunit.client.0.smithi002.stdout:5/733: stat dc 0 2023-12-17T11:57:53.330 INFO:tasks.workunit.client.0.smithi002.stdout:1/760: link d3/d6/d16/d9f/ccb d3/d6/d16/d61/cfb 0 2023-12-17T11:57:53.331 INFO:tasks.workunit.client.0.smithi002.stdout:1/761: write d3/d2f/d74/dbe/dd8/fb0 [614908,66730] 0 2023-12-17T11:57:53.331 INFO:tasks.workunit.client.0.smithi002.stdout:7/709: write d6/d17/dc/d67/d8b/f35 [1906696,48541] 0 2023-12-17T11:57:53.340 INFO:tasks.workunit.client.1.smithi119.stdout:1/689: rename d3/db/d2a/f34 to d3/db/d17/d24/ffc 0 2023-12-17T11:57:53.340 INFO:tasks.workunit.client.1.smithi119.stdout:1/690: stat d3/db/d26/d19/d3f/d64/l77 0 2023-12-17T11:57:53.340 INFO:tasks.workunit.client.1.smithi119.stdout:1/691: dread - d3/db/d17/d24/d20/dba/dbc/d7e/fdf zero size 2023-12-17T11:57:53.340 INFO:tasks.workunit.client.1.smithi119.stdout:1/692: read - d3/db/d26/d8f/fa8 zero size 2023-12-17T11:57:53.340 INFO:tasks.workunit.client.1.smithi119.stdout:7/727: dread d2/d4/d11/d2c/d68/d99/f30 [0,4194304] 0 2023-12-17T11:57:53.340 INFO:tasks.workunit.client.0.smithi002.stdout:6/718: dread d0/d1/d21/d56/d8c/d93/da5/f8d [0,4194304] 0 2023-12-17T11:57:53.341 INFO:tasks.workunit.client.0.smithi002.stdout:6/719: dread - d0/d1/d21/d56/d8c/fdd zero size 2023-12-17T11:57:53.341 INFO:tasks.workunit.client.1.smithi119.stdout:3/802: getdents d9/d59/dae 0 2023-12-17T11:57:53.343 INFO:tasks.workunit.client.0.smithi002.stdout:4/668: link d0/d10/c32 d0/d10/cd8 0 2023-12-17T11:57:53.350 INFO:tasks.workunit.client.1.smithi119.stdout:4/716: dread dd/f94 [0,4194304] 0 2023-12-17T11:57:53.354 INFO:tasks.workunit.client.0.smithi002.stdout:9/816: rmdir dc/d42/d4f/d9e/de2 39 2023-12-17T11:57:53.356 INFO:tasks.workunit.client.0.smithi002.stdout:3/756: dwrite d9/d1b/d35/d41/d59/d7c/f8b [4194304,4194304] 0 2023-12-17T11:57:53.357 INFO:tasks.workunit.client.0.smithi002.stdout:8/784: dwrite d3/d8/da/dd/db0/fef [0,4194304] 0 2023-12-17T11:57:53.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/710: symlink d6/d17/dc/d13/d37/ld7 0 2023-12-17T11:57:53.358 INFO:tasks.workunit.client.0.smithi002.stdout:7/711: write d6/d17/dc/d13/d37/d4f/f80 [1436743,124624] 0 2023-12-17T11:57:53.359 INFO:tasks.workunit.client.0.smithi002.stdout:7/712: fsync d6/d17/dc/d67/f5d 0 2023-12-17T11:57:53.359 INFO:tasks.workunit.client.0.smithi002.stdout:7/713: read d6/d17/dc/d67/d8b/f35 [896685,54998] 0 2023-12-17T11:57:53.359 INFO:tasks.workunit.client.0.smithi002.stdout:7/714: dread - d6/d17/dc/d13/d37/fd3 zero size 2023-12-17T11:57:53.359 INFO:tasks.workunit.client.0.smithi002.stdout:7/715: fsync d6/d17/dc/f89 0 2023-12-17T11:57:53.364 INFO:tasks.workunit.client.0.smithi002.stdout:1/762: creat d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/ffc x:0 0 0 2023-12-17T11:57:53.369 INFO:tasks.workunit.client.1.smithi119.stdout:0/725: dwrite d2/d66/faf [0,4194304] 0 2023-12-17T11:57:53.371 INFO:tasks.workunit.client.1.smithi119.stdout:4/717: write dd/d15/d16/f45 [1605529,9301] 0 2023-12-17T11:57:53.377 INFO:tasks.workunit.client.0.smithi002.stdout:5/734: dread fa [4194304,4194304] 0 2023-12-17T11:57:53.377 INFO:tasks.workunit.client.0.smithi002.stdout:5/735: write dc/d17/d2f/d99/f9d [1379240,21859] 0 2023-12-17T11:57:53.380 INFO:tasks.workunit.client.0.smithi002.stdout:0/694: rmdir d0/d15/d59 39 2023-12-17T11:57:53.380 INFO:tasks.workunit.client.0.smithi002.stdout:6/720: creat d0/d1/dc/d58/dae/fef x:0 0 0 2023-12-17T11:57:53.380 INFO:tasks.workunit.client.0.smithi002.stdout:0/695: dread - d0/d6/d26/d14/d19/d61/f88 zero size 2023-12-17T11:57:53.380 INFO:tasks.workunit.client.0.smithi002.stdout:9/817: unlink dc/d1d/d25/c62 0 2023-12-17T11:57:53.380 INFO:tasks.workunit.client.0.smithi002.stdout:6/721: truncate d0/d1/dc/d17/dd6/feb 126698 0 2023-12-17T11:57:53.381 INFO:tasks.workunit.client.0.smithi002.stdout:4/669: mknod d0/d3e/d56/cd9 0 2023-12-17T11:57:53.381 INFO:tasks.workunit.client.0.smithi002.stdout:4/670: fdatasync d0/d3e/d56/d65/d78/f81 0 2023-12-17T11:57:53.382 INFO:tasks.workunit.client.0.smithi002.stdout:2/707: dwrite d3/d4/d17/fa5 [0,4194304] 0 2023-12-17T11:57:53.384 INFO:tasks.workunit.client.1.smithi119.stdout:9/795: symlink d12/d1d/d28/d4d/d73/d78/lfd 0 2023-12-17T11:57:53.387 INFO:tasks.workunit.client.1.smithi119.stdout:6/645: symlink d2/d9b/dac/lc8 0 2023-12-17T11:57:53.388 INFO:tasks.workunit.client.0.smithi002.stdout:3/757: rename d9/d15/d52/l8a to d9/d1b/d35/d41/d59/d65/lf4 0 2023-12-17T11:57:53.389 INFO:tasks.workunit.client.1.smithi119.stdout:8/623: symlink d7/da/d11/d60/lc8 0 2023-12-17T11:57:53.393 INFO:tasks.workunit.client.0.smithi002.stdout:5/736: unlink dc/d1a/d47/d9b/f9c 0 2023-12-17T11:57:53.393 INFO:tasks.workunit.client.1.smithi119.stdout:1/693: dwrite d3/db/d17/d24/f32 [0,4194304] 0 2023-12-17T11:57:53.394 INFO:tasks.workunit.client.1.smithi119.stdout:7/728: unlink d2/d5b/cdc 0 2023-12-17T11:57:53.394 INFO:tasks.workunit.client.0.smithi002.stdout:5/737: write dc/d1a/f46 [187019,5682] 0 2023-12-17T11:57:53.395 INFO:tasks.workunit.client.1.smithi119.stdout:6/646: dread d2/d2b/f3d [0,4194304] 0 2023-12-17T11:57:53.396 INFO:tasks.workunit.client.1.smithi119.stdout:8/624: dread d7/d18/d15/d81/f8f [0,4194304] 0 2023-12-17T11:57:53.396 INFO:tasks.workunit.client.1.smithi119.stdout:8/625: dread - d7/da/fc6 zero size 2023-12-17T11:57:53.401 INFO:tasks.workunit.client.1.smithi119.stdout:9/796: dread d12/d1d/d28/d4d/d73/d78/fa9 [0,4194304] 0 2023-12-17T11:57:53.401 INFO:tasks.workunit.client.1.smithi119.stdout:5/781: rename d1/d70/d85/cb1 to d1/da7/d71/d97/db3/cfe 0 2023-12-17T11:57:53.402 INFO:tasks.workunit.client.0.smithi002.stdout:0/696: mknod d0/d15/cdf 0 2023-12-17T11:57:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:53 smithi119 ceph-mon[117414]: pgmap v29: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 278 MiB/s rd, 349 MiB/s wr, 479 op/s 2023-12-17T11:57:53.409 INFO:tasks.workunit.client.0.smithi002.stdout:9/818: symlink dc/d1d/d25/d85/dc2/ddd/dfa/l127 0 2023-12-17T11:57:53.410 INFO:tasks.workunit.client.0.smithi002.stdout:9/819: fdatasync dc/d42/da0/d72/d93/f46 0 2023-12-17T11:57:53.414 INFO:tasks.workunit.client.0.smithi002.stdout:6/722: creat d0/d1/dc/d17/d4c/dc5/ff0 x:0 0 0 2023-12-17T11:57:53.417 INFO:tasks.workunit.client.1.smithi119.stdout:2/811: sync 2023-12-17T11:57:53.418 INFO:tasks.workunit.client.1.smithi119.stdout:9/797: write d12/d1d/d28/d4d/f5e [5999353,44737] 0 2023-12-17T11:57:53.418 INFO:tasks.workunit.client.1.smithi119.stdout:4/718: dwrite dd/d11/d2d/d9c/d55/d81/db8/d78/f89 [0,4194304] 0 2023-12-17T11:57:53.420 INFO:tasks.workunit.client.1.smithi119.stdout:0/726: rename d2/d66/d2e/d44/c73 to d2/d66/d2e/d44/cdc 0 2023-12-17T11:57:53.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/671: truncate d0/d3e/d56/f9e 970947 0 2023-12-17T11:57:53.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/672: chown d0/d10/d14/d27/d69 3811 1 2023-12-17T11:57:53.424 INFO:tasks.workunit.client.0.smithi002.stdout:6/723: write d0/d1/dc/d17/d67/f84 [28088,101668] 0 2023-12-17T11:57:53.427 INFO:tasks.workunit.client.1.smithi119.stdout:7/729: creat d2/d4/d11/d2c/d68/fe2 x:0 0 0 2023-12-17T11:57:53.429 INFO:tasks.workunit.client.1.smithi119.stdout:6/647: stat d2/df/d17/c90 0 2023-12-17T11:57:53.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/708: link d3/d4/d7/d14/d2e/f6d d3/d4/dbc/ffb 0 2023-12-17T11:57:53.436 INFO:tasks.workunit.client.0.smithi002.stdout:2/709: write d3/d4/d17/d19/d4d/d72/d77/ff0 [921837,27122] 0 2023-12-17T11:57:53.437 INFO:tasks.workunit.client.1.smithi119.stdout:1/694: dwrite d3/fcf [0,4194304] 0 2023-12-17T11:57:53.437 INFO:tasks.workunit.client.1.smithi119.stdout:2/812: write d6/d9/d52/d53/ff0 [3553001,7800] 0 2023-12-17T11:57:53.441 INFO:tasks.workunit.client.1.smithi119.stdout:5/782: rename d1/d36/d3a/ld9 to d1/d70/d6b/d77/dae/lff 0 2023-12-17T11:57:53.443 INFO:tasks.workunit.client.0.smithi002.stdout:8/785: write d3/d7/d1a/f5c [2469517,10067] 0 2023-12-17T11:57:53.443 INFO:tasks.workunit.client.0.smithi002.stdout:8/786: fsync d3/d8/d28/d31/d5a/d7c/fa7 0 2023-12-17T11:57:53.445 INFO:tasks.workunit.client.1.smithi119.stdout:8/626: dwrite d7/d12/d23/f38 [0,4194304] 0 2023-12-17T11:57:53.445 INFO:tasks.workunit.client.1.smithi119.stdout:3/803: symlink d9/d35/dbd/dfb/d107/dd3/l12c 0 2023-12-17T11:57:53.457 INFO:tasks.workunit.client.1.smithi119.stdout:1/695: write d3/db/d17/d24/f53 [3308549,25002] 0 2023-12-17T11:57:53.459 INFO:tasks.workunit.client.1.smithi119.stdout:9/798: mknod d12/d1d/d28/d86/d8f/cfe 0 2023-12-17T11:57:53.460 INFO:tasks.workunit.client.0.smithi002.stdout:3/758: getdents d9/d1b/d35/d41/d59/d65/da9/d8f 0 2023-12-17T11:57:53.462 INFO:tasks.workunit.client.1.smithi119.stdout:4/719: getdents dd/d15/d4f 0 2023-12-17T11:57:53.462 INFO:tasks.workunit.client.1.smithi119.stdout:4/720: fsync dd/d11/d2d/d9c/d55/d81/fcd 0 2023-12-17T11:57:53.465 INFO:tasks.workunit.client.1.smithi119.stdout:0/727: symlink d2/d66/dbb/dcd/ldd 0 2023-12-17T11:57:53.468 INFO:tasks.workunit.client.1.smithi119.stdout:6/648: getdents d2/d7e/d93 0 2023-12-17T11:57:53.477 INFO:tasks.workunit.client.1.smithi119.stdout:5/783: symlink d1/d70/d6b/d77/l100 0 2023-12-17T11:57:53.477 INFO:tasks.workunit.client.1.smithi119.stdout:5/784: fdatasync d1/fa8 0 2023-12-17T11:57:53.483 INFO:tasks.workunit.client.1.smithi119.stdout:8/627: mkdir d7/d18/d15/d81/dc9 0 2023-12-17T11:57:53.483 INFO:tasks.workunit.client.1.smithi119.stdout:8/628: chown d7/d12/fba 9440 1 2023-12-17T11:57:53.483 INFO:tasks.workunit.client.1.smithi119.stdout:3/804: creat d9/d59/f12d x:0 0 0 2023-12-17T11:57:53.484 INFO:tasks.workunit.client.1.smithi119.stdout:3/805: stat d9/d59/l82 0 2023-12-17T11:57:53.487 INFO:tasks.workunit.client.1.smithi119.stdout:4/721: creat dd/d15/fe7 x:0 0 0 2023-12-17T11:57:53.490 INFO:tasks.workunit.client.1.smithi119.stdout:0/728: creat d2/d66/d2e/d44/d7b/d5/fde x:0 0 0 2023-12-17T11:57:53.492 INFO:tasks.workunit.client.0.smithi002.stdout:9/820: creat dc/d38/f128 x:0 0 0 2023-12-17T11:57:53.495 INFO:tasks.workunit.client.1.smithi119.stdout:6/649: mknod d2/d7e/cc9 0 2023-12-17T11:57:53.495 INFO:tasks.workunit.client.1.smithi119.stdout:6/650: creat d2/d61/d8a/fca x:0 0 0 2023-12-17T11:57:53.496 INFO:tasks.workunit.client.0.smithi002.stdout:4/673: mkdir d0/d6c/dda 0 2023-12-17T11:57:53.496 INFO:tasks.workunit.client.0.smithi002.stdout:6/724: truncate d0/d1/d28/f7b 277476 0 2023-12-17T11:57:53.506 INFO:tasks.workunit.client.1.smithi119.stdout:5/785: creat d1/d36/dc1/f101 x:0 0 0 2023-12-17T11:57:53.507 INFO:tasks.workunit.client.1.smithi119.stdout:5/786: chown d1/d70/d6b/d77/dae/dba/de3/fe7 96 1 2023-12-17T11:57:53.508 INFO:tasks.workunit.client.1.smithi119.stdout:9/799: dwrite d12/d1d/d28/f87 [0,4194304] 0 2023-12-17T11:57:53.509 INFO:tasks.workunit.client.1.smithi119.stdout:3/806: write d9/d11/d1e/d55/fbe [1004470,60439] 0 2023-12-17T11:57:53.512 INFO:tasks.workunit.client.1.smithi119.stdout:4/722: creat dd/d11/d2d/d9c/d55/d81/db8/d78/fe8 x:0 0 0 2023-12-17T11:57:53.514 INFO:tasks.workunit.client.0.smithi002.stdout:8/787: mknod d3/d7/d18/c108 0 2023-12-17T11:57:53.516 INFO:tasks.workunit.client.1.smithi119.stdout:0/729: rename d2/d16/d35/d39/f6e to d2/d66/d1f/fdf 0 2023-12-17T11:57:53.516 INFO:tasks.workunit.client.1.smithi119.stdout:0/730: chown d2/d16/d35/d39/c95 812833 1 2023-12-17T11:57:53.522 INFO:tasks.workunit.client.1.smithi119.stdout:1/696: dwrite d3/db/d26/d19/f4b [0,4194304] 0 2023-12-17T11:57:53.524 INFO:tasks.workunit.client.1.smithi119.stdout:5/787: link d1/d70/d85/l88 d1/d70/d6b/df1/l102 0 2023-12-17T11:57:53.528 INFO:tasks.workunit.client.1.smithi119.stdout:7/730: dwrite d2/d4/d11/d2c/d68/d99/d6c/fbd [0,4194304] 0 2023-12-17T11:57:53.531 INFO:tasks.workunit.client.0.smithi002.stdout:3/759: mknod d9/d1b/d35/d41/d59/da3/cf5 0 2023-12-17T11:57:53.532 INFO:tasks.workunit.client.1.smithi119.stdout:2/813: dwrite d6/d9/d13/d34/d88/fd4 [0,4194304] 0 2023-12-17T11:57:53.532 INFO:tasks.workunit.client.1.smithi119.stdout:6/651: dread d2/df/d17/f4e [0,4194304] 0 2023-12-17T11:57:53.532 INFO:tasks.workunit.client.1.smithi119.stdout:6/652: write d2/d2b/d7f/fa7 [523130,55715] 0 2023-12-17T11:57:53.532 INFO:tasks.workunit.client.1.smithi119.stdout:6/653: write d2/d2b/f3a [135128,73116] 0 2023-12-17T11:57:53.544 INFO:tasks.workunit.client.1.smithi119.stdout:9/800: mkdir d12/d1d/d28/d46/dff 0 2023-12-17T11:57:53.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/807: mknod d9/d59/dda/c12e 0 2023-12-17T11:57:53.545 INFO:tasks.workunit.client.0.smithi002.stdout:4/674: truncate d0/d10/d14/f52 3089871 0 2023-12-17T11:57:53.545 INFO:tasks.workunit.client.0.smithi002.stdout:4/675: chown d0/d3e/d56 7 1 2023-12-17T11:57:53.546 INFO:tasks.workunit.client.1.smithi119.stdout:7/731: dread d2/d4/d11/d3c/d75/fb1 [0,4194304] 0 2023-12-17T11:57:53.556 INFO:tasks.workunit.client.0.smithi002.stdout:3/760: unlink d9/d15/fad 0 2023-12-17T11:57:53.558 INFO:tasks.workunit.client.0.smithi002.stdout:7/716: rename d6/d17/dc/d67/d8b/dbd/d75 to d6/d17/dc/d13/dd8 0 2023-12-17T11:57:53.562 INFO:tasks.workunit.client.1.smithi119.stdout:5/788: mkdir d1/da7/d71/d97/df0/d103 0 2023-12-17T11:57:53.563 INFO:tasks.workunit.client.0.smithi002.stdout:3/761: creat d9/d1b/d35/d41/d59/d72/ff6 x:0 0 0 2023-12-17T11:57:53.569 INFO:tasks.workunit.client.0.smithi002.stdout:5/738: rename dc/d1a/c37 to dc/d94/ded/d2d/dcf/dea/c104 0 2023-12-17T11:57:53.574 INFO:tasks.workunit.client.1.smithi119.stdout:6/654: dread d2/d61/fb9 [0,4194304] 0 2023-12-17T11:57:53.575 INFO:tasks.workunit.client.1.smithi119.stdout:7/732: dread d2/d4/f29 [0,4194304] 0 2023-12-17T11:57:53.581 INFO:tasks.workunit.client.1.smithi119.stdout:4/723: getdents dd/d11/d2d/d9c/d55/d81/d88/d91 0 2023-12-17T11:57:53.581 INFO:tasks.workunit.client.1.smithi119.stdout:9/801: dread d12/d1d/d28/d46/d50/fb2 [0,4194304] 0 2023-12-17T11:57:53.581 INFO:tasks.workunit.client.1.smithi119.stdout:1/697: rename d3/db/d26/d19/d3f to d3/d44/dfd 0 2023-12-17T11:57:53.581 INFO:tasks.workunit.client.1.smithi119.stdout:1/698: write d3/db/d17/d24/fbf [493265,73780] 0 2023-12-17T11:57:53.582 INFO:tasks.workunit.client.0.smithi002.stdout:3/762: mknod d9/d1b/d35/d41/d59/da3/cf7 0 2023-12-17T11:57:53.582 INFO:tasks.workunit.client.1.smithi119.stdout:3/808: dread d9/da/df/d41/fdd [0,4194304] 0 2023-12-17T11:57:53.584 INFO:tasks.workunit.client.1.smithi119.stdout:7/733: dread d2/f26 [0,4194304] 0 2023-12-17T11:57:53.584 INFO:tasks.workunit.client.1.smithi119.stdout:7/734: write d2/d4/d11/d2c/d68/d99/d6c/fa5 [578571,40348] 0 2023-12-17T11:57:53.585 INFO:tasks.workunit.client.1.smithi119.stdout:1/699: creat d3/db/d17/d24/d20/d6c/db7/de4/ffe x:0 0 0 2023-12-17T11:57:53.585 INFO:tasks.workunit.client.1.smithi119.stdout:1/700: creat d3/db/d17/d24/d20/d6c/db7/fff x:0 0 0 2023-12-17T11:57:53.586 INFO:tasks.workunit.client.1.smithi119.stdout:0/731: dwrite d2/d16/d35/d74/fa7 [0,4194304] 0 2023-12-17T11:57:53.586 INFO:tasks.workunit.client.1.smithi119.stdout:4/724: dread dd/d15/d16/d5a/f99 [0,4194304] 0 2023-12-17T11:57:53.589 INFO:tasks.workunit.client.0.smithi002.stdout:9/821: dwrite dc/d1d/d25/f124 [4194304,4194304] 0 2023-12-17T11:57:53.590 INFO:tasks.workunit.client.0.smithi002.stdout:9/822: creat dc/d1d/d7c/d90/dc0/f129 x:0 0 0 2023-12-17T11:57:53.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/697: rename d0/d6/d26/d14/d19/d37/dcf/ccb to d0/d6/d26/d14/d6d/d7e/ce0 0 2023-12-17T11:57:53.597 INFO:tasks.workunit.client.0.smithi002.stdout:9/823: write dc/d1d/f78 [1307631,63909] 0 2023-12-17T11:57:53.601 INFO:tasks.workunit.client.1.smithi119.stdout:7/735: rmdir d2/d4/d70 39 2023-12-17T11:57:53.605 INFO:tasks.workunit.client.0.smithi002.stdout:3/763: truncate d9/d1b/fc1 3379867 0 2023-12-17T11:57:53.605 INFO:tasks.workunit.client.0.smithi002.stdout:3/764: dread - d9/d15/fa5 zero size 2023-12-17T11:57:53.606 INFO:tasks.workunit.client.1.smithi119.stdout:0/732: mkdir d2/d66/dbb/dcd/de0 0 2023-12-17T11:57:53.607 INFO:tasks.workunit.client.1.smithi119.stdout:0/733: write d2/d66/d2e/d44/d7b/d5/dc/d7f/fc4 [906971,118400] 0 2023-12-17T11:57:53.607 INFO:tasks.workunit.client.1.smithi119.stdout:0/734: chown d2/d66/d1f/f20 412 1 2023-12-17T11:57:53.610 INFO:tasks.workunit.client.1.smithi119.stdout:6/655: write d2/df/d17/f50 [4085325,75458] 0 2023-12-17T11:57:53.610 INFO:tasks.workunit.client.0.smithi002.stdout:6/725: dwrite d0/d1/dc/f39 [0,4194304] 0 2023-12-17T11:57:53.610 INFO:tasks.workunit.client.0.smithi002.stdout:6/726: dread - d0/d1/dc/d58/dae/ddb/fd0 zero size 2023-12-17T11:57:53.610 INFO:tasks.workunit.client.0.smithi002.stdout:8/788: dwrite d3/d7/d1a/fac [0,4194304] 0 2023-12-17T11:57:53.611 INFO:tasks.workunit.client.1.smithi119.stdout:6/656: read d2/f19 [299630,126319] 0 2023-12-17T11:57:53.613 INFO:tasks.workunit.client.1.smithi119.stdout:3/809: rmdir d9/d11/d1e 39 2023-12-17T11:57:53.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/698: creat d0/d6/d26/d14/d90/d64/fe1 x:0 0 0 2023-12-17T11:57:53.619 INFO:tasks.workunit.client.0.smithi002.stdout:9/824: mkdir dc/d42/da0/d12a 0 2023-12-17T11:57:53.620 INFO:tasks.workunit.client.1.smithi119.stdout:0/735: symlink d2/d66/d2e/le1 0 2023-12-17T11:57:53.623 INFO:tasks.workunit.client.0.smithi002.stdout:9/825: write dc/d42/d4f/f98 [661901,74599] 0 2023-12-17T11:57:53.628 INFO:tasks.workunit.client.0.smithi002.stdout:3/765: unlink d9/f1e 0 2023-12-17T11:57:53.629 INFO:tasks.workunit.client.0.smithi002.stdout:4/676: dwrite d0/d3e/d56/d99/fb8 [0,4194304] 0 2023-12-17T11:57:53.629 INFO:tasks.workunit.client.1.smithi119.stdout:6/657: mkdir d2/d2b/d43/dcb 0 2023-12-17T11:57:53.629 INFO:tasks.workunit.client.1.smithi119.stdout:6/658: write d2/df/f55 [826301,41583] 0 2023-12-17T11:57:53.633 INFO:tasks.workunit.client.1.smithi119.stdout:2/814: dwrite d6/d9/d52/d53/ff0 [4194304,4194304] 0 2023-12-17T11:57:53.633 INFO:tasks.workunit.client.1.smithi119.stdout:2/815: dread - d6/d9/d13/d34/d56/f10a zero size 2023-12-17T11:57:53.633 INFO:tasks.workunit.client.1.smithi119.stdout:2/816: fdatasync d6/d9/d52/d53/d55/d58/d6b/f93 0 2023-12-17T11:57:53.637 INFO:tasks.workunit.client.1.smithi119.stdout:3/810: rename d9/d35/f108 to d9/da/df/d67/f12f 0 2023-12-17T11:57:53.641 INFO:tasks.workunit.client.0.smithi002.stdout:6/727: write d0/d1/dc/d17/f2e [2194523,33692] 0 2023-12-17T11:57:53.641 INFO:tasks.workunit.client.0.smithi002.stdout:6/728: fsync d0/d1/d28/dab/fe3 0 2023-12-17T11:57:53.641 INFO:tasks.workunit.client.0.smithi002.stdout:9/826: dread dc/d1d/d25/d85/dc2/ddd/dfa/d47/f5c [0,4194304] 0 2023-12-17T11:57:53.642 INFO:tasks.workunit.client.1.smithi119.stdout:4/725: dwrite dd/fdf [0,4194304] 0 2023-12-17T11:57:53.645 INFO:tasks.workunit.client.1.smithi119.stdout:1/701: truncate d3/db/d26/d19/f4b 1750586 0 2023-12-17T11:57:53.645 INFO:tasks.workunit.client.1.smithi119.stdout:1/702: truncate d3/db/d26/fa4 5076665 0 2023-12-17T11:57:53.645 INFO:tasks.workunit.client.0.smithi002.stdout:4/677: symlink d0/d3e/d56/d65/d78/d85/da3/ldb 0 2023-12-17T11:57:53.647 INFO:tasks.workunit.client.0.smithi002.stdout:1/763: sync 2023-12-17T11:57:53.651 INFO:tasks.workunit.client.0.smithi002.stdout:6/729: rmdir d0/d1/d21/d56/d8c/d93 39 2023-12-17T11:57:53.653 INFO:tasks.workunit.client.1.smithi119.stdout:4/726: dread dd/d4b/fa4 [0,4194304] 0 2023-12-17T11:57:53.653 INFO:tasks.workunit.client.1.smithi119.stdout:4/727: chown dd/d4b/c79 4421558 1 2023-12-17T11:57:53.655 INFO:tasks.workunit.client.1.smithi119.stdout:0/736: mknod d2/dac/dcf/ce2 0 2023-12-17T11:57:53.657 INFO:tasks.workunit.client.1.smithi119.stdout:6/659: getdents d2/d9b/dac 0 2023-12-17T11:57:53.657 INFO:tasks.workunit.client.1.smithi119.stdout:6/660: creat d2/d2b/d43/d76/d8d/dc2/fcc x:0 0 0 2023-12-17T11:57:53.657 INFO:tasks.workunit.client.1.smithi119.stdout:6/661: chown d2/f98 16041 1 2023-12-17T11:57:53.657 INFO:tasks.workunit.client.1.smithi119.stdout:6/662: chown d2/l6e 452511548 1 2023-12-17T11:57:53.657 INFO:tasks.workunit.client.1.smithi119.stdout:6/663: write d2/df/d17/f50 [1348377,124288] 0 2023-12-17T11:57:53.660 INFO:tasks.workunit.client.0.smithi002.stdout:0/699: dread d0/d6/d26/f24 [4194304,4194304] 0 2023-12-17T11:57:53.662 INFO:tasks.workunit.client.0.smithi002.stdout:4/678: link d0/ca d0/d6c/dda/cdc 0 2023-12-17T11:57:53.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/739: dwrite dc/d17/d2f/d99/fac [0,4194304] 0 2023-12-17T11:57:53.664 INFO:tasks.workunit.client.1.smithi119.stdout:2/817: creat d6/d9/d86/db0/f120 x:0 0 0 2023-12-17T11:57:53.665 INFO:tasks.workunit.client.0.smithi002.stdout:1/764: dread d3/d6/d9/f29 [0,4194304] 0 2023-12-17T11:57:53.666 INFO:tasks.workunit.client.0.smithi002.stdout:7/717: dwrite d6/d17/dc/d67/d8b/d24/fca [0,4194304] 0 2023-12-17T11:57:53.667 INFO:tasks.workunit.client.1.smithi119.stdout:7/736: dwrite d2/d4/d11/f2d [0,4194304] 0 2023-12-17T11:57:53.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/730: symlink d0/d1/d21/d56/d8c/dce/lf1 0 2023-12-17T11:57:53.672 INFO:tasks.workunit.client.0.smithi002.stdout:9/827: write dc/d1d/d25/f124 [144634,35164] 0 2023-12-17T11:57:53.672 INFO:tasks.workunit.client.0.smithi002.stdout:9/828: read - dc/d1d/d25/d85/dc2/ddd/dfa/fb8 zero size 2023-12-17T11:57:53.673 INFO:tasks.workunit.client.1.smithi119.stdout:9/802: dwrite d12/d1d/d28/f3a [0,4194304] 0 2023-12-17T11:57:53.677 INFO:tasks.workunit.client.0.smithi002.stdout:2/710: sync 2023-12-17T11:57:53.678 INFO:tasks.workunit.client.0.smithi002.stdout:4/679: mknod d0/d10/d14/d27/cdd 0 2023-12-17T11:57:53.678 INFO:tasks.workunit.client.1.smithi119.stdout:7/737: write d2/d4/d70/d57/d56/f62 [872110,48332] 0 2023-12-17T11:57:53.678 INFO:tasks.workunit.client.1.smithi119.stdout:7/738: chown d2/d4/d11/d3c/f9e 534332977 1 2023-12-17T11:57:53.678 INFO:tasks.workunit.client.1.smithi119.stdout:1/703: write d3/d44/dfd/f97 [815801,97563] 0 2023-12-17T11:57:53.678 INFO:tasks.workunit.client.1.smithi119.stdout:1/704: truncate d3/db/d17/d24/d20/dba/dbc/f82 3995923 0 2023-12-17T11:57:53.678 INFO:tasks.workunit.client.1.smithi119.stdout:1/705: write d3/db/d17/d24/f37 [592742,52852] 0 2023-12-17T11:57:53.679 INFO:tasks.workunit.client.0.smithi002.stdout:5/740: creat dc/d1a/f105 x:0 0 0 2023-12-17T11:57:53.679 INFO:tasks.workunit.client.0.smithi002.stdout:5/741: chown dc/d94/ded/d5a 74471497 1 2023-12-17T11:57:53.680 INFO:tasks.workunit.client.0.smithi002.stdout:5/742: fsync dc/d17/f55 0 2023-12-17T11:57:53.680 INFO:tasks.workunit.client.0.smithi002.stdout:5/743: write dc/d94/ded/ff7 [657075,63974] 0 2023-12-17T11:57:53.684 INFO:tasks.workunit.client.1.smithi119.stdout:0/737: symlink d2/d16/d35/d74/dc3/le3 0 2023-12-17T11:57:53.685 INFO:tasks.workunit.client.1.smithi119.stdout:0/738: fsync d2/d66/d1f/fdf 0 2023-12-17T11:57:53.685 INFO:tasks.workunit.client.1.smithi119.stdout:0/739: write d2/d66/d2e/d44/d7b/d5/dc/faa [47353,11127] 0 2023-12-17T11:57:53.685 INFO:tasks.workunit.client.1.smithi119.stdout:0/740: fsync d2/d66/d1f/f4e 0 2023-12-17T11:57:53.693 INFO:tasks.workunit.client.0.smithi002.stdout:1/765: write d3/d6/f3e [3442359,54068] 0 2023-12-17T11:57:53.695 INFO:tasks.workunit.client.0.smithi002.stdout:1/766: chown d3/d6/l8d 2658150 1 2023-12-17T11:57:53.695 INFO:tasks.workunit.client.0.smithi002.stdout:9/829: mkdir dc/d42/da0/d72/d93/d52/d12b 0 2023-12-17T11:57:53.699 INFO:tasks.workunit.client.0.smithi002.stdout:2/711: link d3/d4/d7/d14/d2e/d37/d3f/c4c d3/d4/d17/d19/cfc 0 2023-12-17T11:57:53.699 INFO:tasks.workunit.client.0.smithi002.stdout:2/712: chown d3/d4/d17/d19/d4d/fa2 4766 1 2023-12-17T11:57:53.701 INFO:tasks.workunit.client.0.smithi002.stdout:3/766: dwrite d9/d40/f9a [4194304,4194304] 0 2023-12-17T11:57:53.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/664: rename d2/df/d17/f64 to d2/dba/fcd 0 2023-12-17T11:57:53.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/665: creat d2/da3/fce x:0 0 0 2023-12-17T11:57:53.706 INFO:tasks.workunit.client.1.smithi119.stdout:6/666: chown d2/fb6 1079 1 2023-12-17T11:57:53.707 INFO:tasks.workunit.client.0.smithi002.stdout:6/731: dread d0/d1/dc/f54 [0,4194304] 0 2023-12-17T11:57:53.713 INFO:tasks.workunit.client.1.smithi119.stdout:2/818: symlink d6/d9/d13/d34/dcf/l121 0 2023-12-17T11:57:53.714 INFO:tasks.workunit.client.0.smithi002.stdout:4/680: rename d0/d10/d14/d27/f79 to d0/d10/d14/dae/fde 0 2023-12-17T11:57:53.716 INFO:tasks.workunit.client.0.smithi002.stdout:9/830: link dc/d42/da0/d72/d93/d76/le6 dc/d42/da0/d72/d93/d76/l12c 0 2023-12-17T11:57:53.722 INFO:tasks.workunit.client.0.smithi002.stdout:2/713: write d3/d4/d7/f86 [5087385,54976] 0 2023-12-17T11:57:53.726 INFO:tasks.workunit.client.0.smithi002.stdout:3/767: rmdir d9/d1b/d35/d41/d59 39 2023-12-17T11:57:53.730 INFO:tasks.workunit.client.0.smithi002.stdout:6/732: symlink d0/d1/dc0/lf2 0 2023-12-17T11:57:53.731 INFO:tasks.workunit.client.0.smithi002.stdout:7/718: dwrite d6/d17/dc/d67/d8b/d24/fca [0,4194304] 0 2023-12-17T11:57:53.734 INFO:tasks.workunit.client.1.smithi119.stdout:3/811: dwrite d9/d11/d1e/d55/d65/f7a [0,4194304] 0 2023-12-17T11:57:53.734 INFO:tasks.workunit.client.1.smithi119.stdout:3/812: chown d9/da/f30 13057 1 2023-12-17T11:57:53.735 INFO:tasks.workunit.client.0.smithi002.stdout:5/744: dwrite dc/d94/fce [0,4194304] 0 2023-12-17T11:57:53.736 INFO:tasks.workunit.client.1.smithi119.stdout:9/803: dwrite d12/d65/f72 [0,4194304] 0 2023-12-17T11:57:53.741 INFO:tasks.workunit.client.1.smithi119.stdout:1/706: creat d3/d44/dfd/d64/f100 x:0 0 0 2023-12-17T11:57:53.743 INFO:tasks.workunit.client.0.smithi002.stdout:2/714: mknod d3/d4/d7/d14/d9b/cfd 0 2023-12-17T11:57:53.743 INFO:tasks.workunit.client.0.smithi002.stdout:2/715: write d3/d4/d7/d14/d1b/d5b/f63 [642804,35711] 0 2023-12-17T11:57:53.744 INFO:tasks.workunit.client.1.smithi119.stdout:4/728: rmdir dd/d15/d16/d5a 39 2023-12-17T11:57:53.747 INFO:tasks.workunit.client.0.smithi002.stdout:7/719: dread d6/d17/dc/d13/d37/d4f/fa8 [0,4194304] 0 2023-12-17T11:57:53.748 INFO:tasks.workunit.client.0.smithi002.stdout:6/733: mknod d0/d1/dc/d17/dd7/cf3 0 2023-12-17T11:57:53.748 INFO:tasks.workunit.client.0.smithi002.stdout:6/734: write d0/d1/dc/d17/d67/f84 [346068,121707] 0 2023-12-17T11:57:53.748 INFO:tasks.workunit.client.0.smithi002.stdout:6/735: read - d0/d1/d21/d56/d8c/fdd zero size 2023-12-17T11:57:53.752 INFO:tasks.workunit.client.1.smithi119.stdout:0/741: creat d2/d16/d35/d74/fe4 x:0 0 0 2023-12-17T11:57:53.752 INFO:tasks.workunit.client.0.smithi002.stdout:1/767: dwrite d3/d6/d9/d37/d39/d43/fa4 [0,4194304] 0 2023-12-17T11:57:53.753 INFO:tasks.workunit.client.0.smithi002.stdout:1/768: read d3/d6/d9/d30/f41 [612334,67843] 0 2023-12-17T11:57:53.756 INFO:tasks.workunit.client.1.smithi119.stdout:4/729: dread dd/d15/d4f/f6b [0,4194304] 0 2023-12-17T11:57:53.757 INFO:tasks.workunit.client.1.smithi119.stdout:7/739: rename d2/d4/d11/d3c/d75/dad/fbe to d2/d4/d70/d57/d56/fe3 0 2023-12-17T11:57:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/768: dwrite d9/d1b/fa4 [0,4194304] 0 2023-12-17T11:57:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/769: write d9/d24/f6d [5136186,58233] 0 2023-12-17T11:57:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:3/770: write d9/f45 [212548,339] 0 2023-12-17T11:57:53.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/736: dread d0/d1/d21/d56/d8c/d93/da5/f90 [0,4194304] 0 2023-12-17T11:57:53.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/737: write d0/d1/dc/d17/f1f [389629,1193] 0 2023-12-17T11:57:53.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/738: write d0/d1/d21/d56/d8c/fdd [608432,78984] 0 2023-12-17T11:57:53.764 INFO:tasks.workunit.client.0.smithi002.stdout:6/739: truncate d0/d1/dc/d17/d3c/fb5 1701523 0 2023-12-17T11:57:53.768 INFO:tasks.workunit.client.1.smithi119.stdout:6/667: mkdir d2/d61/d8a/dcf 0 2023-12-17T11:57:53.768 INFO:tasks.workunit.client.1.smithi119.stdout:2/819: rmdir d6/d2b/d3f 39 2023-12-17T11:57:53.772 INFO:tasks.workunit.client.1.smithi119.stdout:7/740: dread d2/d4/d11/d3c/d75/f7f [4194304,4194304] 0 2023-12-17T11:57:53.772 INFO:tasks.workunit.client.1.smithi119.stdout:7/741: chown d2/d4/d11/d2c/d55 3772548 1 2023-12-17T11:57:53.772 INFO:tasks.workunit.client.1.smithi119.stdout:7/742: write d2/d40/dc3/f52 [2356682,98019] 0 2023-12-17T11:57:53.774 INFO:tasks.workunit.client.0.smithi002.stdout:6/740: dread d0/d1/dc/d17/d8f/f9d [0,4194304] 0 2023-12-17T11:57:53.774 INFO:tasks.workunit.client.0.smithi002.stdout:6/741: readlink d0/d1/dc/d17/d67/d6c/d7f/lb0 0 2023-12-17T11:57:53.775 INFO:tasks.workunit.client.0.smithi002.stdout:2/716: mknod d3/d4/d7/d14/d42/d8a/cfe 0 2023-12-17T11:57:53.776 INFO:tasks.workunit.client.1.smithi119.stdout:3/813: symlink d9/d11/d87/l130 0 2023-12-17T11:57:53.780 INFO:tasks.workunit.client.0.smithi002.stdout:9/831: dwrite dc/d42/da0/d72/d93/dd0/dd4/f11b [0,4194304] 0 2023-12-17T11:57:53.783 INFO:tasks.workunit.client.0.smithi002.stdout:4/681: dwrite d0/d10/d21/d33/f89 [0,4194304] 0 2023-12-17T11:57:53.784 INFO:tasks.workunit.client.1.smithi119.stdout:3/814: dread d9/d59/f5d [0,4194304] 0 2023-12-17T11:57:53.784 INFO:tasks.workunit.client.1.smithi119.stdout:3/815: write d9/da/fbc [97310,91891] 0 2023-12-17T11:57:53.788 INFO:tasks.workunit.client.0.smithi002.stdout:1/769: mknod d3/d6/d9/d37/d39/cfd 0 2023-12-17T11:57:53.791 INFO:tasks.workunit.client.1.smithi119.stdout:8/629: sync 2023-12-17T11:57:53.792 INFO:tasks.workunit.client.1.smithi119.stdout:8/630: dread - d7/d18/d45/d9e/fbd zero size 2023-12-17T11:57:53.792 INFO:tasks.workunit.client.1.smithi119.stdout:8/631: stat d7/d18/d45/d9f/d75 0 2023-12-17T11:57:53.796 INFO:tasks.workunit.client.1.smithi119.stdout:0/742: dwrite d2/d16/f6f [0,4194304] 0 2023-12-17T11:57:53.797 INFO:tasks.workunit.client.1.smithi119.stdout:0/743: write d2/d66/d2e/d44/f26 [4489880,91151] 0 2023-12-17T11:57:53.798 INFO:tasks.workunit.client.1.smithi119.stdout:0/744: readlink d2/d16/d35/l72 0 2023-12-17T11:57:53.798 INFO:tasks.workunit.client.1.smithi119.stdout:1/707: mkdir d3/db/d17/d24/d20/dba/dbc/d7e/da1/d101 0 2023-12-17T11:57:53.800 INFO:tasks.workunit.client.1.smithi119.stdout:7/743: write d2/d40/fc6 [2069292,110591] 0 2023-12-17T11:57:53.804 INFO:tasks.workunit.client.1.smithi119.stdout:4/730: creat dd/d11/d2d/d9c/d55/d81/db8/dbd/fe9 x:0 0 0 2023-12-17T11:57:53.807 INFO:tasks.workunit.client.1.smithi119.stdout:9/804: rename d12/dca/dbd/ce8 to d12/d1d/d28/d4d/d73/d78/c100 0 2023-12-17T11:57:53.807 INFO:tasks.workunit.client.1.smithi119.stdout:9/805: chown d12/d1d/d49/l58 1741 1 2023-12-17T11:57:53.807 INFO:tasks.workunit.client.1.smithi119.stdout:0/745: dread d2/d66/d2e/d44/fb9 [0,4194304] 0 2023-12-17T11:57:53.809 INFO:tasks.workunit.client.0.smithi002.stdout:3/771: chown d9/d1b/d35/d41/d43/d73/d89/l9f 62079016 1 2023-12-17T11:57:53.809 INFO:tasks.workunit.client.0.smithi002.stdout:3/772: write d9/d24/d6f/d84/f86 [682648,14895] 0 2023-12-17T11:57:53.813 INFO:tasks.workunit.client.1.smithi119.stdout:2/820: getdents d6/d38 0 2023-12-17T11:57:53.818 INFO:tasks.workunit.client.0.smithi002.stdout:6/742: creat d0/d1/dc/d17/d67/ff4 x:0 0 0 2023-12-17T11:57:53.819 INFO:tasks.workunit.client.1.smithi119.stdout:1/708: dread d3/db/d17/d24/d20/d6c/f86 [0,4194304] 0 2023-12-17T11:57:53.823 INFO:tasks.workunit.client.0.smithi002.stdout:2/717: truncate d3/d4/d7/d14/d9b/fc1 1856086 0 2023-12-17T11:57:53.823 INFO:tasks.workunit.client.1.smithi119.stdout:8/632: mknod d7/da/d1a/d8a/cca 0 2023-12-17T11:57:53.823 INFO:tasks.workunit.client.1.smithi119.stdout:8/633: dread - d7/d18/d45/d9e/fbd zero size 2023-12-17T11:57:53.823 INFO:tasks.workunit.client.1.smithi119.stdout:4/731: dread dd/f28 [0,4194304] 0 2023-12-17T11:57:53.826 INFO:tasks.workunit.client.0.smithi002.stdout:4/682: dwrite d0/d5a/f76 [0,4194304] 0 2023-12-17T11:57:53.837 INFO:tasks.workunit.client.0.smithi002.stdout:9/832: creat dc/d1d/d7c/d90/de4/f12d x:0 0 0 2023-12-17T11:57:53.839 INFO:tasks.workunit.client.1.smithi119.stdout:7/744: truncate d2/d4/d1f/f4c 6109145 0 2023-12-17T11:57:53.845 INFO:tasks.workunit.client.1.smithi119.stdout:2/821: truncate d6/d2b/f87 1966973 0 2023-12-17T11:57:53.845 INFO:tasks.workunit.client.1.smithi119.stdout:8/634: creat d7/d18/d45/fcb x:0 0 0 2023-12-17T11:57:53.846 INFO:tasks.workunit.client.1.smithi119.stdout:5/789: sync 2023-12-17T11:57:53.862 INFO:tasks.workunit.client.1.smithi119.stdout:7/745: dread d2/d4/d11/d2c/d68/f85 [0,4194304] 0 2023-12-17T11:57:53.863 INFO:tasks.workunit.client.1.smithi119.stdout:4/732: rename dd/d15/d16/d3d/dab/lb5 to dd/d11/d26/lea 0 2023-12-17T11:57:53.879 INFO:tasks.workunit.client.0.smithi002.stdout:3/773: mkdir d9/d1b/d35/df3/df8 0 2023-12-17T11:57:53.880 INFO:tasks.workunit.client.1.smithi119.stdout:4/733: write dd/f1d [2979598,72566] 0 2023-12-17T11:57:53.883 INFO:tasks.workunit.client.1.smithi119.stdout:7/746: getdents d2/d4/d11/d2c/d55 0 2023-12-17T11:57:53.885 INFO:tasks.workunit.client.1.smithi119.stdout:0/746: dwrite d2/d66/d1f/d24/d50/fa3 [4194304,4194304] 0 2023-12-17T11:57:53.888 INFO:tasks.workunit.client.1.smithi119.stdout:5/790: getdents d1/d36/dc1 0 2023-12-17T11:57:53.888 INFO:tasks.workunit.client.1.smithi119.stdout:5/791: chown d1/d70/d6b/d77/dae/dba/de3/d86/dda 91 1 2023-12-17T11:57:53.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/718: creat d3/d4/d7/d14/d34/fff x:0 0 0 2023-12-17T11:57:53.895 INFO:tasks.workunit.client.0.smithi002.stdout:4/683: link d0/d10/d14/d4e/fbb d0/d10/d14/dae/fdf 0 2023-12-17T11:57:53.900 INFO:tasks.workunit.client.1.smithi119.stdout:1/709: dwrite d3/fcf [0,4194304] 0 2023-12-17T11:57:53.905 INFO:tasks.workunit.client.0.smithi002.stdout:9/833: rename dc/d1d/d25/d85/dc2/ddd/dfa/d47/f10d to dc/d42/f12e 0 2023-12-17T11:57:53.910 INFO:tasks.workunit.client.1.smithi119.stdout:4/734: mknod dd/d11/d2d/d9c/d55/d81/d88/ceb 0 2023-12-17T11:57:53.912 INFO:tasks.workunit.client.0.smithi002.stdout:8/789: sync 2023-12-17T11:57:53.917 INFO:tasks.workunit.client.1.smithi119.stdout:0/747: truncate d2/d66/d2e/f6d 521333 0 2023-12-17T11:57:53.919 INFO:tasks.workunit.client.0.smithi002.stdout:6/743: rmdir d0/d1/dc/d58/dae 39 2023-12-17T11:57:53.919 INFO:tasks.workunit.client.0.smithi002.stdout:6/744: chown d0/d1/d21/d56/d8c/dce 120487457 1 2023-12-17T11:57:53.921 INFO:tasks.workunit.client.1.smithi119.stdout:5/792: creat d1/d70/d6b/f104 x:0 0 0 2023-12-17T11:57:53.921 INFO:tasks.workunit.client.1.smithi119.stdout:5/793: dread - d1/d36/dc1/f101 zero size 2023-12-17T11:57:53.923 INFO:tasks.workunit.client.0.smithi002.stdout:2/719: creat d3/d4/dbc/f100 x:0 0 0 2023-12-17T11:57:53.924 INFO:tasks.workunit.client.0.smithi002.stdout:4/684: truncate d0/d10/f94 782873 0 2023-12-17T11:57:53.925 INFO:tasks.workunit.client.1.smithi119.stdout:1/710: truncate d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/fc5 2058201 0 2023-12-17T11:57:53.927 INFO:tasks.workunit.client.0.smithi002.stdout:9/834: creat dc/d1d/f12f x:0 0 0 2023-12-17T11:57:53.928 INFO:tasks.workunit.client.1.smithi119.stdout:4/735: unlink dd/d11/d2d/d9c/d55/d81/db8/ld0 0 2023-12-17T11:57:53.929 INFO:tasks.workunit.client.0.smithi002.stdout:6/745: read d0/d1/d21/d56/d60/f62 [2500120,106372] 0 2023-12-17T11:57:53.929 INFO:tasks.workunit.client.0.smithi002.stdout:8/790: symlink d3/d7/d6e/daa/l109 0 2023-12-17T11:57:53.931 INFO:tasks.workunit.client.1.smithi119.stdout:7/747: truncate d2/f24 4110117 0 2023-12-17T11:57:53.931 INFO:tasks.workunit.client.1.smithi119.stdout:7/748: dread - d2/d4/d70/d57/d56/f7d zero size 2023-12-17T11:57:53.931 INFO:tasks.workunit.client.1.smithi119.stdout:7/749: creat d2/d4/d11/d2c/d68/d98/fe4 x:0 0 0 2023-12-17T11:57:53.932 INFO:tasks.workunit.client.1.smithi119.stdout:7/750: truncate d2/d4/d1f/f9b 352195 0 2023-12-17T11:57:53.933 INFO:tasks.workunit.client.1.smithi119.stdout:9/806: dwrite ff [0,4194304] 0 2023-12-17T11:57:53.933 INFO:tasks.workunit.client.0.smithi002.stdout:2/720: rename d3/d4/d7/d14/d42/ce9 to d3/d4/d7/d14/d34/c101 0 2023-12-17T11:57:53.936 INFO:tasks.workunit.client.0.smithi002.stdout:3/774: dwrite d9/d1b/f28 [0,4194304] 0 2023-12-17T11:57:53.941 INFO:tasks.workunit.client.1.smithi119.stdout:2/822: dwrite d6/d9/d52/d53/fcd [0,4194304] 0 2023-12-17T11:57:53.943 INFO:tasks.workunit.client.1.smithi119.stdout:8/635: dwrite d7/d18/f5f [0,4194304] 0 2023-12-17T11:57:53.944 INFO:tasks.workunit.client.0.smithi002.stdout:9/835: symlink dc/l130 0 2023-12-17T11:57:53.944 INFO:tasks.workunit.client.0.smithi002.stdout:6/746: mknod d0/d1/d6d/cf5 0 2023-12-17T11:57:53.945 INFO:tasks.workunit.client.0.smithi002.stdout:6/747: dread - d0/d1/d28/fe9 zero size 2023-12-17T11:57:53.946 INFO:tasks.workunit.client.1.smithi119.stdout:4/736: dread dd/d15/f53 [0,4194304] 0 2023-12-17T11:57:53.950 INFO:tasks.workunit.client.1.smithi119.stdout:0/748: write d2/d66/f1a [2361322,109410] 0 2023-12-17T11:57:53.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/749: stat d2/d66/d2e/f8a 0 2023-12-17T11:57:53.951 INFO:tasks.workunit.client.1.smithi119.stdout:0/750: chown d2/d66/d2e/d44/d7b 21 1 2023-12-17T11:57:53.951 INFO:tasks.workunit.client.1.smithi119.stdout:1/711: write d3/db/d17/d24/d20/d6c/db7/fe2 [1516580,94954] 0 2023-12-17T11:57:53.951 INFO:tasks.workunit.client.1.smithi119.stdout:1/712: creat d3/db/d17/d24/d20/d6c/db7/de4/f102 x:0 0 0 2023-12-17T11:57:53.955 INFO:tasks.workunit.client.0.smithi002.stdout:3/775: creat d9/d1b/d35/df3/ff9 x:0 0 0 2023-12-17T11:57:53.956 INFO:tasks.workunit.client.0.smithi002.stdout:9/836: rename dc to dc/d1d/d7c/d131 22 2023-12-17T11:57:53.957 INFO:tasks.workunit.client.0.smithi002.stdout:2/721: read d3/d4/d7/d14/d2e/d37/d3f/fad [5325539,74935] 0 2023-12-17T11:57:53.966 INFO:tasks.workunit.client.0.smithi002.stdout:0/700: sync 2023-12-17T11:57:53.967 INFO:tasks.workunit.client.1.smithi119.stdout:7/751: creat d2/d4/d11/d3c/fe5 x:0 0 0 2023-12-17T11:57:53.977 INFO:tasks.workunit.client.0.smithi002.stdout:6/748: creat d0/d1/dc/d58/dae/ddb/dc6/ff6 x:0 0 0 2023-12-17T11:57:53.984 INFO:tasks.workunit.client.0.smithi002.stdout:9/837: symlink dc/d42/da0/d82/l132 0 2023-12-17T11:57:53.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/791: dwrite d3/d7/d6e/d7f/d65/fa1 [0,4194304] 0 2023-12-17T11:57:53.987 INFO:tasks.workunit.client.0.smithi002.stdout:8/792: dread - d3/d8/da/dd/db0/fbc zero size 2023-12-17T11:57:53.992 INFO:tasks.workunit.client.0.smithi002.stdout:2/722: getdents d3/d4/d7/d14 0 2023-12-17T11:57:53.992 INFO:tasks.workunit.client.0.smithi002.stdout:2/723: write d3/d4/d7/d14/d42/ff5 [375068,2640] 0 2023-12-17T11:57:53.993 INFO:tasks.workunit.client.0.smithi002.stdout:9/838: dread dc/d42/da0/f119 [0,4194304] 0 2023-12-17T11:57:53.996 INFO:tasks.workunit.client.0.smithi002.stdout:9/839: chown dc/d42/da0/d72/d93/dd0/fd7 650668572 1 2023-12-17T11:57:53.996 INFO:tasks.workunit.client.0.smithi002.stdout:9/840: creat dc/d1d/d7c/d90/de4/f133 x:0 0 0 2023-12-17T11:57:53.997 INFO:tasks.workunit.client.0.smithi002.stdout:9/841: stat dc/d42/da0/ccc 0 2023-12-17T11:57:53.997 INFO:tasks.workunit.client.0.smithi002.stdout:9/842: write dc/f21 [3697546,32762] 0 2023-12-17T11:57:53.997 INFO:tasks.workunit.client.0.smithi002.stdout:0/701: creat d0/d6/d26/d14/fe2 x:0 0 0 2023-12-17T11:57:53.999 INFO:tasks.workunit.client.1.smithi119.stdout:5/794: dwrite d1/da7/d71/d97/ffc [0,4194304] 0 2023-12-17T11:57:53.999 INFO:tasks.workunit.client.0.smithi002.stdout:6/749: rename d0/c49 to d0/d1/dc/d58/dae/ddb/cf7 0 2023-12-17T11:57:54.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/737: mkdir dd/d11/d2d/d9c/d55/d81/db8/dbd/dec 0 2023-12-17T11:57:54.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/738: stat dd/d15/d16/f45 0 2023-12-17T11:57:54.005 INFO:tasks.workunit.client.0.smithi002.stdout:8/793: mknod d3/d8/d28/d31/d5a/db4/dec/c10a 0 2023-12-17T11:57:54.011 INFO:tasks.workunit.client.0.smithi002.stdout:2/724: creat d3/d50/df6/f102 x:0 0 0 2023-12-17T11:57:54.013 INFO:tasks.workunit.client.1.smithi119.stdout:9/807: dwrite d12/d1d/f2f [0,4194304] 0 2023-12-17T11:57:54.013 INFO:tasks.workunit.client.0.smithi002.stdout:9/843: write dc/d42/da0/d72/d93/f29 [1004647,113696] 0 2023-12-17T11:57:54.014 INFO:tasks.workunit.client.0.smithi002.stdout:2/725: write d3/d4/d17/d19/d4d/d72/d77/ff0 [129158,9888] 0 2023-12-17T11:57:54.015 INFO:tasks.workunit.client.0.smithi002.stdout:0/702: rename d0/d6/d26/d25 to d0/d6/d26/d14/d19/d61/de3 0 2023-12-17T11:57:54.015 INFO:tasks.workunit.client.1.smithi119.stdout:4/739: link dd/d15/d16/f1e dd/d11/d26/fed 0 2023-12-17T11:57:54.015 INFO:tasks.workunit.client.1.smithi119.stdout:4/740: readlink dd/d11/d2d/lde 0 2023-12-17T11:57:54.015 INFO:tasks.workunit.client.1.smithi119.stdout:4/741: truncate dd/d11/d2d/d9c/d55/d81/d88/d91/fe6 1007265 0 2023-12-17T11:57:54.015 INFO:tasks.workunit.client.1.smithi119.stdout:9/808: chown d12/d1d/d28/d4d/l75 45975340 1 2023-12-17T11:57:54.016 INFO:tasks.workunit.client.0.smithi002.stdout:6/750: creat d0/d1/dc/d17/d40/ff8 x:0 0 0 2023-12-17T11:57:54.016 INFO:tasks.workunit.client.1.smithi119.stdout:4/742: rename dd/d15/d4f/c61 to dd/d15/cee 0 2023-12-17T11:57:54.016 INFO:tasks.workunit.client.1.smithi119.stdout:4/743: truncate dd/f18 8176050 0 2023-12-17T11:57:54.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/794: mkdir d3/d7/d18/dde/d10b 0 2023-12-17T11:57:54.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/795: write d3/d7/d6e/d7f/d65/da2/fea [790805,836] 0 2023-12-17T11:57:54.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/796: fsync d3/d7/d1a/fd9 0 2023-12-17T11:57:54.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/797: chown d3/d7/d18/d74/d7b/lf4 0 1 2023-12-17T11:57:54.018 INFO:tasks.workunit.client.0.smithi002.stdout:8/798: write d3/d8/da/d44/f102 [643509,118940] 0 2023-12-17T11:57:54.018 INFO:tasks.workunit.client.1.smithi119.stdout:4/744: creat dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/fef x:0 0 0 2023-12-17T11:57:54.019 INFO:tasks.workunit.client.0.smithi002.stdout:9/844: mknod dc/d1d/d25/d85/dc2/ddd/dfa/c134 0 2023-12-17T11:57:54.025 INFO:tasks.workunit.client.1.smithi119.stdout:1/713: dwrite d3/db/d17/d24/d20/dbd/dcb/fd8 [0,4194304] 0 2023-12-17T11:57:54.025 INFO:tasks.workunit.client.1.smithi119.stdout:1/714: creat d3/db/d17/d24/d20/d40/d76/d84/f103 x:0 0 0 2023-12-17T11:57:54.031 INFO:tasks.workunit.client.0.smithi002.stdout:8/799: dread d3/d8/da/dd/f66 [0,4194304] 0 2023-12-17T11:57:54.033 INFO:tasks.workunit.client.1.smithi119.stdout:4/745: symlink dd/d11/d2d/d9c/d55/d81/lf0 0 2023-12-17T11:57:54.039 INFO:tasks.workunit.client.0.smithi002.stdout:2/726: rename d3/d4/d8b/da6/lee to d3/d4/d7/d14/d42/l103 0 2023-12-17T11:57:54.045 INFO:tasks.workunit.client.1.smithi119.stdout:5/795: dread d1/da7/f41 [0,4194304] 0 2023-12-17T11:57:54.045 INFO:tasks.workunit.client.1.smithi119.stdout:2/823: dwrite d6/fbd [4194304,4194304] 0 2023-12-17T11:57:54.046 INFO:tasks.workunit.client.1.smithi119.stdout:5/796: fdatasync d1/f33 0 2023-12-17T11:57:54.050 INFO:tasks.workunit.client.1.smithi119.stdout:8/636: dwrite d7/d18/d45/d9f/f6a [0,4194304] 0 2023-12-17T11:57:54.053 INFO:tasks.workunit.client.1.smithi119.stdout:7/752: dwrite d2/d4/d70/f87 [0,4194304] 0 2023-12-17T11:57:54.053 INFO:tasks.workunit.client.1.smithi119.stdout:0/751: dwrite d2/d16/d35/d74/fd9 [0,4194304] 0 2023-12-17T11:57:54.053 INFO:tasks.workunit.client.1.smithi119.stdout:7/753: write d2/f9f [1107196,44335] 0 2023-12-17T11:57:54.053 INFO:tasks.workunit.client.1.smithi119.stdout:7/754: truncate d2/d4/d11/d2c/d68/d99/f37 6183598 0 2023-12-17T11:57:54.054 INFO:tasks.workunit.client.1.smithi119.stdout:0/752: readlink d2/d66/d2e/d44/d7b/d5/l8d 0 2023-12-17T11:57:54.054 INFO:tasks.workunit.client.1.smithi119.stdout:0/753: chown d2/d16/d35/d39/f76 902307 1 2023-12-17T11:57:54.054 INFO:tasks.workunit.client.0.smithi002.stdout:5/745: sync 2023-12-17T11:57:54.057 INFO:tasks.workunit.client.0.smithi002.stdout:0/703: dwrite d0/d6/d26/d14/d19/d61/de3/f46 [0,4194304] 0 2023-12-17T11:57:54.059 INFO:tasks.workunit.client.1.smithi119.stdout:1/715: mkdir d3/db/d26/d19/dc8/d104 0 2023-12-17T11:57:54.062 INFO:tasks.workunit.client.1.smithi119.stdout:4/746: creat dd/d11/d2d/d9c/d55/d81/db8/d78/dca/ff1 x:0 0 0 2023-12-17T11:57:54.062 INFO:tasks.workunit.client.1.smithi119.stdout:4/747: chown dd/d15/cd2 771061 1 2023-12-17T11:57:54.062 INFO:tasks.workunit.client.1.smithi119.stdout:4/748: dread - dd/d11/d2d/f68 zero size 2023-12-17T11:57:54.066 INFO:tasks.workunit.client.1.smithi119.stdout:4/749: write dd/d11/f74 [248684,126884] 0 2023-12-17T11:57:54.067 INFO:tasks.workunit.client.0.smithi002.stdout:6/751: rename d0/d1/dc/d17/d4c/cd5 to d0/d1/dc/d17/cf9 0 2023-12-17T11:57:54.071 INFO:tasks.workunit.client.1.smithi119.stdout:1/716: dread d3/db/d17/d24/d20/dba/dbc/f6e [0,4194304] 0 2023-12-17T11:57:54.073 INFO:tasks.workunit.client.1.smithi119.stdout:5/797: unlink d1/da7/f5c 0 2023-12-17T11:57:54.074 INFO:tasks.workunit.client.1.smithi119.stdout:3/816: sync 2023-12-17T11:57:54.077 INFO:tasks.workunit.client.1.smithi119.stdout:9/809: dwrite d12/d1d/f36 [4194304,4194304] 0 2023-12-17T11:57:54.078 INFO:tasks.workunit.client.0.smithi002.stdout:2/727: write d3/d50/f8f [208397,64901] 0 2023-12-17T11:57:54.078 INFO:tasks.workunit.client.0.smithi002.stdout:7/720: sync 2023-12-17T11:57:54.079 INFO:tasks.workunit.client.0.smithi002.stdout:1/770: sync 2023-12-17T11:57:54.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/728: chown d3/d56/c64 0 1 2023-12-17T11:57:54.079 INFO:tasks.workunit.client.0.smithi002.stdout:2/729: stat d3/d4/d7/d14/d34 0 2023-12-17T11:57:54.080 INFO:tasks.workunit.client.1.smithi119.stdout:4/750: dread dd/f18 [4194304,4194304] 0 2023-12-17T11:57:54.082 INFO:tasks.workunit.client.0.smithi002.stdout:0/704: symlink d0/d6/d26/d14/d19/d37/dcf/le4 0 2023-12-17T11:57:54.082 INFO:tasks.workunit.client.0.smithi002.stdout:9/845: dwrite dc/d1d/d25/d85/dc2/ddd/dfa/d47/f48 [0,4194304] 0 2023-12-17T11:57:54.084 INFO:tasks.workunit.client.1.smithi119.stdout:8/637: rmdir d7/d18/d15/dbb 0 2023-12-17T11:57:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:6/752: creat d0/d1/dc/d58/dae/ffa x:0 0 0 2023-12-17T11:57:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:2/730: dread d3/d4/d7/d14/d34/f46 [0,4194304] 0 2023-12-17T11:57:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:6/753: write d0/d1/dc/d17/d3c/fa3 [1773330,110265] 0 2023-12-17T11:57:54.088 INFO:tasks.workunit.client.0.smithi002.stdout:6/754: truncate d0/d1/d21/d56/d8c/fdd 780645 0 2023-12-17T11:57:54.090 INFO:tasks.workunit.client.0.smithi002.stdout:8/800: dwrite d3/d7/d6e/d7f/d65/fa1 [0,4194304] 0 2023-12-17T11:57:54.091 INFO:tasks.workunit.client.0.smithi002.stdout:5/746: getdents dc/d94/ded/d5a/d96 0 2023-12-17T11:57:54.091 INFO:tasks.workunit.client.0.smithi002.stdout:5/747: write dc/d1a/d53/ffa [249534,59642] 0 2023-12-17T11:57:54.091 INFO:tasks.workunit.client.1.smithi119.stdout:6/668: sync 2023-12-17T11:57:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:7/721: symlink d6/d17/dc/d13/dd8/ld9 0 2023-12-17T11:57:54.093 INFO:tasks.workunit.client.0.smithi002.stdout:7/722: fdatasync d6/d17/f61 0 2023-12-17T11:57:54.096 INFO:tasks.workunit.client.1.smithi119.stdout:5/798: dread d1/fa [0,4194304] 0 2023-12-17T11:57:54.096 INFO:tasks.workunit.client.1.smithi119.stdout:5/799: dread - d1/d36/d3a/fd7 zero size 2023-12-17T11:57:54.096 INFO:tasks.workunit.client.1.smithi119.stdout:5/800: fsync d1/da7/d71/d97/db3/ff7 0 2023-12-17T11:57:54.096 INFO:tasks.workunit.client.1.smithi119.stdout:5/801: dread - d1/d70/d6b/d77/dae/dba/de3/f89 zero size 2023-12-17T11:57:54.096 INFO:tasks.workunit.client.0.smithi002.stdout:0/705: link d0/d6/d26/d14/d19/d37/dcf/l43 d0/d6/d26/d14/d19/d37/d91/dae/le5 0 2023-12-17T11:57:54.097 INFO:tasks.workunit.client.0.smithi002.stdout:0/706: creat d0/d6/d26/d14/fe6 x:0 0 0 2023-12-17T11:57:54.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/755: symlink d2/d40/dc3/dca/le6 0 2023-12-17T11:57:54.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/756: read d2/d4/f29 [347748,110227] 0 2023-12-17T11:57:54.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/757: fsync d2/d4/d70/fd2 0 2023-12-17T11:57:54.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/758: read d2/d40/f5a [2177764,71357] 0 2023-12-17T11:57:54.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/759: readlink d2/d4/d11/d2c/d68/d99/ld3 0 2023-12-17T11:57:54.102 INFO:tasks.workunit.client.0.smithi002.stdout:5/748: dread dc/d1a/d53/ffa [0,4194304] 0 2023-12-17T11:57:54.102 INFO:tasks.workunit.client.0.smithi002.stdout:5/749: write dc/d1a/d53/fde [424274,77688] 0 2023-12-17T11:57:54.102 INFO:tasks.workunit.client.0.smithi002.stdout:9/846: symlink dc/d42/da0/l135 0 2023-12-17T11:57:54.102 INFO:tasks.workunit.client.0.smithi002.stdout:9/847: chown dc/d42/da0/d72 2579 1 2023-12-17T11:57:54.106 INFO:tasks.workunit.client.1.smithi119.stdout:0/754: mknod d2/dcc/ce5 0 2023-12-17T11:57:54.107 INFO:tasks.workunit.client.1.smithi119.stdout:1/717: mkdir d3/d44/dfd/d105 0 2023-12-17T11:57:54.107 INFO:tasks.workunit.client.0.smithi002.stdout:2/731: mknod d3/d4/d17/d19/d8d/c104 0 2023-12-17T11:57:54.107 INFO:tasks.workunit.client.1.smithi119.stdout:3/817: creat d9/d35/dbd/dfb/f131 x:0 0 0 2023-12-17T11:57:54.109 INFO:tasks.workunit.client.0.smithi002.stdout:2/732: read d3/d56/fa0 [389655,55409] 0 2023-12-17T11:57:54.109 INFO:tasks.workunit.client.0.smithi002.stdout:2/733: fdatasync d3/d4/d7/d14/d42/f47 0 2023-12-17T11:57:54.109 INFO:tasks.workunit.client.1.smithi119.stdout:6/669: write d2/d2b/d43/f4a [3961443,116484] 0 2023-12-17T11:57:54.115 INFO:tasks.workunit.client.1.smithi119.stdout:9/810: creat d12/d1d/d28/d46/dea/dcf/f101 x:0 0 0 2023-12-17T11:57:54.117 INFO:tasks.workunit.client.0.smithi002.stdout:8/801: mknod d3/d7/d6e/c10c 0 2023-12-17T11:57:54.117 INFO:tasks.workunit.client.0.smithi002.stdout:8/802: dread - d3/d8/da/fb9 zero size 2023-12-17T11:57:54.117 INFO:tasks.workunit.client.0.smithi002.stdout:8/803: chown d3/d7/d18/d3f/d49 13 1 2023-12-17T11:57:54.121 INFO:tasks.workunit.client.1.smithi119.stdout:4/751: rmdir dd/d15/d16/d3d/dab 39 2023-12-17T11:57:54.121 INFO:tasks.workunit.client.0.smithi002.stdout:4/685: sync 2023-12-17T11:57:54.121 INFO:tasks.workunit.client.0.smithi002.stdout:3/776: sync 2023-12-17T11:57:54.125 INFO:tasks.workunit.client.1.smithi119.stdout:8/638: getdents d7/da/d1a/d84 0 2023-12-17T11:57:54.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/686: dread d0/f8 [0,4194304] 0 2023-12-17T11:57:54.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/687: dread - d0/d10/d14/d27/fbd zero size 2023-12-17T11:57:54.128 INFO:tasks.workunit.client.0.smithi002.stdout:4/688: chown d0/d10/d21/d33/d96/cb1 214 1 2023-12-17T11:57:54.135 INFO:tasks.workunit.client.0.smithi002.stdout:7/723: symlink d6/d17/dc/d67/d86/lda 0 2023-12-17T11:57:54.141 INFO:tasks.workunit.client.0.smithi002.stdout:0/707: mkdir d0/d6/d26/d14/d19/d37/d86/de7 0 2023-12-17T11:57:54.148 INFO:tasks.workunit.client.0.smithi002.stdout:5/750: mknod dc/d94/ded/d5a/d68/d97/c106 0 2023-12-17T11:57:54.150 INFO:tasks.workunit.client.0.smithi002.stdout:9/848: truncate dc/d42/da0/d72/d93/dd0/dd4/f11b 900462 0 2023-12-17T11:57:54.151 INFO:tasks.workunit.client.0.smithi002.stdout:9/849: readlink dc/d1d/d25/d85/dc2/ddd/lec 0 2023-12-17T11:57:54.152 INFO:tasks.workunit.client.0.smithi002.stdout:2/734: unlink d3/d4/c21 0 2023-12-17T11:57:54.153 INFO:tasks.workunit.client.0.smithi002.stdout:9/850: write dc/d42/da0/d72/d93/f60 [375500,24248] 0 2023-12-17T11:57:54.153 INFO:tasks.workunit.client.0.smithi002.stdout:9/851: dread - dc/d1d/fff zero size 2023-12-17T11:57:54.157 INFO:tasks.workunit.client.0.smithi002.stdout:8/804: symlink d3/d7/d18/d74/d7b/l10d 0 2023-12-17T11:57:54.160 INFO:tasks.workunit.client.0.smithi002.stdout:3/777: symlink d9/d15/d52/d79/dab/lfa 0 2023-12-17T11:57:54.160 INFO:tasks.workunit.client.0.smithi002.stdout:3/778: truncate d9/d1b/d4f/d88/fb3 191642 0 2023-12-17T11:57:54.164 INFO:tasks.workunit.client.0.smithi002.stdout:4/689: rename d0/d10/d14/d27/l2c to d0/d3e/dc8/dca/le0 0 2023-12-17T11:57:54.168 INFO:tasks.workunit.client.0.smithi002.stdout:7/724: rmdir d6/d99/da1 39 2023-12-17T11:57:54.170 INFO:tasks.workunit.client.1.smithi119.stdout:4/752: dread dd/d4b/fa4 [0,4194304] 0 2023-12-17T11:57:54.172 INFO:tasks.workunit.client.0.smithi002.stdout:0/708: symlink d0/d6/d26/d14/d90/d64/le8 0 2023-12-17T11:57:54.172 INFO:tasks.workunit.client.1.smithi119.stdout:1/718: dwrite d3/db/d17/d24/d20/dbd/dcb/fdc [0,4194304] 0 2023-12-17T11:57:54.172 INFO:tasks.workunit.client.1.smithi119.stdout:1/719: stat d3/db/d17/d24/d20/d6c/db7/cc3 0 2023-12-17T11:57:54.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/751: mkdir dc/d94/d107 0 2023-12-17T11:57:54.174 INFO:tasks.workunit.client.0.smithi002.stdout:5/752: write dc/d17/d2f/f7a [986483,112969] 0 2023-12-17T11:57:54.174 INFO:tasks.workunit.client.0.smithi002.stdout:5/753: stat dc/d17/dd2/le7 0 2023-12-17T11:57:54.176 INFO:tasks.workunit.client.1.smithi119.stdout:2/824: rmdir d6/d9 39 2023-12-17T11:57:54.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/779: dread d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:54.180 INFO:tasks.workunit.client.0.smithi002.stdout:3/780: chown d9/d1b/d35/d41/d59/d7c/db7 0 1 2023-12-17T11:57:54.181 INFO:tasks.workunit.client.1.smithi119.stdout:5/802: rename d1/da7/d71/d76/d83/dd1/cd5 to d1/da7/c105 0 2023-12-17T11:57:54.182 INFO:tasks.workunit.client.0.smithi002.stdout:6/755: dwrite d0/d1/d6d/d83/faf [0,4194304] 0 2023-12-17T11:57:54.185 INFO:tasks.workunit.client.1.smithi119.stdout:6/670: dwrite d2/df/d17/d79/f96 [4194304,4194304] 0 2023-12-17T11:57:54.185 INFO:tasks.workunit.client.1.smithi119.stdout:6/671: fdatasync d2/d2b/d7f/fa7 0 2023-12-17T11:57:54.192 INFO:tasks.workunit.client.1.smithi119.stdout:7/760: link d2/d4/d11/d2c/d68/d98/fcf d2/d4/d70/d57/d56/db6/fe7 0 2023-12-17T11:57:54.194 INFO:tasks.workunit.client.0.smithi002.stdout:9/852: creat dc/d42/da0/d72/d93/d52/d12b/f136 x:0 0 0 2023-12-17T11:57:54.195 INFO:tasks.workunit.client.1.smithi119.stdout:0/755: symlink d2/d16/le6 0 2023-12-17T11:57:54.200 INFO:tasks.workunit.client.0.smithi002.stdout:8/805: symlink d3/d8/d28/d31/d5a/db4/dec/l10e 0 2023-12-17T11:57:54.200 INFO:tasks.workunit.client.0.smithi002.stdout:8/806: creat d3/d7/d18/d3f/d49/f10f x:0 0 0 2023-12-17T11:57:54.204 INFO:tasks.workunit.client.1.smithi119.stdout:3/818: creat d9/da/df/d41/d33/db4/f132 x:0 0 0 2023-12-17T11:57:54.204 INFO:tasks.workunit.client.0.smithi002.stdout:2/735: write d3/d4/d7/d14/d9b/fc1 [2250685,66304] 0 2023-12-17T11:57:54.206 INFO:tasks.workunit.client.0.smithi002.stdout:7/725: truncate d6/d17/dc/d67/d8b/d24/fca 3934004 0 2023-12-17T11:57:54.208 INFO:tasks.workunit.client.0.smithi002.stdout:5/754: rmdir dc/d94/ded/d2d/d5b 39 2023-12-17T11:57:54.209 INFO:tasks.workunit.client.0.smithi002.stdout:5/755: write dc/d94/ded/f63 [4360888,116487] 0 2023-12-17T11:57:54.211 INFO:tasks.workunit.client.1.smithi119.stdout:9/811: mkdir d12/d65/d102 0 2023-12-17T11:57:54.211 INFO:tasks.workunit.client.1.smithi119.stdout:4/753: rename dd/d11/d2d/d9c/d55/d81/db8/l56 to dd/d11/d2d/d9c/d55/d81/db8/lf2 0 2023-12-17T11:57:54.216 INFO:tasks.workunit.client.0.smithi002.stdout:3/781: truncate d9/d1b/d35/d41/d59/d7c/f8b 898353 0 2023-12-17T11:57:54.219 INFO:tasks.workunit.client.1.smithi119.stdout:8/639: dwrite d7/da/d11/f59 [0,4194304] 0 2023-12-17T11:57:54.223 INFO:tasks.workunit.client.1.smithi119.stdout:2/825: chown d6/d9/d13/d34/d88/l8b 2027047 1 2023-12-17T11:57:54.223 INFO:tasks.workunit.client.1.smithi119.stdout:8/640: write d7/d18/d15/d81/da2/faf [122451,69483] 0 2023-12-17T11:57:54.224 INFO:tasks.workunit.client.1.smithi119.stdout:5/803: mknod d1/da7/d71/d97/df0/d103/c106 0 2023-12-17T11:57:54.224 INFO:tasks.workunit.client.1.smithi119.stdout:5/804: write d1/da7/d71/d76/d83/fb2 [1821168,5464] 0 2023-12-17T11:57:54.228 INFO:tasks.workunit.client.1.smithi119.stdout:7/761: rename d2/d4/d1f/f4c to d2/d4/d11/d3c/d75/dda/fe8 0 2023-12-17T11:57:54.228 INFO:tasks.workunit.client.1.smithi119.stdout:7/762: getdents d2/d40/da7 0 2023-12-17T11:57:54.228 INFO:tasks.workunit.client.1.smithi119.stdout:7/763: fsync d2/d4/d11/d2c/d68/d6a/f78 0 2023-12-17T11:57:54.232 INFO:tasks.workunit.client.1.smithi119.stdout:3/819: creat d9/f133 x:0 0 0 2023-12-17T11:57:54.234 INFO:tasks.workunit.client.1.smithi119.stdout:9/812: read d12/d1d/f36 [2445480,83884] 0 2023-12-17T11:57:54.234 INFO:tasks.workunit.client.1.smithi119.stdout:9/813: creat d12/d1d/d28/d46/d6e/f103 x:0 0 0 2023-12-17T11:57:54.235 INFO:tasks.workunit.client.1.smithi119.stdout:4/754: creat dd/d15/d16/d20/ff3 x:0 0 0 2023-12-17T11:57:54.235 INFO:tasks.workunit.client.0.smithi002.stdout:6/756: unlink d0/d1/dc/d10/f98 0 2023-12-17T11:57:54.238 INFO:tasks.workunit.client.1.smithi119.stdout:4/755: write dd/d11/d2d/fb4 [213247,51359] 0 2023-12-17T11:57:54.238 INFO:tasks.workunit.client.1.smithi119.stdout:6/672: dwrite d2/f11 [4194304,4194304] 0 2023-12-17T11:57:54.241 INFO:tasks.workunit.client.1.smithi119.stdout:5/805: creat d1/d70/d6b/d77/f107 x:0 0 0 2023-12-17T11:57:54.241 INFO:tasks.workunit.client.1.smithi119.stdout:5/806: chown d1/d70/d6b/d77/dae/fd6 7138298 1 2023-12-17T11:57:54.243 INFO:tasks.workunit.client.0.smithi002.stdout:8/807: mknod d3/d7/d18/c110 0 2023-12-17T11:57:54.244 INFO:tasks.workunit.client.0.smithi002.stdout:9/853: dwrite dc/d1d/d25/d85/dc2/ddd/dfa/d47/ff3 [0,4194304] 0 2023-12-17T11:57:54.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/736: creat d3/d4/d17/f105 x:0 0 0 2023-12-17T11:57:54.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/737: write d3/d50/fc0 [346011,50256] 0 2023-12-17T11:57:54.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/738: creat d3/d4/d17/d19/d4d/d72/d77/da7/f106 x:0 0 0 2023-12-17T11:57:54.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/739: chown d3/d4/d7/d14/d34/cb1 468 1 2023-12-17T11:57:54.245 INFO:tasks.workunit.client.0.smithi002.stdout:2/740: chown d3/d4/d7/d14/d42/f76 6814 1 2023-12-17T11:57:54.246 INFO:tasks.workunit.client.1.smithi119.stdout:7/764: truncate d2/d40/fc6 1718885 0 2023-12-17T11:57:54.247 INFO:tasks.workunit.client.0.smithi002.stdout:5/756: mkdir dc/d17/d2f/d99/d108 0 2023-12-17T11:57:54.250 INFO:tasks.workunit.client.0.smithi002.stdout:3/782: unlink d9/d1b/d35/l93 0 2023-12-17T11:57:54.250 INFO:tasks.workunit.client.0.smithi002.stdout:3/783: truncate d9/d1b/d35/d41/d59/d65/da9/d8f/f90 1829008 0 2023-12-17T11:57:54.252 INFO:tasks.workunit.client.0.smithi002.stdout:6/757: truncate d0/d1/dc/d17/d3c/fb5 1615422 0 2023-12-17T11:57:54.252 INFO:tasks.workunit.client.0.smithi002.stdout:6/758: chown d0/d1/dc/d58/de8 568817 1 2023-12-17T11:57:54.253 INFO:tasks.workunit.client.1.smithi119.stdout:2/826: dread d6/d2b/da3/fc5 [0,4194304] 0 2023-12-17T11:57:54.253 INFO:tasks.workunit.client.1.smithi119.stdout:2/827: fsync d6/d9/d52/d53/d55/d58/da5/f102 0 2023-12-17T11:57:54.258 INFO:tasks.workunit.client.0.smithi002.stdout:7/726: dwrite d6/d99/f9c [0,4194304] 0 2023-12-17T11:57:54.258 INFO:tasks.workunit.client.0.smithi002.stdout:7/727: write d6/d17/dc/d13/d37/d4f/f6d [5622705,25557] 0 2023-12-17T11:57:54.258 INFO:tasks.workunit.client.1.smithi119.stdout:9/814: mknod d12/d1d/d28/d46/d50/d92/da1/c104 0 2023-12-17T11:57:54.261 INFO:tasks.workunit.client.1.smithi119.stdout:8/641: write d7/da/d11/d26/d49/f5e [1323027,92279] 0 2023-12-17T11:57:54.263 INFO:tasks.workunit.client.1.smithi119.stdout:4/756: read dd/f94 [3305261,58986] 0 2023-12-17T11:57:54.263 INFO:tasks.workunit.client.1.smithi119.stdout:4/757: fdatasync dd/d11/d2d/d9c/d55/d81/db8/d78/dca/ff1 0 2023-12-17T11:57:54.263 INFO:tasks.workunit.client.0.smithi002.stdout:8/808: mkdir d3/d7/d111 0 2023-12-17T11:57:54.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/809: write d3/d8/da/f46 [5033551,9042] 0 2023-12-17T11:57:54.265 INFO:tasks.workunit.client.1.smithi119.stdout:6/673: stat d2/d2b/d43/d5e/db3/lc4 0 2023-12-17T11:57:54.269 INFO:tasks.workunit.client.0.smithi002.stdout:9/854: link dc/d42/d4f/c101 dc/d1d/d7c/d90/de4/c137 0 2023-12-17T11:57:54.269 INFO:tasks.workunit.client.0.smithi002.stdout:9/855: stat f0 0 2023-12-17T11:57:54.273 INFO:tasks.workunit.client.1.smithi119.stdout:7/765: mkdir d2/d40/dc3/de9 0 2023-12-17T11:57:54.274 INFO:tasks.workunit.client.1.smithi119.stdout:5/807: mknod d1/d70/d6b/d77/dae/dba/de3/d86/c108 0 2023-12-17T11:57:54.274 INFO:tasks.workunit.client.1.smithi119.stdout:5/808: chown d1/d70/d85/d95 1719702 1 2023-12-17T11:57:54.274 INFO:tasks.workunit.client.1.smithi119.stdout:5/809: chown d1/d70/d6b/d77/dae/dba/de3/d86/fc9 26054 1 2023-12-17T11:57:54.281 INFO:tasks.workunit.client.1.smithi119.stdout:5/810: write d1/d25/f31 [1124320,6420] 0 2023-12-17T11:57:54.281 INFO:tasks.workunit.client.1.smithi119.stdout:5/811: chown d1/d25/f46 1911 1 2023-12-17T11:57:54.282 INFO:tasks.workunit.client.1.smithi119.stdout:5/812: chown d1/d70/d6b/d77/dae/dba/de3/lb5 340252687 1 2023-12-17T11:57:54.282 INFO:tasks.workunit.client.0.smithi002.stdout:2/741: mkdir d3/d4/d17/d19/d4d/d72/d83/d94/d107 0 2023-12-17T11:57:54.282 INFO:tasks.workunit.client.0.smithi002.stdout:3/784: symlink d9/d24/d6f/d84/lfb 0 2023-12-17T11:57:54.284 INFO:tasks.workunit.client.1.smithi119.stdout:0/756: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:57:54.285 INFO:tasks.workunit.client.1.smithi119.stdout:3/820: rename d9/da/df/l29 to d9/d59/dda/l134 0 2023-12-17T11:57:54.286 INFO:tasks.workunit.client.1.smithi119.stdout:2/828: truncate d6/d38/f94 1428862 0 2023-12-17T11:57:54.291 INFO:tasks.workunit.client.1.smithi119.stdout:4/758: truncate f2 191030 0 2023-12-17T11:57:54.294 INFO:tasks.workunit.client.0.smithi002.stdout:7/728: mkdir d6/d17/dc/d6c/dcb/ddb 0 2023-12-17T11:57:54.298 INFO:tasks.workunit.client.0.smithi002.stdout:1/771: sync 2023-12-17T11:57:54.301 INFO:tasks.workunit.client.1.smithi119.stdout:9/815: dread d12/d1d/d28/d4d/d73/f88 [0,4194304] 0 2023-12-17T11:57:54.303 INFO:tasks.workunit.client.1.smithi119.stdout:7/766: mknod d2/d4/d11/d2c/d68/d98/dd1/cea 0 2023-12-17T11:57:54.306 INFO:tasks.workunit.client.1.smithi119.stdout:7/767: write d2/d4/d70/d57/d56/f59 [5085949,121596] 0 2023-12-17T11:57:54.306 INFO:tasks.workunit.client.1.smithi119.stdout:7/768: truncate d2/d4/d11/d2c/d68/d77/f79 4578843 0 2023-12-17T11:57:54.306 INFO:tasks.workunit.client.1.smithi119.stdout:7/769: chown d2/d40/dc3/dca/dd9 10424562 1 2023-12-17T11:57:54.307 INFO:tasks.workunit.client.0.smithi002.stdout:0/709: dwrite d0/d6/d26/d14/d19/d61/f7c [0,4194304] 0 2023-12-17T11:57:54.308 INFO:tasks.workunit.client.0.smithi002.stdout:9/856: creat dc/d1d/d25/d85/f138 x:0 0 0 2023-12-17T11:57:54.320 INFO:tasks.workunit.client.0.smithi002.stdout:2/742: symlink d3/d4/d43/l108 0 2023-12-17T11:57:54.323 INFO:tasks.workunit.client.0.smithi002.stdout:3/785: mknod d9/d15/d6a/cfc 0 2023-12-17T11:57:54.323 INFO:tasks.workunit.client.0.smithi002.stdout:3/786: chown d9/d24/le9 1059450 1 2023-12-17T11:57:54.326 INFO:tasks.workunit.client.0.smithi002.stdout:8/810: getdents d3/d8/da/dd 0 2023-12-17T11:57:54.330 INFO:tasks.workunit.client.0.smithi002.stdout:7/729: rename d6/d17/dc/d6c/d93/fa0 to d6/d17/dc/d13/dd8/db0/fdc 0 2023-12-17T11:57:54.331 INFO:tasks.workunit.client.0.smithi002.stdout:1/772: rmdir d3/d2f/d74/d97 39 2023-12-17T11:57:54.331 INFO:tasks.workunit.client.0.smithi002.stdout:1/773: write d3/d6/d9/d37/f65 [4577375,35223] 0 2023-12-17T11:57:54.331 INFO:tasks.workunit.client.0.smithi002.stdout:6/759: dwrite d0/d1/dc/d58/dae/ddb/fd0 [0,4194304] 0 2023-12-17T11:57:54.333 INFO:tasks.workunit.client.1.smithi119.stdout:5/813: dread d1/d36/d3a/f4b [4194304,4194304] 0 2023-12-17T11:57:54.335 INFO:tasks.workunit.client.1.smithi119.stdout:3/821: mkdir d9/d11/d1e/d55/d77/d135 0 2023-12-17T11:57:54.337 INFO:tasks.workunit.client.0.smithi002.stdout:0/710: symlink d0/d6/d26/d14/d6d/d7e/le9 0 2023-12-17T11:57:54.338 INFO:tasks.workunit.client.1.smithi119.stdout:2/829: fsync d6/d9/f60 0 2023-12-17T11:57:54.339 INFO:tasks.workunit.client.0.smithi002.stdout:9/857: mknod dc/d42/d4f/dd5/c139 0 2023-12-17T11:57:54.341 INFO:tasks.workunit.client.1.smithi119.stdout:9/816: rename d12/d1d/d28/d46/dea/fed to d12/d1d/d28/d46/d50/d92/dae/f105 0 2023-12-17T11:57:54.343 INFO:tasks.workunit.client.0.smithi002.stdout:2/743: unlink d3/d4/f87 0 2023-12-17T11:57:54.344 INFO:tasks.workunit.client.0.smithi002.stdout:8/811: mkdir d3/d8/da/dd/db0/d112 0 2023-12-17T11:57:54.345 INFO:tasks.workunit.client.1.smithi119.stdout:5/814: mkdir d1/d70/d85/d95/d109 0 2023-12-17T11:57:54.348 INFO:tasks.workunit.client.1.smithi119.stdout:3/822: truncate f4 1320735 0 2023-12-17T11:57:54.348 INFO:tasks.workunit.client.1.smithi119.stdout:3/823: creat d9/da/dcc/db8/f136 x:0 0 0 2023-12-17T11:57:54.349 INFO:tasks.workunit.client.1.smithi119.stdout:2/830: mkdir d6/d2b/d3f/da8/d122 0 2023-12-17T11:57:54.350 INFO:tasks.workunit.client.1.smithi119.stdout:9/817: mkdir d12/d1d/d28/d46/d50/d92/dcc/d106 0 2023-12-17T11:57:54.351 INFO:tasks.workunit.client.0.smithi002.stdout:2/744: dread d3/d4/d17/d19/d4d/d72/d77/ff0 [0,4194304] 0 2023-12-17T11:57:54.351 INFO:tasks.workunit.client.0.smithi002.stdout:2/745: fdatasync d3/d4/d17/d19/d4d/d72/d83/fb3 0 2023-12-17T11:57:54.353 INFO:tasks.workunit.client.1.smithi119.stdout:5/815: link d1/d70/d6b/d77/dae/dba/de3/d86/l92 d1/d70/d6b/d77/l10a 0 2023-12-17T11:57:54.353 INFO:tasks.workunit.client.1.smithi119.stdout:8/642: dwrite d7/d12/d69/f74 [0,4194304] 0 2023-12-17T11:57:54.354 INFO:tasks.workunit.client.0.smithi002.stdout:7/730: creat d6/d17/dc/d13/dd8/dd0/fdd x:0 0 0 2023-12-17T11:57:54.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/774: dread d3/d6/d16/d28/f58 [0,4194304] 0 2023-12-17T11:57:54.357 INFO:tasks.workunit.client.0.smithi002.stdout:1/775: chown c0 845 1 2023-12-17T11:57:54.358 INFO:tasks.workunit.client.1.smithi119.stdout:7/770: dwrite d2/d4/d70/f9d [0,4194304] 0 2023-12-17T11:57:54.358 INFO:tasks.workunit.client.1.smithi119.stdout:7/771: fsync d2/d40/f6d 0 2023-12-17T11:57:54.359 INFO:tasks.workunit.client.0.smithi002.stdout:9/858: dread dc/d1d/d7c/d90/dc0/fc8 [0,4194304] 0 2023-12-17T11:57:54.359 INFO:tasks.workunit.client.0.smithi002.stdout:2/746: dread d3/d4/d7/d14/f82 [0,4194304] 0 2023-12-17T11:57:54.359 INFO:tasks.workunit.client.0.smithi002.stdout:2/747: write d3/d4/d17/d19/d4d/d72/fa3 [500833,70529] 0 2023-12-17T11:57:54.359 INFO:tasks.workunit.client.1.smithi119.stdout:3/824: mkdir d9/da/df/d41/d33/db4/d137 0 2023-12-17T11:57:54.361 INFO:tasks.workunit.client.0.smithi002.stdout:0/711: unlink d0/d6/d26/d14/f5d 0 2023-12-17T11:57:54.362 INFO:tasks.workunit.client.0.smithi002.stdout:8/812: rmdir d3/d8/d28/d31/d5a 39 2023-12-17T11:57:54.363 INFO:tasks.workunit.client.1.smithi119.stdout:9/818: mkdir d12/d1d/d28/d46/dbb/d107 0 2023-12-17T11:57:54.364 INFO:tasks.workunit.client.1.smithi119.stdout:6/674: dwrite d2/df/f55 [4194304,4194304] 0 2023-12-17T11:57:54.364 INFO:tasks.workunit.client.1.smithi119.stdout:6/675: stat d2/d2b/c88 0 2023-12-17T11:57:54.364 INFO:tasks.workunit.client.1.smithi119.stdout:6/676: dread - d2/d7e/f9e zero size 2023-12-17T11:57:54.365 INFO:tasks.workunit.client.0.smithi002.stdout:7/731: link d6/l85 d6/d17/dc/d13/d3e/lde 0 2023-12-17T11:57:54.367 INFO:tasks.workunit.client.1.smithi119.stdout:5/816: mkdir d1/da7/d10b 0 2023-12-17T11:57:54.367 INFO:tasks.workunit.client.1.smithi119.stdout:5/817: truncate d1/d70/d6b/f87 1096404 0 2023-12-17T11:57:54.370 INFO:tasks.workunit.client.1.smithi119.stdout:8/643: symlink d7/d18/d15/d64/dc5/lcc 0 2023-12-17T11:57:54.373 INFO:tasks.workunit.client.0.smithi002.stdout:6/760: rmdir d0/d1/dc0 39 2023-12-17T11:57:54.376 INFO:tasks.workunit.client.0.smithi002.stdout:2/748: unlink d3/d50/l73 0 2023-12-17T11:57:54.377 INFO:tasks.workunit.client.1.smithi119.stdout:7/772: rename d2/d4/d11/d2c/d68/d99/f4a to d2/d4/d11/d2c/feb 0 2023-12-17T11:57:54.379 INFO:tasks.workunit.client.0.smithi002.stdout:8/813: truncate d3/d8/da/fcb 411705 0 2023-12-17T11:57:54.382 INFO:tasks.workunit.client.1.smithi119.stdout:3/825: mknod d9/d59/c138 0 2023-12-17T11:57:54.382 INFO:tasks.workunit.client.1.smithi119.stdout:3/826: write d9/d59/f5d [960260,20790] 0 2023-12-17T11:57:54.385 INFO:tasks.workunit.client.0.smithi002.stdout:7/732: truncate d6/d17/dc/d13/d37/d4f/fa8 6074348 0 2023-12-17T11:57:54.385 INFO:tasks.workunit.client.1.smithi119.stdout:2/831: unlink d6/c36 0 2023-12-17T11:57:54.386 INFO:tasks.workunit.client.0.smithi002.stdout:9/859: dread dc/d1d/d25/f124 [0,4194304] 0 2023-12-17T11:57:54.386 INFO:tasks.workunit.client.0.smithi002.stdout:9/860: dread - dc/d1d/d25/d85/dc2/ddd/dfa/d47/fc7 zero size 2023-12-17T11:57:54.387 INFO:tasks.workunit.client.0.smithi002.stdout:9/861: readlink dc/d42/lc4 0 2023-12-17T11:57:54.387 INFO:tasks.workunit.client.0.smithi002.stdout:8/814: dread d3/d8/da/f9f [0,4194304] 0 2023-12-17T11:57:54.387 INFO:tasks.workunit.client.0.smithi002.stdout:2/749: write d3/d4/d7/f1a [854563,20272] 0 2023-12-17T11:57:54.389 INFO:tasks.workunit.client.1.smithi119.stdout:7/773: dread d2/d5b/f96 [0,4194304] 0 2023-12-17T11:57:54.390 INFO:tasks.workunit.client.0.smithi002.stdout:6/761: write d0/d1/dc/f8 [5280972,103738] 0 2023-12-17T11:57:54.392 INFO:tasks.workunit.client.0.smithi002.stdout:3/787: dwrite d9/d1b/d35/d41/d59/d72/ff6 [0,4194304] 0 2023-12-17T11:57:54.392 INFO:tasks.workunit.client.0.smithi002.stdout:3/788: getdents d9/d1b/d35/df3/df8 0 2023-12-17T11:57:54.392 INFO:tasks.workunit.client.0.smithi002.stdout:3/789: creat d9/d1b/d35/d41/d59/d72/ffd x:0 0 0 2023-12-17T11:57:54.393 INFO:tasks.workunit.client.1.smithi119.stdout:9/819: mknod d12/d1d/d28/d46/d50/d92/daf/deb/c108 0 2023-12-17T11:57:54.396 INFO:tasks.workunit.client.1.smithi119.stdout:6/677: creat d2/d2b/d43/dcb/fd0 x:0 0 0 2023-12-17T11:57:54.396 INFO:tasks.workunit.client.1.smithi119.stdout:6/678: fdatasync d2/d2b/d43/d5e/f70 0 2023-12-17T11:57:54.396 INFO:tasks.workunit.client.1.smithi119.stdout:6/679: chown d2/f19 234981 1 2023-12-17T11:57:54.397 INFO:tasks.workunit.client.0.smithi002.stdout:9/862: creat dc/d1d/d25/d85/dc2/ddd/dfa/d47/d4b/f13a x:0 0 0 2023-12-17T11:57:54.397 INFO:tasks.workunit.client.0.smithi002.stdout:9/863: stat dc/d1d/d7c/d90/de4/f12d 0 2023-12-17T11:57:54.398 INFO:tasks.workunit.client.1.smithi119.stdout:5/818: symlink d1/d70/d6b/d77/dae/dba/de3/d86/l10c 0 2023-12-17T11:57:54.399 INFO:tasks.workunit.client.1.smithi119.stdout:5/819: fdatasync d1/d25/f79 0 2023-12-17T11:57:54.399 INFO:tasks.workunit.client.1.smithi119.stdout:5/820: write d1/da7/d71/d76/d83/dd1/fe0 [263807,54643] 0 2023-12-17T11:57:54.399 INFO:tasks.workunit.client.1.smithi119.stdout:5/821: chown d1/d44/d52/f8c 66255900 1 2023-12-17T11:57:54.401 INFO:tasks.workunit.client.0.smithi002.stdout:8/815: mknod d3/d7/d6e/d7f/c113 0 2023-12-17T11:57:54.401 INFO:tasks.workunit.client.1.smithi119.stdout:8/644: getdents d7/da/d1a/d8a 0 2023-12-17T11:57:54.402 INFO:tasks.workunit.client.1.smithi119.stdout:8/645: creat d7/d18/d15/d81/d8e/fcd x:0 0 0 2023-12-17T11:57:54.402 INFO:tasks.workunit.client.1.smithi119.stdout:8/646: fdatasync d7/d18/d45/f6d 0 2023-12-17T11:57:54.406 INFO:tasks.workunit.client.1.smithi119.stdout:2/832: rename d6/l9a to d6/d2b/l123 0 2023-12-17T11:57:54.406 INFO:tasks.workunit.client.1.smithi119.stdout:2/833: chown d6/d9/d13/d34/d88/fd4 1433211409 1 2023-12-17T11:57:54.408 INFO:tasks.workunit.client.0.smithi002.stdout:9/864: dread dc/d42/da0/d72/d93/d76/fc1 [0,4194304] 0 2023-12-17T11:57:54.409 INFO:tasks.workunit.client.1.smithi119.stdout:7/774: dread d2/d4/f16 [0,4194304] 0 2023-12-17T11:57:54.409 INFO:tasks.workunit.client.1.smithi119.stdout:7/775: read d2/d4/d11/d2c/d68/f85 [146066,30483] 0 2023-12-17T11:57:54.410 INFO:tasks.workunit.client.0.smithi002.stdout:2/750: mkdir d3/d4/d7/d14/d2e/d37/dce/df1/d109 0 2023-12-17T11:57:54.414 INFO:tasks.workunit.client.0.smithi002.stdout:0/712: dwrite d0/d6/d26/d14/d19/d37/d91/fbb [0,4194304] 0 2023-12-17T11:57:54.414 INFO:tasks.workunit.client.0.smithi002.stdout:0/713: chown d0/d6/d26/d14/d19/d61/de3/f45 24 1 2023-12-17T11:57:54.416 INFO:tasks.workunit.client.1.smithi119.stdout:5/822: creat d1/d70/d85/d95/dc3/f10d x:0 0 0 2023-12-17T11:57:54.416 INFO:tasks.workunit.client.1.smithi119.stdout:5/823: creat d1/d70/da3/f10e x:0 0 0 2023-12-17T11:57:54.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/762: mknod d0/d1/dc/d58/dae/cfb 0 2023-12-17T11:57:54.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/763: dread - d0/d1/dc/d58/dae/ffa zero size 2023-12-17T11:57:54.421 INFO:tasks.workunit.client.1.smithi119.stdout:8/647: mknod d7/d12/d23/d9c/dad/cce 0 2023-12-17T11:57:54.427 INFO:tasks.workunit.client.1.smithi119.stdout:2/834: rename d6/d2b/d3f/d5b/l7c to d6/d2b/d3f/da8/l124 0 2023-12-17T11:57:54.427 INFO:tasks.workunit.client.1.smithi119.stdout:2/835: fdatasync d6/d38/f57 0 2023-12-17T11:57:54.427 INFO:tasks.workunit.client.1.smithi119.stdout:2/836: chown d6/d9/d86/f105 0 1 2023-12-17T11:57:54.427 INFO:tasks.workunit.client.1.smithi119.stdout:2/837: dread - d6/d9/f8e zero size 2023-12-17T11:57:54.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/714: write d0/d6/d26/f3b [3820752,111031] 0 2023-12-17T11:57:54.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/715: chown d0/d6/d26/d14/d19/d61/dbf/cd9 145330605 1 2023-12-17T11:57:54.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/716: fdatasync d0/d6/d26/d14/fe6 0 2023-12-17T11:57:54.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/717: chown d0/d6/d26/d14/d90/d64/cd0 3477727 1 2023-12-17T11:57:54.428 INFO:tasks.workunit.client.0.smithi002.stdout:0/718: creat d0/d6/d26/d14/d19/d2b/fea x:0 0 0 2023-12-17T11:57:54.429 INFO:tasks.workunit.client.1.smithi119.stdout:7/776: creat d2/d4/d11/d3c/d75/fec x:0 0 0 2023-12-17T11:57:54.432 INFO:tasks.workunit.client.0.smithi002.stdout:3/790: creat d9/d15/d6a/ffe x:0 0 0 2023-12-17T11:57:54.432 INFO:tasks.workunit.client.1.smithi119.stdout:7/777: write d2/d5b/f92 [1120539,51792] 0 2023-12-17T11:57:54.432 INFO:tasks.workunit.client.1.smithi119.stdout:7/778: chown d2/d4/d11/d2c/c3b 65822890 1 2023-12-17T11:57:54.438 INFO:tasks.workunit.client.1.smithi119.stdout:5/824: getdents d1/da7/d71/d97/df0/d103 0 2023-12-17T11:57:54.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/719: dread d0/d6/d26/d14/d19/d37/d62/fc7 [0,4194304] 0 2023-12-17T11:57:54.439 INFO:tasks.workunit.client.0.smithi002.stdout:8/816: mkdir d3/d7/d114 0 2023-12-17T11:57:54.442 INFO:tasks.workunit.client.0.smithi002.stdout:2/751: creat d3/d4/d7/d14/d42/d8a/f10a x:0 0 0 2023-12-17T11:57:54.442 INFO:tasks.workunit.client.0.smithi002.stdout:2/752: chown d3/d4/f3a 25089998 1 2023-12-17T11:57:54.448 INFO:tasks.workunit.client.1.smithi119.stdout:5/825: link d1/da7/c105 d1/d70/d6b/d77/dae/dba/de3/d86/c10f 0 2023-12-17T11:57:54.449 INFO:tasks.workunit.client.0.smithi002.stdout:6/764: creat d0/d1/dc/d17/ffc x:0 0 0 2023-12-17T11:57:54.451 INFO:tasks.workunit.client.1.smithi119.stdout:8/648: link d7/da/f3e d7/d18/fcf 0 2023-12-17T11:57:54.453 INFO:tasks.workunit.client.0.smithi002.stdout:9/865: dwrite dc/d32/f53 [0,4194304] 0 2023-12-17T11:57:54.455 INFO:tasks.workunit.client.0.smithi002.stdout:4/690: sync 2023-12-17T11:57:54.455 INFO:tasks.workunit.client.0.smithi002.stdout:5/757: sync 2023-12-17T11:57:54.455 INFO:tasks.workunit.client.0.smithi002.stdout:4/691: fdatasync d0/d10/d21/f2f 0 2023-12-17T11:57:54.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/758: write dc/d94/ded/d5a/d96/fec [451752,46254] 0 2023-12-17T11:57:54.456 INFO:tasks.workunit.client.0.smithi002.stdout:5/759: truncate dc/d94/ded/d5a/d96/ff5 10836 0 2023-12-17T11:57:54.456 INFO:tasks.workunit.client.1.smithi119.stdout:9/820: dwrite d12/d1d/d28/d46/dea/dcf/f101 [0,4194304] 0 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/779: rmdir d2/d5b 39 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/780: fdatasync d2/d4/d11/d3c/d75/f7f 0 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/781: chown d2/d5b/f92 2142 1 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.1.smithi119.stdout:7/782: write d2/d40/dc3/fb3 [630876,103616] 0 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.0.smithi002.stdout:3/791: creat d9/d1b/d35/df3/df8/fff x:0 0 0 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.1.smithi119.stdout:5/826: mknod d1/d44/c110 0 2023-12-17T11:57:54.457 INFO:tasks.workunit.client.1.smithi119.stdout:5/827: creat d1/f111 x:0 0 0 2023-12-17T11:57:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/817: symlink d3/d7/l115 0 2023-12-17T11:57:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/818: chown d3/d7/d18/c108 66206922 1 2023-12-17T11:57:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/819: write d3/d7/d18/d74/f79 [1446308,65580] 0 2023-12-17T11:57:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:8/820: creat d3/d7/d18/d3f/d49/f116 x:0 0 0 2023-12-17T11:57:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:2/753: rename d3/d4/d43/ce4 to d3/d4/d17/d19/d8d/c10b 0 2023-12-17T11:57:54.460 INFO:tasks.workunit.client.0.smithi002.stdout:2/754: stat d3/d4/fe 0 2023-12-17T11:57:54.461 INFO:tasks.workunit.client.1.smithi119.stdout:5/828: write d1/d70/d85/d95/f8f [114341,53002] 0 2023-12-17T11:57:54.461 INFO:tasks.workunit.client.1.smithi119.stdout:5/829: truncate d1/fa 5189458 0 2023-12-17T11:57:54.463 INFO:tasks.workunit.client.1.smithi119.stdout:8/649: symlink d7/d12/d69/ld0 0 2023-12-17T11:57:54.465 INFO:tasks.workunit.client.0.smithi002.stdout:0/720: dread d0/d6/d26/d14/d19/d61/de3/f45 [0,4194304] 0 2023-12-17T11:57:54.465 INFO:tasks.workunit.client.0.smithi002.stdout:0/721: creat d0/d6/d26/d14/d19/d37/d86/feb x:0 0 0 2023-12-17T11:57:54.466 INFO:tasks.workunit.client.0.smithi002.stdout:0/722: creat d0/d6/d26/d14/fec x:0 0 0 2023-12-17T11:57:54.467 INFO:tasks.workunit.client.0.smithi002.stdout:6/765: mknod d0/d1/dc/d17/d4c/dc5/cfd 0 2023-12-17T11:57:54.472 INFO:tasks.workunit.client.0.smithi002.stdout:4/692: mkdir d0/d6c/dda/de1 0 2023-12-17T11:57:54.477 INFO:tasks.workunit.client.0.smithi002.stdout:3/792: symlink d9/d24/d6f/l100 0 2023-12-17T11:57:54.478 INFO:tasks.workunit.client.0.smithi002.stdout:9/866: dread dc/d42/d4f/dd5/f123 [0,4194304] 0 2023-12-17T11:57:54.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/760: dread dc/d94/ded/d2d/d5b/fcb [0,4194304] 0 2023-12-17T11:57:54.486 INFO:tasks.workunit.client.1.smithi119.stdout:8/650: dread d7/da/f41 [4194304,4194304] 0 2023-12-17T11:57:54.491 INFO:tasks.workunit.client.0.smithi002.stdout:2/755: unlink d3/d4/d17/d19/d4d/d72/cd0 0 2023-12-17T11:57:54.491 INFO:tasks.workunit.client.0.smithi002.stdout:2/756: dread - d3/d4/d8b/da6/fdd zero size 2023-12-17T11:57:54.491 INFO:tasks.workunit.client.1.smithi119.stdout:7/783: mknod d2/d4/d11/d2c/d68/db4/ced 0 2023-12-17T11:57:54.493 INFO:tasks.workunit.client.0.smithi002.stdout:0/723: creat d0/d6/d26/d14/d90/fed x:0 0 0 2023-12-17T11:57:54.512 INFO:tasks.workunit.client.0.smithi002.stdout:0/724: dread d0/d6/d26/d14/d19/d2b/f30 [0,4194304] 0 2023-12-17T11:57:54.512 INFO:tasks.workunit.client.0.smithi002.stdout:8/821: rename d3/d8/da/dd to d3/d8/d28/d31/d5a/db4/d117 0 2023-12-17T11:57:54.513 INFO:tasks.workunit.client.0.smithi002.stdout:5/761: getdents dc/d94/ded/d2d/d5b 0 2023-12-17T11:57:54.514 INFO:tasks.workunit.client.1.smithi119.stdout:8/651: creat d7/d12/d23/fd1 x:0 0 0 2023-12-17T11:57:54.520 INFO:tasks.workunit.client.1.smithi119.stdout:7/784: creat d2/d4/fee x:0 0 0 2023-12-17T11:57:54.528 INFO:tasks.workunit.client.0.smithi002.stdout:2/757: symlink d3/d4/d17/d19/d8d/l10c 0 2023-12-17T11:57:54.531 INFO:tasks.workunit.client.0.smithi002.stdout:9/867: rmdir dc/d1d/d25/d85/dc2/df8 39 2023-12-17T11:57:54.531 INFO:tasks.workunit.client.0.smithi002.stdout:6/766: dread d0/d1/dc/d17/d3c/fb5 [0,4194304] 0 2023-12-17T11:57:54.532 INFO:tasks.workunit.client.1.smithi119.stdout:8/652: write d7/da/d11/faa [3799,60029] 0 2023-12-17T11:57:54.534 INFO:tasks.workunit.client.0.smithi002.stdout:0/725: mkdir d0/d6/d26/d14/d19/d37/d62/d77/dee 0 2023-12-17T11:57:54.538 INFO:tasks.workunit.client.1.smithi119.stdout:9/821: dwrite ff [0,4194304] 0 2023-12-17T11:57:54.539 INFO:tasks.workunit.client.0.smithi002.stdout:8/822: symlink d3/d8/da/l118 0 2023-12-17T11:57:54.539 INFO:tasks.workunit.client.0.smithi002.stdout:2/758: creat d3/d4/d7/d14/d9b/f10d x:0 0 0 2023-12-17T11:57:54.539 INFO:tasks.workunit.client.0.smithi002.stdout:8/823: truncate d3/d8/d28/d31/d5a/d7c/f89 1489492 0 2023-12-17T11:57:54.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/767: mkdir d0/d1/dc/d58/de8/dfe 0 2023-12-17T11:57:54.540 INFO:tasks.workunit.client.0.smithi002.stdout:1/776: dwrite d3/d2f/d4d/d95/f96 [0,4194304] 0 2023-12-17T11:57:54.540 INFO:tasks.workunit.client.0.smithi002.stdout:1/777: write d3/d2f/d74/dbd/fd7 [145795,77759] 0 2023-12-17T11:57:54.540 INFO:tasks.workunit.client.0.smithi002.stdout:1/778: dread - d3/d6/d16/d61/f7c zero size 2023-12-17T11:57:54.542 INFO:tasks.workunit.client.0.smithi002.stdout:3/793: dwrite d9/f14 [4194304,4194304] 0 2023-12-17T11:57:54.545 INFO:tasks.workunit.client.0.smithi002.stdout:9/868: creat dc/d1d/d25/d85/dc2/ddd/dfa/d47/f13b x:0 0 0 2023-12-17T11:57:54.546 INFO:tasks.workunit.client.0.smithi002.stdout:9/869: stat dc/d42/da0/d72/d93 0 2023-12-17T11:57:54.552 INFO:tasks.workunit.client.0.smithi002.stdout:5/762: dread dc/d94/ded/f63 [0,4194304] 0 2023-12-17T11:57:54.555 INFO:tasks.workunit.client.0.smithi002.stdout:8/824: dread d3/d7/d6e/d7f/f3a [0,4194304] 0 2023-12-17T11:57:54.555 INFO:tasks.workunit.client.0.smithi002.stdout:8/825: write d3/d7/d18/d74/d7b/f104 [369941,83154] 0 2023-12-17T11:57:54.555 INFO:tasks.workunit.client.0.smithi002.stdout:8/826: fsync d3/d8/da/d44/fcf 0 2023-12-17T11:57:54.562 INFO:tasks.workunit.client.0.smithi002.stdout:5/763: dread dc/d17/d2f/fb8 [0,4194304] 0 2023-12-17T11:57:54.566 INFO:tasks.workunit.client.0.smithi002.stdout:6/768: symlink d0/d1/d6d/d83/da2/lff 0 2023-12-17T11:57:54.566 INFO:tasks.workunit.client.0.smithi002.stdout:6/769: dread - d0/d1/d21/d56/d60/fb1 zero size 2023-12-17T11:57:54.569 INFO:tasks.workunit.client.0.smithi002.stdout:1/779: link d3/d6/fe d3/d6/d9/d37/d39/d43/d4a/deb/ffe 0 2023-12-17T11:57:54.570 INFO:tasks.workunit.client.0.smithi002.stdout:3/794: rmdir d9/d24 39 2023-12-17T11:57:54.572 INFO:tasks.workunit.client.1.smithi119.stdout:5/830: dwrite d1/fa8 [0,4194304] 0 2023-12-17T11:57:54.574 INFO:tasks.workunit.client.0.smithi002.stdout:9/870: creat dc/d1d/d25/d85/dc2/df8/f13c x:0 0 0 2023-12-17T11:57:54.574 INFO:tasks.workunit.client.0.smithi002.stdout:9/871: read dc/d1d/d25/d85/dc2/ddd/dfa/fae [168928,18864] 0 2023-12-17T11:57:54.574 INFO:tasks.workunit.client.0.smithi002.stdout:9/872: truncate dc/d42/d4f/f92 4989239 0 2023-12-17T11:57:54.578 INFO:tasks.workunit.client.1.smithi119.stdout:5/831: rename d1/l1c to d1/d70/d6b/df1/l112 0 2023-12-17T11:57:54.588 INFO:tasks.workunit.client.1.smithi119.stdout:7/785: dwrite d2/d4/d11/d3c/fde [4194304,4194304] 0 2023-12-17T11:57:54.588 INFO:tasks.workunit.client.1.smithi119.stdout:7/786: fdatasync d2/d4/d1f/fa3 0 2023-12-17T11:57:54.592 INFO:tasks.workunit.client.0.smithi002.stdout:4/693: dwrite d0/d3e/d56/f63 [0,4194304] 0 2023-12-17T11:57:54.592 INFO:tasks.workunit.client.0.smithi002.stdout:8/827: dread d3/d7/d18/d3f/d49/f52 [0,4194304] 0 2023-12-17T11:57:54.598 INFO:tasks.workunit.client.1.smithi119.stdout:5/832: dread d1/da7/f3b [0,4194304] 0 2023-12-17T11:57:54.602 INFO:tasks.workunit.client.1.smithi119.stdout:8/653: dwrite d7/d18/d45/f76 [0,4194304] 0 2023-12-17T11:57:54.602 INFO:tasks.workunit.client.1.smithi119.stdout:8/654: fsync d7/da/f3f 0 2023-12-17T11:57:54.607 INFO:tasks.workunit.client.1.smithi119.stdout:7/787: rename d2/d4/d70/d57/d56 to d2/d4/d11/d2c/d68/d99/d6c/def 0 2023-12-17T11:57:54.608 INFO:tasks.workunit.client.0.smithi002.stdout:4/694: write d0/d10/d21/f48 [971621,82632] 0 2023-12-17T11:57:54.609 INFO:tasks.workunit.client.1.smithi119.stdout:5/833: creat d1/d70/d6b/df1/f113 x:0 0 0 2023-12-17T11:57:54.611 INFO:tasks.workunit.client.1.smithi119.stdout:5/834: write d1/d70/d6b/d77/fb9 [249703,46519] 0 2023-12-17T11:57:54.611 INFO:tasks.workunit.client.1.smithi119.stdout:5/835: dread - d1/da7/d71/f94 zero size 2023-12-17T11:57:54.611 INFO:tasks.workunit.client.1.smithi119.stdout:9/822: dwrite d12/f2c [0,4194304] 0 2023-12-17T11:57:54.614 INFO:tasks.workunit.client.0.smithi002.stdout:2/759: getdents d3/d4 0 2023-12-17T11:57:54.615 INFO:tasks.workunit.client.1.smithi119.stdout:8/655: rmdir d7/d12/d23/db4 39 2023-12-17T11:57:54.616 INFO:tasks.workunit.client.1.smithi119.stdout:8/656: fdatasync d7/da/f3f 0 2023-12-17T11:57:54.616 INFO:tasks.workunit.client.1.smithi119.stdout:8/657: creat d7/d18/d15/d81/d8e/fd2 x:0 0 0 2023-12-17T11:57:54.617 INFO:tasks.workunit.client.0.smithi002.stdout:5/764: creat dc/f109 x:0 0 0 2023-12-17T11:57:54.617 INFO:tasks.workunit.client.0.smithi002.stdout:5/765: dread - dc/d1a/d47/fc2 zero size 2023-12-17T11:57:54.619 INFO:tasks.workunit.client.1.smithi119.stdout:1/720: sync 2023-12-17T11:57:54.620 INFO:tasks.workunit.client.1.smithi119.stdout:7/788: rmdir d2/d4/d11/d2c/d55 39 2023-12-17T11:57:54.624 INFO:tasks.workunit.client.1.smithi119.stdout:5/836: mknod d1/d70/d85/c114 0 2023-12-17T11:57:54.624 INFO:tasks.workunit.client.1.smithi119.stdout:5/837: chown d1/d25 35632 1 2023-12-17T11:57:54.626 INFO:tasks.workunit.client.0.smithi002.stdout:1/780: unlink d3/d6/d9/d30/d9c/cb1 0 2023-12-17T11:57:54.632 INFO:tasks.workunit.client.0.smithi002.stdout:3/795: link d9/d24/d6f/fbd d9/d15/d6a/f101 0 2023-12-17T11:57:54.634 INFO:tasks.workunit.client.0.smithi002.stdout:9/873: mkdir dc/d42/da0/d72/d93/d52/d12b/d13d 0 2023-12-17T11:57:54.635 INFO:tasks.workunit.client.0.smithi002.stdout:0/726: rmdir d0/d6 39 2023-12-17T11:57:54.647 INFO:tasks.workunit.client.1.smithi119.stdout:9/823: mknod d12/d1d/d28/d4d/c109 0 2023-12-17T11:57:54.647 INFO:tasks.workunit.client.1.smithi119.stdout:9/824: write d12/d1d/f31 [1659295,118190] 0 2023-12-17T11:57:54.656 INFO:tasks.workunit.client.1.smithi119.stdout:1/721: mkdir d3/db/d106 0 2023-12-17T11:57:54.661 INFO:tasks.workunit.client.1.smithi119.stdout:7/789: truncate d2/f19 1213467 0 2023-12-17T11:57:54.666 INFO:tasks.workunit.client.1.smithi119.stdout:9/825: rmdir d12/d1d/d28/d46/d50/d92/da1 39 2023-12-17T11:57:54.671 INFO:tasks.workunit.client.1.smithi119.stdout:1/722: mknod d3/d44/d89/c107 0 2023-12-17T11:57:54.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/727: dread d0/d6/d26/d14/d19/d2b/f97 [0,4194304] 0 2023-12-17T11:57:54.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/728: write d0/d6/d26/f3b [3333796,69202] 0 2023-12-17T11:57:54.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/729: dread - d0/d6/d26/d14/fec zero size 2023-12-17T11:57:54.675 INFO:tasks.workunit.client.0.smithi002.stdout:0/730: chown d0/d15 376051454 1 2023-12-17T11:57:54.676 INFO:tasks.workunit.client.0.smithi002.stdout:0/731: fdatasync d0/d6/d26/f2d 0 2023-12-17T11:57:54.679 INFO:tasks.workunit.client.0.smithi002.stdout:8/828: creat d3/d7/d111/f119 x:0 0 0 2023-12-17T11:57:54.681 INFO:tasks.workunit.client.0.smithi002.stdout:4/695: getdents d0/d10 0 2023-12-17T11:57:54.682 INFO:tasks.workunit.client.1.smithi119.stdout:1/723: dread d3/db/d26/f39 [0,4194304] 0 2023-12-17T11:57:54.683 INFO:tasks.workunit.client.1.smithi119.stdout:7/790: truncate d2/d40/dc3/fb3 568807 0 2023-12-17T11:57:54.684 INFO:tasks.workunit.client.0.smithi002.stdout:2/760: mkdir d3/d4/d7/d14/d2e/d37/d3f/d10e 0 2023-12-17T11:57:54.684 INFO:tasks.workunit.client.0.smithi002.stdout:2/761: creat d3/d4/d7/d14/d34/dde/f10f x:0 0 0 2023-12-17T11:57:54.685 INFO:tasks.workunit.client.1.smithi119.stdout:9/826: truncate d12/d1d/d28/d46/f66 701525 0 2023-12-17T11:57:54.687 INFO:tasks.workunit.client.0.smithi002.stdout:5/766: symlink dc/d8e/dd6/l10a 0 2023-12-17T11:57:54.689 INFO:tasks.workunit.client.1.smithi119.stdout:8/658: dwrite d7/d18/f4f [0,4194304] 0 2023-12-17T11:57:54.692 INFO:tasks.workunit.client.1.smithi119.stdout:5/838: rmdir d1/d36 39 2023-12-17T11:57:54.692 INFO:tasks.workunit.client.1.smithi119.stdout:5/839: dread - d1/d70/d6b/f104 zero size 2023-12-17T11:57:54.695 INFO:tasks.workunit.client.0.smithi002.stdout:4/696: dread d0/d10/f15 [0,4194304] 0 2023-12-17T11:57:54.696 INFO:tasks.workunit.client.0.smithi002.stdout:9/874: dwrite dc/d42/da0/d72/d93/dd0/fd7 [0,4194304] 0 2023-12-17T11:57:54.696 INFO:tasks.workunit.client.0.smithi002.stdout:9/875: chown dc/d1d/d25/d85/dc2/ddd/dfa/l31 297457 1 2023-12-17T11:57:54.696 INFO:tasks.workunit.client.0.smithi002.stdout:3/796: mknod d9/d1b/d35/d41/d43/d4b/d92/c102 0 2023-12-17T11:57:54.697 INFO:tasks.workunit.client.1.smithi119.stdout:1/724: symlink d3/db/d26/d19/dc8/l108 0 2023-12-17T11:57:54.702 INFO:tasks.workunit.client.1.smithi119.stdout:9/827: mkdir d12/d1d/d28/d46/dbb/d10a 0 2023-12-17T11:57:54.705 INFO:tasks.workunit.client.0.smithi002.stdout:8/829: mkdir d3/d7/d6e/d11a 0 2023-12-17T11:57:54.709 INFO:tasks.workunit.client.1.smithi119.stdout:1/725: link d3/db/d17/d24/d20/d40/d76/d84/cee d3/db/d17/d24/d20/dba/c109 0 2023-12-17T11:57:54.709 INFO:tasks.workunit.client.1.smithi119.stdout:1/726: fdatasync d3/db/d17/d24/d20/f7f 0 2023-12-17T11:57:54.710 INFO:tasks.workunit.client.0.smithi002.stdout:2/762: rmdir d3/d4 39 2023-12-17T11:57:54.712 INFO:tasks.workunit.client.0.smithi002.stdout:5/767: mknod dc/d17/d2f/d82/c10b 0 2023-12-17T11:57:54.712 INFO:tasks.workunit.client.0.smithi002.stdout:5/768: readlink dc/d1a/l7b 0 2023-12-17T11:57:54.716 INFO:tasks.workunit.client.1.smithi119.stdout:5/840: dread d1/d70/d6b/d77/dae/dba/de3/fa1 [0,4194304] 0 2023-12-17T11:57:54.716 INFO:tasks.workunit.client.1.smithi119.stdout:8/659: dread d7/da/f41 [0,4194304] 0 2023-12-17T11:57:54.716 INFO:tasks.workunit.client.1.smithi119.stdout:8/660: fsync d7/d12/d69/d98/fb1 0 2023-12-17T11:57:54.716 INFO:tasks.workunit.client.1.smithi119.stdout:1/727: rename d3/db/d26/l90 to d3/db/d17/d24/d20/d40/l10a 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:8/830: read d3/d7/d6e/d7f/d65/f85 [1379106,24753] 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:8/831: truncate d3/d8/da/d44/da4/fbe 4681 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:8/832: stat d3/d7/d18/d3f/d49 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:8/833: stat d3/d7/d6e/fb1 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:1/781: rename c0 to d3/d6/d9/d37/d39/d43/d4a/cff 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:1/782: write d3/d6/d16/d28/fd2 [414748,19957] 0 2023-12-17T11:57:54.717 INFO:tasks.workunit.client.0.smithi002.stdout:1/783: fsync d3/d6/d9/d37/d39/fa6 0 2023-12-17T11:57:54.718 INFO:tasks.workunit.client.1.smithi119.stdout:7/791: rmdir d2/d4/d11/d3c/d75/dad 0 2023-12-17T11:57:54.721 INFO:tasks.workunit.client.0.smithi002.stdout:4/697: symlink d0/d10/d21/d33/d96/le2 0 2023-12-17T11:57:54.722 INFO:tasks.workunit.client.1.smithi119.stdout:8/661: getdents d7/da/d11 0 2023-12-17T11:57:54.722 INFO:tasks.workunit.client.1.smithi119.stdout:8/662: fdatasync d7/d18/fcf 0 2023-12-17T11:57:54.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/876: mknod dc/d1d/d7c/d90/dc0/c13e 0 2023-12-17T11:57:54.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/877: fsync dc/d42/da0/d72/d93/d76/f94 0 2023-12-17T11:57:54.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/878: chown dc/d42/da0/d82 102979689 1 2023-12-17T11:57:54.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/879: write dc/d1d/d25/d85/dc2/ddd/dfa/d47/fc7 [330837,69884] 0 2023-12-17T11:57:54.724 INFO:tasks.workunit.client.0.smithi002.stdout:9/880: fdatasync dc/d42/d4f/f92 0 2023-12-17T11:57:54.725 INFO:tasks.workunit.client.1.smithi119.stdout:1/728: creat d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/f10b x:0 0 0 2023-12-17T11:57:54.725 INFO:tasks.workunit.client.1.smithi119.stdout:1/729: chown d3/db/d17/d24/d20/dbd/dcb/fdc 116237923 1 2023-12-17T11:57:54.725 INFO:tasks.workunit.client.1.smithi119.stdout:1/730: write d3/db/d17/d24/d20/d6c/db7/de4/f102 [682209,127553] 0 2023-12-17T11:57:54.727 INFO:tasks.workunit.client.0.smithi002.stdout:3/797: rmdir d9/d1b/d35/d41/d43 39 2023-12-17T11:57:54.728 INFO:tasks.workunit.client.1.smithi119.stdout:5/841: read d1/d70/d6b/d77/dae/dba/de3/d86/f66 [3532412,49340] 0 2023-12-17T11:57:54.728 INFO:tasks.workunit.client.1.smithi119.stdout:7/792: symlink d2/d4/d70/dac/lf0 0 2023-12-17T11:57:54.730 INFO:tasks.workunit.client.0.smithi002.stdout:0/732: link d0/d6/d26/d14/d90/d64/le8 d0/d6/d26/d14/d19/d61/de3/lef 0 2023-12-17T11:57:54.734 INFO:tasks.workunit.client.1.smithi119.stdout:8/663: link d7/da/d1a/d84/ca1 d7/d18/d45/d9f/d7b/cd3 0 2023-12-17T11:57:54.736 INFO:tasks.workunit.client.1.smithi119.stdout:1/731: symlink d3/db/d17/d24/d20/dbd/dcb/l10c 0 2023-12-17T11:57:54.738 INFO:tasks.workunit.client.0.smithi002.stdout:5/769: creat dc/d1a/d53/da9/f10c x:0 0 0 2023-12-17T11:57:54.740 INFO:tasks.workunit.client.0.smithi002.stdout:8/834: dread d3/d8/f9a [0,4194304] 0 2023-12-17T11:57:54.742 INFO:tasks.workunit.client.0.smithi002.stdout:1/784: truncate d3/d6/d16/d61/f93 4954776 0 2023-12-17T11:57:54.742 INFO:tasks.workunit.client.1.smithi119.stdout:5/842: creat d1/d70/d85/d95/dc3/dfd/f115 x:0 0 0 2023-12-17T11:57:54.743 INFO:tasks.workunit.client.1.smithi119.stdout:7/793: mkdir d2/d4/d11/d3c/df1 0 2023-12-17T11:57:54.744 INFO:tasks.workunit.client.1.smithi119.stdout:7/794: dread - d2/d4/d11/d2c/f8f zero size 2023-12-17T11:57:54.744 INFO:tasks.workunit.client.0.smithi002.stdout:4/698: dread d0/d10/d14/f98 [0,4194304] 0 2023-12-17T11:57:54.744 INFO:tasks.workunit.client.0.smithi002.stdout:4/699: read - d0/d10/d14/d27/fbd zero size 2023-12-17T11:57:54.748 INFO:tasks.workunit.client.0.smithi002.stdout:9/881: link dc/d1d/d7c/d90/dc0/cf7 dc/d42/da0/d72/d93/c13f 0 2023-12-17T11:57:54.748 INFO:tasks.workunit.client.0.smithi002.stdout:9/882: readlink dc/d1d/lc6 0 2023-12-17T11:57:54.749 INFO:tasks.workunit.client.1.smithi119.stdout:1/732: mknod d3/d44/dfd/d64/db2/c10d 0 2023-12-17T11:57:54.749 INFO:tasks.workunit.client.0.smithi002.stdout:7/733: sync 2023-12-17T11:57:54.753 INFO:tasks.workunit.client.1.smithi119.stdout:8/664: write d7/da/f3f [3592698,74923] 0 2023-12-17T11:57:54.753 INFO:tasks.workunit.client.1.smithi119.stdout:8/665: truncate d7/d18/d45/f76 5164564 0 2023-12-17T11:57:54.755 INFO:tasks.workunit.client.1.smithi119.stdout:4/759: sync 2023-12-17T11:57:54.755 INFO:tasks.workunit.client.1.smithi119.stdout:6/680: sync 2023-12-17T11:57:54.756 INFO:tasks.workunit.client.1.smithi119.stdout:6/681: chown d2/d2b/f52 1240838 1 2023-12-17T11:57:54.756 INFO:tasks.workunit.client.1.smithi119.stdout:6/682: fsync d2/df/d17/f34 0 2023-12-17T11:57:54.756 INFO:tasks.workunit.client.1.smithi119.stdout:6/683: dread - d2/df/d17/d79/fc5 zero size 2023-12-17T11:57:54.756 INFO:tasks.workunit.client.1.smithi119.stdout:6/684: fdatasync d2/df/f1f 0 2023-12-17T11:57:54.757 INFO:tasks.workunit.client.1.smithi119.stdout:6/685: write d2/d2b/f3d [1091369,108194] 0 2023-12-17T11:57:54.757 INFO:tasks.workunit.client.1.smithi119.stdout:3/827: sync 2023-12-17T11:57:54.758 INFO:tasks.workunit.client.1.smithi119.stdout:3/828: dread - d9/da/df/f128 zero size 2023-12-17T11:57:54.758 INFO:tasks.workunit.client.1.smithi119.stdout:0/757: sync 2023-12-17T11:57:54.758 INFO:tasks.workunit.client.1.smithi119.stdout:0/758: truncate d2/d66/fba 3480679 0 2023-12-17T11:57:54.758 INFO:tasks.workunit.client.0.smithi002.stdout:0/733: mkdir d0/d6/d26/d14/d19/d61/df0 0 2023-12-17T11:57:54.758 INFO:tasks.workunit.client.0.smithi002.stdout:0/734: readlink d0/d6/d26/lac 0 2023-12-17T11:57:54.758 INFO:tasks.workunit.client.0.smithi002.stdout:0/735: write d0/d6/d26/d14/d19/d2b/f97 [853178,16177] 0 2023-12-17T11:57:54.759 INFO:tasks.workunit.client.1.smithi119.stdout:5/843: mknod d1/d70/d6b/d77/dae/dba/de3/d86/dda/c116 0 2023-12-17T11:57:54.760 INFO:tasks.workunit.client.0.smithi002.stdout:2/763: getdents d3/d4/d17/d19/d4d/d72/d77/da7 0 2023-12-17T11:57:54.762 INFO:tasks.workunit.client.0.smithi002.stdout:6/770: sync 2023-12-17T11:57:54.766 INFO:tasks.workunit.client.0.smithi002.stdout:5/770: mkdir dc/d94/ded/d2d/dcf/d10d 0 2023-12-17T11:57:54.771 INFO:tasks.workunit.client.1.smithi119.stdout:7/795: rename d2/d4/d70/f64 to d2/d4/d11/d3c/ff2 0 2023-12-17T11:57:54.772 INFO:tasks.workunit.client.0.smithi002.stdout:8/835: link d3/d8/da/d44/fc8 d3/d8/f11b 0 2023-12-17T11:57:54.774 INFO:tasks.workunit.client.1.smithi119.stdout:8/666: symlink d7/d18/d45/d9f/d7b/ld4 0 2023-12-17T11:57:54.774 INFO:tasks.workunit.client.1.smithi119.stdout:8/667: chown d7/d12/fbe 17 1 2023-12-17T11:57:54.775 INFO:tasks.workunit.client.0.smithi002.stdout:5/771: write dc/d94/ded/f63 [4099303,104469] 0 2023-12-17T11:57:54.775 INFO:tasks.workunit.client.0.smithi002.stdout:9/883: truncate dc/d1d/f78 485604 0 2023-12-17T11:57:54.777 INFO:tasks.workunit.client.1.smithi119.stdout:4/760: creat dd/d15/d16/ff4 x:0 0 0 2023-12-17T11:57:54.779 INFO:tasks.workunit.client.0.smithi002.stdout:7/734: mkdir d6/d17/dc/d67/d8b/dbd/dce/ddf 0 2023-12-17T11:57:54.780 INFO:tasks.workunit.client.0.smithi002.stdout:2/764: dread d3/d4/d7/d14/d42/d8a/fc3 [0,4194304] 0 2023-12-17T11:57:54.787 INFO:tasks.workunit.client.1.smithi119.stdout:6/686: creat d2/d2b/d43/d5e/db3/fd1 x:0 0 0 2023-12-17T11:57:54.787 INFO:tasks.workunit.client.0.smithi002.stdout:4/700: dwrite d0/d10/d21/d33/f89 [0,4194304] 0 2023-12-17T11:57:54.788 INFO:tasks.workunit.client.0.smithi002.stdout:5/772: write dc/d94/ded/fc7 [551796,16722] 0 2023-12-17T11:57:54.791 INFO:tasks.workunit.client.1.smithi119.stdout:3/829: mkdir d9/d11/d1e/d55/d65/ddf/d139 0 2023-12-17T11:57:54.795 INFO:tasks.workunit.client.1.smithi119.stdout:2/838: sync 2023-12-17T11:57:54.795 INFO:tasks.workunit.client.1.smithi119.stdout:2/839: dread - d6/d38/f103 zero size 2023-12-17T11:57:54.796 INFO:tasks.workunit.client.1.smithi119.stdout:0/759: mknod d2/d16/d8c/ce7 0 2023-12-17T11:57:54.799 INFO:tasks.workunit.client.1.smithi119.stdout:7/796: write d2/f3 [3940023,18089] 0 2023-12-17T11:57:54.802 INFO:tasks.workunit.client.1.smithi119.stdout:5/844: mknod d1/d70/d6b/c117 0 2023-12-17T11:57:54.804 INFO:tasks.workunit.client.0.smithi002.stdout:3/798: dwrite d9/d1b/d35/d41/fb0 [0,4194304] 0 2023-12-17T11:57:54.810 INFO:tasks.workunit.client.1.smithi119.stdout:1/733: rename d3/db/d17/d24/d20/dba/dbc/d7e/da1/fd6 to d3/d44/dfd/d64/f10e 0 2023-12-17T11:57:54.810 INFO:tasks.workunit.client.1.smithi119.stdout:1/734: write d3/db/d17/d24/d20/d6c/db7/de4/f102 [1438324,13396] 0 2023-12-17T11:57:54.813 INFO:tasks.workunit.client.1.smithi119.stdout:8/668: mknod d7/d12/d23/db4/cd5 0 2023-12-17T11:57:54.815 INFO:tasks.workunit.client.0.smithi002.stdout:0/736: rmdir d0/d6/d26/d14/d19/d37/d86/dca 39 2023-12-17T11:57:54.817 INFO:tasks.workunit.client.1.smithi119.stdout:6/687: symlink d2/d2b/d43/d76/ld2 0 2023-12-17T11:57:54.817 INFO:tasks.workunit.client.1.smithi119.stdout:6/688: fsync d2/df/f55 0 2023-12-17T11:57:54.817 INFO:tasks.workunit.client.1.smithi119.stdout:6/689: stat d2/d2b/d43/d76/d8d/dc2/fc6 0 2023-12-17T11:57:54.819 INFO:tasks.workunit.client.0.smithi002.stdout:8/836: rename d3/d8/d28/d31/d5a to d3/d7/d18/d74/d7b/d11c 0 2023-12-17T11:57:54.819 INFO:tasks.workunit.client.0.smithi002.stdout:8/837: stat d3/d7/d18/d3f/f60 0 2023-12-17T11:57:54.819 INFO:tasks.workunit.client.0.smithi002.stdout:8/838: getdents d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112 0 2023-12-17T11:57:54.821 INFO:tasks.workunit.client.0.smithi002.stdout:9/884: getdents dc/d1d/d7c/d90 0 2023-12-17T11:57:54.823 INFO:tasks.workunit.client.1.smithi119.stdout:2/840: dread d6/d2b/d4b/f77 [4194304,4194304] 0 2023-12-17T11:57:54.827 INFO:tasks.workunit.client.0.smithi002.stdout:7/735: link d6/d17/dc/d13/d21/c56 d6/d81/ce0 0 2023-12-17T11:57:54.828 INFO:tasks.workunit.client.0.smithi002.stdout:6/771: dwrite d0/d1/dc/d17/d40/f4f [0,4194304] 0 2023-12-17T11:57:54.831 INFO:tasks.workunit.client.0.smithi002.stdout:2/765: creat d3/d4/d17/d19/f110 x:0 0 0 2023-12-17T11:57:54.835 INFO:tasks.workunit.client.1.smithi119.stdout:7/797: rmdir d2/d4/d11/d2c/d68/db4 39 2023-12-17T11:57:54.835 INFO:tasks.workunit.client.1.smithi119.stdout:7/798: chown d2/d40/da7 10066588 1 2023-12-17T11:57:54.835 INFO:tasks.workunit.client.1.smithi119.stdout:7/799: chown d2/d4/d11/d2c/d68/d98/fab 114500 1 2023-12-17T11:57:54.836 INFO:tasks.workunit.client.0.smithi002.stdout:4/701: truncate d0/d10/d14/dae/fde 4611539 0 2023-12-17T11:57:54.839 INFO:tasks.workunit.client.0.smithi002.stdout:5/773: creat dc/d17/df1/f10e x:0 0 0 2023-12-17T11:57:54.840 INFO:tasks.workunit.client.0.smithi002.stdout:0/737: write d0/d6/d26/d14/d19/d61/de3/f8b [3231378,53229] 0 2023-12-17T11:57:54.841 INFO:tasks.workunit.client.1.smithi119.stdout:0/760: write d2/d66/d2e/d44/d7b/d5/d3f/f5e [3060351,49406] 0 2023-12-17T11:57:54.846 INFO:tasks.workunit.client.1.smithi119.stdout:1/735: dread d3/f4 [4194304,4194304] 0 2023-12-17T11:57:54.847 INFO:tasks.workunit.client.0.smithi002.stdout:3/799: truncate d9/d15/d52/ff2 107626 0 2023-12-17T11:57:54.848 INFO:tasks.workunit.client.1.smithi119.stdout:5/845: symlink d1/d70/d85/d95/dc3/l118 0 2023-12-17T11:57:54.850 INFO:tasks.workunit.client.0.smithi002.stdout:8/839: getdents d3/d7/d6e/d7f/d90 0 2023-12-17T11:57:54.851 INFO:tasks.workunit.client.0.smithi002.stdout:9/885: mkdir dc/d42/d4f/d140 0 2023-12-17T11:57:54.851 INFO:tasks.workunit.client.0.smithi002.stdout:8/840: chown d3/d7/d6e/daa/cbb 176161 1 2023-12-17T11:57:54.851 INFO:tasks.workunit.client.0.smithi002.stdout:8/841: read - d3/d7/d18/d3f/d49/f94 zero size 2023-12-17T11:57:54.851 INFO:tasks.workunit.client.0.smithi002.stdout:7/736: truncate d6/d17/dc/d13/d37/d4f/f63 2831504 0 2023-12-17T11:57:54.851 INFO:tasks.workunit.client.0.smithi002.stdout:7/737: dread - d6/d17/dc/d13/d21/d2e/d4a/daf/db1/fb4 zero size 2023-12-17T11:57:54.852 INFO:tasks.workunit.client.1.smithi119.stdout:4/761: rename dd/d11/d2d/d9c/d55/d81/d88/d91/fe6 to dd/d11/d26/d86/ff5 0 2023-12-17T11:57:54.852 INFO:tasks.workunit.client.1.smithi119.stdout:4/762: truncate dd/d11/d2d/d9c/d55/d81/db8/d78/faf 1591398 0 2023-12-17T11:57:54.853 INFO:tasks.workunit.client.1.smithi119.stdout:6/690: mknod d2/d2b/d43/d76/d8d/cd3 0 2023-12-17T11:57:54.862 INFO:tasks.workunit.client.1.smithi119.stdout:3/830: dwrite d9/d11/d1e/d55/d65/ddf/f102 [0,4194304] 0 2023-12-17T11:57:54.862 INFO:tasks.workunit.client.0.smithi002.stdout:6/772: symlink d0/d1/d21/d56/d8c/d93/l100 0 2023-12-17T11:57:54.863 INFO:tasks.workunit.client.1.smithi119.stdout:7/800: symlink d2/d40/dc3/lf3 0 2023-12-17T11:57:54.863 INFO:tasks.workunit.client.1.smithi119.stdout:0/761: symlink d2/d66/dbb/dcd/le8 0 2023-12-17T11:57:54.864 INFO:tasks.workunit.client.0.smithi002.stdout:2/766: mknod d3/d4/d7/d14/d42/d8a/dd8/c111 0 2023-12-17T11:57:54.864 INFO:tasks.workunit.client.0.smithi002.stdout:2/767: fsync d3/d4/d17/d19/f67 0 2023-12-17T11:57:54.864 INFO:tasks.workunit.client.0.smithi002.stdout:2/768: dread - d3/d4/d7/d14/d2e/f69 zero size 2023-12-17T11:57:54.866 INFO:tasks.workunit.client.0.smithi002.stdout:4/702: creat d0/d6c/fe3 x:0 0 0 2023-12-17T11:57:54.868 INFO:tasks.workunit.client.0.smithi002.stdout:5/774: dread dc/d1a/d47/f49 [0,4194304] 0 2023-12-17T11:57:54.868 INFO:tasks.workunit.client.0.smithi002.stdout:5/775: chown dc/d1a/fa5 0 1 2023-12-17T11:57:54.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/738: rmdir d0/d6/d26/d14/d19/d61/de3/dce 0 2023-12-17T11:57:54.868 INFO:tasks.workunit.client.0.smithi002.stdout:0/739: write d0/d15/f28 [1125747,23428] 0 2023-12-17T11:57:54.870 INFO:tasks.workunit.client.0.smithi002.stdout:6/773: symlink d0/d1/d5b/l101 0 2023-12-17T11:57:54.870 INFO:tasks.workunit.client.0.smithi002.stdout:6/774: write d0/d1/d28/dab/fac [383977,78765] 0 2023-12-17T11:57:54.873 INFO:tasks.workunit.client.0.smithi002.stdout:4/703: creat d0/d3e/d56/d65/d78/fe4 x:0 0 0 2023-12-17T11:57:54.874 INFO:tasks.workunit.client.1.smithi119.stdout:3/831: mknod d9/d44/c13a 0 2023-12-17T11:57:54.874 INFO:tasks.workunit.client.1.smithi119.stdout:3/832: chown d9/d35/dbd/dfb/cfe 1 1 2023-12-17T11:57:54.874 INFO:tasks.workunit.client.1.smithi119.stdout:3/833: creat d9/d59/f13b x:0 0 0 2023-12-17T11:57:54.877 INFO:tasks.workunit.client.1.smithi119.stdout:7/801: rename d2/d4/d11/d2c/f3a to d2/d40/dc3/dca/dd9/ff4 0 2023-12-17T11:57:54.877 INFO:tasks.workunit.client.1.smithi119.stdout:7/802: fsync d2/d4/d11/d3c/f9c 0 2023-12-17T11:57:54.877 INFO:tasks.workunit.client.1.smithi119.stdout:7/803: fdatasync d2/d40/f6b 0 2023-12-17T11:57:54.878 INFO:tasks.workunit.client.1.smithi119.stdout:7/804: stat d2/d4/d11/d2c/d68/d99/d6c/def/db6/cdd 0 2023-12-17T11:57:54.878 INFO:tasks.workunit.client.1.smithi119.stdout:7/805: stat d2/f3 0 2023-12-17T11:57:54.878 INFO:tasks.workunit.client.0.smithi002.stdout:5/776: mknod dc/d17/c10f 0 2023-12-17T11:57:54.879 INFO:tasks.workunit.client.0.smithi002.stdout:8/842: write d3/d7/f58 [281730,42644] 0 2023-12-17T11:57:54.879 INFO:tasks.workunit.client.0.smithi002.stdout:9/886: dread dc/d1d/d25/d85/dc2/ddd/dfa/f11f [0,4194304] 0 2023-12-17T11:57:54.879 INFO:tasks.workunit.client.0.smithi002.stdout:9/887: fsync dc/d42/f8c 0 2023-12-17T11:57:54.879 INFO:tasks.workunit.client.0.smithi002.stdout:0/740: mkdir d0/d6/d26/d14/d19/d2b/df1 0 2023-12-17T11:57:54.882 INFO:tasks.workunit.client.0.smithi002.stdout:4/704: creat d0/d6c/dda/de1/fe5 x:0 0 0 2023-12-17T11:57:54.882 INFO:tasks.workunit.client.0.smithi002.stdout:4/705: creat d0/d10/d14/d4e/fe6 x:0 0 0 2023-12-17T11:57:54.882 INFO:tasks.workunit.client.0.smithi002.stdout:4/706: readlink d0/d3e/d56/d65/d78/d85/da3/laa 0 2023-12-17T11:57:54.882 INFO:tasks.workunit.client.0.smithi002.stdout:4/707: readlink d0/d10/d14/d27/d57/l58 0 2023-12-17T11:57:54.884 INFO:tasks.workunit.client.1.smithi119.stdout:0/762: mkdir d2/d16/d35/de9 0 2023-12-17T11:57:54.884 INFO:tasks.workunit.client.1.smithi119.stdout:0/763: write d2/d66/d2e/d44/d7b/f14 [533954,49841] 0 2023-12-17T11:57:54.884 INFO:tasks.workunit.client.1.smithi119.stdout:5/846: rmdir d1/d70/d85/d95/dc3/dfd 39 2023-12-17T11:57:54.892 INFO:tasks.workunit.client.1.smithi119.stdout:4/763: rmdir dd/d15 39 2023-12-17T11:57:54.894 INFO:tasks.workunit.client.1.smithi119.stdout:6/691: dread d2/f2e [0,4194304] 0 2023-12-17T11:57:54.894 INFO:tasks.workunit.client.1.smithi119.stdout:6/692: chown d2/df/d17/c90 30785 1 2023-12-17T11:57:54.899 INFO:tasks.workunit.client.0.smithi002.stdout:8/843: creat d3/d7/d114/f11d x:0 0 0 2023-12-17T11:57:54.899 INFO:tasks.workunit.client.0.smithi002.stdout:8/844: write d3/d7/d114/f11d [253157,90851] 0 2023-12-17T11:57:54.900 INFO:tasks.workunit.client.0.smithi002.stdout:9/888: mknod dc/d1d/d25/d85/dc2/d91/c141 0 2023-12-17T11:57:54.902 INFO:tasks.workunit.client.1.smithi119.stdout:2/841: dwrite d6/d9/d52/d53/d55/d58/dba/fd0 [0,4194304] 0 2023-12-17T11:57:54.909 INFO:tasks.workunit.client.1.smithi119.stdout:1/736: dwrite d3/f9f [0,4194304] 0 2023-12-17T11:57:54.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:54 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:54.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:54 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:54.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:54 smithi119 ceph-mon[117414]: Reconfiguring node-exporter.smithi119 (dependencies changed)... 2023-12-17T11:57:54.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:54 smithi119 ceph-mon[117414]: Reconfiguring daemon node-exporter.smithi119 on smithi119 2023-12-17T11:57:54.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:54 smithi119 ceph-mon[117414]: pgmap v30: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 176 MiB/s rd, 230 MiB/s wr, 314 op/s 2023-12-17T11:57:54.910 INFO:tasks.workunit.client.0.smithi002.stdout:7/738: dread d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:57:54.912 INFO:tasks.workunit.client.1.smithi119.stdout:5/847: dread d1/d25/f31 [0,4194304] 0 2023-12-17T11:57:54.913 INFO:tasks.workunit.client.1.smithi119.stdout:7/806: stat d2/d40/c8d 0 2023-12-17T11:57:54.914 INFO:tasks.workunit.client.1.smithi119.stdout:7/807: chown d2/d4/d11/d2c/d55/d67/ca0 184777986 1 2023-12-17T11:57:54.916 INFO:tasks.workunit.client.1.smithi119.stdout:0/764: truncate d2/d66/d2e/d44/d7b/d5/d3f/f97 2256543 0 2023-12-17T11:57:54.916 INFO:tasks.workunit.client.1.smithi119.stdout:0/765: readlink d2/d66/d2e/d44/l9c 0 2023-12-17T11:57:54.916 INFO:tasks.workunit.client.1.smithi119.stdout:0/766: dread - d2/d66/fb6 zero size 2023-12-17T11:57:54.921 INFO:tasks.workunit.client.0.smithi002.stdout:0/741: dread d0/d15/f28 [0,4194304] 0 2023-12-17T11:57:54.926 INFO:tasks.workunit.client.1.smithi119.stdout:2/842: write d6/d9/d52/d5a/f65 [2427594,105038] 0 2023-12-17T11:57:54.926 INFO:tasks.workunit.client.1.smithi119.stdout:2/843: fsync d6/f114 0 2023-12-17T11:57:54.926 INFO:tasks.workunit.client.1.smithi119.stdout:6/693: rename d2/f2e to d2/d2b/d43/d5e/fd4 0 2023-12-17T11:57:54.926 INFO:tasks.workunit.client.1.smithi119.stdout:6/694: write d2/d61/fb9 [1968912,49402] 0 2023-12-17T11:57:54.933 INFO:tasks.workunit.client.0.smithi002.stdout:7/739: getdents d6/d17/dc/d8e 0 2023-12-17T11:57:54.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/740: chown d6/d17/dc/d67/d8b/f35 33318566 1 2023-12-17T11:57:54.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/741: write d6/d17/dc/d67/d8b/fab [170755,128397] 0 2023-12-17T11:57:54.934 INFO:tasks.workunit.client.0.smithi002.stdout:7/742: readlink d6/d17/l19 0 2023-12-17T11:57:54.936 INFO:tasks.workunit.client.0.smithi002.stdout:0/742: mkdir d0/d6/d26/df2 0 2023-12-17T11:57:54.937 INFO:tasks.workunit.client.0.smithi002.stdout:0/743: write d0/d6/d26/d14/d19/d61/f88 [642019,127378] 0 2023-12-17T11:57:54.944 INFO:tasks.workunit.client.0.smithi002.stdout:0/744: getdents d0/d6/d26/d14/d19/d37/d86/dca 0 2023-12-17T11:57:54.952 INFO:tasks.workunit.client.0.smithi002.stdout:8/845: dread d3/d7/f63 [0,4194304] 0 2023-12-17T11:57:54.954 INFO:tasks.workunit.client.0.smithi002.stdout:0/745: unlink d0/d6/d26/d14/d19/d61/dbf/ld4 0 2023-12-17T11:57:54.956 INFO:tasks.workunit.client.1.smithi119.stdout:1/737: rmdir d3/db/d17/d24/d20 39 2023-12-17T11:57:54.960 INFO:tasks.workunit.client.1.smithi119.stdout:1/738: write d3/d44/dfd/d64/f75 [1113153,119350] 0 2023-12-17T11:57:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:6/775: dwrite d0/d1/dc/f54 [0,4194304] 0 2023-12-17T11:57:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:6/776: fsync d0/d1/dc/d17/f1e 0 2023-12-17T11:57:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:6/777: chown d0/d1/d21/d56/d8c/dce 128912394 1 2023-12-17T11:57:54.962 INFO:tasks.workunit.client.0.smithi002.stdout:8/846: unlink d3/d8/da/fb9 0 2023-12-17T11:57:54.962 INFO:tasks.workunit.client.0.smithi002.stdout:7/743: read d6/d17/dc/d67/d8b/d24/fca [2929867,75044] 0 2023-12-17T11:57:54.963 INFO:tasks.workunit.client.0.smithi002.stdout:3/800: dwrite d9/f13 [0,4194304] 0 2023-12-17T11:57:54.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/777: dwrite dc/d17/f81 [0,4194304] 0 2023-12-17T11:57:54.968 INFO:tasks.workunit.client.0.smithi002.stdout:5/778: readlink dc/d94/ded/d5a/d68/lbb 0 2023-12-17T11:57:54.968 INFO:tasks.workunit.client.1.smithi119.stdout:5/848: rename d1/d44/f56 to d1/da7/d71/d76/d83/dd1/f119 0 2023-12-17T11:57:54.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/778: creat d0/d1/d28/dde/f102 x:0 0 0 2023-12-17T11:57:54.970 INFO:tasks.workunit.client.0.smithi002.stdout:6/779: readlink d0/d1/d5b/l7e 0 2023-12-17T11:57:54.971 INFO:tasks.workunit.client.1.smithi119.stdout:2/844: symlink d6/d9/d52/d53/d55/daf/l125 0 2023-12-17T11:57:54.973 INFO:tasks.workunit.client.0.smithi002.stdout:8/847: creat d3/d7/d18/d74/d7b/d11c/db4/d117/f11e x:0 0 0 2023-12-17T11:57:54.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/848: chown d3/d7/d6e/d7f/c36 0 1 2023-12-17T11:57:54.974 INFO:tasks.workunit.client.0.smithi002.stdout:1/785: sync 2023-12-17T11:57:54.974 INFO:tasks.workunit.client.0.smithi002.stdout:1/786: getdents d3/d6/d9/d37/d39/d43/d8f/dea 0 2023-12-17T11:57:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:54 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:54 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:54 smithi002 ceph-mon[107131]: Reconfiguring node-exporter.smithi119 (dependencies changed)... 2023-12-17T11:57:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:54 smithi002 ceph-mon[107131]: Reconfiguring daemon node-exporter.smithi119 on smithi119 2023-12-17T11:57:54.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:54 smithi002 ceph-mon[107131]: pgmap v30: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 176 MiB/s rd, 230 MiB/s wr, 314 op/s 2023-12-17T11:57:54.977 INFO:tasks.workunit.client.1.smithi119.stdout:4/764: dwrite dd/d11/f5e [0,4194304] 0 2023-12-17T11:57:54.977 INFO:tasks.workunit.client.1.smithi119.stdout:8/669: write d7/d18/d15/f21 [548514,3660] 0 2023-12-17T11:57:54.980 INFO:tasks.workunit.client.1.smithi119.stdout:5/849: truncate d1/d36/f47 8124366 0 2023-12-17T11:57:54.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/769: dwrite d3/d4/d7/d14/d34/f6c [0,4194304] 0 2023-12-17T11:57:54.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/770: write d3/d50/df6/f102 [845504,60478] 0 2023-12-17T11:57:54.985 INFO:tasks.workunit.client.1.smithi119.stdout:2/845: mknod d6/d2b/d3f/d5c/d109/c126 0 2023-12-17T11:57:54.985 INFO:tasks.workunit.client.1.smithi119.stdout:3/834: dwrite d9/d35/f58 [0,4194304] 0 2023-12-17T11:57:54.987 INFO:tasks.workunit.client.0.smithi002.stdout:5/779: creat dc/d17/d2f/f110 x:0 0 0 2023-12-17T11:57:54.994 INFO:tasks.workunit.client.0.smithi002.stdout:6/780: rename d0/d1/dc/d58/dae/cfb to d0/d1/dc/d10/c103 0 2023-12-17T11:57:54.994 INFO:tasks.workunit.client.1.smithi119.stdout:1/739: dread d3/db/d26/f83 [0,4194304] 0 2023-12-17T11:57:55.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/765: creat dd/d15/d16/d5a/dbc/ff6 x:0 0 0 2023-12-17T11:57:55.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/766: write dd/d15/d16/d20/ff3 [843727,175] 0 2023-12-17T11:57:55.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/767: read dd/d11/d26/f36 [3042843,51607] 0 2023-12-17T11:57:55.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/768: truncate dd/d15/d16/ff4 524976 0 2023-12-17T11:57:55.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/769: fsync dd/f1b 0 2023-12-17T11:57:55.000 INFO:tasks.workunit.client.1.smithi119.stdout:4/770: chown dd/d15/d16/d5a/dbc/ff6 279778310 1 2023-12-17T11:57:55.009 INFO:tasks.workunit.client.0.smithi002.stdout:9/889: dwrite dc/d42/fb0 [0,4194304] 0 2023-12-17T11:57:55.009 INFO:tasks.workunit.client.0.smithi002.stdout:9/890: readlink dc/d42/da0/le1 0 2023-12-17T11:57:55.009 INFO:tasks.workunit.client.0.smithi002.stdout:8/849: link d3/d7/d6e/d7f/d90/cb6 d3/dca/d100/c11f 0 2023-12-17T11:57:55.010 INFO:tasks.workunit.client.1.smithi119.stdout:7/808: dwrite d2/d4/d11/f3d [0,4194304] 0 2023-12-17T11:57:55.012 INFO:tasks.workunit.client.1.smithi119.stdout:8/670: creat d7/d18/d15/d81/da2/dbf/fd6 x:0 0 0 2023-12-17T11:57:55.013 INFO:tasks.workunit.client.1.smithi119.stdout:8/671: fdatasync d7/da/d11/d26/f28 0 2023-12-17T11:57:55.013 INFO:tasks.workunit.client.0.smithi002.stdout:2/771: dread d3/d4/f65 [0,4194304] 0 2023-12-17T11:57:55.013 INFO:tasks.workunit.client.0.smithi002.stdout:2/772: readlink d3/d4/d17/lec 0 2023-12-17T11:57:55.016 INFO:tasks.workunit.client.0.smithi002.stdout:8/850: read d3/d7/d6e/fe5 [29037,76035] 0 2023-12-17T11:57:55.016 INFO:tasks.workunit.client.0.smithi002.stdout:1/787: rmdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa 39 2023-12-17T11:57:55.017 INFO:tasks.workunit.client.1.smithi119.stdout:6/695: dwrite d2/df/d17/fa4 [0,4194304] 0 2023-12-17T11:57:55.025 INFO:tasks.workunit.client.1.smithi119.stdout:2/846: mknod d6/d9/d13/d34/c127 0 2023-12-17T11:57:55.025 INFO:tasks.workunit.client.1.smithi119.stdout:3/835: mknod d9/d59/dda/c13c 0 2023-12-17T11:57:55.025 INFO:tasks.workunit.client.1.smithi119.stdout:3/836: write d9/d35/f5e [2200181,68283] 0 2023-12-17T11:57:55.028 INFO:tasks.workunit.client.0.smithi002.stdout:7/744: dwrite d6/d17/dc/d13/f57 [4194304,4194304] 0 2023-12-17T11:57:55.029 INFO:tasks.workunit.client.1.smithi119.stdout:7/809: mknod d2/d4/d11/d3c/d75/dda/cf5 0 2023-12-17T11:57:55.029 INFO:tasks.workunit.client.1.smithi119.stdout:7/810: chown d2/d4/d11/d2c/d68/d77 2 1 2023-12-17T11:57:55.029 INFO:tasks.workunit.client.1.smithi119.stdout:7/811: dread - d2/d4/d11/d3c/fe5 zero size 2023-12-17T11:57:55.030 INFO:tasks.workunit.client.1.smithi119.stdout:7/812: write d2/d40/f6b [775493,25539] 0 2023-12-17T11:57:55.031 INFO:tasks.workunit.client.1.smithi119.stdout:8/672: symlink d7/d18/d15/d81/d8e/ld7 0 2023-12-17T11:57:55.032 INFO:tasks.workunit.client.1.smithi119.stdout:8/673: chown d7/d12/d69/f24 0 1 2023-12-17T11:57:55.032 INFO:tasks.workunit.client.1.smithi119.stdout:8/674: creat d7/da/fd8 x:0 0 0 2023-12-17T11:57:55.037 INFO:tasks.workunit.client.0.smithi002.stdout:8/851: dread d3/d8/da/fa6 [0,4194304] 0 2023-12-17T11:57:55.037 INFO:tasks.workunit.client.0.smithi002.stdout:8/852: write d3/d7/d18/d74/d7b/d11c/db4/d117/f5f [3208805,20806] 0 2023-12-17T11:57:55.037 INFO:tasks.workunit.client.0.smithi002.stdout:8/853: creat d3/d7/d18/d74/d7b/f120 x:0 0 0 2023-12-17T11:57:55.040 INFO:tasks.workunit.client.0.smithi002.stdout:2/773: dread d3/d4/d7/d14/d34/f5e [0,4194304] 0 2023-12-17T11:57:55.045 INFO:tasks.workunit.client.1.smithi119.stdout:9/828: sync 2023-12-17T11:57:55.046 INFO:tasks.workunit.client.1.smithi119.stdout:8/675: dread d7/d18/fcf [0,4194304] 0 2023-12-17T11:57:55.050 INFO:tasks.workunit.client.0.smithi002.stdout:5/780: mknod dc/d1a/d61/c111 0 2023-12-17T11:57:55.056 INFO:tasks.workunit.client.1.smithi119.stdout:5/850: dwrite d1/da7/d71/ff8 [0,4194304] 0 2023-12-17T11:57:55.059 INFO:tasks.workunit.client.0.smithi002.stdout:9/891: creat dc/d1d/d25/d85/dc2/ddd/f142 x:0 0 0 2023-12-17T11:57:55.061 INFO:tasks.workunit.client.0.smithi002.stdout:1/788: mkdir d3/d2f/d4d/d95/d100 0 2023-12-17T11:57:55.062 INFO:tasks.workunit.client.1.smithi119.stdout:6/696: symlink d2/ld5 0 2023-12-17T11:57:55.062 INFO:tasks.workunit.client.1.smithi119.stdout:6/697: dread - d2/d2b/d43/d76/d8d/dc2/fc6 zero size 2023-12-17T11:57:55.064 INFO:tasks.workunit.client.0.smithi002.stdout:6/781: dwrite d0/d1/d28/dab/fac [0,4194304] 0 2023-12-17T11:57:55.065 INFO:tasks.workunit.client.1.smithi119.stdout:9/829: dread d12/f2c [0,4194304] 0 2023-12-17T11:57:55.068 INFO:tasks.workunit.client.1.smithi119.stdout:2/847: truncate d6/d2b/d3f/da8/fe1 3793869 0 2023-12-17T11:57:55.069 INFO:tasks.workunit.client.0.smithi002.stdout:9/892: dread dc/d1d/d25/d85/dc2/ddd/dfa/fae [0,4194304] 0 2023-12-17T11:57:55.076 INFO:tasks.workunit.client.0.smithi002.stdout:1/789: dread d3/d6/d16/f31 [0,4194304] 0 2023-12-17T11:57:55.077 INFO:tasks.workunit.client.1.smithi119.stdout:3/837: write d9/f95 [977062,107320] 0 2023-12-17T11:57:55.078 INFO:tasks.workunit.client.1.smithi119.stdout:5/851: dread d1/d44/d52/f55 [0,4194304] 0 2023-12-17T11:57:55.078 INFO:tasks.workunit.client.1.smithi119.stdout:7/813: dwrite d2/d4/d11/f43 [0,4194304] 0 2023-12-17T11:57:55.078 INFO:tasks.workunit.client.1.smithi119.stdout:4/771: dwrite dd/d15/d16/d3d/f7c [0,4194304] 0 2023-12-17T11:57:55.078 INFO:tasks.workunit.client.1.smithi119.stdout:4/772: write dd/d15/d16/f51 [3186658,44054] 0 2023-12-17T11:57:55.081 INFO:tasks.workunit.client.1.smithi119.stdout:1/740: dwrite d3/db/d26/f55 [0,4194304] 0 2023-12-17T11:57:55.083 INFO:tasks.workunit.client.0.smithi002.stdout:8/854: creat d3/d8/d28/d31/f121 x:0 0 0 2023-12-17T11:57:55.086 INFO:tasks.workunit.client.0.smithi002.stdout:2/774: creat d3/d4/d7/d14/d2e/d37/d3f/d10e/f112 x:0 0 0 2023-12-17T11:57:55.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/781: link dc/d94/ded/d5a/d96/fc1 dc/d94/ded/d2d/dcf/d10d/f112 0 2023-12-17T11:57:55.094 INFO:tasks.workunit.client.1.smithi119.stdout:6/698: truncate d2/d2b/f6f 4016643 0 2023-12-17T11:57:55.097 INFO:tasks.workunit.client.1.smithi119.stdout:9/830: mknod d12/d1d/d28/d46/d50/d92/daf/deb/c10b 0 2023-12-17T11:57:55.099 INFO:tasks.workunit.client.1.smithi119.stdout:2/848: creat d6/d2b/d4b/d11b/f128 x:0 0 0 2023-12-17T11:57:55.099 INFO:tasks.workunit.client.1.smithi119.stdout:2/849: write d6/d9/d13/ffc [429256,24882] 0 2023-12-17T11:57:55.105 INFO:tasks.workunit.client.1.smithi119.stdout:5/852: creat d1/d70/d85/d95/dc3/dfd/f11a x:0 0 0 2023-12-17T11:57:55.106 INFO:tasks.workunit.client.0.smithi002.stdout:9/893: symlink dc/d1d/d25/d85/l143 0 2023-12-17T11:57:55.111 INFO:tasks.workunit.client.0.smithi002.stdout:1/790: rename d3/d6/d9/f29 to d3/d2f/d74/d97/f101 0 2023-12-17T11:57:55.117 INFO:tasks.workunit.client.0.smithi002.stdout:8/855: creat d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/f122 x:0 0 0 2023-12-17T11:57:55.118 INFO:tasks.workunit.client.1.smithi119.stdout:7/814: creat d2/d4/d11/d2c/d68/d99/d6c/ff6 x:0 0 0 2023-12-17T11:57:55.119 INFO:tasks.workunit.client.1.smithi119.stdout:7/815: read d2/d40/dc3/dc8/fd6 [123232,79812] 0 2023-12-17T11:57:55.122 INFO:tasks.workunit.client.1.smithi119.stdout:4/773: rename dd/d11/d26/la6 to dd/lf7 0 2023-12-17T11:57:55.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/801: sync 2023-12-17T11:57:55.124 INFO:tasks.workunit.client.0.smithi002.stdout:0/746: sync 2023-12-17T11:57:55.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/802: stat d9/d1b/d35/d41/d59/d7c/l3f 0 2023-12-17T11:57:55.124 INFO:tasks.workunit.client.0.smithi002.stdout:3/803: chown d9/d15/f19 244082432 1 2023-12-17T11:57:55.124 INFO:tasks.workunit.client.0.smithi002.stdout:0/747: fsync d0/d6/d26/d14/d19/d61/f73 0 2023-12-17T11:57:55.124 INFO:tasks.workunit.client.1.smithi119.stdout:3/838: dwrite d9/da/df/d41/d33/d3a/d90/f94 [0,4194304] 0 2023-12-17T11:57:55.125 INFO:tasks.workunit.client.0.smithi002.stdout:4/708: sync 2023-12-17T11:57:55.125 INFO:tasks.workunit.client.0.smithi002.stdout:6/782: dwrite d0/d1/dc/f8 [4194304,4194304] 0 2023-12-17T11:57:55.130 INFO:tasks.workunit.client.0.smithi002.stdout:1/791: unlink d3/d6/d9/d37/d39/d43/d4a/deb/fef 0 2023-12-17T11:57:55.130 INFO:tasks.workunit.client.0.smithi002.stdout:1/792: truncate d3/d2f/d74/dbd/fd7 473244 0 2023-12-17T11:57:55.130 INFO:tasks.workunit.client.0.smithi002.stdout:8/856: creat d3/d7/d18/d74/d7b/d11c/db4/f123 x:0 0 0 2023-12-17T11:57:55.130 INFO:tasks.workunit.client.0.smithi002.stdout:2/775: truncate d3/d4/d7/d14/d34/f6c 1149465 0 2023-12-17T11:57:55.130 INFO:tasks.workunit.client.0.smithi002.stdout:2/776: creat d3/d4/d7/d14/d9b/f113 x:0 0 0 2023-12-17T11:57:55.130 INFO:tasks.workunit.client.0.smithi002.stdout:2/777: write d3/d4/d17/d19/d4d/d72/d77/ff0 [1854772,32965] 0 2023-12-17T11:57:55.131 INFO:tasks.workunit.client.0.smithi002.stdout:5/782: dwrite dc/d1a/d47/f49 [4194304,4194304] 0 2023-12-17T11:57:55.132 INFO:tasks.workunit.client.0.smithi002.stdout:5/783: dread - dc/d1a/faa zero size 2023-12-17T11:57:55.133 INFO:tasks.workunit.client.0.smithi002.stdout:4/709: dread d0/d10/d21/d33/dbc/fcc [0,4194304] 0 2023-12-17T11:57:55.133 INFO:tasks.workunit.client.0.smithi002.stdout:4/710: fdatasync d0/d3e/d56/d99/fb8 0 2023-12-17T11:57:55.133 INFO:tasks.workunit.client.0.smithi002.stdout:4/711: chown d0/d3e/d56/d99/fb8 605 1 2023-12-17T11:57:55.136 INFO:tasks.workunit.client.0.smithi002.stdout:3/804: mkdir d9/d1b/d35/d41/d43/d4b/d92/d103 0 2023-12-17T11:57:55.136 INFO:tasks.workunit.client.0.smithi002.stdout:3/805: fdatasync d9/d24/fa8 0 2023-12-17T11:57:55.136 INFO:tasks.workunit.client.0.smithi002.stdout:3/806: chown d9/d1b/d35/d41/d59/d7c/db7/fcb 18 1 2023-12-17T11:57:55.138 INFO:tasks.workunit.client.1.smithi119.stdout:1/741: creat d3/db/d17/d24/d20/dba/f10f x:0 0 0 2023-12-17T11:57:55.140 INFO:tasks.workunit.client.0.smithi002.stdout:8/857: creat d3/d7/d6e/d7f/f124 x:0 0 0 2023-12-17T11:57:55.140 INFO:tasks.workunit.client.0.smithi002.stdout:8/858: write d3/d8/da/d44/f3b [1204030,7336] 0 2023-12-17T11:57:55.146 INFO:tasks.workunit.client.1.smithi119.stdout:9/831: unlink d12/d1d/d49/l58 0 2023-12-17T11:57:55.147 INFO:tasks.workunit.client.1.smithi119.stdout:2/850: creat d6/d2b/d3f/da8/d122/f129 x:0 0 0 2023-12-17T11:57:55.157 INFO:tasks.workunit.client.1.smithi119.stdout:5/853: mknod d1/d70/d85/d95/dc3/c11b 0 2023-12-17T11:57:55.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/793: read d3/d6/d9/d37/f65 [4164686,128916] 0 2023-12-17T11:57:55.160 INFO:tasks.workunit.client.0.smithi002.stdout:1/794: chown d3/d6/d16/dcf/ldc 18 1 2023-12-17T11:57:55.170 INFO:tasks.workunit.client.0.smithi002.stdout:6/783: dwrite d0/d1/d21/d56/d8c/d93/da5/f8d [0,4194304] 0 2023-12-17T11:57:55.170 INFO:tasks.workunit.client.0.smithi002.stdout:6/784: write d0/d1/d21/d56/d8c/d93/da5/f90 [1638441,59323] 0 2023-12-17T11:57:55.170 INFO:tasks.workunit.client.0.smithi002.stdout:6/785: stat d0/d1/d5b/dda 0 2023-12-17T11:57:55.171 INFO:tasks.workunit.client.0.smithi002.stdout:6/786: chown d0/d1/dc/c69 15 1 2023-12-17T11:57:55.183 INFO:tasks.workunit.client.1.smithi119.stdout:6/699: rename d2/d2b/d43/d76/d8d/f97 to d2/d2b/d43/d5e/d92/da8/fd6 0 2023-12-17T11:57:55.185 INFO:tasks.workunit.client.1.smithi119.stdout:4/774: truncate dd/f41 1552175 0 2023-12-17T11:57:55.185 INFO:tasks.workunit.client.1.smithi119.stdout:4/775: fdatasync dd/d11/d2d/d9c/d55/d81/db8/d78/f89 0 2023-12-17T11:57:55.186 INFO:tasks.workunit.client.1.smithi119.stdout:4/776: creat dd/d4b/ff8 x:0 0 0 2023-12-17T11:57:55.192 INFO:tasks.workunit.client.0.smithi002.stdout:9/894: dwrite dc/d42/da0/d72/d93/f2e [0,4194304] 0 2023-12-17T11:57:55.195 INFO:tasks.workunit.client.1.smithi119.stdout:3/839: mknod d9/d59/c13d 0 2023-12-17T11:57:55.196 INFO:tasks.workunit.client.0.smithi002.stdout:3/807: creat d9/d1b/d35/d41/d43/d73/f104 x:0 0 0 2023-12-17T11:57:55.197 INFO:tasks.workunit.client.1.smithi119.stdout:0/767: sync 2023-12-17T11:57:55.199 INFO:tasks.workunit.client.1.smithi119.stdout:2/851: mkdir d6/d9/d86/db0/d12a 0 2023-12-17T11:57:55.200 INFO:tasks.workunit.client.0.smithi002.stdout:1/795: symlink d3/d6/d9/l102 0 2023-12-17T11:57:55.202 INFO:tasks.workunit.client.1.smithi119.stdout:5/854: unlink d1/d70/d6b/d77/dae/dba/de3/l90 0 2023-12-17T11:57:55.203 INFO:tasks.workunit.client.0.smithi002.stdout:3/808: dread d9/d1b/d4f/fb2 [0,4194304] 0 2023-12-17T11:57:55.204 INFO:tasks.workunit.client.0.smithi002.stdout:6/787: unlink d0/d1/dc/d58/dae/ddb/dc6/ce0 0 2023-12-17T11:57:55.207 INFO:tasks.workunit.client.0.smithi002.stdout:5/784: dwrite dc/d94/ded/d75/fff [0,4194304] 0 2023-12-17T11:57:55.208 INFO:tasks.workunit.client.1.smithi119.stdout:7/816: dwrite d2/d4/fee [0,4194304] 0 2023-12-17T11:57:55.209 INFO:tasks.workunit.client.1.smithi119.stdout:1/742: dwrite d3/db/d17/d24/d20/dba/dbc/d7e/da1/fe7 [0,4194304] 0 2023-12-17T11:57:55.210 INFO:tasks.workunit.client.1.smithi119.stdout:9/832: dwrite d12/d1d/d49/fba [0,4194304] 0 2023-12-17T11:57:55.210 INFO:tasks.workunit.client.0.smithi002.stdout:1/796: symlink d3/d2f/d74/dbd/dc4/l103 0 2023-12-17T11:57:55.210 INFO:tasks.workunit.client.0.smithi002.stdout:1/797: write d3/d2f/d74/dbe/dd8/fb0 [1431227,48804] 0 2023-12-17T11:57:55.212 INFO:tasks.workunit.client.1.smithi119.stdout:4/777: truncate dd/d11/f14 3940984 0 2023-12-17T11:57:55.212 INFO:tasks.workunit.client.1.smithi119.stdout:4/778: fsync dd/d11/d2d/d9c/d55/d81/db8/d78/f89 0 2023-12-17T11:57:55.214 INFO:tasks.workunit.client.0.smithi002.stdout:6/788: symlink d0/d1/dc/d58/l104 0 2023-12-17T11:57:55.214 INFO:tasks.workunit.client.0.smithi002.stdout:6/789: truncate d0/d1/dc/d17/d40/f5f 4941605 0 2023-12-17T11:57:55.216 INFO:tasks.workunit.client.1.smithi119.stdout:0/768: mkdir d2/d66/d1f/d24/d50/dbd/dea 0 2023-12-17T11:57:55.220 INFO:tasks.workunit.client.0.smithi002.stdout:5/785: link f8 dc/d94/ded/d2d/dcf/f113 0 2023-12-17T11:57:55.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/895: write dc/d1d/d25/d85/dc2/ddd/dfa/d47/f48 [2042268,62855] 0 2023-12-17T11:57:55.221 INFO:tasks.workunit.client.1.smithi119.stdout:5/855: symlink d1/da7/l11c 0 2023-12-17T11:57:55.221 INFO:tasks.workunit.client.0.smithi002.stdout:4/712: dwrite d0/d3e/d56/d99/fb8 [0,4194304] 0 2023-12-17T11:57:55.222 INFO:tasks.workunit.client.0.smithi002.stdout:4/713: stat d0/d3e/d56/d65/d78 0 2023-12-17T11:57:55.222 INFO:tasks.workunit.client.0.smithi002.stdout:4/714: chown d0/d5a/fd6 29357 1 2023-12-17T11:57:55.222 INFO:tasks.workunit.client.0.smithi002.stdout:4/715: write d0/d10/d14/d27/fbd [239842,96467] 0 2023-12-17T11:57:55.222 INFO:tasks.workunit.client.1.smithi119.stdout:4/779: dread dd/d15/f95 [0,4194304] 0 2023-12-17T11:57:55.223 INFO:tasks.workunit.client.0.smithi002.stdout:7/745: sync 2023-12-17T11:57:55.227 INFO:tasks.workunit.client.0.smithi002.stdout:8/859: rename d3/d7/d6e/d7f to d3/d7/d18/d74/d125 0 2023-12-17T11:57:55.227 INFO:tasks.workunit.client.0.smithi002.stdout:8/860: dread - d3/d7/d18/d74/d7b/f120 zero size 2023-12-17T11:57:55.229 INFO:tasks.workunit.client.1.smithi119.stdout:6/700: getdents d2/d2b/d43/dcb 0 2023-12-17T11:57:55.231 INFO:tasks.workunit.client.0.smithi002.stdout:5/786: symlink dc/d94/ded/dad/l114 0 2023-12-17T11:57:55.232 INFO:tasks.workunit.client.0.smithi002.stdout:9/896: symlink dc/d42/da0/d72/d93/l144 0 2023-12-17T11:57:55.233 INFO:tasks.workunit.client.1.smithi119.stdout:3/840: dread d9/d1c/f49 [0,4194304] 0 2023-12-17T11:57:55.236 INFO:tasks.workunit.client.1.smithi119.stdout:4/780: dread dd/d15/f53 [0,4194304] 0 2023-12-17T11:57:55.236 INFO:tasks.workunit.client.1.smithi119.stdout:4/781: truncate dd/f28 4968368 0 2023-12-17T11:57:55.236 INFO:tasks.workunit.client.1.smithi119.stdout:4/782: truncate dd/d15/d4f/fbb 449137 0 2023-12-17T11:57:55.237 INFO:tasks.workunit.client.1.smithi119.stdout:2/852: getdents d6/d9/d86/db0 0 2023-12-17T11:57:55.237 INFO:tasks.workunit.client.1.smithi119.stdout:2/853: write d6/d2b/f117 [109301,59791] 0 2023-12-17T11:57:55.237 INFO:tasks.workunit.client.1.smithi119.stdout:2/854: fsync d6/d2b/d3f/d5c/f79 0 2023-12-17T11:57:55.237 INFO:tasks.workunit.client.1.smithi119.stdout:2/855: read - d6/d2b/d4b/d11b/f128 zero size 2023-12-17T11:57:55.239 INFO:tasks.workunit.client.1.smithi119.stdout:4/783: write dd/d11/d2d/d9c/d55/d81/fcd [36301,121695] 0 2023-12-17T11:57:55.239 INFO:tasks.workunit.client.1.smithi119.stdout:4/784: stat dd/c73 0 2023-12-17T11:57:55.239 INFO:tasks.workunit.client.1.smithi119.stdout:4/785: fdatasync dd/d15/d4f/f6b 0 2023-12-17T11:57:55.239 INFO:tasks.workunit.client.1.smithi119.stdout:4/786: creat dd/d11/d2d/d9c/d55/d81/db8/d78/dca/ff9 x:0 0 0 2023-12-17T11:57:55.242 INFO:tasks.workunit.client.1.smithi119.stdout:7/817: unlink d2/d4/d11/d2c/d68/d99/lc1 0 2023-12-17T11:57:55.242 INFO:tasks.workunit.client.1.smithi119.stdout:7/818: read - d2/d4/d11/d2c/f8f zero size 2023-12-17T11:57:55.243 INFO:tasks.workunit.client.1.smithi119.stdout:1/743: creat d3/db/d17/f110 x:0 0 0 2023-12-17T11:57:55.248 INFO:tasks.workunit.client.1.smithi119.stdout:9/833: link d12/l69 d12/d1d/d28/d46/d50/l10c 0 2023-12-17T11:57:55.248 INFO:tasks.workunit.client.1.smithi119.stdout:9/834: creat d12/dca/f10d x:0 0 0 2023-12-17T11:57:55.251 INFO:tasks.workunit.client.0.smithi002.stdout:3/809: dwrite d9/d1b/d35/d41/d59/d7c/db7/fcb [0,4194304] 0 2023-12-17T11:57:55.257 INFO:tasks.workunit.client.1.smithi119.stdout:5/856: rename d1/d70/d85/d95/dc3/dfd/f115 to d1/d70/d6b/df1/f11d 0 2023-12-17T11:57:55.259 INFO:tasks.workunit.client.1.smithi119.stdout:6/701: symlink d2/d61/ld7 0 2023-12-17T11:57:55.259 INFO:tasks.workunit.client.1.smithi119.stdout:6/702: write d2/f4 [4943525,66261] 0 2023-12-17T11:57:55.262 INFO:tasks.workunit.client.0.smithi002.stdout:4/716: mkdir d0/d10/d14/d27/d57/de7 0 2023-12-17T11:57:55.262 INFO:tasks.workunit.client.0.smithi002.stdout:4/717: creat d0/d6c/dda/de1/fe8 x:0 0 0 2023-12-17T11:57:55.263 INFO:tasks.workunit.client.1.smithi119.stdout:3/841: symlink d9/d11/d87/l13e 0 2023-12-17T11:57:55.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/746: unlink d6/d17/dc/d13/dd8/fc3 0 2023-12-17T11:57:55.268 INFO:tasks.workunit.client.0.smithi002.stdout:1/798: symlink d3/d6/d9/d37/d39/d43/d4a/dac/l104 0 2023-12-17T11:57:55.268 INFO:tasks.workunit.client.0.smithi002.stdout:1/799: chown d3/d6/d16/d28/l92 53558 1 2023-12-17T11:57:55.271 INFO:tasks.workunit.client.1.smithi119.stdout:4/787: creat dd/d11/d2d/d9c/d55/d81/db8/dbd/dec/ffa x:0 0 0 2023-12-17T11:57:55.272 INFO:tasks.workunit.client.0.smithi002.stdout:8/861: getdents d3/d7/d18/d74/d125/d65/da2 0 2023-12-17T11:57:55.273 INFO:tasks.workunit.client.1.smithi119.stdout:6/703: write d2/d7e/f9f [3661454,60335] 0 2023-12-17T11:57:55.274 INFO:tasks.workunit.client.0.smithi002.stdout:6/790: dwrite d0/d1/d21/d56/d8c/d93/da5/dbc/dc4/fd9 [0,4194304] 0 2023-12-17T11:57:55.274 INFO:tasks.workunit.client.0.smithi002.stdout:6/791: readlink d0/d1/dc/d17/d67/d6c/d7f/lb0 0 2023-12-17T11:57:55.274 INFO:tasks.workunit.client.0.smithi002.stdout:2/778: dwrite d3/d4/d7/d14/d1b/d5b/f97 [0,4194304] 0 2023-12-17T11:57:55.275 INFO:tasks.workunit.client.1.smithi119.stdout:7/819: unlink d2/d4/d11/d2c/d68/d6a/f78 0 2023-12-17T11:57:55.275 INFO:tasks.workunit.client.1.smithi119.stdout:8/676: sync 2023-12-17T11:57:55.275 INFO:tasks.workunit.client.1.smithi119.stdout:8/677: readlink d7/da/d11/d60/lc8 0 2023-12-17T11:57:55.276 INFO:tasks.workunit.client.1.smithi119.stdout:8/678: chown d7/da/d11/f87 0 1 2023-12-17T11:57:55.276 INFO:tasks.workunit.client.0.smithi002.stdout:5/787: symlink dc/d1a/d47/l115 0 2023-12-17T11:57:55.277 INFO:tasks.workunit.client.1.smithi119.stdout:1/744: symlink d3/db/d17/d24/d20/d6c/db7/de4/l111 0 2023-12-17T11:57:55.277 INFO:tasks.workunit.client.0.smithi002.stdout:9/897: getdents dc/d1d/d25/d85/dc2/d91 0 2023-12-17T11:57:55.282 INFO:tasks.workunit.client.1.smithi119.stdout:9/835: truncate d12/d1d/d28/f3a 3654373 0 2023-12-17T11:57:55.283 INFO:tasks.workunit.client.0.smithi002.stdout:3/810: mknod d9/d1b/d35/d41/d59/d65/da9/d8f/c105 0 2023-12-17T11:57:55.284 INFO:tasks.workunit.client.1.smithi119.stdout:1/745: dread d3/db/d17/f8e [0,4194304] 0 2023-12-17T11:57:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:4/718: mknod d0/d3e/dc8/dcd/ce9 0 2023-12-17T11:57:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:0/748: sync 2023-12-17T11:57:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:4/719: write d0/d3e/d56/d99/f9f [391070,77049] 0 2023-12-17T11:57:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:0/749: chown d0/d6/d26/d14/d19/d61/f7c 1351 1 2023-12-17T11:57:55.288 INFO:tasks.workunit.client.0.smithi002.stdout:0/750: readlink d0/d6/d26/d14/d19/d37/dcf/lb2 0 2023-12-17T11:57:55.289 INFO:tasks.workunit.client.1.smithi119.stdout:0/769: mknod d2/d16/d35/d74/ceb 0 2023-12-17T11:57:55.289 INFO:tasks.workunit.client.1.smithi119.stdout:0/770: write d2/dac/fc6 [201820,83288] 0 2023-12-17T11:57:55.291 INFO:tasks.workunit.client.0.smithi002.stdout:7/747: rename d6/d17/dc/d13/d21/d2e/d4a/d91 to d6/d17/dc/d13/de1 0 2023-12-17T11:57:55.292 INFO:tasks.workunit.client.1.smithi119.stdout:5/857: mkdir d1/d70/d6b/d77/dae/dba/de3/d86/dda/d11e 0 2023-12-17T11:57:55.292 INFO:tasks.workunit.client.1.smithi119.stdout:5/858: chown d1/d36/d3a/fdf 1 1 2023-12-17T11:57:55.293 INFO:tasks.workunit.client.1.smithi119.stdout:5/859: truncate d1/d70/d6b/d77/f98 429094 0 2023-12-17T11:57:55.293 INFO:tasks.workunit.client.1.smithi119.stdout:5/860: fdatasync d1/d70/d6b/d77/fb9 0 2023-12-17T11:57:55.294 INFO:tasks.workunit.client.0.smithi002.stdout:1/800: truncate d3/d2f/d4d/d95/fe9 669324 0 2023-12-17T11:57:55.294 INFO:tasks.workunit.client.0.smithi002.stdout:1/801: readlink d3/d6/ld 0 2023-12-17T11:57:55.295 INFO:tasks.workunit.client.1.smithi119.stdout:3/842: rmdir d9/d11/d1e/d9f 39 2023-12-17T11:57:55.295 INFO:tasks.workunit.client.1.smithi119.stdout:3/843: fsync d9/d11/d1e/f37 0 2023-12-17T11:57:55.298 INFO:tasks.workunit.client.0.smithi002.stdout:8/862: symlink d3/d7/d6e/l126 0 2023-12-17T11:57:55.304 INFO:tasks.workunit.client.1.smithi119.stdout:6/704: rmdir d2/d2b/d43/d5e/d92 39 2023-12-17T11:57:55.307 INFO:tasks.workunit.client.1.smithi119.stdout:0/771: dread d2/d66/d2e/d44/fbe [0,4194304] 0 2023-12-17T11:57:55.308 INFO:tasks.workunit.client.1.smithi119.stdout:7/820: getdents d2/d4/d11/d2c/d68/db4 0 2023-12-17T11:57:55.312 INFO:tasks.workunit.client.0.smithi002.stdout:6/792: mkdir d0/d1/d28/dde/d105 0 2023-12-17T11:57:55.313 INFO:tasks.workunit.client.1.smithi119.stdout:8/679: creat d7/d18/d15/d81/dc9/fd9 x:0 0 0 2023-12-17T11:57:55.314 INFO:tasks.workunit.client.0.smithi002.stdout:8/863: dread d3/d8/f42 [0,4194304] 0 2023-12-17T11:57:55.316 INFO:tasks.workunit.client.0.smithi002.stdout:5/788: mknod dc/d94/ded/d2d/c116 0 2023-12-17T11:57:55.317 INFO:tasks.workunit.client.0.smithi002.stdout:7/748: dwrite d6/f3b [0,4194304] 0 2023-12-17T11:57:55.317 INFO:tasks.workunit.client.1.smithi119.stdout:9/836: link d12/d1d/d28/d46/dea/laa d12/d1d/d28/d46/d50/d92/dcc/l10e 0 2023-12-17T11:57:55.324 INFO:tasks.workunit.client.1.smithi119.stdout:5/861: mkdir d1/d70/d6b/d77/dae/dba/de3/d11f 0 2023-12-17T11:57:55.324 INFO:tasks.workunit.client.1.smithi119.stdout:5/862: stat d1/da7/l11c 0 2023-12-17T11:57:55.329 INFO:tasks.workunit.client.0.smithi002.stdout:3/811: creat d9/d15/d52/d85/dd9/f106 x:0 0 0 2023-12-17T11:57:55.330 INFO:tasks.workunit.client.0.smithi002.stdout:4/720: rmdir d0/d3e/dd1 0 2023-12-17T11:57:55.330 INFO:tasks.workunit.client.0.smithi002.stdout:3/812: write d9/d24/f6d [3657349,85121] 0 2023-12-17T11:57:55.330 INFO:tasks.workunit.client.1.smithi119.stdout:3/844: mkdir d9/da/df/d67/d13f 0 2023-12-17T11:57:55.331 INFO:tasks.workunit.client.0.smithi002.stdout:0/751: symlink d0/d6/d26/d14/d19/d37/d62/lf3 0 2023-12-17T11:57:55.332 INFO:tasks.workunit.client.0.smithi002.stdout:0/752: write d0/d6/d26/f3b [1263045,36165] 0 2023-12-17T11:57:55.334 INFO:tasks.workunit.client.1.smithi119.stdout:8/680: write d7/d12/d23/f38 [7797877,45607] 0 2023-12-17T11:57:55.334 INFO:tasks.workunit.client.1.smithi119.stdout:0/772: unlink d2/dac/fc6 0 2023-12-17T11:57:55.337 INFO:tasks.workunit.client.0.smithi002.stdout:2/779: rename d3/d4/d17/d19/d8d/ff8 to d3/d4/d17/d19/d4d/d72/f114 0 2023-12-17T11:57:55.338 INFO:tasks.workunit.client.0.smithi002.stdout:2/780: write d3/d4/d7/fb0 [4962225,51240] 0 2023-12-17T11:57:55.338 INFO:tasks.workunit.client.0.smithi002.stdout:1/802: rmdir d3/d6/d16/d61 39 2023-12-17T11:57:55.339 INFO:tasks.workunit.client.1.smithi119.stdout:7/821: symlink d2/d4/d11/d2c/d68/db4/lf7 0 2023-12-17T11:57:55.339 INFO:tasks.workunit.client.1.smithi119.stdout:7/822: truncate d2/d4/d11/d2c/f58 5073800 0 2023-12-17T11:57:55.340 INFO:tasks.workunit.client.1.smithi119.stdout:7/823: chown d2/d5b/f65 0 1 2023-12-17T11:57:55.340 INFO:tasks.workunit.client.1.smithi119.stdout:7/824: chown d2/f76 38084892 1 2023-12-17T11:57:55.340 INFO:tasks.workunit.client.0.smithi002.stdout:5/789: unlink dc/d8e/feb 0 2023-12-17T11:57:55.343 INFO:tasks.workunit.client.0.smithi002.stdout:7/749: creat d6/d17/fe2 x:0 0 0 2023-12-17T11:57:55.344 INFO:tasks.workunit.client.0.smithi002.stdout:7/750: truncate d6/d17/dc/d13/d21/d6e/f7e 5177607 0 2023-12-17T11:57:55.344 INFO:tasks.workunit.client.0.smithi002.stdout:7/751: write d6/d17/dc/d67/d8b/d24/da3/fb6 [1871949,14946] 0 2023-12-17T11:57:55.344 INFO:tasks.workunit.client.0.smithi002.stdout:7/752: fdatasync d6/d17/dc/d13/d37/d4f/f9d 0 2023-12-17T11:57:55.344 INFO:tasks.workunit.client.1.smithi119.stdout:4/788: truncate dd/d11/f14 3949483 0 2023-12-17T11:57:55.344 INFO:tasks.workunit.client.1.smithi119.stdout:4/789: dread - dd/d15/d16/d5a/fcf zero size 2023-12-17T11:57:55.346 INFO:tasks.workunit.client.1.smithi119.stdout:9/837: mkdir d12/d1d/d28/d46/d50/d92/dae/d10f 0 2023-12-17T11:57:55.348 INFO:tasks.workunit.client.0.smithi002.stdout:4/721: symlink d0/d10/d21/d33/d96/lea 0 2023-12-17T11:57:55.349 INFO:tasks.workunit.client.1.smithi119.stdout:1/746: getdents d3/db/d17/d24/d20/d40/d76/d96/d99/d9a 0 2023-12-17T11:57:55.349 INFO:tasks.workunit.client.1.smithi119.stdout:1/747: fdatasync d3/db/d17/f31 0 2023-12-17T11:57:55.352 INFO:tasks.workunit.client.1.smithi119.stdout:5/863: mkdir d1/d70/da3/d120 0 2023-12-17T11:57:55.352 INFO:tasks.workunit.client.0.smithi002.stdout:3/813: truncate d9/d24/f51 1173451 0 2023-12-17T11:57:55.355 INFO:tasks.workunit.client.0.smithi002.stdout:0/753: creat d0/d6/d26/d14/d19/d2b/ff4 x:0 0 0 2023-12-17T11:57:55.355 INFO:tasks.workunit.client.1.smithi119.stdout:3/845: creat d9/d11/d1e/d9f/f140 x:0 0 0 2023-12-17T11:57:55.356 INFO:tasks.workunit.client.1.smithi119.stdout:3/846: chown d9/d44/db7/ld2 3 1 2023-12-17T11:57:55.356 INFO:tasks.workunit.client.1.smithi119.stdout:3/847: chown d9/d44/d8c/fe3 12 1 2023-12-17T11:57:55.356 INFO:tasks.workunit.client.1.smithi119.stdout:0/773: mknod d2/d16/cec 0 2023-12-17T11:57:55.356 INFO:tasks.workunit.client.1.smithi119.stdout:0/774: write d2/d66/d2e/d44/d7b/d5/dc/f91 [323400,84637] 0 2023-12-17T11:57:55.356 INFO:tasks.workunit.client.1.smithi119.stdout:0/775: chown d2/d16/d35 811510 1 2023-12-17T11:57:55.358 INFO:tasks.workunit.client.0.smithi002.stdout:8/864: dwrite d3/d7/d1a/f9c [0,4194304] 0 2023-12-17T11:57:55.361 INFO:tasks.workunit.client.1.smithi119.stdout:6/705: dwrite d2/f98 [0,4194304] 0 2023-12-17T11:57:55.362 INFO:tasks.workunit.client.1.smithi119.stdout:6/706: write d2/df/d17/d79/f7d [823857,121292] 0 2023-12-17T11:57:55.363 INFO:tasks.workunit.client.1.smithi119.stdout:6/707: stat d2/da3/lbb 0 2023-12-17T11:57:55.363 INFO:tasks.workunit.client.1.smithi119.stdout:6/708: chown d2/d2b/c40 1306 1 2023-12-17T11:57:55.364 INFO:tasks.workunit.client.1.smithi119.stdout:7/825: creat d2/d4/d11/d2c/d55/d67/ff8 x:0 0 0 2023-12-17T11:57:55.367 INFO:tasks.workunit.client.0.smithi002.stdout:2/781: truncate d3/d4/d7/d14/d42/dae/fb9 769019 0 2023-12-17T11:57:55.367 INFO:tasks.workunit.client.0.smithi002.stdout:2/782: chown d3/d4/d17/d19/ld7 45839430 1 2023-12-17T11:57:55.371 INFO:tasks.workunit.client.1.smithi119.stdout:4/790: creat dd/d11/d2d/d9c/d55/d81/d88/d91/ffb x:0 0 0 2023-12-17T11:57:55.374 INFO:tasks.workunit.client.0.smithi002.stdout:1/803: creat d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/f105 x:0 0 0 2023-12-17T11:57:55.374 INFO:tasks.workunit.client.0.smithi002.stdout:1/804: read d3/f83 [2693768,114979] 0 2023-12-17T11:57:55.376 INFO:tasks.workunit.client.1.smithi119.stdout:1/748: mkdir d3/db/d17/d112 0 2023-12-17T11:57:55.378 INFO:tasks.workunit.client.0.smithi002.stdout:5/790: mknod dc/d17/df1/c117 0 2023-12-17T11:57:55.381 INFO:tasks.workunit.client.1.smithi119.stdout:5/864: rename d1/f111 to d1/da7/f121 0 2023-12-17T11:57:55.381 INFO:tasks.workunit.client.1.smithi119.stdout:5/865: write d1/d70/d6b/d77/f98 [1438667,37523] 0 2023-12-17T11:57:55.381 INFO:tasks.workunit.client.1.smithi119.stdout:5/866: creat d1/d70/d85/d95/f122 x:0 0 0 2023-12-17T11:57:55.382 INFO:tasks.workunit.client.0.smithi002.stdout:5/791: write dc/d94/f103 [4204487,113777] 0 2023-12-17T11:57:55.382 INFO:tasks.workunit.client.0.smithi002.stdout:5/792: chown dc/d1a/d61/la1 919 1 2023-12-17T11:57:55.382 INFO:tasks.workunit.client.0.smithi002.stdout:5/793: truncate dc/d94/ded/d2d/d5b/fa2 388784 0 2023-12-17T11:57:55.382 INFO:tasks.workunit.client.0.smithi002.stdout:1/805: dread d3/d6/d9/d30/f4c [0,4194304] 0 2023-12-17T11:57:55.385 INFO:tasks.workunit.client.0.smithi002.stdout:7/753: creat d6/d17/db3/fe3 x:0 0 0 2023-12-17T11:57:55.387 INFO:tasks.workunit.client.1.smithi119.stdout:6/709: dread d2/d7e/f9f [0,4194304] 0 2023-12-17T11:57:55.393 INFO:tasks.workunit.client.0.smithi002.stdout:3/814: dwrite d9/d24/fa8 [0,4194304] 0 2023-12-17T11:57:55.399 INFO:tasks.workunit.client.1.smithi119.stdout:3/848: unlink d9/d11/d1e/d55/d77/lf6 0 2023-12-17T11:57:55.404 INFO:tasks.workunit.client.1.smithi119.stdout:1/749: symlink d3/db/d17/d24/d20/dba/l113 0 2023-12-17T11:57:55.404 INFO:tasks.workunit.client.1.smithi119.stdout:1/750: creat d3/db/d17/d24/d20/d6c/db7/f114 x:0 0 0 2023-12-17T11:57:55.405 INFO:tasks.workunit.client.1.smithi119.stdout:7/826: rename d2/d5b/l63 to d2/d4/d11/d2c/lf9 0 2023-12-17T11:57:55.406 INFO:tasks.workunit.client.0.smithi002.stdout:4/722: truncate d0/fd 132606 0 2023-12-17T11:57:55.407 INFO:tasks.workunit.client.0.smithi002.stdout:8/865: dwrite d3/d7/d18/d74/d125/f54 [0,4194304] 0 2023-12-17T11:57:55.408 INFO:tasks.workunit.client.0.smithi002.stdout:0/754: creat d0/d6/d26/d14/ff5 x:0 0 0 2023-12-17T11:57:55.408 INFO:tasks.workunit.client.0.smithi002.stdout:0/755: write d0/d6/d26/d14/d19/d2b/f30 [5591522,118543] 0 2023-12-17T11:57:55.408 INFO:tasks.workunit.client.1.smithi119.stdout:5/867: dread d1/da7/f3b [0,4194304] 0 2023-12-17T11:57:55.408 INFO:tasks.workunit.client.1.smithi119.stdout:8/681: dwrite d7/d18/d45/d9f/f6a [0,4194304] 0 2023-12-17T11:57:55.409 INFO:tasks.workunit.client.1.smithi119.stdout:6/710: rename d2/d2b/d43/d5e/f70 to d2/df/d17/fd8 0 2023-12-17T11:57:55.410 INFO:tasks.workunit.client.1.smithi119.stdout:6/711: read - d2/da3/fb5 zero size 2023-12-17T11:57:55.413 INFO:tasks.workunit.client.0.smithi002.stdout:2/783: truncate d3/d50/f53 16972 0 2023-12-17T11:57:55.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/794: symlink dc/d94/ded/d75/l118 0 2023-12-17T11:57:55.416 INFO:tasks.workunit.client.0.smithi002.stdout:5/795: write dc/d94/ded/d75/fff [4259436,89957] 0 2023-12-17T11:57:55.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/796: write dc/d1a/d53/ffb [810853,79019] 0 2023-12-17T11:57:55.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/797: chown dc/d17/f55 3 1 2023-12-17T11:57:55.417 INFO:tasks.workunit.client.0.smithi002.stdout:5/798: write dc/d17/f84 [926230,130703] 0 2023-12-17T11:57:55.418 INFO:tasks.workunit.client.1.smithi119.stdout:9/838: dwrite d12/d1d/d28/d46/d6e/fb6 [0,4194304] 0 2023-12-17T11:57:55.418 INFO:tasks.workunit.client.1.smithi119.stdout:6/712: unlink d2/ld5 0 2023-12-17T11:57:55.418 INFO:tasks.workunit.client.1.smithi119.stdout:6/713: readlink d2/df/d17/l3c 0 2023-12-17T11:57:55.418 INFO:tasks.workunit.client.1.smithi119.stdout:5/868: getdents d1/d70/d6b/d77/dae/dba/de3 0 2023-12-17T11:57:55.418 INFO:tasks.workunit.client.1.smithi119.stdout:0/776: read d2/d16/d35/d74/f83 [47498,19482] 0 2023-12-17T11:57:55.418 INFO:tasks.workunit.client.1.smithi119.stdout:0/777: creat d2/fed x:0 0 0 2023-12-17T11:57:55.419 INFO:tasks.workunit.client.1.smithi119.stdout:9/839: mknod d12/d1d/d28/d46/dea/c110 0 2023-12-17T11:57:55.419 INFO:tasks.workunit.client.0.smithi002.stdout:1/806: creat d3/d6/d16/f106 x:0 0 0 2023-12-17T11:57:55.420 INFO:tasks.workunit.client.1.smithi119.stdout:6/714: symlink d2/d2b/d43/d76/ld9 0 2023-12-17T11:57:55.422 INFO:tasks.workunit.client.1.smithi119.stdout:5/869: mknod d1/d44/c123 0 2023-12-17T11:57:55.422 INFO:tasks.workunit.client.1.smithi119.stdout:5/870: creat d1/d44/f124 x:0 0 0 2023-12-17T11:57:55.422 INFO:tasks.workunit.client.1.smithi119.stdout:5/871: chown d1/d44/f124 25 1 2023-12-17T11:57:55.423 INFO:tasks.workunit.client.0.smithi002.stdout:3/815: creat d9/d1b/d35/d41/d43/d73/f107 x:0 0 0 2023-12-17T11:57:55.425 INFO:tasks.workunit.client.1.smithi119.stdout:0/778: stat d2/d66/d2e/d44/d7b/d5/l1b 0 2023-12-17T11:57:55.425 INFO:tasks.workunit.client.1.smithi119.stdout:0/779: truncate d2/dac/fc1 32631 0 2023-12-17T11:57:55.430 INFO:tasks.workunit.client.1.smithi119.stdout:9/840: rename d12/d1d/d28/l83 to d12/d1d/d28/d4d/d73/d78/d8b/da0/l111 0 2023-12-17T11:57:55.433 INFO:tasks.workunit.client.1.smithi119.stdout:6/715: symlink d2/d2b/d7f/lda 0 2023-12-17T11:57:55.438 INFO:tasks.workunit.client.1.smithi119.stdout:8/682: dread d7/da/d11/faa [0,4194304] 0 2023-12-17T11:57:55.439 INFO:tasks.workunit.client.1.smithi119.stdout:8/683: write d7/da/d11/d26/f58 [3961269,31088] 0 2023-12-17T11:57:55.439 INFO:tasks.workunit.client.1.smithi119.stdout:8/684: write d7/da/d11/d26/d49/f8d [4835048,131058] 0 2023-12-17T11:57:55.444 INFO:tasks.workunit.client.1.smithi119.stdout:5/872: mkdir d1/da7/d71/d125 0 2023-12-17T11:57:55.448 INFO:tasks.workunit.client.0.smithi002.stdout:4/723: symlink d0/d3e/dc8/dcd/leb 0 2023-12-17T11:57:55.448 INFO:tasks.workunit.client.0.smithi002.stdout:4/724: fdatasync d0/d10/d14/d4e/f53 0 2023-12-17T11:57:55.449 INFO:tasks.workunit.client.1.smithi119.stdout:0/780: mknod d2/d66/dbb/dcd/cee 0 2023-12-17T11:57:55.449 INFO:tasks.workunit.client.1.smithi119.stdout:4/791: dwrite dd/d11/d2d/d9c/d55/d81/db8/d78/f89 [0,4194304] 0 2023-12-17T11:57:55.449 INFO:tasks.workunit.client.1.smithi119.stdout:4/792: readlink dd/d15/l7f 0 2023-12-17T11:57:55.451 INFO:tasks.workunit.client.0.smithi002.stdout:5/799: write dc/d94/ded/d5a/d96/f36 [3764308,10732] 0 2023-12-17T11:57:55.455 INFO:tasks.workunit.client.0.smithi002.stdout:0/756: creat d0/d6/d26/d14/d90/ff6 x:0 0 0 2023-12-17T11:57:55.456 INFO:tasks.workunit.client.1.smithi119.stdout:5/873: dread d1/d70/da3/fbf [0,4194304] 0 2023-12-17T11:57:55.457 INFO:tasks.workunit.client.1.smithi119.stdout:5/874: fsync d1/da7/faa 0 2023-12-17T11:57:55.457 INFO:tasks.workunit.client.1.smithi119.stdout:5/875: fdatasync d1/f29 0 2023-12-17T11:57:55.459 INFO:tasks.workunit.client.1.smithi119.stdout:9/841: dread d12/d1d/d28/d4d/f6c [0,4194304] 0 2023-12-17T11:57:55.459 INFO:tasks.workunit.client.1.smithi119.stdout:9/842: dread - d12/d1d/d28/d86/ff1 zero size 2023-12-17T11:57:55.459 INFO:tasks.workunit.client.1.smithi119.stdout:9/843: dread - d12/d1d/d28/d46/d50/d92/dae/fb5 zero size 2023-12-17T11:57:55.460 INFO:tasks.workunit.client.1.smithi119.stdout:9/844: chown d12/d1d/d28/d4d/d73/d78/c100 13 1 2023-12-17T11:57:55.460 INFO:tasks.workunit.client.1.smithi119.stdout:9/845: write d12/d65/f7d [5086169,55792] 0 2023-12-17T11:57:55.461 INFO:tasks.workunit.client.1.smithi119.stdout:8/685: link d7/d12/d69/d98/l9b d7/d12/d23/d9c/lda 0 2023-12-17T11:57:55.461 INFO:tasks.workunit.client.0.smithi002.stdout:7/754: dwrite d6/d17/dc/d13/d37/fd3 [0,4194304] 0 2023-12-17T11:57:55.466 INFO:tasks.workunit.client.1.smithi119.stdout:1/751: dwrite d3/db/d17/d24/f1a [0,4194304] 0 2023-12-17T11:57:55.467 INFO:tasks.workunit.client.1.smithi119.stdout:7/827: dread d2/d4/d11/d2c/d68/d99/d6c/fbd [0,4194304] 0 2023-12-17T11:57:55.471 INFO:tasks.workunit.client.1.smithi119.stdout:0/781: creat d2/d66/d1f/d24/fef x:0 0 0 2023-12-17T11:57:55.471 INFO:tasks.workunit.client.1.smithi119.stdout:0/782: fsync d2/d66/d1f/fdf 0 2023-12-17T11:57:55.473 INFO:tasks.workunit.client.1.smithi119.stdout:4/793: link dd/d11/d2d/d9c/d55/d81/c85 dd/d15/d16/d5a/cfc 0 2023-12-17T11:57:55.475 INFO:tasks.workunit.client.0.smithi002.stdout:8/866: dwrite d3/d7/d18/d74/d125/d65/da2/fb5 [0,4194304] 0 2023-12-17T11:57:55.475 INFO:tasks.workunit.client.0.smithi002.stdout:8/867: creat d3/d7/d18/d3f/f127 x:0 0 0 2023-12-17T11:57:55.475 INFO:tasks.workunit.client.0.smithi002.stdout:8/868: creat d3/d8/da/d44/f128 x:0 0 0 2023-12-17T11:57:55.481 INFO:tasks.workunit.client.0.smithi002.stdout:5/800: symlink dc/l119 0 2023-12-17T11:57:55.481 INFO:tasks.workunit.client.0.smithi002.stdout:9/898: sync 2023-12-17T11:57:55.485 INFO:tasks.workunit.client.0.smithi002.stdout:2/784: getdents d3/d4/d8b/da6 0 2023-12-17T11:57:55.485 INFO:tasks.workunit.client.0.smithi002.stdout:2/785: creat d3/f115 x:0 0 0 2023-12-17T11:57:55.488 INFO:tasks.workunit.client.1.smithi119.stdout:5/876: creat d1/da7/d10b/f126 x:0 0 0 2023-12-17T11:57:55.490 INFO:tasks.workunit.client.0.smithi002.stdout:1/807: link d3/d6/d9/d37/d39/d43/d4a/fc9 d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3/f107 0 2023-12-17T11:57:55.495 INFO:tasks.workunit.client.1.smithi119.stdout:5/877: dread d1/d70/d6b/f87 [0,4194304] 0 2023-12-17T11:57:55.501 INFO:tasks.workunit.client.1.smithi119.stdout:9/846: unlink d12/d1d/d79/cde 0 2023-12-17T11:57:55.505 INFO:tasks.workunit.client.0.smithi002.stdout:7/755: dread d6/d17/dc/d6c/f6f [0,4194304] 0 2023-12-17T11:57:55.505 INFO:tasks.workunit.client.0.smithi002.stdout:7/756: truncate d6/d17/dc/d13/d3e/fd4 574890 0 2023-12-17T11:57:55.505 INFO:tasks.workunit.client.0.smithi002.stdout:7/757: write d6/d17/dc/d13/d21/d2e/fb5 [581324,27046] 0 2023-12-17T11:57:55.506 INFO:tasks.workunit.client.1.smithi119.stdout:1/752: symlink d3/db/d17/d24/d20/dba/dbc/d7e/l115 0 2023-12-17T11:57:55.507 INFO:tasks.workunit.client.1.smithi119.stdout:1/753: chown d3/db/d17/d24/d20/d40/d76/d96/d99/la3 125 1 2023-12-17T11:57:55.509 INFO:tasks.workunit.client.1.smithi119.stdout:7/828: creat d2/d40/dc3/dca/dd9/ffa x:0 0 0 2023-12-17T11:57:55.510 INFO:tasks.workunit.client.1.smithi119.stdout:9/847: dread d12/d1d/d49/f5b [0,4194304] 0 2023-12-17T11:57:55.510 INFO:tasks.workunit.client.0.smithi002.stdout:4/725: dwrite d0/d3e/d56/f77 [4194304,4194304] 0 2023-12-17T11:57:55.513 INFO:tasks.workunit.client.1.smithi119.stdout:7/829: read d2/f9f [399272,297] 0 2023-12-17T11:57:55.513 INFO:tasks.workunit.client.1.smithi119.stdout:7/830: readlink d2/d4/d11/d2c/d55/l61 0 2023-12-17T11:57:55.513 INFO:tasks.workunit.client.1.smithi119.stdout:0/783: unlink d2/d66/d2e/d44/d7b/d5/d3f/ld5 0 2023-12-17T11:57:55.514 INFO:tasks.workunit.client.0.smithi002.stdout:5/801: creat dc/d94/ded/d2d/f11a x:0 0 0 2023-12-17T11:57:55.515 INFO:tasks.workunit.client.0.smithi002.stdout:5/802: write dc/d94/ded/d5a/d96/f35 [4001317,109499] 0 2023-12-17T11:57:55.515 INFO:tasks.workunit.client.0.smithi002.stdout:5/803: creat dc/d1a/d53/da9/f11b x:0 0 0 2023-12-17T11:57:55.515 INFO:tasks.workunit.client.0.smithi002.stdout:6/793: sync 2023-12-17T11:57:55.515 INFO:tasks.workunit.client.1.smithi119.stdout:5/878: getdents d1/d36/d3a 0 2023-12-17T11:57:55.515 INFO:tasks.workunit.client.1.smithi119.stdout:5/879: fsync d1/d70/d6b/df1/ff3 0 2023-12-17T11:57:55.517 INFO:tasks.workunit.client.0.smithi002.stdout:9/899: creat dc/d1d/d7c/d90/f145 x:0 0 0 2023-12-17T11:57:55.517 INFO:tasks.workunit.client.0.smithi002.stdout:9/900: fsync dc/d42/da0/d72/d93/d52/f8f 0 2023-12-17T11:57:55.517 INFO:tasks.workunit.client.1.smithi119.stdout:1/754: read d3/db/d17/d24/d20/dba/fda [1528099,72147] 0 2023-12-17T11:57:55.518 INFO:tasks.workunit.client.1.smithi119.stdout:4/794: dwrite dd/d15/d16/d3d/f4c [0,4194304] 0 2023-12-17T11:57:55.520 INFO:tasks.workunit.client.1.smithi119.stdout:9/848: mknod d12/d1d/d28/d46/dea/c112 0 2023-12-17T11:57:55.520 INFO:tasks.workunit.client.0.smithi002.stdout:8/869: write d3/d7/d18/d74/d7b/d11c/f80 [4023309,72387] 0 2023-12-17T11:57:55.521 INFO:tasks.workunit.client.0.smithi002.stdout:2/786: creat d3/d4/d7/d14/d1b/d5b/de3/f116 x:0 0 0 2023-12-17T11:57:55.521 INFO:tasks.workunit.client.0.smithi002.stdout:2/787: chown d3/d4/d8b/da6 7433843 1 2023-12-17T11:57:55.522 INFO:tasks.workunit.client.0.smithi002.stdout:2/788: fsync d3/d4/d7/d14/d9b/fd1 0 2023-12-17T11:57:55.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/757: dwrite d0/d6/d26/d14/fe6 [0,4194304] 0 2023-12-17T11:57:55.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/758: stat d0/d6/d26/f35 0 2023-12-17T11:57:55.522 INFO:tasks.workunit.client.0.smithi002.stdout:0/759: truncate d0/d6/d26/d14/d19/d2f/fad 688991 0 2023-12-17T11:57:55.522 INFO:tasks.workunit.client.1.smithi119.stdout:6/716: rename d2/d2b/d7f to d2/d7e/dbc/ddb 0 2023-12-17T11:57:55.523 INFO:tasks.workunit.client.1.smithi119.stdout:6/717: chown d2/d61 3220 1 2023-12-17T11:57:55.527 INFO:tasks.workunit.client.0.smithi002.stdout:3/816: write d9/d1b/d4f/d88/fb3 [358853,46225] 0 2023-12-17T11:57:55.527 INFO:tasks.workunit.client.0.smithi002.stdout:3/817: fsync d9/d1b/d35/d41/d59/da3/fb8 0 2023-12-17T11:57:55.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/880: rmdir d1/d70/d6b/d77/dae/dba/de3/d86/dda/d11e 0 2023-12-17T11:57:55.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/808: unlink d3/d6/d9/l102 0 2023-12-17T11:57:55.533 INFO:tasks.workunit.client.0.smithi002.stdout:1/809: readlink d3/d6/d16/l34 0 2023-12-17T11:57:55.536 INFO:tasks.workunit.client.0.smithi002.stdout:7/758: mkdir d6/d17/dc/d13/d37/d4f/de4 0 2023-12-17T11:57:55.537 INFO:tasks.workunit.client.1.smithi119.stdout:4/795: link dd/d11/d2d/lc6 dd/d11/d2d/d9c/d55/d81/d88/d91/lfd 0 2023-12-17T11:57:55.538 INFO:tasks.workunit.client.0.smithi002.stdout:4/726: symlink d0/d3e/da5/daf/lec 0 2023-12-17T11:57:55.541 INFO:tasks.workunit.client.0.smithi002.stdout:3/818: write d9/d15/f32 [634831,93625] 0 2023-12-17T11:57:55.541 INFO:tasks.workunit.client.1.smithi119.stdout:9/849: creat d12/d1d/d28/d4d/d73/dda/f113 x:0 0 0 2023-12-17T11:57:55.541 INFO:tasks.workunit.client.1.smithi119.stdout:9/850: stat d12/d1d/d28/d46/dbb/le5 0 2023-12-17T11:57:55.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/810: dread d3/d2f/d4d/f5e [0,4194304] 0 2023-12-17T11:57:55.548 INFO:tasks.workunit.client.0.smithi002.stdout:5/804: mkdir dc/d94/ded/d75/d11c 0 2023-12-17T11:57:55.550 INFO:tasks.workunit.client.0.smithi002.stdout:6/794: getdents d0/d1/d21/d56/d8c/d93/da5/dbc 0 2023-12-17T11:57:55.554 INFO:tasks.workunit.client.0.smithi002.stdout:9/901: rmdir dc/d1d/d25/d85/dc2/d91/db2/dbf 39 2023-12-17T11:57:55.561 INFO:tasks.workunit.client.1.smithi119.stdout:9/851: mkdir d12/d1d/d28/d46/d50/d92/daf/deb/dee/d114 0 2023-12-17T11:57:55.562 INFO:tasks.workunit.client.0.smithi002.stdout:8/870: mknod d3/d7/d111/c129 0 2023-12-17T11:57:55.562 INFO:tasks.workunit.client.0.smithi002.stdout:8/871: chown d3/d7/d18/dde/d10b 8 1 2023-12-17T11:57:55.579 INFO:tasks.workunit.client.1.smithi119.stdout:0/784: rmdir d2/d66/d2e/d44/d7b/d5 39 2023-12-17T11:57:55.580 INFO:tasks.workunit.client.1.smithi119.stdout:7/831: dwrite d2/d4/d11/d3c/d75/fb1 [0,4194304] 0 2023-12-17T11:57:55.581 INFO:tasks.workunit.client.0.smithi002.stdout:7/759: link d6/d81/lbc d6/d17/dc/d67/d8b/dbd/le5 0 2023-12-17T11:57:55.587 INFO:tasks.workunit.client.0.smithi002.stdout:2/789: dwrite d3/d4/d7/d14/d9b/f10d [0,4194304] 0 2023-12-17T11:57:55.587 INFO:tasks.workunit.client.0.smithi002.stdout:2/790: dread - d3/d4/d7/d14/d34/fff zero size 2023-12-17T11:57:55.588 INFO:tasks.workunit.client.0.smithi002.stdout:4/727: read d0/d3e/d56/d65/f67 [669771,37341] 0 2023-12-17T11:57:55.594 INFO:tasks.workunit.client.0.smithi002.stdout:0/760: dwrite d0/d6/d26/d14/d19/d37/d91/fbb [0,4194304] 0 2023-12-17T11:57:55.598 INFO:tasks.workunit.client.1.smithi119.stdout:4/796: dread dd/d15/d16/d3d/f7c [0,4194304] 0 2023-12-17T11:57:55.598 INFO:tasks.workunit.client.1.smithi119.stdout:4/797: fdatasync dd/d11/f5e 0 2023-12-17T11:57:55.598 INFO:tasks.workunit.client.1.smithi119.stdout:4/798: chown dd/f94 28246035 1 2023-12-17T11:57:55.599 INFO:tasks.workunit.client.0.smithi002.stdout:3/819: dwrite d9/d15/f66 [0,4194304] 0 2023-12-17T11:57:55.601 INFO:tasks.workunit.client.1.smithi119.stdout:1/755: write d3/db/d17/d24/d20/dba/dbc/f82 [921652,50960] 0 2023-12-17T11:57:55.602 INFO:tasks.workunit.client.1.smithi119.stdout:5/881: dwrite d1/d36/d3a/f4b [4194304,4194304] 0 2023-12-17T11:57:55.604 INFO:tasks.workunit.client.0.smithi002.stdout:7/760: creat d6/d17/dc/d13/fe6 x:0 0 0 2023-12-17T11:57:55.606 INFO:tasks.workunit.client.1.smithi119.stdout:4/799: dread dd/d11/d2d/d9c/d55/f80 [0,4194304] 0 2023-12-17T11:57:55.609 INFO:tasks.workunit.client.1.smithi119.stdout:4/800: write dd/d15/d16/d3d/f84 [675090,54647] 0 2023-12-17T11:57:55.609 INFO:tasks.workunit.client.1.smithi119.stdout:4/801: fdatasync dd/d4b/fd7 0 2023-12-17T11:57:55.613 INFO:tasks.workunit.client.0.smithi002.stdout:5/805: dwrite dc/d94/ded/f6e [0,4194304] 0 2023-12-17T11:57:55.614 INFO:tasks.workunit.client.0.smithi002.stdout:3/820: dread d9/d24/f25 [0,4194304] 0 2023-12-17T11:57:55.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/872: dwrite d3/d7/d6e/fd1 [0,4194304] 0 2023-12-17T11:57:55.617 INFO:tasks.workunit.client.0.smithi002.stdout:8/873: readlink d3/d7/d18/d74/d7b/d11c/lab 0 2023-12-17T11:57:55.619 INFO:tasks.workunit.client.0.smithi002.stdout:2/791: dread d3/d4/d7/fe0 [0,4194304] 0 2023-12-17T11:57:55.620 INFO:tasks.workunit.client.1.smithi119.stdout:9/852: truncate d12/d1d/d28/d4d/d73/f96 1988093 0 2023-12-17T11:57:55.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/821: dread d9/d24/f6d [4194304,4194304] 0 2023-12-17T11:57:55.623 INFO:tasks.workunit.client.0.smithi002.stdout:3/822: read d9/d1b/d35/d41/d59/d7c/f8b [386389,39711] 0 2023-12-17T11:57:55.627 INFO:tasks.workunit.client.0.smithi002.stdout:0/761: mkdir d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7 0 2023-12-17T11:57:55.627 INFO:tasks.workunit.client.0.smithi002.stdout:0/762: truncate d0/d6/d26/d14/d19/d37/d86/f98 277117 0 2023-12-17T11:57:55.630 INFO:tasks.workunit.client.0.smithi002.stdout:9/902: rmdir dc/d42/d4f/d9e 39 2023-12-17T11:57:55.630 INFO:tasks.workunit.client.0.smithi002.stdout:9/903: creat dc/d1d/d25/d85/dc2/ddd/dfa/f146 x:0 0 0 2023-12-17T11:57:55.634 INFO:tasks.workunit.client.1.smithi119.stdout:0/785: getdents d2/d66/d2e/d44/d7b/d5/dc 0 2023-12-17T11:57:55.636 INFO:tasks.workunit.client.1.smithi119.stdout:7/832: creat d2/d4/d11/d3c/ffb x:0 0 0 2023-12-17T11:57:55.636 INFO:tasks.workunit.client.1.smithi119.stdout:7/833: stat d2/d5b 0 2023-12-17T11:57:55.640 INFO:tasks.workunit.client.1.smithi119.stdout:8/686: rename d7/d18/d15/d81/da2 to d7/da/d1a/d8a/ddb 0 2023-12-17T11:57:55.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/904: write dc/d32/faa [1312040,43962] 0 2023-12-17T11:57:55.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/905: fsync dc/d42/f12e 0 2023-12-17T11:57:55.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/906: dread - dc/d1d/fff zero size 2023-12-17T11:57:55.646 INFO:tasks.workunit.client.0.smithi002.stdout:9/907: dread - dc/d1d/d7c/d90/de4/f12d zero size 2023-12-17T11:57:55.646 INFO:tasks.workunit.client.0.smithi002.stdout:7/761: rmdir d6/d17/dc/d8e 39 2023-12-17T11:57:55.646 INFO:tasks.workunit.client.0.smithi002.stdout:7/762: chown d6/d17/dc/d13/c83 495 1 2023-12-17T11:57:55.650 INFO:tasks.workunit.client.0.smithi002.stdout:5/806: mknod dc/d8e/c11d 0 2023-12-17T11:57:55.655 INFO:tasks.workunit.client.1.smithi119.stdout:6/718: rename d2/d2b/d43/f62 to d2/da3/fdc 0 2023-12-17T11:57:55.655 INFO:tasks.workunit.client.1.smithi119.stdout:1/756: rename d3/db to d3/db/d17/d24/d20/d40/d76/d96/d99/d116 22 2023-12-17T11:57:55.656 INFO:tasks.workunit.client.1.smithi119.stdout:7/834: dread d2/d4/d11/d3c/d75/dda/fe8 [0,4194304] 0 2023-12-17T11:57:55.657 INFO:tasks.workunit.client.1.smithi119.stdout:5/882: getdents d1/d70/da3 0 2023-12-17T11:57:55.661 INFO:tasks.workunit.client.0.smithi002.stdout:7/763: dread d6/d17/dc/f76 [0,4194304] 0 2023-12-17T11:57:55.662 INFO:tasks.workunit.client.1.smithi119.stdout:4/802: dwrite dd/d11/d2d/d9c/d55/d81/db8/d78/f89 [0,4194304] 0 2023-12-17T11:57:55.663 INFO:tasks.workunit.client.1.smithi119.stdout:4/803: fdatasync dd/d15/d16/d3d/dab/db1/fb2 0 2023-12-17T11:57:55.663 INFO:tasks.workunit.client.1.smithi119.stdout:4/804: chown dd/d15/d16/l23 95418100 1 2023-12-17T11:57:55.666 INFO:tasks.workunit.client.1.smithi119.stdout:1/757: getdents d3/d44/dfd/d64/db2 0 2023-12-17T11:57:55.666 INFO:tasks.workunit.client.1.smithi119.stdout:1/758: chown d3/db/d26/lb0 1851119 1 2023-12-17T11:57:55.666 INFO:tasks.workunit.client.1.smithi119.stdout:1/759: write d3/db/d17/d24/d20/d40/f80 [515914,80192] 0 2023-12-17T11:57:55.669 INFO:tasks.workunit.client.0.smithi002.stdout:8/874: mkdir d3/d7/d1a/d12a 0 2023-12-17T11:57:55.670 INFO:tasks.workunit.client.1.smithi119.stdout:7/835: mknod d2/d4/d11/d3c/df1/cfc 0 2023-12-17T11:57:55.672 INFO:tasks.workunit.client.1.smithi119.stdout:3/849: sync 2023-12-17T11:57:55.672 INFO:tasks.workunit.client.1.smithi119.stdout:2/856: sync 2023-12-17T11:57:55.672 INFO:tasks.workunit.client.1.smithi119.stdout:3/850: readlink d9/da/df/d41/d33/l38 0 2023-12-17T11:57:55.677 INFO:tasks.workunit.client.1.smithi119.stdout:3/851: chown d9/da 100927632 1 2023-12-17T11:57:55.677 INFO:tasks.workunit.client.1.smithi119.stdout:3/852: write d9/d11/d1e/f3e [1898502,28153] 0 2023-12-17T11:57:55.677 INFO:tasks.workunit.client.1.smithi119.stdout:3/853: write d9/da/df/f32 [2162348,82912] 0 2023-12-17T11:57:55.677 INFO:tasks.workunit.client.1.smithi119.stdout:3/854: truncate d9/d1c/f49 4829979 0 2023-12-17T11:57:55.677 INFO:tasks.workunit.client.1.smithi119.stdout:6/719: dread d2/df/d17/fd8 [0,4194304] 0 2023-12-17T11:57:55.677 INFO:tasks.workunit.client.1.smithi119.stdout:5/883: mkdir d1/d127 0 2023-12-17T11:57:55.678 INFO:tasks.workunit.client.1.smithi119.stdout:6/720: read d2/da3/fdc [252641,44677] 0 2023-12-17T11:57:55.678 INFO:tasks.workunit.client.1.smithi119.stdout:6/721: creat d2/fdd x:0 0 0 2023-12-17T11:57:55.679 INFO:tasks.workunit.client.0.smithi002.stdout:7/764: dread d6/d17/dc/d13/f57 [4194304,4194304] 0 2023-12-17T11:57:55.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/811: rmdir d3/d6/d9/d37/d39/d43/d8f/dea 0 2023-12-17T11:57:55.681 INFO:tasks.workunit.client.0.smithi002.stdout:2/792: unlink d3/d4/d7/d14/d1b/l75 0 2023-12-17T11:57:55.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/812: fdatasync d3/d6/d9/d37/d39/f8c 0 2023-12-17T11:57:55.683 INFO:tasks.workunit.client.0.smithi002.stdout:3/823: getdents d9/d24/d6f/d84 0 2023-12-17T11:57:55.683 INFO:tasks.workunit.client.0.smithi002.stdout:3/824: write d9/d1b/d35/d41/d59/d72/ffd [933824,33904] 0 2023-12-17T11:57:55.686 INFO:tasks.workunit.client.1.smithi119.stdout:9/853: write d12/d65/f6a [550865,128621] 0 2023-12-17T11:57:55.686 INFO:tasks.workunit.client.1.smithi119.stdout:1/760: dread d3/d44/dfd/f51 [0,4194304] 0 2023-12-17T11:57:55.686 INFO:tasks.workunit.client.1.smithi119.stdout:8/687: dwrite d7/d18/d15/d81/f62 [0,4194304] 0 2023-12-17T11:57:55.686 INFO:tasks.workunit.client.1.smithi119.stdout:1/761: creat d3/db/d17/d24/f117 x:0 0 0 2023-12-17T11:57:55.692 INFO:tasks.workunit.client.1.smithi119.stdout:7/836: truncate d2/f35 209191 0 2023-12-17T11:57:55.692 INFO:tasks.workunit.client.1.smithi119.stdout:3/855: read d9/d11/d1e/d9f/dde/ff2 [332209,241] 0 2023-12-17T11:57:55.693 INFO:tasks.workunit.client.1.smithi119.stdout:2/857: dread d6/d9/d13/ffc [0,4194304] 0 2023-12-17T11:57:55.702 INFO:tasks.workunit.client.1.smithi119.stdout:5/884: symlink d1/d70/da3/d120/l128 0 2023-12-17T11:57:55.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/908: rename f1 to dc/d32/f147 0 2023-12-17T11:57:55.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/909: fsync dc/d1d/d7c/d90/fbb 0 2023-12-17T11:57:55.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/910: truncate dc/d1d/d25/d85/f113 282732 0 2023-12-17T11:57:55.705 INFO:tasks.workunit.client.0.smithi002.stdout:9/911: fdatasync dc/d1d/d25/d85/dc2/d91/fd3 0 2023-12-17T11:57:55.706 INFO:tasks.workunit.client.0.smithi002.stdout:7/765: dread d6/d17/dc/d13/d21/d6e/f7e [0,4194304] 0 2023-12-17T11:57:55.706 INFO:tasks.workunit.client.0.smithi002.stdout:7/766: creat d6/d99/fe7 x:0 0 0 2023-12-17T11:57:55.706 INFO:tasks.workunit.client.0.smithi002.stdout:7/767: chown d6/d17/dc/d13/d21/d2e/lc9 14791328 1 2023-12-17T11:57:55.709 INFO:tasks.workunit.client.1.smithi119.stdout:8/688: dread d7/da/d11/d26/d49/f8d [0,4194304] 0 2023-12-17T11:57:55.709 INFO:tasks.workunit.client.1.smithi119.stdout:3/856: write d9/da/df/d41/fdd [668459,93091] 0 2023-12-17T11:57:55.709 INFO:tasks.workunit.client.1.smithi119.stdout:3/857: chown d9/d11/d1e/d55/d65/fc5 47119074 1 2023-12-17T11:57:55.714 INFO:tasks.workunit.client.0.smithi002.stdout:8/875: mkdir d3/d7/d18/d74/d7b/d12b 0 2023-12-17T11:57:55.719 INFO:tasks.workunit.client.1.smithi119.stdout:6/722: mknod d2/d41/cde 0 2023-12-17T11:57:55.719 INFO:tasks.workunit.client.1.smithi119.stdout:6/723: readlink d2/d2b/d43/l46 0 2023-12-17T11:57:55.720 INFO:tasks.workunit.client.0.smithi002.stdout:3/825: creat d9/d1b/d35/d41/d59/d7c/db7/f108 x:0 0 0 2023-12-17T11:57:55.720 INFO:tasks.workunit.client.0.smithi002.stdout:3/826: read - d9/d1b/d35/df3/ff9 zero size 2023-12-17T11:57:55.720 INFO:tasks.workunit.client.0.smithi002.stdout:3/827: write d9/d15/d6a/ffe [501037,16956] 0 2023-12-17T11:57:55.720 INFO:tasks.workunit.client.1.smithi119.stdout:1/762: rmdir d3/db/d17/d24/d20/d40/d76/d96/d99/d9a 39 2023-12-17T11:57:55.721 INFO:tasks.workunit.client.1.smithi119.stdout:1/763: readlink d3/d44/dfd/l95 0 2023-12-17T11:57:55.723 INFO:tasks.workunit.client.1.smithi119.stdout:0/786: rename d2/d16/d35/d74 to d2/d66/d2e/d44/df0 0 2023-12-17T11:57:55.727 INFO:tasks.workunit.client.0.smithi002.stdout:2/793: rename d3/d4/d17/d19/d4d/d72/d83/fb3 to d3/d4/d7/d14/d2e/d37/d3f/d10e/f117 0 2023-12-17T11:57:55.732 INFO:tasks.workunit.client.1.smithi119.stdout:7/837: mknod d2/d4/d11/d2c/d68/d77/cfd 0 2023-12-17T11:57:55.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/813: dread d3/d6/d9/f90 [0,4194304] 0 2023-12-17T11:57:55.736 INFO:tasks.workunit.client.0.smithi002.stdout:1/814: stat d3/d2f/d74/dbe/dd8/fb0 0 2023-12-17T11:57:55.738 INFO:tasks.workunit.client.0.smithi002.stdout:7/768: link d6/d17/dc/d67/d8b/d24/fca d6/d17/dc/fe8 0 2023-12-17T11:57:55.738 INFO:tasks.workunit.client.0.smithi002.stdout:9/912: unlink dc/d38/l6d 0 2023-12-17T11:57:55.742 INFO:tasks.workunit.client.1.smithi119.stdout:8/689: creat d7/da/d1a/fdc x:0 0 0 2023-12-17T11:57:55.743 INFO:tasks.workunit.client.0.smithi002.stdout:4/728: sync 2023-12-17T11:57:55.743 INFO:tasks.workunit.client.0.smithi002.stdout:4/729: chown d0/d10/d14/d4e/lb4 212 1 2023-12-17T11:57:55.743 INFO:tasks.workunit.client.0.smithi002.stdout:6/795: sync 2023-12-17T11:57:55.745 INFO:tasks.workunit.client.1.smithi119.stdout:6/724: creat d2/d2b/fdf x:0 0 0 2023-12-17T11:57:55.745 INFO:tasks.workunit.client.1.smithi119.stdout:6/725: creat d2/d2b/d43/d76/dbd/fe0 x:0 0 0 2023-12-17T11:57:55.747 INFO:tasks.workunit.client.1.smithi119.stdout:1/764: mknod d3/db/d17/d24/d20/dba/dbc/d7e/da1/c118 0 2023-12-17T11:57:55.752 INFO:tasks.workunit.client.0.smithi002.stdout:3/828: truncate d9/d1b/d4f/fb2 775574 0 2023-12-17T11:57:55.752 INFO:tasks.workunit.client.0.smithi002.stdout:7/769: mknod d6/d17/dc/d13/d37/ce9 0 2023-12-17T11:57:55.753 INFO:tasks.workunit.client.1.smithi119.stdout:3/858: read d9/da/df/d41/d33/db4/f93 [2247741,22964] 0 2023-12-17T11:57:55.753 INFO:tasks.workunit.client.1.smithi119.stdout:4/805: rename dd/d11/f5e to dd/d11/d2d/d9c/d55/d81/d88/ffe 0 2023-12-17T11:57:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:1/815: dread d3/d6/d9/f90 [0,4194304] 0 2023-12-17T11:57:55.754 INFO:tasks.workunit.client.1.smithi119.stdout:2/858: dwrite d6/d9/d52/d53/d55/d58/fae [0,4194304] 0 2023-12-17T11:57:55.755 INFO:tasks.workunit.client.0.smithi002.stdout:2/794: unlink d3/d4/d7/d14/d2e/f69 0 2023-12-17T11:57:55.757 INFO:tasks.workunit.client.0.smithi002.stdout:4/730: dread d0/d10/d21/d33/dbc/fcc [0,4194304] 0 2023-12-17T11:57:55.757 INFO:tasks.workunit.client.0.smithi002.stdout:4/731: chown d0/d3e/d56/d65/d78/d85/da3/ldb 206684 1 2023-12-17T11:57:55.757 INFO:tasks.workunit.client.0.smithi002.stdout:4/732: chown d0/d10/f39 391 1 2023-12-17T11:57:55.757 INFO:tasks.workunit.client.0.smithi002.stdout:4/733: chown d0/d10/f39 91 1 2023-12-17T11:57:55.757 INFO:tasks.workunit.client.0.smithi002.stdout:9/913: symlink dc/d1d/d25/d85/dc2/d91/l148 0 2023-12-17T11:57:55.757 INFO:tasks.workunit.client.1.smithi119.stdout:7/838: dread d2/d4/d11/d2c/feb [0,4194304] 0 2023-12-17T11:57:55.764 INFO:tasks.workunit.client.0.smithi002.stdout:7/770: mknod d6/d17/dc/d13/d37/cea 0 2023-12-17T11:57:55.770 INFO:tasks.workunit.client.1.smithi119.stdout:6/726: mknod d2/d7e/d93/ce1 0 2023-12-17T11:57:55.774 INFO:tasks.workunit.client.1.smithi119.stdout:3/859: creat d9/d59/dda/f141 x:0 0 0 2023-12-17T11:57:55.774 INFO:tasks.workunit.client.1.smithi119.stdout:3/860: readlink d9/da/lee 0 2023-12-17T11:57:55.776 INFO:tasks.workunit.client.0.smithi002.stdout:2/795: write d3/d4/d7/d14/d2e/d37/d3f/f91 [3440260,107784] 0 2023-12-17T11:57:55.779 INFO:tasks.workunit.client.0.smithi002.stdout:4/734: truncate d0/d3e/d41/fcb 2521895 0 2023-12-17T11:57:55.779 INFO:tasks.workunit.client.0.smithi002.stdout:9/914: link dc/cca dc/d42/d4f/dd5/c149 0 2023-12-17T11:57:55.779 INFO:tasks.workunit.client.0.smithi002.stdout:7/771: truncate d6/d17/dc/d13/d37/fd3 2788890 0 2023-12-17T11:57:55.779 INFO:tasks.workunit.client.0.smithi002.stdout:9/915: creat dc/d1d/d7c/d90/f14a x:0 0 0 2023-12-17T11:57:55.780 INFO:tasks.workunit.client.0.smithi002.stdout:0/763: sync 2023-12-17T11:57:55.780 INFO:tasks.workunit.client.1.smithi119.stdout:4/806: symlink dd/d11/d2d/d9c/d55/d81/db8/d78/dcc/lff 0 2023-12-17T11:57:55.780 INFO:tasks.workunit.client.1.smithi119.stdout:4/807: chown dd/d15/d16/d3d/f77 53431729 1 2023-12-17T11:57:55.780 INFO:tasks.workunit.client.1.smithi119.stdout:4/808: chown dd/d11/d2d/d9c/d55/d81/d88/ffe 1335197 1 2023-12-17T11:57:55.780 INFO:tasks.workunit.client.1.smithi119.stdout:4/809: chown dd/d15/d16/d20/lba 241137 1 2023-12-17T11:57:55.782 INFO:tasks.workunit.client.1.smithi119.stdout:2/859: mkdir d6/d2b/d4b/d5d/d11c/d12b 0 2023-12-17T11:57:55.782 INFO:tasks.workunit.client.1.smithi119.stdout:2/860: truncate d6/d2b/da3/f11d 581755 0 2023-12-17T11:57:55.782 INFO:tasks.workunit.client.1.smithi119.stdout:2/861: stat d6/d38/d96 0 2023-12-17T11:57:55.782 INFO:tasks.workunit.client.1.smithi119.stdout:2/862: chown d6/d9/d52/d53/d55/d58/d6b 0 1 2023-12-17T11:57:55.782 INFO:tasks.workunit.client.1.smithi119.stdout:2/863: truncate d6/d9/d52/d53/f112 813162 0 2023-12-17T11:57:55.786 INFO:tasks.workunit.client.1.smithi119.stdout:8/690: rename d7/d18/d15/d81/d8e/fb8 to d7/da/d11/d26/d49/fdd 0 2023-12-17T11:57:55.787 INFO:tasks.workunit.client.1.smithi119.stdout:8/691: readlink d7/da/d11/l2e 0 2023-12-17T11:57:55.787 INFO:tasks.workunit.client.1.smithi119.stdout:8/692: write d7/d18/d15/d81/d8e/fcd [702627,52879] 0 2023-12-17T11:57:55.791 INFO:tasks.workunit.client.0.smithi002.stdout:2/796: symlink d3/d50/df6/l118 0 2023-12-17T11:57:55.792 INFO:tasks.workunit.client.1.smithi119.stdout:7/839: symlink d2/d40/lfe 0 2023-12-17T11:57:55.794 INFO:tasks.workunit.client.0.smithi002.stdout:3/829: write d9/d24/d6f/fb6 [281737,91238] 0 2023-12-17T11:57:55.795 INFO:tasks.workunit.client.0.smithi002.stdout:8/876: dwrite d3/d8/f42 [0,4194304] 0 2023-12-17T11:57:55.795 INFO:tasks.workunit.client.0.smithi002.stdout:8/877: fdatasync d3/d7/d18/d74/d7b/d11c/f80 0 2023-12-17T11:57:55.797 INFO:tasks.workunit.client.0.smithi002.stdout:4/735: symlink d0/d6c/dda/led 0 2023-12-17T11:57:55.799 INFO:tasks.workunit.client.0.smithi002.stdout:7/772: read d6/d17/dc/d13/d21/d2e/f7f [1477158,43972] 0 2023-12-17T11:57:55.799 INFO:tasks.workunit.client.1.smithi119.stdout:6/727: write d2/d41/f68 [3759584,24031] 0 2023-12-17T11:57:55.802 INFO:tasks.workunit.client.1.smithi119.stdout:1/765: rename d3/db/d26/d19/dc8 to d3/db/d17/d24/d20/d40/d76/d84/d119 0 2023-12-17T11:57:55.803 INFO:tasks.workunit.client.1.smithi119.stdout:7/840: getdents d2/d4/d11/d2c/d68/d99/d6c/def 0 2023-12-17T11:57:55.815 INFO:tasks.workunit.client.0.smithi002.stdout:0/764: mknod d0/d6/d26/d14/d19/d37/dcf/cf8 0 2023-12-17T11:57:55.815 INFO:tasks.workunit.client.0.smithi002.stdout:8/878: creat d3/d8/f12c x:0 0 0 2023-12-17T11:57:55.815 INFO:tasks.workunit.client.0.smithi002.stdout:7/773: unlink d6/d17/dc/d13/d21/d6e/fcd 0 2023-12-17T11:57:55.816 INFO:tasks.workunit.client.1.smithi119.stdout:2/864: rename d6/d9/d13/d34/d70/lfb to d6/d9/d52/d53/d55/d58/d6b/l12c 0 2023-12-17T11:57:55.818 INFO:tasks.workunit.client.0.smithi002.stdout:9/916: getdents dc/d1d/d7c/d90/dc0 0 2023-12-17T11:57:55.819 INFO:tasks.workunit.client.0.smithi002.stdout:4/736: getdents d0/d10/d14/d4e 0 2023-12-17T11:57:55.820 INFO:tasks.workunit.client.1.smithi119.stdout:2/865: getdents d6/d9/d52 0 2023-12-17T11:57:55.820 INFO:tasks.workunit.client.1.smithi119.stdout:2/866: chown d6/d38/d96/l97 2038067 1 2023-12-17T11:57:55.820 INFO:tasks.workunit.client.1.smithi119.stdout:2/867: read d6/d9/d13/d1d/f50 [438979,53125] 0 2023-12-17T11:57:55.821 INFO:tasks.workunit.client.1.smithi119.stdout:2/868: creat d6/d2b/da3/f12d x:0 0 0 2023-12-17T11:57:55.822 INFO:tasks.workunit.client.0.smithi002.stdout:9/917: rename dc/d42/da0/cb3 to dc/d1d/d25/d85/dc2/ddd/dfa/c14b 0 2023-12-17T11:57:55.823 INFO:tasks.workunit.client.0.smithi002.stdout:9/918: write dc/d1d/d25/d85/dc2/d91/fa2 [157387,47845] 0 2023-12-17T11:57:55.823 INFO:tasks.workunit.client.0.smithi002.stdout:9/919: write dc/fee [1738365,24982] 0 2023-12-17T11:57:55.824 INFO:tasks.workunit.client.1.smithi119.stdout:2/869: mkdir d6/d9/d52/d53/d55/daf/d12e 0 2023-12-17T11:57:55.828 INFO:tasks.workunit.client.0.smithi002.stdout:9/920: unlink dc/d1d/d25/d85/dc2/d91/f105 0 2023-12-17T11:57:55.830 INFO:tasks.workunit.client.0.smithi002.stdout:3/830: dread d9/d15/f22 [0,4194304] 0 2023-12-17T11:57:55.831 INFO:tasks.workunit.client.1.smithi119.stdout:8/693: dread d7/d18/d45/f76 [0,4194304] 0 2023-12-17T11:57:55.831 INFO:tasks.workunit.client.1.smithi119.stdout:8/694: fsync d7/d12/d23/db4/f9a 0 2023-12-17T11:57:55.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/921: symlink dc/l14c 0 2023-12-17T11:57:55.832 INFO:tasks.workunit.client.0.smithi002.stdout:9/922: stat dc/d42/da0/d72/d93/d52/d12b/f136 0 2023-12-17T11:57:55.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/923: write dc/d1d/d25/d85/dc2/ddd/dfa/fb8 [239048,73972] 0 2023-12-17T11:57:55.833 INFO:tasks.workunit.client.0.smithi002.stdout:9/924: dread - dc/d42/da0/d72/d93/dd0/dd4/fea zero size 2023-12-17T11:57:55.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/831: mkdir d9/d1b/d35/d41/d59/d7c/d109 0 2023-12-17T11:57:55.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/832: chown d9/d1b/d35/df3 58544946 1 2023-12-17T11:57:55.836 INFO:tasks.workunit.client.0.smithi002.stdout:3/833: fsync d9/d1b/d35/d41/d59/d7c/db7/f108 0 2023-12-17T11:57:55.837 INFO:tasks.workunit.client.0.smithi002.stdout:3/834: write d9/d15/d52/d85/dd9/f106 [734521,105772] 0 2023-12-17T11:57:55.840 INFO:tasks.workunit.client.0.smithi002.stdout:3/835: link d9/d40/f9a d9/d15/d71/f10a 0 2023-12-17T11:57:55.842 INFO:tasks.workunit.client.1.smithi119.stdout:0/787: write d2/d66/f53 [260664,117136] 0 2023-12-17T11:57:55.842 INFO:tasks.workunit.client.1.smithi119.stdout:0/788: fdatasync d2/d66/d1f/f22 0 2023-12-17T11:57:55.843 INFO:tasks.workunit.client.0.smithi002.stdout:6/796: dwrite d0/d1/d21/d56/f78 [0,4194304] 0 2023-12-17T11:57:55.847 INFO:tasks.workunit.client.0.smithi002.stdout:7/774: dread d6/d17/dc/d13/d21/d2e/f7f [0,4194304] 0 2023-12-17T11:57:55.847 INFO:tasks.workunit.client.0.smithi002.stdout:7/775: chown d6/d17/dc/d67/d8b/dbd/ccf 12 1 2023-12-17T11:57:55.848 INFO:tasks.workunit.client.0.smithi002.stdout:4/737: dread d0/d10/d14/d27/d57/f7b [0,4194304] 0 2023-12-17T11:57:55.849 INFO:tasks.workunit.client.1.smithi119.stdout:1/766: read d3/db/d17/d24/d20/f50 [3383695,16628] 0 2023-12-17T11:57:55.850 INFO:tasks.workunit.client.1.smithi119.stdout:3/861: dwrite d9/da/df/d41/d33/f62 [0,4194304] 0 2023-12-17T11:57:55.850 INFO:tasks.workunit.client.1.smithi119.stdout:3/862: chown d9/d11/d1e/f123 72071 1 2023-12-17T11:57:55.850 INFO:tasks.workunit.client.1.smithi119.stdout:3/863: chown d9/da/dcc/db3 2 1 2023-12-17T11:57:55.858 INFO:tasks.workunit.client.0.smithi002.stdout:7/776: mkdir d6/d17/dc/d6c/dcb/deb 0 2023-12-17T11:57:55.862 INFO:tasks.workunit.client.1.smithi119.stdout:1/767: symlink d3/db/d26/d8f/dd1/l11a 0 2023-12-17T11:57:55.868 INFO:tasks.workunit.client.1.smithi119.stdout:1/768: link d3/db/d26/f55 d3/db/d17/d24/d91/f11b 0 2023-12-17T11:57:55.874 INFO:tasks.workunit.client.0.smithi002.stdout:7/777: getdents d6/d17/dc/d13/dd8 0 2023-12-17T11:57:55.883 INFO:tasks.workunit.client.0.smithi002.stdout:7/778: dread d6/d17/dc/d67/d8b/d24/f7d [0,4194304] 0 2023-12-17T11:57:55.884 INFO:tasks.workunit.client.0.smithi002.stdout:7/779: truncate d6/fa6 184471 0 2023-12-17T11:57:55.884 INFO:tasks.workunit.client.1.smithi119.stdout:2/870: write d6/d9/d52/d53/d55/d58/dba/fd0 [560151,74664] 0 2023-12-17T11:57:55.884 INFO:tasks.workunit.client.1.smithi119.stdout:1/769: mknod d3/db/d17/d24/d20/d40/d76/d96/d99/d9d/c11c 0 2023-12-17T11:57:55.884 INFO:tasks.workunit.client.1.smithi119.stdout:1/770: write d3/db/d26/d5e/fb3 [1584706,52462] 0 2023-12-17T11:57:55.884 INFO:tasks.workunit.client.1.smithi119.stdout:1/771: write d3/db/d17/d24/d20/dba/f10f [923717,26813] 0 2023-12-17T11:57:55.884 INFO:tasks.workunit.client.1.smithi119.stdout:3/864: write d9/da/df/d67/f89 [2583201,113530] 0 2023-12-17T11:57:55.888 INFO:tasks.workunit.client.0.smithi002.stdout:3/836: dread d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:55.888 INFO:tasks.workunit.client.0.smithi002.stdout:7/780: mkdir d6/d17/dc/d13/d21/d2e/d4a/daf/dec 0 2023-12-17T11:57:55.893 INFO:tasks.workunit.client.1.smithi119.stdout:4/810: dwrite dd/f18 [4194304,4194304] 0 2023-12-17T11:57:55.893 INFO:tasks.workunit.client.0.smithi002.stdout:1/816: dwrite d3/d6/d9/d37/d39/d43/d4a/fc9 [0,4194304] 0 2023-12-17T11:57:55.901 INFO:tasks.workunit.client.1.smithi119.stdout:1/772: creat d3/db/d17/d24/d20/dba/dbc/d7e/da1/d101/f11d x:0 0 0 2023-12-17T11:57:55.901 INFO:tasks.workunit.client.1.smithi119.stdout:6/728: dwrite d2/d61/f67 [0,4194304] 0 2023-12-17T11:57:55.901 INFO:tasks.workunit.client.1.smithi119.stdout:6/729: creat d2/d2b/d43/d76/d8d/dc2/fe2 x:0 0 0 2023-12-17T11:57:55.901 INFO:tasks.workunit.client.1.smithi119.stdout:6/730: write d2/d2b/d43/d76/fb0 [191346,129902] 0 2023-12-17T11:57:55.901 INFO:tasks.workunit.client.1.smithi119.stdout:6/731: creat d2/df/d17/d79/fe3 x:0 0 0 2023-12-17T11:57:55.902 INFO:tasks.workunit.client.1.smithi119.stdout:6/732: dread - d2/d7e/f9d zero size 2023-12-17T11:57:55.910 INFO:tasks.workunit.client.1.smithi119.stdout:3/865: mknod d9/da/df/d41/d33/d3a/c142 0 2023-12-17T11:57:55.910 INFO:tasks.workunit.client.1.smithi119.stdout:3/866: chown d9/d11/d1e/d55/d65/fc5 2685 1 2023-12-17T11:57:55.928 INFO:tasks.workunit.client.1.smithi119.stdout:4/811: truncate dd/d11/d2d/d9c/d55/f80 203739 0 2023-12-17T11:57:55.929 INFO:tasks.workunit.client.1.smithi119.stdout:8/695: dwrite d7/d12/d23/d9c/fc3 [0,4194304] 0 2023-12-17T11:57:55.930 INFO:tasks.workunit.client.1.smithi119.stdout:7/841: dwrite d2/d4/f47 [4194304,4194304] 0 2023-12-17T11:57:55.930 INFO:tasks.workunit.client.1.smithi119.stdout:7/842: fsync d2/d40/dc3/dca/dd9/ffa 0 2023-12-17T11:57:55.932 INFO:tasks.workunit.client.0.smithi002.stdout:0/765: dwrite d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:55.932 INFO:tasks.workunit.client.0.smithi002.stdout:4/738: dwrite d0/f6f [0,4194304] 0 2023-12-17T11:57:55.932 INFO:tasks.workunit.client.0.smithi002.stdout:4/739: fdatasync d0/d5a/fd6 0 2023-12-17T11:57:55.936 INFO:tasks.workunit.client.1.smithi119.stdout:3/867: write d9/da/df/fce [3239061,121599] 0 2023-12-17T11:57:55.938 INFO:tasks.workunit.client.1.smithi119.stdout:2/871: dwrite d6/d2b/da3/fd5 [0,4194304] 0 2023-12-17T11:57:55.942 INFO:tasks.workunit.client.0.smithi002.stdout:8/879: dwrite d3/ffe [0,4194304] 0 2023-12-17T11:57:55.942 INFO:tasks.workunit.client.0.smithi002.stdout:8/880: creat d3/d7/d18/d74/d7b/d11c/db4/d117/f12d x:0 0 0 2023-12-17T11:57:55.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/837: getdents d9 0 2023-12-17T11:57:55.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/838: readlink d9/d1b/d4f/d88/lcc 0 2023-12-17T11:57:55.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/839: fdatasync d9/d24/d6f/fbd 0 2023-12-17T11:57:55.947 INFO:tasks.workunit.client.0.smithi002.stdout:3/840: chown d9/d15/leb 7105276 1 2023-12-17T11:57:55.947 INFO:tasks.workunit.client.0.smithi002.stdout:1/817: read d3/d6/d9/d37/d39/d43/d4a/f5f [616527,114309] 0 2023-12-17T11:57:55.948 INFO:tasks.workunit.client.0.smithi002.stdout:5/807: sync 2023-12-17T11:57:55.948 INFO:tasks.workunit.client.1.smithi119.stdout:1/773: mknod d3/db/d26/d8f/c11e 0 2023-12-17T11:57:55.957 INFO:tasks.workunit.client.0.smithi002.stdout:0/766: creat d0/d6/d26/d14/d19/d37/d62/db8/ddd/ff9 x:0 0 0 2023-12-17T11:57:55.957 INFO:tasks.workunit.client.0.smithi002.stdout:0/767: chown d0/d6/d26/d14/d19/d2b/f97 7132 1 2023-12-17T11:57:55.958 INFO:tasks.workunit.client.0.smithi002.stdout:7/781: dwrite d6/d17/dc/d13/d21/d2e/f5a [0,4194304] 0 2023-12-17T11:57:55.963 INFO:tasks.workunit.client.0.smithi002.stdout:4/740: mknod d0/d3e/d56/cee 0 2023-12-17T11:57:55.963 INFO:tasks.workunit.client.0.smithi002.stdout:4/741: truncate d0/d3e/d56/d99/f9f 1393818 0 2023-12-17T11:57:55.963 INFO:tasks.workunit.client.0.smithi002.stdout:4/742: readlink d0/d3e/d56/d65/d78/d85/da3/laa 0 2023-12-17T11:57:55.964 INFO:tasks.workunit.client.0.smithi002.stdout:5/808: dread dc/d94/ded/d2d/dcf/f92 [0,4194304] 0 2023-12-17T11:57:55.966 INFO:tasks.workunit.client.1.smithi119.stdout:6/733: rename d2/d2b/d43/d76/d8d/dc2/fcc to d2/d7e/dbc/fe4 0 2023-12-17T11:57:55.966 INFO:tasks.workunit.client.1.smithi119.stdout:6/734: chown d2/d2b/d43/d5e/f69 22527 1 2023-12-17T11:57:55.969 INFO:tasks.workunit.client.1.smithi119.stdout:4/812: mknod dd/d11/d2d/d9c/d55/d81/db8/d78/c100 0 2023-12-17T11:57:55.970 INFO:tasks.workunit.client.1.smithi119.stdout:4/813: creat dd/d11/d2d/d9c/d55/d81/db8/dbd/dec/f101 x:0 0 0 2023-12-17T11:57:55.973 INFO:tasks.workunit.client.1.smithi119.stdout:8/696: dwrite d7/d12/d23/d9c/dad/fb7 [0,4194304] 0 2023-12-17T11:57:55.974 INFO:tasks.workunit.client.0.smithi002.stdout:8/881: truncate d3/d7/d18/d74/d125/d90/fd5 3383263 0 2023-12-17T11:57:55.978 INFO:tasks.workunit.client.1.smithi119.stdout:6/735: dread d2/d2b/d43/d76/f7a [0,4194304] 0 2023-12-17T11:57:55.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/774: dwrite d3/db/d26/fa4 [0,4194304] 0 2023-12-17T11:57:55.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/775: chown d3/db/d17/d24/d20/dba/dbc/d7e/fbe 7761193 1 2023-12-17T11:57:55.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/776: dread - d3/d44/dfd/f46 zero size 2023-12-17T11:57:55.979 INFO:tasks.workunit.client.1.smithi119.stdout:1/777: write d3/db/d17/d24/d20/dba/dbc/f82 [850608,6459] 0 2023-12-17T11:57:55.980 INFO:tasks.workunit.client.0.smithi002.stdout:0/768: write d0/d6/d26/d14/d19/d37/f99 [1855284,102430] 0 2023-12-17T11:57:55.980 INFO:tasks.workunit.client.0.smithi002.stdout:0/769: dread - d0/d6/d26/d14/d90/d64/fe1 zero size 2023-12-17T11:57:55.980 INFO:tasks.workunit.client.1.smithi119.stdout:7/843: readlink d2/d4/d11/d2c/d55/d67/l97 0 2023-12-17T11:57:55.985 INFO:tasks.workunit.client.0.smithi002.stdout:3/841: symlink d9/d1b/d35/d41/d59/d7c/db7/l10b 0 2023-12-17T11:57:55.985 INFO:tasks.workunit.client.0.smithi002.stdout:3/842: write d9/d15/d52/d79/dab/fdb [1046347,47747] 0 2023-12-17T11:57:55.985 INFO:tasks.workunit.client.0.smithi002.stdout:3/843: stat d9/d1b/d35/d41/la0 0 2023-12-17T11:57:55.985 INFO:tasks.workunit.client.0.smithi002.stdout:4/743: dread d0/d3e/d56/f9e [0,4194304] 0 2023-12-17T11:57:55.988 INFO:tasks.workunit.client.1.smithi119.stdout:8/697: write d7/d12/d23/db4/f91 [2583254,54353] 0 2023-12-17T11:57:55.989 INFO:tasks.workunit.client.1.smithi119.stdout:8/698: readlink d7/d18/d45/d9f/d7b/l7c 0 2023-12-17T11:57:55.989 INFO:tasks.workunit.client.1.smithi119.stdout:8/699: chown d7/d12/d23 61 1 2023-12-17T11:57:55.989 INFO:tasks.workunit.client.0.smithi002.stdout:1/818: unlink d3/d5c/fd5 0 2023-12-17T11:57:55.989 INFO:tasks.workunit.client.0.smithi002.stdout:1/819: write d3/d6/d9/f3c [3799053,44773] 0 2023-12-17T11:57:55.992 INFO:tasks.workunit.client.1.smithi119.stdout:2/872: mknod d6/d9/d52/d53/d55/d58/c12f 0 2023-12-17T11:57:55.992 INFO:tasks.workunit.client.1.smithi119.stdout:2/873: chown d6/d9/f60 82 1 2023-12-17T11:57:55.997 INFO:tasks.workunit.client.0.smithi002.stdout:3/844: dread d9/d15/f32 [0,4194304] 0 2023-12-17T11:57:56.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/782: dwrite d6/d17/dc/d13/d21/d2e/d4a/f92 [0,4194304] 0 2023-12-17T11:57:56.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/783: chown d6/d17/dc/f89 419166264 1 2023-12-17T11:57:56.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/784: write d6/d17/dc/d67/d8b/dbd/f78 [2370565,18596] 0 2023-12-17T11:57:56.002 INFO:tasks.workunit.client.0.smithi002.stdout:8/882: creat d3/d7/d18/d74/d125/d65/f12e x:0 0 0 2023-12-17T11:57:56.003 INFO:tasks.workunit.client.0.smithi002.stdout:0/770: dread d0/d6/d26/d14/d19/d37/f99 [0,4194304] 0 2023-12-17T11:57:56.004 INFO:tasks.workunit.client.1.smithi119.stdout:8/700: write d7/d18/d45/f83 [1069902,73325] 0 2023-12-17T11:57:56.005 INFO:tasks.workunit.client.1.smithi119.stdout:4/814: getdents dd/d11 0 2023-12-17T11:57:56.008 INFO:tasks.workunit.client.0.smithi002.stdout:4/744: read d0/fd [18026,5168] 0 2023-12-17T11:57:56.009 INFO:tasks.workunit.client.0.smithi002.stdout:3/845: creat d9/d15/f10c x:0 0 0 2023-12-17T11:57:56.013 INFO:tasks.workunit.client.0.smithi002.stdout:2/797: sync 2023-12-17T11:57:56.016 INFO:tasks.workunit.client.1.smithi119.stdout:6/736: rename d2/d2b/d43/d5e/l87 to d2/df/d17/d79/le5 0 2023-12-17T11:57:56.016 INFO:tasks.workunit.client.1.smithi119.stdout:6/737: write d2/da3/fb4 [998611,17161] 0 2023-12-17T11:57:56.017 INFO:tasks.workunit.client.1.smithi119.stdout:6/738: truncate d2/df/d17/f5f 1099947 0 2023-12-17T11:57:56.018 INFO:tasks.workunit.client.1.smithi119.stdout:1/778: mkdir d3/db/d106/d11f 0 2023-12-17T11:57:56.027 INFO:tasks.workunit.client.1.smithi119.stdout:2/874: creat d6/d2b/d3f/d5b/f130 x:0 0 0 2023-12-17T11:57:56.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/815: mknod dd/d15/d4f/c102 0 2023-12-17T11:57:56.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/816: fsync dd/d15/f95 0 2023-12-17T11:57:56.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/817: dread - dd/d15/d4f/f8d zero size 2023-12-17T11:57:56.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/818: chown dd/d15/d16/d3d/f84 186092 1 2023-12-17T11:57:56.027 INFO:tasks.workunit.client.1.smithi119.stdout:4/819: stat dd/d15/d16/d3d/dab/cc3 0 2023-12-17T11:57:56.028 INFO:tasks.workunit.client.1.smithi119.stdout:4/820: stat dd/f1b 0 2023-12-17T11:57:56.028 INFO:tasks.workunit.client.1.smithi119.stdout:4/821: truncate dd/d15/d16/d3d/fbf 637426 0 2023-12-17T11:57:56.030 INFO:tasks.workunit.client.1.smithi119.stdout:8/701: unlink d7/d18/d45/d9f/c88 0 2023-12-17T11:57:56.030 INFO:tasks.workunit.client.1.smithi119.stdout:8/702: write d7/d18/fcf [2206702,79226] 0 2023-12-17T11:57:56.031 INFO:tasks.workunit.client.0.smithi002.stdout:7/785: mkdir d6/d17/dc/d13/dd8/dd0/dd2/ded 0 2023-12-17T11:57:56.032 INFO:tasks.workunit.client.1.smithi119.stdout:1/779: mkdir d3/d44/d89/d120 0 2023-12-17T11:57:56.036 INFO:tasks.workunit.client.0.smithi002.stdout:2/798: symlink d3/d4/d7/d14/d2e/d37/dc2/l119 0 2023-12-17T11:57:56.042 INFO:tasks.workunit.client.1.smithi119.stdout:1/780: dread d3/db/d17/d24/d20/d40/f78 [0,4194304] 0 2023-12-17T11:57:56.044 INFO:tasks.workunit.client.0.smithi002.stdout:7/786: getdents d6/d17/dc/d13/d21/d2e/d4a 0 2023-12-17T11:57:56.044 INFO:tasks.workunit.client.0.smithi002.stdout:7/787: write d6/d81/fbb [356082,88987] 0 2023-12-17T11:57:56.046 INFO:tasks.workunit.client.1.smithi119.stdout:4/822: creat dd/d11/f103 x:0 0 0 2023-12-17T11:57:56.047 INFO:tasks.workunit.client.0.smithi002.stdout:2/799: mkdir d3/d4/d17/d11a 0 2023-12-17T11:57:56.048 INFO:tasks.workunit.client.1.smithi119.stdout:2/875: dread d6/d2b/d3f/da8/fe1 [0,4194304] 0 2023-12-17T11:57:56.048 INFO:tasks.workunit.client.1.smithi119.stdout:1/781: mknod d3/db/d17/d24/d20/d40/d76/d96/c121 0 2023-12-17T11:57:56.048 INFO:tasks.workunit.client.1.smithi119.stdout:2/876: fsync d6/d2b/da3/f12d 0 2023-12-17T11:57:56.049 INFO:tasks.workunit.client.0.smithi002.stdout:0/771: dread d0/d6/d26/d14/d19/d2f/fad [0,4194304] 0 2023-12-17T11:57:56.050 INFO:tasks.workunit.client.1.smithi119.stdout:2/877: fdatasync d6/d9/fd 0 2023-12-17T11:57:56.051 INFO:tasks.workunit.client.1.smithi119.stdout:2/878: readlink d6/d2b/l123 0 2023-12-17T11:57:56.053 INFO:tasks.workunit.client.1.smithi119.stdout:1/782: creat d3/db/d17/d24/d20/d40/d76/d84/d119/f122 x:0 0 0 2023-12-17T11:57:56.054 INFO:tasks.workunit.client.1.smithi119.stdout:7/844: dread d2/d4/d11/d2c/d68/d77/f79 [0,4194304] 0 2023-12-17T11:57:56.056 INFO:tasks.workunit.client.1.smithi119.stdout:2/879: truncate d6/d2b/d4b/d5d/d11c/deb/f110 280101 0 2023-12-17T11:57:56.061 INFO:tasks.workunit.client.1.smithi119.stdout:7/845: creat d2/d4/d11/d2c/d68/d99/fff x:0 0 0 2023-12-17T11:57:56.061 INFO:tasks.workunit.client.1.smithi119.stdout:7/846: truncate d2/d4/d11/d2c/d68/fe2 240987 0 2023-12-17T11:57:56.066 INFO:tasks.workunit.client.0.smithi002.stdout:0/772: dread d0/d6/d26/d14/d19/d37/dcf/f5b [0,4194304] 0 2023-12-17T11:57:56.069 INFO:tasks.workunit.client.1.smithi119.stdout:4/823: dread dd/d11/d26/f9f [0,4194304] 0 2023-12-17T11:57:56.069 INFO:tasks.workunit.client.1.smithi119.stdout:4/824: readlink dd/d15/d16/l23 0 2023-12-17T11:57:56.069 INFO:tasks.workunit.client.0.smithi002.stdout:4/745: dwrite d0/d10/d14/f52 [0,4194304] 0 2023-12-17T11:57:56.070 INFO:tasks.workunit.client.1.smithi119.stdout:4/825: truncate dd/d11/d2d/d9c/d55/d81/da1/fb9 716602 0 2023-12-17T11:57:56.071 INFO:tasks.workunit.client.1.smithi119.stdout:2/880: unlink d6/d2b/da3/f118 0 2023-12-17T11:57:56.071 INFO:tasks.workunit.client.1.smithi119.stdout:2/881: stat d6/d38/f103 0 2023-12-17T11:57:56.073 INFO:tasks.workunit.client.1.smithi119.stdout:8/703: write d7/d18/f5f [3234349,89922] 0 2023-12-17T11:57:56.074 INFO:tasks.workunit.client.0.smithi002.stdout:0/773: rmdir d0/d6/d26/d14/d19/d37/d86/de7 0 2023-12-17T11:57:56.074 INFO:tasks.workunit.client.0.smithi002.stdout:0/774: chown d0/d6/d26/d14/d19/d37/fbc 25 1 2023-12-17T11:57:56.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/746: link d0/d10/d21/d33/f89 d0/d3e/d41/fef 0 2023-12-17T11:57:56.077 INFO:tasks.workunit.client.0.smithi002.stdout:4/747: truncate d0/d3e/d56/f9a 969754 0 2023-12-17T11:57:56.078 INFO:tasks.workunit.client.1.smithi119.stdout:4/826: symlink dd/d11/d2d/d9c/d55/d81/db8/d78/dcc/l104 0 2023-12-17T11:57:56.079 INFO:tasks.workunit.client.0.smithi002.stdout:6/797: sync 2023-12-17T11:57:56.079 INFO:tasks.workunit.client.0.smithi002.stdout:9/925: sync 2023-12-17T11:57:56.080 INFO:tasks.workunit.client.0.smithi002.stdout:0/775: creat d0/d6/d26/d14/d19/d2f/ffa x:0 0 0 2023-12-17T11:57:56.080 INFO:tasks.workunit.client.0.smithi002.stdout:0/776: read d0/d6/d26/d14/f53 [3378176,89706] 0 2023-12-17T11:57:56.083 INFO:tasks.workunit.client.0.smithi002.stdout:4/748: mkdir d0/d3e/dc8/dca/df0 0 2023-12-17T11:57:56.086 INFO:tasks.workunit.client.1.smithi119.stdout:6/739: rename d2/df to d2/d2b/d43/de6 0 2023-12-17T11:57:56.089 INFO:tasks.workunit.client.0.smithi002.stdout:2/800: dread d3/d4/f6 [0,4194304] 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:2/801: chown d3/d4/d8b 6 1 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:5/809: dwrite fb [0,4194304] 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:2/802: write d3/d4/d7/d14/d2e/f6d [9871,33816] 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:2/803: fdatasync d3/d4/d7/d14/d2e/d37/fea 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:1/820: dwrite d3/d2f/d4d/d95/fc0 [0,4194304] 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:1/821: chown d3/d6/d9/d37/d39/cfd 223730058 1 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:1/822: write d3/d6/d9/f38 [854854,47445] 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:6/798: creat d0/d1/d21/d56/f106 x:0 0 0 2023-12-17T11:57:56.090 INFO:tasks.workunit.client.0.smithi002.stdout:3/846: dwrite d9/d15/fa5 [0,4194304] 0 2023-12-17T11:57:56.091 INFO:tasks.workunit.client.0.smithi002.stdout:7/788: dwrite d6/d17/dc/d67/f5d [0,4194304] 0 2023-12-17T11:57:56.093 INFO:tasks.workunit.client.0.smithi002.stdout:9/926: rename dc/d42/f12e to dc/d1d/d25/d85/dc2/d91/db2/dbf/f14d 0 2023-12-17T11:57:56.093 INFO:tasks.workunit.client.0.smithi002.stdout:1/823: rename d3/d2f/d74 to d3/d2f/d74/dbe/dd8/d108 22 2023-12-17T11:57:56.097 INFO:tasks.workunit.client.0.smithi002.stdout:0/777: mknod d0/d6/d26/d14/d6d/cfb 0 2023-12-17T11:57:56.097 INFO:tasks.workunit.client.1.smithi119.stdout:2/882: dread d6/d9/d52/d53/ff0 [4194304,4194304] 0 2023-12-17T11:57:56.097 INFO:tasks.workunit.client.1.smithi119.stdout:2/883: dread - d6/d38/fdb zero size 2023-12-17T11:57:56.097 INFO:tasks.workunit.client.1.smithi119.stdout:2/884: readlink d6/d2b/d3f/da8/l124 0 2023-12-17T11:57:56.097 INFO:tasks.workunit.client.1.smithi119.stdout:2/885: write d6/d2b/d4b/d5d/fa1 [447065,76054] 0 2023-12-17T11:57:56.098 INFO:tasks.workunit.client.0.smithi002.stdout:4/749: link d0/d10/d21/d33/f45 d0/d10/d14/d27/ff1 0 2023-12-17T11:57:56.100 INFO:tasks.workunit.client.1.smithi119.stdout:7/847: rename d2/d4/d11/d2c/d68/d77/laa to d2/d40/dc3/dc8/l100 0 2023-12-17T11:57:56.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/824: dread d3/f17 [0,4194304] 0 2023-12-17T11:57:56.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/825: write d3/d2f/d74/dbe/dd8/fb0 [1473114,72890] 0 2023-12-17T11:57:56.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/826: getdents d3/d2f/d4d/d95/d100 0 2023-12-17T11:57:56.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/827: fsync d3/d6/d9/f35 0 2023-12-17T11:57:56.103 INFO:tasks.workunit.client.0.smithi002.stdout:1/828: stat d3/d6/d16/dcf 0 2023-12-17T11:57:56.106 INFO:tasks.workunit.client.1.smithi119.stdout:2/886: creat d6/d9/f131 x:0 0 0 2023-12-17T11:57:56.106 INFO:tasks.workunit.client.1.smithi119.stdout:2/887: read - d6/d9/d13/d34/dcf/ffa zero size 2023-12-17T11:57:56.106 INFO:tasks.workunit.client.1.smithi119.stdout:2/888: fsync d6/d9/d52/d5a/fce 0 2023-12-17T11:57:56.109 INFO:tasks.workunit.client.1.smithi119.stdout:8/704: rename d7/da/f3e to d7/d12/fde 0 2023-12-17T11:57:56.110 INFO:tasks.workunit.client.0.smithi002.stdout:5/810: creat dc/d8e/dd6/f11e x:0 0 0 2023-12-17T11:57:56.119 INFO:tasks.workunit.client.1.smithi119.stdout:7/848: dread d2/d40/f6d [0,4194304] 0 2023-12-17T11:57:56.119 INFO:tasks.workunit.client.1.smithi119.stdout:1/783: write d3/d44/dfd/f73 [94845,99208] 0 2023-12-17T11:57:56.123 INFO:tasks.workunit.client.1.smithi119.stdout:2/889: write d6/d2b/d3f/f83 [2424867,90883] 0 2023-12-17T11:57:56.125 INFO:tasks.workunit.client.1.smithi119.stdout:7/849: mkdir d2/d4/d11/d2c/d68/d99/d101 0 2023-12-17T11:57:56.128 INFO:tasks.workunit.client.1.smithi119.stdout:1/784: mkdir d3/db/d106/d11f/d123 0 2023-12-17T11:57:56.132 INFO:tasks.workunit.client.1.smithi119.stdout:2/890: creat d6/d2b/d4b/d5d/d11c/deb/f132 x:0 0 0 2023-12-17T11:57:56.136 INFO:tasks.workunit.client.1.smithi119.stdout:1/785: symlink d3/db/d17/d24/d20/d40/d76/l124 0 2023-12-17T11:57:56.137 INFO:tasks.workunit.client.1.smithi119.stdout:1/786: fsync d3/d44/fdb 0 2023-12-17T11:57:56.138 INFO:tasks.workunit.client.0.smithi002.stdout:6/799: rename d0/d1/fca to d0/d1/dc/d58/dae/ddb/dc6/f107 0 2023-12-17T11:57:56.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/927: symlink dc/d1d/d25/d85/dc2/d91/de3/l14e 0 2023-12-17T11:57:56.139 INFO:tasks.workunit.client.0.smithi002.stdout:9/928: creat dc/d1d/d25/d85/dc2/ddd/dfa/f14f x:0 0 0 2023-12-17T11:57:56.140 INFO:tasks.workunit.client.1.smithi119.stdout:1/787: mknod d3/db/d2a/c125 0 2023-12-17T11:57:56.142 INFO:tasks.workunit.client.0.smithi002.stdout:0/778: mkdir d0/d6/d26/d14/d90/d64/dab/dfc 0 2023-12-17T11:57:56.143 INFO:tasks.workunit.client.1.smithi119.stdout:9/854: sync 2023-12-17T11:57:56.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/829: rmdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa 39 2023-12-17T11:57:56.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/830: stat d3/d6/d9/f13 0 2023-12-17T11:57:56.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/831: chown d3/d6/d9/d30/d9c 0 1 2023-12-17T11:57:56.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/832: stat d3/d6/d9/d37/fe4 0 2023-12-17T11:57:56.148 INFO:tasks.workunit.client.0.smithi002.stdout:5/811: symlink dc/d17/df1/l11f 0 2023-12-17T11:57:56.149 INFO:tasks.workunit.client.1.smithi119.stdout:7/850: write d2/d4/d70/fd2 [2992229,7117] 0 2023-12-17T11:57:56.152 INFO:tasks.workunit.client.0.smithi002.stdout:7/789: dwrite d6/d17/dc/d67/f5d [0,4194304] 0 2023-12-17T11:57:56.154 INFO:tasks.workunit.client.0.smithi002.stdout:3/847: rename d9/d15/d52/d79/dd1/ce8 to d9/d15/d71/d82/c10d 0 2023-12-17T11:57:56.154 INFO:tasks.workunit.client.0.smithi002.stdout:3/848: chown d9/d1b/d35/d41/d43/d73/f107 9295 1 2023-12-17T11:57:56.155 INFO:tasks.workunit.client.0.smithi002.stdout:5/812: dread dc/d17/d1c/fae [0,4194304] 0 2023-12-17T11:57:56.158 INFO:tasks.workunit.client.0.smithi002.stdout:9/929: symlink dc/d42/da0/d72/l150 0 2023-12-17T11:57:56.160 INFO:tasks.workunit.client.1.smithi119.stdout:8/705: dwrite d7/d18/d15/d81/d8e/fd2 [0,4194304] 0 2023-12-17T11:57:56.160 INFO:tasks.workunit.client.1.smithi119.stdout:8/706: dread - d7/da/d11/d26/d49/f79 zero size 2023-12-17T11:57:56.160 INFO:tasks.workunit.client.1.smithi119.stdout:8/707: readlink d7/d18/d15/d81/la3 0 2023-12-17T11:57:56.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/800: dread d0/d1/dc/d17/f1e [0,4194304] 0 2023-12-17T11:57:56.166 INFO:tasks.workunit.client.0.smithi002.stdout:5/813: dread dc/d94/ded/ff7 [0,4194304] 0 2023-12-17T11:57:56.168 INFO:tasks.workunit.client.0.smithi002.stdout:4/750: rename d0/d10/d14/l18 to d0/d10/d14/d27/d57/d7d/lf2 0 2023-12-17T11:57:56.168 INFO:tasks.workunit.client.0.smithi002.stdout:9/930: dread dc/d1d/d25/d85/fd6 [0,4194304] 0 2023-12-17T11:57:56.168 INFO:tasks.workunit.client.0.smithi002.stdout:4/751: write d0/d5a/f71 [2909633,35451] 0 2023-12-17T11:57:56.168 INFO:tasks.workunit.client.0.smithi002.stdout:4/752: chown d0/d10/d14 9 1 2023-12-17T11:57:56.171 INFO:tasks.workunit.client.1.smithi119.stdout:2/891: dread d6/f33 [0,4194304] 0 2023-12-17T11:57:56.171 INFO:tasks.workunit.client.1.smithi119.stdout:2/892: fdatasync d6/d9/d13/d34/d70/dff/f115 0 2023-12-17T11:57:56.172 INFO:tasks.workunit.client.1.smithi119.stdout:2/893: chown d6/f21 1793 1 2023-12-17T11:57:56.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/883: sync 2023-12-17T11:57:56.180 INFO:tasks.workunit.client.0.smithi002.stdout:1/833: rmdir d3/d6/d9/d30/d9c 39 2023-12-17T11:57:56.181 INFO:tasks.workunit.client.0.smithi002.stdout:6/801: rmdir d0/d1/d21/d56/d8c/d93/da5 39 2023-12-17T11:57:56.187 INFO:tasks.workunit.client.0.smithi002.stdout:5/814: link dc/d1a/d47/fc2 dc/d94/ded/d5a/d68/f120 0 2023-12-17T11:57:56.187 INFO:tasks.workunit.client.0.smithi002.stdout:5/815: read - dc/d1a/d7c/ff8 zero size 2023-12-17T11:57:56.188 INFO:tasks.workunit.client.1.smithi119.stdout:1/788: dwrite d3/db/d17/d24/d20/fd7 [0,4194304] 0 2023-12-17T11:57:56.188 INFO:tasks.workunit.client.1.smithi119.stdout:1/789: chown d3/db/d17/f7d 6 1 2023-12-17T11:57:56.188 INFO:tasks.workunit.client.1.smithi119.stdout:1/790: stat d3/db/d17/d24/d20 0 2023-12-17T11:57:56.191 INFO:tasks.workunit.client.1.smithi119.stdout:2/894: rmdir d6/d2b/d4b 39 2023-12-17T11:57:56.191 INFO:tasks.workunit.client.1.smithi119.stdout:2/895: chown d6/d2b/d3f/da8/d122 29 1 2023-12-17T11:57:56.191 INFO:tasks.workunit.client.1.smithi119.stdout:2/896: truncate d6/d2b/d4b/d5d/d11c/deb/f132 80754 0 2023-12-17T11:57:56.191 INFO:tasks.workunit.client.1.smithi119.stdout:2/897: write d6/d2b/d4b/d5d/fd7 [422194,120773] 0 2023-12-17T11:57:56.193 INFO:tasks.workunit.client.0.smithi002.stdout:8/884: rename d3/d7/d18/d74/d7b/d11c/db4/d117/db0/ff0 to d3/d7/d18/d74/d125/d90/df3/f12f 0 2023-12-17T11:57:56.196 INFO:tasks.workunit.client.0.smithi002.stdout:8/885: write d3/d7/d18/d74/d7b/d11c/d7c/f7e [76491,25899] 0 2023-12-17T11:57:56.198 INFO:tasks.workunit.client.0.smithi002.stdout:3/849: link d9/d1b/d35/d41/d59/d65/da9/d8f/f90 d9/d1b/d35/d41/d43/d73/f10e 0 2023-12-17T11:57:56.200 INFO:tasks.workunit.client.0.smithi002.stdout:1/834: symlink d3/d2f/d74/dbe/dd8/l109 0 2023-12-17T11:57:56.201 INFO:tasks.workunit.client.1.smithi119.stdout:1/791: mknod d3/db/d26/d8f/c126 0 2023-12-17T11:57:56.201 INFO:tasks.workunit.client.1.smithi119.stdout:1/792: write d3/db/d17/d24/d20/dba/dbc/d7e/da1/d101/f11d [639225,46502] 0 2023-12-17T11:57:56.201 INFO:tasks.workunit.client.1.smithi119.stdout:1/793: write d3/db/f5f [535786,117222] 0 2023-12-17T11:57:56.202 INFO:tasks.workunit.client.0.smithi002.stdout:6/802: creat d0/d1/dc0/f108 x:0 0 0 2023-12-17T11:57:56.205 INFO:tasks.workunit.client.1.smithi119.stdout:2/898: rename d6/d2b/d3f/d5c to d6/d9/d52/d53/d55/d58/da5/d133 0 2023-12-17T11:57:56.206 INFO:tasks.workunit.client.0.smithi002.stdout:0/779: dwrite d0/d6/d26/d14/d19/d37/fbc [0,4194304] 0 2023-12-17T11:57:56.206 INFO:tasks.workunit.client.1.smithi119.stdout:8/708: dwrite d7/d18/d45/f56 [0,4194304] 0 2023-12-17T11:57:56.206 INFO:tasks.workunit.client.1.smithi119.stdout:8/709: creat d7/d18/d45/d9f/d7b/fdf x:0 0 0 2023-12-17T11:57:56.207 INFO:tasks.workunit.client.0.smithi002.stdout:9/931: rmdir dc/d1d/d25/d85/dc2/ddd/dfa/d47 39 2023-12-17T11:57:56.208 INFO:tasks.workunit.client.1.smithi119.stdout:7/851: dwrite d2/d4/d11/d2c/d68/d99/d6c/ff6 [0,4194304] 0 2023-12-17T11:57:56.208 INFO:tasks.workunit.client.1.smithi119.stdout:7/852: stat d2/d40/dc3 0 2023-12-17T11:57:56.211 INFO:tasks.workunit.client.0.smithi002.stdout:8/886: mknod d3/d8/d28/c130 0 2023-12-17T11:57:56.213 INFO:tasks.workunit.client.1.smithi119.stdout:2/899: getdents d6/d9/d13/d34/d70 0 2023-12-17T11:57:56.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/850: mknod d9/d15/d52/d79/c10f 0 2023-12-17T11:57:56.219 INFO:tasks.workunit.client.1.smithi119.stdout:8/710: mknod d7/da/d11/ce0 0 2023-12-17T11:57:56.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/932: dread dc/d32/f53 [0,4194304] 0 2023-12-17T11:57:56.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/933: write dc/d1d/d25/d85/dc2/ff2 [4968145,65798] 0 2023-12-17T11:57:56.220 INFO:tasks.workunit.client.0.smithi002.stdout:9/934: chown dc/d42/da0/d82/fa4 494305 1 2023-12-17T11:57:56.223 INFO:tasks.workunit.client.0.smithi002.stdout:0/780: getdents d0/d6/d26/d14/d19/d37/d86 0 2023-12-17T11:57:56.226 INFO:tasks.workunit.client.0.smithi002.stdout:8/887: creat d3/d7/d18/d74/d125/d90/df3/f131 x:0 0 0 2023-12-17T11:57:56.229 INFO:tasks.workunit.client.0.smithi002.stdout:1/835: rename d3/d2f/d74/dbd/dc4 to d3/d6/d9/d37/d39/d43/d4a/d10a 0 2023-12-17T11:57:56.229 INFO:tasks.workunit.client.0.smithi002.stdout:1/836: chown d3/d6/d9/d37/d39/d43/c62 204 1 2023-12-17T11:57:56.233 INFO:tasks.workunit.client.1.smithi119.stdout:1/794: rename d3/db/d17/d24/d20/dba/dbc to d3/db/d2a/d127 0 2023-12-17T11:57:56.233 INFO:tasks.workunit.client.0.smithi002.stdout:9/935: rmdir dc/d1d/d25/d85/dc2 39 2023-12-17T11:57:56.238 INFO:tasks.workunit.client.1.smithi119.stdout:7/853: symlink d2/d4/d11/d2c/d55/d67/l102 0 2023-12-17T11:57:56.238 INFO:tasks.workunit.client.0.smithi002.stdout:0/781: dread d0/d6/d26/d14/d19/d61/de3/f31 [0,4194304] 0 2023-12-17T11:57:56.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/837: creat d3/d2f/d4d/d95/d100/f10b x:0 0 0 2023-12-17T11:57:56.241 INFO:tasks.workunit.client.0.smithi002.stdout:4/753: dwrite d0/d10/d14/f98 [4194304,4194304] 0 2023-12-17T11:57:56.242 INFO:tasks.workunit.client.1.smithi119.stdout:8/711: rename d7/da/d11/f59 to d7/d18/d15/d64/dc5/fe1 0 2023-12-17T11:57:56.242 INFO:tasks.workunit.client.1.smithi119.stdout:8/712: fsync d7/da/d11/d26/d49/f79 0 2023-12-17T11:57:56.244 INFO:tasks.workunit.client.0.smithi002.stdout:3/851: rename d9/d1b/d35/d41/d59/da3/cf5 to d9/d1b/c110 0 2023-12-17T11:57:56.246 INFO:tasks.workunit.client.1.smithi119.stdout:1/795: mknod d3/d44/dfd/d64/c128 0 2023-12-17T11:57:56.246 INFO:tasks.workunit.client.1.smithi119.stdout:1/796: fsync d3/db/d2a/d127/d7e/fc2 0 2023-12-17T11:57:56.246 INFO:tasks.workunit.client.1.smithi119.stdout:1/797: dread - d3/db/d26/d19/fde zero size 2023-12-17T11:57:56.252 INFO:tasks.workunit.client.1.smithi119.stdout:7/854: unlink d2/d4/d1f/l93 0 2023-12-17T11:57:56.252 INFO:tasks.workunit.client.1.smithi119.stdout:7/855: chown d2/d40/dc3/cb2 49726659 1 2023-12-17T11:57:56.252 INFO:tasks.workunit.client.1.smithi119.stdout:7/856: write d2/d4/d11/d2c/d68/f84 [3204735,52764] 0 2023-12-17T11:57:56.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/782: mknod d0/d6/d26/d14/cfd 0 2023-12-17T11:57:56.253 INFO:tasks.workunit.client.0.smithi002.stdout:0/783: stat d0/d6/d26/d14/d19/d37/dcf/f5b 0 2023-12-17T11:57:56.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/838: mknod d3/d6/c10c 0 2023-12-17T11:57:56.254 INFO:tasks.workunit.client.0.smithi002.stdout:1/839: write d3/d6/d9/d30/f4c [1585489,121864] 0 2023-12-17T11:57:56.259 INFO:tasks.workunit.client.1.smithi119.stdout:8/713: rmdir d7/d18/d45/d9f/d7b/d92 0 2023-12-17T11:57:56.264 INFO:tasks.workunit.client.0.smithi002.stdout:4/754: rmdir d0/d3e/da5 39 2023-12-17T11:57:56.264 INFO:tasks.workunit.client.1.smithi119.stdout:1/798: unlink d3/db/d17/d24/fbf 0 2023-12-17T11:57:56.265 INFO:tasks.workunit.client.1.smithi119.stdout:8/714: creat d7/d12/d23/db4/fe2 x:0 0 0 2023-12-17T11:57:56.266 INFO:tasks.workunit.client.0.smithi002.stdout:9/936: getdents dc/d1d/d25/d85/dc2 0 2023-12-17T11:57:56.267 INFO:tasks.workunit.client.0.smithi002.stdout:6/803: dwrite d0/d1/dc/d17/d3c/f94 [0,4194304] 0 2023-12-17T11:57:56.267 INFO:tasks.workunit.client.1.smithi119.stdout:7/857: dread d2/f9f [0,4194304] 0 2023-12-17T11:57:56.270 INFO:tasks.workunit.client.0.smithi002.stdout:0/784: link d0/d15/d59/l6f d0/d6/d26/d14/d19/db1/lfe 0 2023-12-17T11:57:56.273 INFO:tasks.workunit.client.1.smithi119.stdout:8/715: symlink d7/d18/d45/le3 0 2023-12-17T11:57:56.274 INFO:tasks.workunit.client.1.smithi119.stdout:7/858: mkdir d2/d4/d11/d2c/d55/d103 0 2023-12-17T11:57:56.275 INFO:tasks.workunit.client.0.smithi002.stdout:8/888: dwrite d3/d7/d18/d74/d7b/d11c/db4/d117/f66 [0,4194304] 0 2023-12-17T11:57:56.275 INFO:tasks.workunit.client.0.smithi002.stdout:3/852: rmdir d9/d15/d52/d85/dd9 39 2023-12-17T11:57:56.277 INFO:tasks.workunit.client.0.smithi002.stdout:6/804: write d0/d1/dc/d10/fb6 [1121760,98756] 0 2023-12-17T11:57:56.278 INFO:tasks.workunit.client.1.smithi119.stdout:8/716: unlink d7/da/d11/d26/f28 0 2023-12-17T11:57:56.279 INFO:tasks.workunit.client.0.smithi002.stdout:3/853: write d9/d1b/d35/d41/d59/d65/f77 [1243276,78385] 0 2023-12-17T11:57:56.279 INFO:tasks.workunit.client.0.smithi002.stdout:4/755: mknod d0/d10/d14/d27/d69/cf3 0 2023-12-17T11:57:56.281 INFO:tasks.workunit.client.1.smithi119.stdout:2/900: dwrite d6/d2b/d3f/f83 [0,4194304] 0 2023-12-17T11:57:56.282 INFO:tasks.workunit.client.0.smithi002.stdout:5/816: dwrite dc/d17/d1c/fae [0,4194304] 0 2023-12-17T11:57:56.295 INFO:tasks.workunit.client.0.smithi002.stdout:3/854: dread d9/d24/d6f/fbd [0,4194304] 0 2023-12-17T11:57:56.324 INFO:tasks.workunit.client.0.smithi002.stdout:1/840: rename d3/d6/d9/d37/d39/d43/d4a/f77 to d3/d2f/d4d/d95/f10d 0 2023-12-17T11:57:56.327 INFO:tasks.workunit.client.1.smithi119.stdout:8/717: unlink d7/d18/d15/c50 0 2023-12-17T11:57:56.330 INFO:tasks.workunit.client.0.smithi002.stdout:8/889: symlink d3/l132 0 2023-12-17T11:57:56.334 INFO:tasks.workunit.client.0.smithi002.stdout:0/785: dwrite d0/d6/fe [4194304,4194304] 0 2023-12-17T11:57:56.334 INFO:tasks.workunit.client.1.smithi119.stdout:2/901: dwrite d6/d9/d52/d53/d55/d58/da5/d133/f79 [0,4194304] 0 2023-12-17T11:57:56.336 INFO:tasks.workunit.client.0.smithi002.stdout:4/756: mknod d0/d3e/dc8/dca/cf4 0 2023-12-17T11:57:56.337 INFO:tasks.workunit.client.0.smithi002.stdout:6/805: creat d0/d1/dc/d17/dd7/f109 x:0 0 0 2023-12-17T11:57:56.337 INFO:tasks.workunit.client.1.smithi119.stdout:1/799: dwrite d3/db/d17/d24/f37 [0,4194304] 0 2023-12-17T11:57:56.341 INFO:tasks.workunit.client.1.smithi119.stdout:7/859: dwrite d2/d4/d11/d2c/d68/d99/d6c/fa5 [0,4194304] 0 2023-12-17T11:57:56.343 INFO:tasks.workunit.client.0.smithi002.stdout:0/786: dread d0/d6/d26/d14/d19/d61/f88 [0,4194304] 0 2023-12-17T11:57:56.344 INFO:tasks.workunit.client.0.smithi002.stdout:0/787: write d0/d15/d59/f6b [977521,121665] 0 2023-12-17T11:57:56.345 INFO:tasks.workunit.client.0.smithi002.stdout:0/788: creat d0/d6/d26/d14/fff x:0 0 0 2023-12-17T11:57:56.345 INFO:tasks.workunit.client.0.smithi002.stdout:0/789: chown d0/d6/d26/d14/d6d/cfb 1083 1 2023-12-17T11:57:56.345 INFO:tasks.workunit.client.1.smithi119.stdout:1/800: unlink d3/db/d17/d24/d20/d6c/f86 0 2023-12-17T11:57:56.348 INFO:tasks.workunit.client.1.smithi119.stdout:8/718: dread d7/d18/d15/d81/f62 [0,4194304] 0 2023-12-17T11:57:56.348 INFO:tasks.workunit.client.1.smithi119.stdout:8/719: readlink d7/da/d1a/d84/l93 0 2023-12-17T11:57:56.353 INFO:tasks.workunit.client.0.smithi002.stdout:6/806: dread d0/d1/dc/d17/d3c/f47 [0,4194304] 0 2023-12-17T11:57:56.353 INFO:tasks.workunit.client.0.smithi002.stdout:6/807: write d0/d1/dc/d17/d3c/f47 [3256662,99481] 0 2023-12-17T11:57:56.353 INFO:tasks.workunit.client.0.smithi002.stdout:6/808: fdatasync d0/d1/dc/d17/d4c/f55 0 2023-12-17T11:57:56.354 INFO:tasks.workunit.client.1.smithi119.stdout:2/902: dread d6/d9/d86/fb4 [0,4194304] 0 2023-12-17T11:57:56.355 INFO:tasks.workunit.client.1.smithi119.stdout:5/885: sync 2023-12-17T11:57:56.355 INFO:tasks.workunit.client.1.smithi119.stdout:0/789: sync 2023-12-17T11:57:56.358 INFO:tasks.workunit.client.1.smithi119.stdout:8/720: symlink d7/da/d11/d26/d49/le4 0 2023-12-17T11:57:56.367 INFO:tasks.workunit.client.1.smithi119.stdout:5/886: mkdir d1/d70/d6b/d77/dae/dba/de3/d11f/d129 0 2023-12-17T11:57:56.367 INFO:tasks.workunit.client.1.smithi119.stdout:5/887: write d1/d44/f4c [5083013,26929] 0 2023-12-17T11:57:56.368 INFO:tasks.workunit.client.0.smithi002.stdout:9/937: truncate dc/d1d/d25/d85/dc2/ff2 2200423 0 2023-12-17T11:57:56.371 INFO:tasks.workunit.client.0.smithi002.stdout:6/809: read d0/d1/d21/d56/f78 [1147063,103542] 0 2023-12-17T11:57:56.382 INFO:tasks.workunit.client.1.smithi119.stdout:5/888: rename d1/da7/d71/d76/d83/dd1/fe0 to d1/d127/f12a 0 2023-12-17T11:57:56.389 INFO:tasks.workunit.client.0.smithi002.stdout:5/817: mknod dc/d94/ded/d5a/d96/d6c/c121 0 2023-12-17T11:57:56.389 INFO:tasks.workunit.client.0.smithi002.stdout:5/818: write dc/d17/d2f/f110 [976387,1967] 0 2023-12-17T11:57:56.390 INFO:tasks.workunit.client.1.smithi119.stdout:8/721: getdents d7/da/d11 0 2023-12-17T11:57:56.391 INFO:tasks.workunit.client.0.smithi002.stdout:3/855: mknod d9/d15/d52/d85/c111 0 2023-12-17T11:57:56.392 INFO:tasks.workunit.client.0.smithi002.stdout:3/856: readlink d9/l2d 0 2023-12-17T11:57:56.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/841: creat d3/d6/d9/d37/d39/d43/d4a/d7b/dde/f10e x:0 0 0 2023-12-17T11:57:56.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/842: chown d3/d2f/fb4 3 1 2023-12-17T11:57:56.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/843: truncate d3/d2f/d74/dbe/dd8/fb0 1923173 0 2023-12-17T11:57:56.395 INFO:tasks.workunit.client.0.smithi002.stdout:1/844: creat d3/d2f/d4d/d95/d100/f10f x:0 0 0 2023-12-17T11:57:56.395 INFO:tasks.workunit.client.1.smithi119.stdout:2/903: dread d6/d2b/da3/f11d [0,4194304] 0 2023-12-17T11:57:56.396 INFO:tasks.workunit.client.1.smithi119.stdout:2/904: readlink d6/d2b/l123 0 2023-12-17T11:57:56.396 INFO:tasks.workunit.client.1.smithi119.stdout:2/905: dread - d6/d9/d13/fcb zero size 2023-12-17T11:57:56.399 INFO:tasks.workunit.client.1.smithi119.stdout:7/860: dwrite d2/d4/d1f/f5c [0,4194304] 0 2023-12-17T11:57:56.407 INFO:tasks.workunit.client.0.smithi002.stdout:6/810: dwrite d0/d1/dc0/f108 [0,4194304] 0 2023-12-17T11:57:56.409 INFO:tasks.workunit.client.1.smithi119.stdout:8/722: truncate d7/d12/fba 1641694 0 2023-12-17T11:57:56.410 INFO:tasks.workunit.client.0.smithi002.stdout:8/890: mkdir d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d133 0 2023-12-17T11:57:56.410 INFO:tasks.workunit.client.0.smithi002.stdout:8/891: write d3/d7/d18/d74/d7b/d11c/f80 [1607643,96452] 0 2023-12-17T11:57:56.411 INFO:tasks.workunit.client.1.smithi119.stdout:2/906: getdents d6/d9/d52/d53/d55/d58/dba 0 2023-12-17T11:57:56.413 INFO:tasks.workunit.client.0.smithi002.stdout:7/790: sync 2023-12-17T11:57:56.413 INFO:tasks.workunit.client.0.smithi002.stdout:2/804: sync 2023-12-17T11:57:56.419 INFO:tasks.workunit.client.0.smithi002.stdout:4/757: rmdir d0/d10/d14/d4e 39 2023-12-17T11:57:56.419 INFO:tasks.workunit.client.0.smithi002.stdout:4/758: creat d0/d6c/ff5 x:0 0 0 2023-12-17T11:57:56.419 INFO:tasks.workunit.client.0.smithi002.stdout:4/759: chown d0/d6c/dda 0 1 2023-12-17T11:57:56.422 INFO:tasks.workunit.client.1.smithi119.stdout:2/907: creat d6/d38/f134 x:0 0 0 2023-12-17T11:57:56.423 INFO:tasks.workunit.client.1.smithi119.stdout:2/908: fsync d6/d9/d52/d53/d55/d58/da5/d133/de6/fed 0 2023-12-17T11:57:56.426 INFO:tasks.workunit.client.0.smithi002.stdout:0/790: mknod d0/d6/d26/d14/d19/d37/dcf/c100 0 2023-12-17T11:57:56.426 INFO:tasks.workunit.client.0.smithi002.stdout:0/791: getdents d0/d6/d26/d8f/dc8 0 2023-12-17T11:57:56.429 INFO:tasks.workunit.client.1.smithi119.stdout:0/790: dwrite d2/d66/d2e/f6d [0,4194304] 0 2023-12-17T11:57:56.429 INFO:tasks.workunit.client.1.smithi119.stdout:8/723: mknod d7/da/d1a/d8a/ddb/ce5 0 2023-12-17T11:57:56.433 INFO:tasks.workunit.client.1.smithi119.stdout:2/909: mkdir d6/d9/d52/d74/d135 0 2023-12-17T11:57:56.434 INFO:tasks.workunit.client.0.smithi002.stdout:4/760: write d0/d10/d21/f49 [8198405,59691] 0 2023-12-17T11:57:56.434 INFO:tasks.workunit.client.0.smithi002.stdout:4/761: stat d0/d3e/d56/d65 0 2023-12-17T11:57:56.434 INFO:tasks.workunit.client.0.smithi002.stdout:4/762: stat d0/d10/d21/f54 0 2023-12-17T11:57:56.440 INFO:tasks.workunit.client.0.smithi002.stdout:5/819: creat dc/d17/d2f/d99/d108/f122 x:0 0 0 2023-12-17T11:57:56.442 INFO:tasks.workunit.client.1.smithi119.stdout:0/791: mknod d2/dac/cf1 0 2023-12-17T11:57:56.442 INFO:tasks.workunit.client.1.smithi119.stdout:0/792: creat d2/ff2 x:0 0 0 2023-12-17T11:57:56.444 INFO:tasks.workunit.client.0.smithi002.stdout:9/938: rmdir dc/d42/da0/d72/d93/d52/d12b/d13d 0 2023-12-17T11:57:56.446 INFO:tasks.workunit.client.0.smithi002.stdout:3/857: rename d9/d1b/c110 to d9/d40/c112 0 2023-12-17T11:57:56.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/889: dwrite d1/d25/f46 [0,4194304] 0 2023-12-17T11:57:56.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/890: chown d1/d70/d6b/d77/f98 0 1 2023-12-17T11:57:56.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/891: chown d1/d70/d6b/d77/dae/dba/de3/d86/fc9 519493 1 2023-12-17T11:57:56.447 INFO:tasks.workunit.client.1.smithi119.stdout:1/801: dwrite d3/db/d17/d24/d91/f11b [0,4194304] 0 2023-12-17T11:57:56.448 INFO:tasks.workunit.client.1.smithi119.stdout:8/724: rename d7/d12/d23/db4/fe2 to d7/d12/fe6 0 2023-12-17T11:57:56.451 INFO:tasks.workunit.client.0.smithi002.stdout:1/845: chown d3/d6/d9/d37/d39/d43/d4a/l7f 88 1 2023-12-17T11:57:56.451 INFO:tasks.workunit.client.0.smithi002.stdout:1/846: creat d3/d2f/d74/dbd/f110 x:0 0 0 2023-12-17T11:57:56.458 INFO:tasks.workunit.client.1.smithi119.stdout:1/802: unlink d3/db/d17/d24/d20/d6c/db7/de4/l111 0 2023-12-17T11:57:56.460 INFO:tasks.workunit.client.0.smithi002.stdout:6/811: creat d0/d1/d5b/dda/f10a x:0 0 0 2023-12-17T11:57:56.464 INFO:tasks.workunit.client.1.smithi119.stdout:7/861: dwrite d2/d4/d11/d3c/f88 [0,4194304] 0 2023-12-17T11:57:56.464 INFO:tasks.workunit.client.0.smithi002.stdout:8/892: mkdir d3/d7/d18/dde/d10b/d134 0 2023-12-17T11:57:56.466 INFO:tasks.workunit.client.1.smithi119.stdout:5/892: write d1/d44/f4c [1293890,59114] 0 2023-12-17T11:57:56.467 INFO:tasks.workunit.client.1.smithi119.stdout:0/793: rename d2/d66/d1f/d24/d50/d5d/c8e to d2/dac/cf3 0 2023-12-17T11:57:56.469 INFO:tasks.workunit.client.0.smithi002.stdout:7/791: mknod d6/d81/cee 0 2023-12-17T11:57:56.474 INFO:tasks.workunit.client.0.smithi002.stdout:2/805: mknod d3/d4/d7/d14/d1b/c11b 0 2023-12-17T11:57:56.474 INFO:tasks.workunit.client.0.smithi002.stdout:2/806: creat d3/d4/d7/d14/d34/dde/f11c x:0 0 0 2023-12-17T11:57:56.477 INFO:tasks.workunit.client.0.smithi002.stdout:0/792: creat d0/d6/f101 x:0 0 0 2023-12-17T11:57:56.478 INFO:tasks.workunit.client.0.smithi002.stdout:6/812: write d0/d1/d21/d56/d8c/d93/da5/f8d [2529439,25385] 0 2023-12-17T11:57:56.480 INFO:tasks.workunit.client.0.smithi002.stdout:9/939: mknod dc/d1d/d25/d85/dc2/ddd/dfa/d47/d4b/c151 0 2023-12-17T11:57:56.481 INFO:tasks.workunit.client.1.smithi119.stdout:2/910: rmdir d6/d2b 39 2023-12-17T11:57:56.483 INFO:tasks.workunit.client.0.smithi002.stdout:5/820: rename dc/d94/f103 to dc/d17/d1c/f123 0 2023-12-17T11:57:56.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/803: mknod d3/db/d17/c129 0 2023-12-17T11:57:56.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/804: chown d3/db/d26/d19/f4b 2159 1 2023-12-17T11:57:56.485 INFO:tasks.workunit.client.0.smithi002.stdout:3/858: getdents d9/d1b/d35/d41/d43 0 2023-12-17T11:57:56.485 INFO:tasks.workunit.client.0.smithi002.stdout:3/859: creat d9/d15/d52/d79/dab/f113 x:0 0 0 2023-12-17T11:57:56.485 INFO:tasks.workunit.client.0.smithi002.stdout:3/860: chown d9/d24/d6f/fb6 286 1 2023-12-17T11:57:56.489 INFO:tasks.workunit.client.0.smithi002.stdout:8/893: mknod d3/d8/da/d44/da4/c135 0 2023-12-17T11:57:56.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/763: dwrite d0/d5a/f71 [0,4194304] 0 2023-12-17T11:57:56.494 INFO:tasks.workunit.client.0.smithi002.stdout:1/847: dwrite d3/d2f/d74/dbd/fd7 [0,4194304] 0 2023-12-17T11:57:56.495 INFO:tasks.workunit.client.0.smithi002.stdout:1/848: fsync d3/d2f/fb8 0 2023-12-17T11:57:56.495 INFO:tasks.workunit.client.0.smithi002.stdout:1/849: readlink d3/d2f/d4d/d91/l9a 0 2023-12-17T11:57:56.497 INFO:tasks.workunit.client.1.smithi119.stdout:1/805: dread d3/db/d17/d24/d20/f7f [0,4194304] 0 2023-12-17T11:57:56.498 INFO:tasks.workunit.client.0.smithi002.stdout:7/792: symlink d6/d17/dc/d6c/dcb/ddb/lef 0 2023-12-17T11:57:56.498 INFO:tasks.workunit.client.0.smithi002.stdout:3/861: read d9/d15/f22 [468179,89988] 0 2023-12-17T11:57:56.500 INFO:tasks.workunit.client.0.smithi002.stdout:2/807: unlink d3/d4/d7/d14/d2e/lc6 0 2023-12-17T11:57:56.501 INFO:tasks.workunit.client.0.smithi002.stdout:2/808: creat d3/d4/d7/d14/d34/f11d x:0 0 0 2023-12-17T11:57:56.504 INFO:tasks.workunit.client.0.smithi002.stdout:6/813: link d0/d1/d21/f2d d0/d1/dc/d58/de8/dfe/f10b 0 2023-12-17T11:57:56.504 INFO:tasks.workunit.client.0.smithi002.stdout:6/814: fdatasync d0/d1/d21/d56/d8c/d93/da5/f90 0 2023-12-17T11:57:56.508 INFO:tasks.workunit.client.1.smithi119.stdout:7/862: mkdir d2/d40/dc3/dca/d104 0 2023-12-17T11:57:56.509 INFO:tasks.workunit.client.0.smithi002.stdout:9/940: creat dc/d42/da0/d72/d93/f152 x:0 0 0 2023-12-17T11:57:56.509 INFO:tasks.workunit.client.1.smithi119.stdout:5/893: mknod d1/da7/d71/d76/d83/dd1/c12b 0 2023-12-17T11:57:56.514 INFO:tasks.workunit.client.1.smithi119.stdout:8/725: rename d7/d18/d45/d9f/c44 to d7/ce7 0 2023-12-17T11:57:56.515 INFO:tasks.workunit.client.1.smithi119.stdout:0/794: dwrite d2/d66/d2e/d44/df0/f83 [4194304,4194304] 0 2023-12-17T11:57:56.517 INFO:tasks.workunit.client.0.smithi002.stdout:8/894: rename d3/d7/d18/d74/d7b/d11c/db4/d117/cc3 to d3/dca/d100/c136 0 2023-12-17T11:57:56.519 INFO:tasks.workunit.client.1.smithi119.stdout:7/863: unlink d2/d4/d11/d2c/d55/d67/l97 0 2023-12-17T11:57:56.520 INFO:tasks.workunit.client.1.smithi119.stdout:7/864: creat d2/d4/d11/d2c/d68/d98/f105 x:0 0 0 2023-12-17T11:57:56.527 INFO:tasks.workunit.client.0.smithi002.stdout:2/809: dread d3/d4/d7/d14/d2e/d37/d3f/fad [0,4194304] 0 2023-12-17T11:57:56.530 INFO:tasks.workunit.client.1.smithi119.stdout:2/911: rename d6/d9/d13/ffc to d6/d2b/d3f/da8/d122/f136 0 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/795: read d2/d16/f17 [2912930,121437] 0 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/796: write d2/d66/d2e/d44/d7b/d5/dc/f91 [1874368,86171] 0 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/797: fsync d2/d66/d1f/f57 0 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/798: chown d2/l88 121 1 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/799: truncate d2/d66/d2e/d44/d7b/d5/dc/d7f/fc4 1571627 0 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/800: chown d2/d66/c58 0 1 2023-12-17T11:57:56.533 INFO:tasks.workunit.client.1.smithi119.stdout:0/801: fdatasync d2/d66/d2e/d44/df0/fe4 0 2023-12-17T11:57:56.537 INFO:tasks.workunit.client.1.smithi119.stdout:8/726: creat d7/da/d1a/d8a/ddb/dbf/fe8 x:0 0 0 2023-12-17T11:57:56.546 INFO:tasks.workunit.client.0.smithi002.stdout:3/862: dread d9/d24/d6f/fb6 [0,4194304] 0 2023-12-17T11:57:56.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/894: rename d1/d36/dc1 to d1/da7/d71/d97/df0/d103/d12c 0 2023-12-17T11:57:56.549 INFO:tasks.workunit.client.0.smithi002.stdout:4/764: rename d0/d10/d21/d33/dbc/fcc to d0/d3e/d56/d65/ff6 0 2023-12-17T11:57:56.549 INFO:tasks.workunit.client.0.smithi002.stdout:2/810: mkdir d3/d4/d7/d14/d2e/d37/d11e 0 2023-12-17T11:57:56.549 INFO:tasks.workunit.client.0.smithi002.stdout:4/765: chown d0/d3e/d56/d65/d78/f91 787639092 1 2023-12-17T11:57:56.549 INFO:tasks.workunit.client.0.smithi002.stdout:7/793: getdents d6/d17/dc/d67/d8b/d24 0 2023-12-17T11:57:56.549 INFO:tasks.workunit.client.0.smithi002.stdout:7/794: chown d6/d17/dc/d13/d21/c56 211425026 1 2023-12-17T11:57:56.554 INFO:tasks.workunit.client.0.smithi002.stdout:6/815: rmdir d0/d1/dc/d17/d40 39 2023-12-17T11:57:56.555 INFO:tasks.workunit.client.1.smithi119.stdout:9/855: sync 2023-12-17T11:57:56.557 INFO:tasks.workunit.client.1.smithi119.stdout:6/740: sync 2023-12-17T11:57:56.558 INFO:tasks.workunit.client.1.smithi119.stdout:4/827: sync 2023-12-17T11:57:56.558 INFO:tasks.workunit.client.1.smithi119.stdout:3/868: sync 2023-12-17T11:57:56.558 INFO:tasks.workunit.client.1.smithi119.stdout:6/741: truncate d2/d2b/d43/d76/d8d/dc2/fe2 832225 0 2023-12-17T11:57:56.558 INFO:tasks.workunit.client.1.smithi119.stdout:4/828: write dd/d4b/fac [618223,112374] 0 2023-12-17T11:57:56.558 INFO:tasks.workunit.client.1.smithi119.stdout:4/829: chown dd/d11/d2d/d9c/d55/d81/da1/fb9 43 1 2023-12-17T11:57:56.558 INFO:tasks.workunit.client.1.smithi119.stdout:4/830: read - dd/d4b/ff8 zero size 2023-12-17T11:57:56.561 INFO:tasks.workunit.client.0.smithi002.stdout:7/795: rename c2 to d6/d17/dc/d67/d8b/dbd/cf0 0 2023-12-17T11:57:56.562 INFO:tasks.workunit.client.0.smithi002.stdout:3/863: rmdir d9/d15/d52/d79/dd1 39 2023-12-17T11:57:56.563 INFO:tasks.workunit.client.0.smithi002.stdout:3/864: creat d9/d1b/d35/df3/f114 x:0 0 0 2023-12-17T11:57:56.563 INFO:tasks.workunit.client.0.smithi002.stdout:5/821: dread dc/d94/ded/d5a/d96/f35 [0,4194304] 0 2023-12-17T11:57:56.567 INFO:tasks.workunit.client.1.smithi119.stdout:2/912: dread d6/d9/d52/f72 [0,4194304] 0 2023-12-17T11:57:56.579 INFO:tasks.workunit.client.1.smithi119.stdout:6/742: creat d2/d2b/d43/de6/d17/fe7 x:0 0 0 2023-12-17T11:57:56.588 INFO:tasks.workunit.client.0.smithi002.stdout:8/895: dwrite d3/d7/d18/d3f/f86 [0,4194304] 0 2023-12-17T11:57:56.588 INFO:tasks.workunit.client.0.smithi002.stdout:8/896: chown d3/d7/d18/d3f/d49 7 1 2023-12-17T11:57:56.595 INFO:tasks.workunit.client.1.smithi119.stdout:7/865: dwrite d2/f10 [4194304,4194304] 0 2023-12-17T11:57:56.597 INFO:tasks.workunit.client.0.smithi002.stdout:6/816: rename d0/d1/dc/d58/de8 to d0/d1/dc/d17/dd6/d10c 0 2023-12-17T11:57:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:9/941: dread dc/d1d/d25/d85/dc2/ddd/dfa/f33 [0,4194304] 0 2023-12-17T11:57:56.599 INFO:tasks.workunit.client.0.smithi002.stdout:0/793: dwrite d0/fb9 [0,4194304] 0 2023-12-17T11:57:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:2/811: dread d3/d4/d7/d14/d42/d8a/fc3 [0,4194304] 0 2023-12-17T11:57:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:9/942: write dc/d42/da0/d72/d93/d52/fa5 [404390,69393] 0 2023-12-17T11:57:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:9/943: fsync dc/d1d/f78 0 2023-12-17T11:57:56.600 INFO:tasks.workunit.client.1.smithi119.stdout:2/913: dread d6/d9/d52/d5a/fce [0,4194304] 0 2023-12-17T11:57:56.603 INFO:tasks.workunit.client.1.smithi119.stdout:3/869: rename d9/d59/dae/c110 to d9/d44/db7/c143 0 2023-12-17T11:57:56.603 INFO:tasks.workunit.client.1.smithi119.stdout:3/870: dread - d9/da/f91 zero size 2023-12-17T11:57:56.603 INFO:tasks.workunit.client.1.smithi119.stdout:3/871: write d9/d11/d1e/d55/d65/ddf/f11f [128716,99217] 0 2023-12-17T11:57:56.603 INFO:tasks.workunit.client.1.smithi119.stdout:3/872: readlink d9/d11/d1e/d55/d77/l8a 0 2023-12-17T11:57:56.608 INFO:tasks.workunit.client.1.smithi119.stdout:4/831: unlink dd/d4b/f87 0 2023-12-17T11:57:56.611 INFO:tasks.workunit.client.0.smithi002.stdout:3/865: mknod d9/d1b/d35/d41/d59/d65/da9/c115 0 2023-12-17T11:57:56.613 INFO:tasks.workunit.client.1.smithi119.stdout:6/743: symlink d2/d7e/le8 0 2023-12-17T11:57:56.613 INFO:tasks.workunit.client.1.smithi119.stdout:6/744: stat d2/d2b/d43/l46 0 2023-12-17T11:57:56.613 INFO:tasks.workunit.client.1.smithi119.stdout:6/745: fdatasync d2/f98 0 2023-12-17T11:57:56.615 INFO:tasks.workunit.client.0.smithi002.stdout:1/850: dwrite d3/d2f/fb8 [4194304,4194304] 0 2023-12-17T11:57:56.615 INFO:tasks.workunit.client.0.smithi002.stdout:1/851: stat d3 0 2023-12-17T11:57:56.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/822: stat dc/d94/cf4 0 2023-12-17T11:57:56.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/823: stat dc/d1a/d47/fc2 0 2023-12-17T11:57:56.616 INFO:tasks.workunit.client.0.smithi002.stdout:5/824: read - dc/f109 zero size 2023-12-17T11:57:56.618 INFO:tasks.workunit.client.1.smithi119.stdout:7/866: truncate d2/d40/dc3/dca/dd9/ff4 8196477 0 2023-12-17T11:57:56.618 INFO:tasks.workunit.client.1.smithi119.stdout:7/867: creat d2/d4/d11/d2c/d68/d99/f106 x:0 0 0 2023-12-17T11:57:56.619 INFO:tasks.workunit.client.1.smithi119.stdout:2/914: symlink d6/d2b/l137 0 2023-12-17T11:57:56.619 INFO:tasks.workunit.client.1.smithi119.stdout:2/915: getdents d6/d9/d52/d53/d55/d58/dba 0 2023-12-17T11:57:56.622 INFO:tasks.workunit.client.0.smithi002.stdout:8/897: dread d3/d8/da/d44/fc8 [0,4194304] 0 2023-12-17T11:57:56.623 INFO:tasks.workunit.client.1.smithi119.stdout:4/832: mkdir dd/d11/d2d/d9c/d55/d81/d88/d105 0 2023-12-17T11:57:56.625 INFO:tasks.workunit.client.1.smithi119.stdout:9/856: dwrite d12/dca/f10d [0,4194304] 0 2023-12-17T11:57:56.626 INFO:tasks.workunit.client.1.smithi119.stdout:6/746: creat d2/d7e/dbc/fe9 x:0 0 0 2023-12-17T11:57:56.629 INFO:tasks.workunit.client.0.smithi002.stdout:6/817: dread d0/d1/dc/d17/d40/f5f [4194304,4194304] 0 2023-12-17T11:57:56.629 INFO:tasks.workunit.client.0.smithi002.stdout:6/818: write d0/d1/d5b/dda/f10a [662872,88343] 0 2023-12-17T11:57:56.630 INFO:tasks.workunit.client.1.smithi119.stdout:7/868: mknod d2/d4/d70/dac/dc4/c107 0 2023-12-17T11:57:56.634 INFO:tasks.workunit.client.0.smithi002.stdout:2/812: mknod d3/d4/d17/d19/d8d/c11f 0 2023-12-17T11:57:56.634 INFO:tasks.workunit.client.0.smithi002.stdout:2/813: write d3/d4/d17/d19/d4d/fa2 [1389820,85261] 0 2023-12-17T11:57:56.637 INFO:tasks.workunit.client.1.smithi119.stdout:2/916: creat d6/d2b/d4b/d81/f138 x:0 0 0 2023-12-17T11:57:56.637 INFO:tasks.workunit.client.1.smithi119.stdout:2/917: truncate d6/d9/d52/d53/d55/d58/f92 277377 0 2023-12-17T11:57:56.637 INFO:tasks.workunit.client.1.smithi119.stdout:2/918: truncate d6/d2b/d4b/d5d/fa1 648572 0 2023-12-17T11:57:56.638 INFO:tasks.workunit.client.1.smithi119.stdout:8/727: dwrite d7/d18/f5f [0,4194304] 0 2023-12-17T11:57:56.638 INFO:tasks.workunit.client.1.smithi119.stdout:8/728: truncate d7/da/d1a/fdc 827619 0 2023-12-17T11:57:56.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/852: creat d3/d6/d9/d37/d39/d43/d4a/f111 x:0 0 0 2023-12-17T11:57:56.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/853: truncate d3/d6/d9/d37/d39/d43/d8f/fbf 827252 0 2023-12-17T11:57:56.638 INFO:tasks.workunit.client.0.smithi002.stdout:1/854: chown d3/d6/d9/d37 0 1 2023-12-17T11:57:56.639 INFO:tasks.workunit.client.1.smithi119.stdout:5/895: dwrite d1/d70/d6b/fc4 [0,4194304] 0 2023-12-17T11:57:56.639 INFO:tasks.workunit.client.1.smithi119.stdout:5/896: read - d1/d36/f4e zero size 2023-12-17T11:57:56.640 INFO:tasks.workunit.client.1.smithi119.stdout:5/897: write d1/d70/d6b/d77/dae/dba/ff6 [424831,17964] 0 2023-12-17T11:57:56.640 INFO:tasks.workunit.client.1.smithi119.stdout:5/898: write d1/da7/d71/f94 [704628,1070] 0 2023-12-17T11:57:56.640 INFO:tasks.workunit.client.1.smithi119.stdout:5/899: chown d1/d44/f72 61810 1 2023-12-17T11:57:56.640 INFO:tasks.workunit.client.1.smithi119.stdout:9/857: mkdir d12/d1d/d28/d46/d115 0 2023-12-17T11:57:56.640 INFO:tasks.workunit.client.1.smithi119.stdout:9/858: stat d12/l2d 0 2023-12-17T11:57:56.640 INFO:tasks.workunit.client.1.smithi119.stdout:5/900: creat d1/d70/d85/d95/dc3/f12d x:0 0 0 2023-12-17T11:57:56.641 INFO:tasks.workunit.client.1.smithi119.stdout:5/901: write d1/d70/d85/d95/f8f [1543797,98446] 0 2023-12-17T11:57:56.641 INFO:tasks.workunit.client.1.smithi119.stdout:5/902: fsync d1/da7/f3b 0 2023-12-17T11:57:56.641 INFO:tasks.workunit.client.1.smithi119.stdout:5/903: readlink d1/d44/l6e 0 2023-12-17T11:57:56.641 INFO:tasks.workunit.client.1.smithi119.stdout:5/904: creat d1/d70/d85/d95/f12e x:0 0 0 2023-12-17T11:57:56.642 INFO:tasks.workunit.client.0.smithi002.stdout:5/825: symlink dc/d94/ded/d5a/d68/l124 0 2023-12-17T11:57:56.642 INFO:tasks.workunit.client.0.smithi002.stdout:5/826: creat dc/f125 x:0 0 0 2023-12-17T11:57:56.642 INFO:tasks.workunit.client.0.smithi002.stdout:5/827: stat dc/d94/ff9 0 2023-12-17T11:57:56.643 INFO:tasks.workunit.client.1.smithi119.stdout:6/747: truncate d2/d2b/f63 8227680 0 2023-12-17T11:57:56.643 INFO:tasks.workunit.client.1.smithi119.stdout:6/748: creat d2/d2b/d43/d76/d8d/dc2/fea x:0 0 0 2023-12-17T11:57:56.646 INFO:tasks.workunit.client.1.smithi119.stdout:7/869: symlink d2/d4/d11/d2c/d68/d99/l108 0 2023-12-17T11:57:56.650 INFO:tasks.workunit.client.0.smithi002.stdout:8/898: rmdir d3/d7/d18/d74/dff 0 2023-12-17T11:57:56.652 INFO:tasks.workunit.client.1.smithi119.stdout:8/729: truncate d7/da/fc6 382865 0 2023-12-17T11:57:56.653 INFO:tasks.workunit.client.1.smithi119.stdout:8/730: chown d7/da/d11/d26/f71 125167 1 2023-12-17T11:57:56.653 INFO:tasks.workunit.client.1.smithi119.stdout:8/731: write d7/d12/d23/fd1 [608380,66536] 0 2023-12-17T11:57:56.653 INFO:tasks.workunit.client.1.smithi119.stdout:8/732: read - d7/d18/d15/fc1 zero size 2023-12-17T11:57:56.654 INFO:tasks.workunit.client.0.smithi002.stdout:8/899: symlink d3/d7/d18/d3f/d49/l137 0 2023-12-17T11:57:56.654 INFO:tasks.workunit.client.0.smithi002.stdout:8/900: fsync d3/d7/d111/f119 0 2023-12-17T11:57:56.655 INFO:tasks.workunit.client.0.smithi002.stdout:3/866: dread d9/f45 [0,4194304] 0 2023-12-17T11:57:56.662 INFO:tasks.workunit.client.1.smithi119.stdout:9/859: truncate d12/d1d/d28/d46/d50/f60 669314 0 2023-12-17T11:57:56.662 INFO:tasks.workunit.client.0.smithi002.stdout:7/796: dwrite d6/d17/dc/d67/d8b/fab [0,4194304] 0 2023-12-17T11:57:56.667 INFO:tasks.workunit.client.1.smithi119.stdout:8/733: dread d7/d12/fba [0,4194304] 0 2023-12-17T11:57:56.667 INFO:tasks.workunit.client.1.smithi119.stdout:8/734: fsync d7/d12/d69/f24 0 2023-12-17T11:57:56.676 INFO:tasks.workunit.client.1.smithi119.stdout:5/905: truncate d1/d70/d6b/d77/dae/dba/de3/f9f 2891590 0 2023-12-17T11:57:56.677 INFO:tasks.workunit.client.1.smithi119.stdout:5/906: readlink d1/d70/d6b/df1/l112 0 2023-12-17T11:57:56.677 INFO:tasks.workunit.client.1.smithi119.stdout:5/907: fdatasync d1/d44/f4c 0 2023-12-17T11:57:56.677 INFO:tasks.workunit.client.1.smithi119.stdout:5/908: chown d1/d70/d85 276 1 2023-12-17T11:57:56.677 INFO:tasks.workunit.client.1.smithi119.stdout:5/909: write d1/d70/d85/d95/f122 [7889,104629] 0 2023-12-17T11:57:56.682 INFO:tasks.workunit.client.0.smithi002.stdout:4/766: dwrite d0/d10/d21/f42 [4194304,4194304] 0 2023-12-17T11:57:56.682 INFO:tasks.workunit.client.0.smithi002.stdout:4/767: dread - d0/d6c/ff5 zero size 2023-12-17T11:57:56.682 INFO:tasks.workunit.client.0.smithi002.stdout:4/768: stat d0/d3e/d41/fef 0 2023-12-17T11:57:56.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/794: dwrite d0/d6/d26/d14/fe2 [0,4194304] 0 2023-12-17T11:57:56.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/795: dread - d0/d6/d26/d14/ff5 zero size 2023-12-17T11:57:56.693 INFO:tasks.workunit.client.0.smithi002.stdout:7/797: dread d6/d17/dc/d13/d37/d4f/f9d [0,4194304] 0 2023-12-17T11:57:56.693 INFO:tasks.workunit.client.0.smithi002.stdout:7/798: read d6/d17/dc/fe8 [1042109,50722] 0 2023-12-17T11:57:56.696 INFO:tasks.workunit.client.0.smithi002.stdout:5/828: dread dc/d17/d2f/fb8 [0,4194304] 0 2023-12-17T11:57:56.696 INFO:tasks.workunit.client.0.smithi002.stdout:5/829: fdatasync dc/d94/ded/d2d/d5b/fa2 0 2023-12-17T11:57:56.700 INFO:tasks.workunit.client.1.smithi119.stdout:6/749: creat d2/d61/d8a/dcf/feb x:0 0 0 2023-12-17T11:57:56.705 INFO:tasks.workunit.client.1.smithi119.stdout:2/919: dwrite d6/d2b/f3c [0,4194304] 0 2023-12-17T11:57:56.705 INFO:tasks.workunit.client.0.smithi002.stdout:6/819: dwrite d0/d1/dc/d10/fbd [0,4194304] 0 2023-12-17T11:57:56.705 INFO:tasks.workunit.client.0.smithi002.stdout:6/820: creat d0/d1/dc/d58/f10d x:0 0 0 2023-12-17T11:57:56.713 INFO:tasks.workunit.client.0.smithi002.stdout:2/814: dwrite d3/d4/d17/d19/f89 [0,4194304] 0 2023-12-17T11:57:56.720 INFO:tasks.workunit.client.0.smithi002.stdout:1/855: dwrite d3/d2f/d74/dbd/f78 [0,4194304] 0 2023-12-17T11:57:56.735 INFO:tasks.workunit.client.0.smithi002.stdout:4/769: rename d0/d10/d14/cc1 to d0/d10/d14/d27/d69/cf7 0 2023-12-17T11:57:56.735 INFO:tasks.workunit.client.0.smithi002.stdout:4/770: dread - d0/d10/d14/d4e/fbb zero size 2023-12-17T11:57:56.738 INFO:tasks.workunit.client.0.smithi002.stdout:7/799: truncate d6/d17/dc/f51 4844509 0 2023-12-17T11:57:56.746 INFO:tasks.workunit.client.0.smithi002.stdout:5/830: mkdir dc/d94/ded/d5a/d68/d97/ddd/d126 0 2023-12-17T11:57:56.747 INFO:tasks.workunit.client.0.smithi002.stdout:8/901: dwrite d3/d7/d18/d74/d7b/d11c/db4/d117/db0/fef [0,4194304] 0 2023-12-17T11:57:56.749 INFO:tasks.workunit.client.1.smithi119.stdout:5/910: dwrite d1/d36/d3a/fd7 [0,4194304] 0 2023-12-17T11:57:56.749 INFO:tasks.workunit.client.1.smithi119.stdout:5/911: fdatasync d1/d44/f124 0 2023-12-17T11:57:56.756 INFO:tasks.workunit.client.0.smithi002.stdout:0/796: dwrite d0/d6/d26/d14/d19/d61/de3/f46 [0,4194304] 0 2023-12-17T11:57:56.756 INFO:tasks.workunit.client.0.smithi002.stdout:0/797: stat d0/d6/d26/d14/d19/d2f/c66 0 2023-12-17T11:57:56.756 INFO:tasks.workunit.client.1.smithi119.stdout:9/860: dwrite d12/d1d/d28/d46/d6e/fb9 [0,4194304] 0 2023-12-17T11:57:56.759 INFO:tasks.workunit.client.1.smithi119.stdout:5/912: dread d1/d36/d3a/f67 [0,4194304] 0 2023-12-17T11:57:56.759 INFO:tasks.workunit.client.1.smithi119.stdout:5/913: readlink d1/d70/da3/d120/l128 0 2023-12-17T11:57:56.760 INFO:tasks.workunit.client.0.smithi002.stdout:3/867: dwrite d9/d1b/d35/d41/d59/d65/da9/d8f/f90 [0,4194304] 0 2023-12-17T11:57:56.760 INFO:tasks.workunit.client.0.smithi002.stdout:3/868: dread - d9/d1b/fc7 zero size 2023-12-17T11:57:56.761 INFO:tasks.workunit.client.0.smithi002.stdout:5/831: dread dc/d94/ded/d5a/d68/d97/ddd/fda [0,4194304] 0 2023-12-17T11:57:56.761 INFO:tasks.workunit.client.0.smithi002.stdout:5/832: write dc/d94/ded/d2d/dcf/f113 [3050849,30180] 0 2023-12-17T11:57:56.774 INFO:tasks.workunit.client.0.smithi002.stdout:6/821: dwrite d0/d1/dc/d17/fa0 [0,4194304] 0 2023-12-17T11:57:56.774 INFO:tasks.workunit.client.0.smithi002.stdout:6/822: write d0/d1/dc/d17/d3c/f47 [1070452,46604] 0 2023-12-17T11:57:56.774 INFO:tasks.workunit.client.0.smithi002.stdout:6/823: write d0/d1/dc/d10/fb4 [349605,82558] 0 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/750: mkdir d2/d7e/d93/dec 0 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/751: read d2/f26 [1811760,73104] 0 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/752: fsync d2/d2b/d43/d76/dbd/fe0 0 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/753: readlink d2/d2b/d43/l89 0 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/754: chown d2/d7e 1349314803 1 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/755: readlink d2/d61/laf 0 2023-12-17T11:57:56.775 INFO:tasks.workunit.client.1.smithi119.stdout:6/756: chown d2/d2b/d43/d5e/db3/lc4 13470 1 2023-12-17T11:57:56.779 INFO:tasks.workunit.client.0.smithi002.stdout:6/824: dread d0/d1/dc/d17/d67/d6c/f80 [0,4194304] 0 2023-12-17T11:57:56.782 INFO:tasks.workunit.client.0.smithi002.stdout:2/815: rmdir d3/d4/d7/d14/d2e/d37/dce/df1/d109 0 2023-12-17T11:57:56.788 INFO:tasks.workunit.client.0.smithi002.stdout:1/856: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/daa/c112 0 2023-12-17T11:57:56.791 INFO:tasks.workunit.client.1.smithi119.stdout:9/861: dwrite d12/d1d/d28/d46/d50/d92/fbe [0,4194304] 0 2023-12-17T11:57:56.791 INFO:tasks.workunit.client.0.smithi002.stdout:4/771: mkdir d0/d10/df8 0 2023-12-17T11:57:56.796 INFO:tasks.workunit.client.0.smithi002.stdout:2/816: dread d3/d4/d17/d19/f7c [0,4194304] 0 2023-12-17T11:57:56.796 INFO:tasks.workunit.client.0.smithi002.stdout:2/817: chown d3/d4/d8b/ld6 63076 1 2023-12-17T11:57:56.799 INFO:tasks.workunit.client.0.smithi002.stdout:8/902: mknod d3/d8/da/d44/da4/c138 0 2023-12-17T11:57:56.800 INFO:tasks.workunit.client.0.smithi002.stdout:8/903: creat d3/d7/d114/f139 x:0 0 0 2023-12-17T11:57:56.800 INFO:tasks.workunit.client.0.smithi002.stdout:8/904: fsync d3/d7/d18/d74/d7b/d11c/db4/d117/db0/fbc 0 2023-12-17T11:57:56.804 INFO:tasks.workunit.client.0.smithi002.stdout:0/798: mkdir d0/d15/d59/d102 0 2023-12-17T11:57:56.810 INFO:tasks.workunit.client.0.smithi002.stdout:5/833: mknod dc/d17/c127 0 2023-12-17T11:57:56.811 INFO:tasks.workunit.client.1.smithi119.stdout:9/862: write d12/d1d/d28/d4d/f6c [613361,34988] 0 2023-12-17T11:57:56.812 INFO:tasks.workunit.client.1.smithi119.stdout:8/735: rename d7/da/f22 to d7/da/d1a/d8a/ddb/dbf/fe9 0 2023-12-17T11:57:56.813 INFO:tasks.workunit.client.0.smithi002.stdout:6/825: getdents d0/dc3 0 2023-12-17T11:57:56.813 INFO:tasks.workunit.client.0.smithi002.stdout:6/826: write d0/d1/d21/d56/d8c/d93/da5/dbc/fcc [911930,4856] 0 2023-12-17T11:57:56.815 INFO:tasks.workunit.client.1.smithi119.stdout:6/757: creat d2/d7e/d93/dec/fed x:0 0 0 2023-12-17T11:57:56.815 INFO:tasks.workunit.client.1.smithi119.stdout:6/758: write d2/d61/d8a/dcf/feb [214664,28146] 0 2023-12-17T11:57:56.816 INFO:tasks.workunit.client.0.smithi002.stdout:1/857: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/d113 0 2023-12-17T11:57:56.829 INFO:tasks.workunit.client.0.smithi002.stdout:2/818: rename d3/d4/d7/d14/d1b/lbe to d3/d56/l120 0 2023-12-17T11:57:56.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/799: rmdir d0/d6/d26/d14/d19/d37/d86/dca 39 2023-12-17T11:57:56.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/800: fsync d0/d6/d26/d14/d90/f78 0 2023-12-17T11:57:56.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/801: chown d0/d6/d26/d14/d19/d37/dcf/l9d 3820 1 2023-12-17T11:57:56.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/802: chown d0/d6/d26/d14/d19/d37/d86/dca 1087 1 2023-12-17T11:57:56.830 INFO:tasks.workunit.client.0.smithi002.stdout:3/869: rmdir d9/d15/d6a 39 2023-12-17T11:57:56.830 INFO:tasks.workunit.client.0.smithi002.stdout:3/870: write d9/d15/f19 [9030664,11609] 0 2023-12-17T11:57:56.831 INFO:tasks.workunit.client.1.smithi119.stdout:6/759: truncate d2/f98 985522 0 2023-12-17T11:57:56.837 INFO:tasks.workunit.client.1.smithi119.stdout:9/863: rename d12/d1d/d28/d46/l61 to d12/d1d/d28/d46/d50/d92/dcc/l116 0 2023-12-17T11:57:56.842 INFO:tasks.workunit.client.0.smithi002.stdout:7/800: dwrite d6/d17/dc/f51 [4194304,4194304] 0 2023-12-17T11:57:56.842 INFO:tasks.workunit.client.0.smithi002.stdout:7/801: fsync d6/d17/dc/d67/d8b/fab 0 2023-12-17T11:57:56.842 INFO:tasks.workunit.client.0.smithi002.stdout:7/802: truncate d6/d17/dc/d13/d21/d2e/f7f 4370781 0 2023-12-17T11:57:56.842 INFO:tasks.workunit.client.0.smithi002.stdout:7/803: write d6/d17/dc/d13/d21/f62 [476557,99436] 0 2023-12-17T11:57:56.842 INFO:tasks.workunit.client.0.smithi002.stdout:7/804: fdatasync d6/d17/dc/d13/f14 0 2023-12-17T11:57:56.845 INFO:tasks.workunit.client.0.smithi002.stdout:1/858: mknod d3/d6/d16/d9f/c114 0 2023-12-17T11:57:56.845 INFO:tasks.workunit.client.0.smithi002.stdout:1/859: fdatasync d3/d2f/fb8 0 2023-12-17T11:57:56.847 INFO:tasks.workunit.client.0.smithi002.stdout:5/834: rename dc/d94/ded/d2d/f95 to dc/d1a/d7c/f128 0 2023-12-17T11:57:56.849 INFO:tasks.workunit.client.0.smithi002.stdout:4/772: dwrite d0/d10/d14/d27/d57/f6d [0,4194304] 0 2023-12-17T11:57:56.852 INFO:tasks.workunit.client.1.smithi119.stdout:1/806: sync 2023-12-17T11:57:56.857 INFO:tasks.workunit.client.1.smithi119.stdout:9/864: rmdir d12/d1d/d28/d46/dea 39 2023-12-17T11:57:56.858 INFO:tasks.workunit.client.0.smithi002.stdout:2/819: mknod d3/d4/d7/d14/d42/c121 0 2023-12-17T11:57:56.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/803: creat d0/d6/d26/d14/d19/d61/f103 x:0 0 0 2023-12-17T11:57:56.858 INFO:tasks.workunit.client.0.smithi002.stdout:3/871: dread - d9/d1b/d35/d41/d43/d73/fd6 zero size 2023-12-17T11:57:56.858 INFO:tasks.workunit.client.0.smithi002.stdout:0/804: fsync d0/d6/d26/fc5 0 2023-12-17T11:57:56.860 INFO:tasks.workunit.client.0.smithi002.stdout:0/805: read d0/d6/d26/d14/d19/d37/d91/dae/fb5 [403670,127701] 0 2023-12-17T11:57:56.864 INFO:tasks.workunit.client.0.smithi002.stdout:1/860: getdents d3/d2f/d74 0 2023-12-17T11:57:56.865 INFO:tasks.workunit.client.0.smithi002.stdout:4/773: write d0/d10/d14/d4e/fbe [1288454,44144] 0 2023-12-17T11:57:56.865 INFO:tasks.workunit.client.0.smithi002.stdout:4/774: fdatasync d0/f8a 0 2023-12-17T11:57:56.866 INFO:tasks.workunit.client.1.smithi119.stdout:1/807: creat d3/db/f12a x:0 0 0 2023-12-17T11:57:56.869 INFO:tasks.workunit.client.1.smithi119.stdout:9/865: creat d12/d1d/d28/d46/dbb/d10a/f117 x:0 0 0 2023-12-17T11:57:56.871 INFO:tasks.workunit.client.1.smithi119.stdout:0/802: sync 2023-12-17T11:57:56.871 INFO:tasks.workunit.client.1.smithi119.stdout:0/803: write d2/d66/d2e/d44/d7b/d5/fde [559053,125695] 0 2023-12-17T11:57:56.872 INFO:tasks.workunit.client.1.smithi119.stdout:3/873: sync 2023-12-17T11:57:56.873 INFO:tasks.workunit.client.1.smithi119.stdout:0/804: write d2/d66/d2e/d44/f78 [318197,33147] 0 2023-12-17T11:57:56.884 INFO:tasks.workunit.client.1.smithi119.stdout:7/870: sync 2023-12-17T11:57:56.884 INFO:tasks.workunit.client.1.smithi119.stdout:4/833: sync 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:8/736: dwrite d7/da/d1a/f1c [0,4194304] 0 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:8/737: chown d7/da 8781 1 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:2/920: dwrite d6/d2b/f87 [0,4194304] 0 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:2/921: dread - d6/d2b/d4b/d11b/f128 zero size 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:6/760: dwrite d2/d2b/d43/de6/d17/d79/fc5 [0,4194304] 0 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:2/922: truncate d6/d38/fdb 136720 0 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:6/761: write d2/d2b/d43/de6/d17/fd8 [3985865,68611] 0 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:2/923: write d6/d9/d86/f119 [90690,14284] 0 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:2/924: chown d6/d2b/da3/f11d 0 1 2023-12-17T11:57:56.886 INFO:tasks.workunit.client.1.smithi119.stdout:6/762: dread - d2/d2b/d43/d76/dbd/fe0 zero size 2023-12-17T11:57:56.887 INFO:tasks.workunit.client.1.smithi119.stdout:6/763: write d2/d2b/d43/f4a [635685,84552] 0 2023-12-17T11:57:56.887 INFO:tasks.workunit.client.1.smithi119.stdout:2/925: write d6/d9/d13/d34/d70/dff/f115 [378586,112128] 0 2023-12-17T11:57:56.892 INFO:tasks.workunit.client.0.smithi002.stdout:6/827: dwrite d0/d1/d21/f2d [0,4194304] 0 2023-12-17T11:57:56.901 INFO:tasks.workunit.client.0.smithi002.stdout:6/828: dread d0/d1/dc/d17/fe7 [0,4194304] 0 2023-12-17T11:57:56.950 INFO:tasks.workunit.client.1.smithi119.stdout:6/764: dwrite d2/d2b/d43/d5e/d92/da8/fd6 [0,4194304] 0 2023-12-17T11:57:56.950 INFO:tasks.workunit.client.1.smithi119.stdout:2/926: dwrite d6/f11 [0,4194304] 0 2023-12-17T11:57:56.950 INFO:tasks.workunit.client.1.smithi119.stdout:2/927: chown d6/d9/d13/d34/dcf/l121 23707 1 2023-12-17T11:57:56.950 INFO:tasks.workunit.client.1.smithi119.stdout:2/928: write d6/f21 [1073168,23633] 0 2023-12-17T11:57:56.950 INFO:tasks.workunit.client.0.smithi002.stdout:9/944: sync 2023-12-17T11:57:56.956 INFO:tasks.workunit.client.1.smithi119.stdout:9/866: rename d12/d1d/f41 to d12/d1d/d28/d46/dea/dcf/f118 0 2023-12-17T11:57:56.956 INFO:tasks.workunit.client.1.smithi119.stdout:9/867: creat d12/d1d/d28/d46/dbb/f119 x:0 0 0 2023-12-17T11:57:56.956 INFO:tasks.workunit.client.1.smithi119.stdout:9/868: chown d12/dca/l4b 9 1 2023-12-17T11:57:56.961 INFO:tasks.workunit.client.1.smithi119.stdout:2/929: dread d6/d2b/d3f/da8/d122/f136 [0,4194304] 0 2023-12-17T11:57:56.965 INFO:tasks.workunit.client.0.smithi002.stdout:9/945: dread dc/d42/da0/d72/d93/d52/f8f [0,4194304] 0 2023-12-17T11:57:56.972 INFO:tasks.workunit.client.1.smithi119.stdout:0/805: mkdir d2/d66/d2e/d44/d7b/dbc/df4 0 2023-12-17T11:57:56.972 INFO:tasks.workunit.client.1.smithi119.stdout:0/806: write d2/d66/f53 [250367,86161] 0 2023-12-17T11:57:56.973 INFO:tasks.workunit.client.0.smithi002.stdout:2/820: symlink d3/d4/d7/d14/d2e/d37/dce/df1/l122 0 2023-12-17T11:57:56.973 INFO:tasks.workunit.client.0.smithi002.stdout:2/821: chown d3/d4/d7/d14/d42/d8a/fc3 226 1 2023-12-17T11:57:56.978 INFO:tasks.workunit.client.0.smithi002.stdout:2/822: dread d3/d4/f5 [0,4194304] 0 2023-12-17T11:57:56.978 INFO:tasks.workunit.client.0.smithi002.stdout:2/823: write d3/d4/f65 [4986772,110395] 0 2023-12-17T11:57:56.980 INFO:tasks.workunit.client.0.smithi002.stdout:3/872: symlink d9/d15/d52/d79/dd1/dd5/l116 0 2023-12-17T11:57:56.981 INFO:tasks.workunit.client.0.smithi002.stdout:3/873: readlink d9/d24/le9 0 2023-12-17T11:57:56.985 INFO:tasks.workunit.client.0.smithi002.stdout:0/806: rename d0/d6/d26/lac to d0/d6/d26/d14/d19/db1/l104 0 2023-12-17T11:57:56.985 INFO:tasks.workunit.client.0.smithi002.stdout:0/807: write d0/d15/f23 [6655223,82121] 0 2023-12-17T11:57:57.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/775: creat d0/d10/df8/ff9 x:0 0 0 2023-12-17T11:57:57.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/776: fdatasync d0/d3e/d56/d99/fb8 0 2023-12-17T11:57:57.008 INFO:tasks.workunit.client.0.smithi002.stdout:4/777: read d0/d10/d14/d27/d57/d7d/fb7 [159476,28215] 0 2023-12-17T11:57:57.010 INFO:tasks.workunit.client.0.smithi002.stdout:2/824: write d3/d4/d7/d14/f92 [900197,60023] 0 2023-12-17T11:57:57.010 INFO:tasks.workunit.client.0.smithi002.stdout:2/825: readlink d3/d4/d17/d19/d4d/d72/d83/lcd 0 2023-12-17T11:57:57.016 INFO:tasks.workunit.client.1.smithi119.stdout:6/765: dwrite d2/d2b/d43/de6/d17/f34 [0,4194304] 0 2023-12-17T11:57:57.039 INFO:tasks.workunit.client.0.smithi002.stdout:0/808: dwrite d0/d6/d26/d14/d19/d37/fa8 [0,4194304] 0 2023-12-17T11:57:57.039 INFO:tasks.workunit.client.0.smithi002.stdout:0/809: write d0/d6/d26/d14/d19/d2f/f8d [417214,16963] 0 2023-12-17T11:57:57.045 INFO:tasks.workunit.client.1.smithi119.stdout:1/808: unlink d3/db/d17/d24/d20/d6c/db7/de4/f102 0 2023-12-17T11:57:57.045 INFO:tasks.workunit.client.1.smithi119.stdout:1/809: read d3/db/d26/f1d [8209632,126403] 0 2023-12-17T11:57:57.071 INFO:tasks.workunit.client.1.smithi119.stdout:1/810: dwrite d3/db/d26/d19/ff9 [0,4194304] 0 2023-12-17T11:57:57.089 INFO:tasks.workunit.client.0.smithi002.stdout:1/861: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa/d115 0 2023-12-17T11:57:57.108 INFO:tasks.workunit.client.0.smithi002.stdout:6/829: mkdir d0/d1/d28/dab/d10e 0 2023-12-17T11:57:57.122 INFO:tasks.workunit.client.1.smithi119.stdout:4/834: write dd/d15/d16/d3d/fbf [20160,13008] 0 2023-12-17T11:57:57.122 INFO:tasks.workunit.client.1.smithi119.stdout:4/835: truncate dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/fef 234545 0 2023-12-17T11:57:57.150 INFO:tasks.workunit.client.1.smithi119.stdout:2/930: mkdir d6/d9/d13/d34/d88/d139 0 2023-12-17T11:57:57.154 INFO:tasks.workunit.client.1.smithi119.stdout:3/874: link d9/da/df/c26 d9/da/df/d41/d113/c144 0 2023-12-17T11:57:57.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:56 smithi119 ceph-mon[117414]: pgmap v31: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 176 MiB/s rd, 230 MiB/s wr, 314 op/s 2023-12-17T11:57:57.159 INFO:tasks.workunit.client.1.smithi119.stdout:0/807: mknod d2/d16/d35/de9/cf5 0 2023-12-17T11:57:57.167 INFO:tasks.workunit.client.1.smithi119.stdout:6/766: rmdir d2/d2b/d43/d76/d8d 39 2023-12-17T11:57:57.167 INFO:tasks.workunit.client.1.smithi119.stdout:5/914: sync 2023-12-17T11:57:57.173 INFO:tasks.workunit.client.0.smithi002.stdout:5/835: getdents dc/d1a 0 2023-12-17T11:57:57.174 INFO:tasks.workunit.client.1.smithi119.stdout:1/811: symlink d3/db/d106/l12b 0 2023-12-17T11:57:57.175 INFO:tasks.workunit.client.0.smithi002.stdout:9/946: rmdir dc/d42/d4f/d9e 39 2023-12-17T11:57:57.176 INFO:tasks.workunit.client.1.smithi119.stdout:4/836: mkdir dd/d11/d2d/d9c/d55/d81/d88/d105/d106 0 2023-12-17T11:57:57.180 INFO:tasks.workunit.client.1.smithi119.stdout:2/931: symlink d6/d2b/d4b/l13a 0 2023-12-17T11:57:57.182 INFO:tasks.workunit.client.0.smithi002.stdout:4/778: mkdir d0/dfa 0 2023-12-17T11:57:57.186 INFO:tasks.workunit.client.1.smithi119.stdout:3/875: symlink d9/d35/dbd/dfb/d107/l145 0 2023-12-17T11:57:57.187 INFO:tasks.workunit.client.0.smithi002.stdout:2/826: chown d3/d4/d7/d14/d1b/d5b/f63 1 1 2023-12-17T11:57:57.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/808: unlink d2/d66/d2e/d44/d7b/d5/dc/f91 0 2023-12-17T11:57:57.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/809: write d2/d66/d2e/d44/fb9 [1041627,52012] 0 2023-12-17T11:57:57.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/810: getdents d2/d66/d2e/d44/d7b/dbc/df4 0 2023-12-17T11:57:57.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/811: readlink d2/d66/d2e/d44/l38 0 2023-12-17T11:57:57.190 INFO:tasks.workunit.client.1.smithi119.stdout:0/812: fsync d2/d66/d2e/d44/d7b/d5/d3f/f5e 0 2023-12-17T11:57:57.192 INFO:tasks.workunit.client.1.smithi119.stdout:6/767: mkdir d2/d2b/d43/dee 0 2023-12-17T11:57:57.200 INFO:tasks.workunit.client.0.smithi002.stdout:4/779: dread d0/f83 [4194304,4194304] 0 2023-12-17T11:57:57.201 INFO:tasks.workunit.client.0.smithi002.stdout:1/862: mknod d3/d2f/d74/dbe/c116 0 2023-12-17T11:57:57.202 INFO:tasks.workunit.client.0.smithi002.stdout:1/863: fsync d3/d6/d9/d37/d39/f8c 0 2023-12-17T11:57:57.206 INFO:tasks.workunit.client.1.smithi119.stdout:1/812: unlink d3/db/d26/fa4 0 2023-12-17T11:57:57.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/837: unlink dd/d11/d26/d86/c9e 0 2023-12-17T11:57:57.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/838: chown dd/d15/f53 1028723 1 2023-12-17T11:57:57.207 INFO:tasks.workunit.client.1.smithi119.stdout:4/839: stat dd/d11 0 2023-12-17T11:57:57.207 INFO:tasks.workunit.client.1.smithi119.stdout:2/932: dread d6/d9/d13/d34/fa0 [0,4194304] 0 2023-12-17T11:57:57.211 INFO:tasks.workunit.client.0.smithi002.stdout:5/836: dwrite dc/d1a/d7c/ff8 [0,4194304] 0 2023-12-17T11:57:57.211 INFO:tasks.workunit.client.0.smithi002.stdout:5/837: chown dc/d94/ded/lb2 345026 1 2023-12-17T11:57:57.211 INFO:tasks.workunit.client.0.smithi002.stdout:5/838: dread - dc/d17/d2f/d99/fef zero size 2023-12-17T11:57:57.212 INFO:tasks.workunit.client.0.smithi002.stdout:5/839: creat dc/d1a/d53/da9/f129 x:0 0 0 2023-12-17T11:57:57.212 INFO:tasks.workunit.client.1.smithi119.stdout:7/871: rename d2/d4/d11/d2c/d55/d67/ca0 to d2/d4/d70/d57/c109 0 2023-12-17T11:57:57.214 INFO:tasks.workunit.client.1.smithi119.stdout:3/876: mkdir d9/d11/d1e/d55/d65/ddf/d139/d146 0 2023-12-17T11:57:57.215 INFO:tasks.workunit.client.0.smithi002.stdout:6/830: symlink d0/d1/d21/d56/d8c/d93/l10f 0 2023-12-17T11:57:57.218 INFO:tasks.workunit.client.1.smithi119.stdout:0/813: truncate d2/f67 3956120 0 2023-12-17T11:57:57.218 INFO:tasks.workunit.client.1.smithi119.stdout:0/814: chown d2/f4 1895703282 1 2023-12-17T11:57:57.219 INFO:tasks.workunit.client.0.smithi002.stdout:9/947: dwrite f0 [0,4194304] 0 2023-12-17T11:57:57.222 INFO:tasks.workunit.client.0.smithi002.stdout:4/780: link d0/d10/d14/fc9 d0/d3e/dc8/dcd/dd5/ffb 0 2023-12-17T11:57:57.223 INFO:tasks.workunit.client.0.smithi002.stdout:1/864: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/c117 0 2023-12-17T11:57:57.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:56 smithi002 ceph-mon[107131]: pgmap v31: 65 pgs: 65 active+clean; 2.9 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 176 MiB/s rd, 230 MiB/s wr, 314 op/s 2023-12-17T11:57:57.227 INFO:tasks.workunit.client.1.smithi119.stdout:6/768: truncate d2/d61/f82 405329 0 2023-12-17T11:57:57.231 INFO:tasks.workunit.client.1.smithi119.stdout:1/813: creat d3/db/d17/d112/f12c x:0 0 0 2023-12-17T11:57:57.238 INFO:tasks.workunit.client.1.smithi119.stdout:2/933: creat d6/d9/d13/f13b x:0 0 0 2023-12-17T11:57:57.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/865: dread d3/d6/d16/d28/f58 [0,4194304] 0 2023-12-17T11:57:57.239 INFO:tasks.workunit.client.0.smithi002.stdout:1/866: creat d3/d6/d9/d37/d39/d43/d8f/f118 x:0 0 0 2023-12-17T11:57:57.241 INFO:tasks.workunit.client.1.smithi119.stdout:7/872: symlink d2/d4/d11/d2c/d68/d98/l10a 0 2023-12-17T11:57:57.243 INFO:tasks.workunit.client.1.smithi119.stdout:8/738: mkdir d7/d12/d23/d9c/dea 0 2023-12-17T11:57:57.243 INFO:tasks.workunit.client.1.smithi119.stdout:5/915: rmdir d1/d70/da3 39 2023-12-17T11:57:57.246 INFO:tasks.workunit.client.1.smithi119.stdout:9/869: rename d12/d1d/d28/d86/d8f/cab to d12/d1d/d28/c11a 0 2023-12-17T11:57:57.248 INFO:tasks.workunit.client.0.smithi002.stdout:6/831: creat d0/d1/d6d/d83/f110 x:0 0 0 2023-12-17T11:57:57.248 INFO:tasks.workunit.client.0.smithi002.stdout:6/832: fdatasync d0/d1/fd 0 2023-12-17T11:57:57.251 INFO:tasks.workunit.client.1.smithi119.stdout:3/877: unlink d9/d11/d1e/d55/d65/ddf/f102 0 2023-12-17T11:57:57.263 INFO:tasks.workunit.client.0.smithi002.stdout:4/781: link d0/ff d0/d3e/d56/d65/ffc 0 2023-12-17T11:57:57.264 INFO:tasks.workunit.client.0.smithi002.stdout:7/805: sync 2023-12-17T11:57:57.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/905: sync 2023-12-17T11:57:57.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/906: fsync d3/d8/da/fa6 0 2023-12-17T11:57:57.264 INFO:tasks.workunit.client.0.smithi002.stdout:8/907: write d3/d8/f12c [345609,118566] 0 2023-12-17T11:57:57.267 INFO:tasks.workunit.client.1.smithi119.stdout:1/814: mknod d3/db/d2a/c12d 0 2023-12-17T11:57:57.267 INFO:tasks.workunit.client.1.smithi119.stdout:9/870: dread ff [0,4194304] 0 2023-12-17T11:57:57.268 INFO:tasks.workunit.client.0.smithi002.stdout:1/867: truncate d3/d2f/fb9 3049762 0 2023-12-17T11:57:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:6/833: mknod d0/d1/d21/d56/d8c/d93/da5/dbc/c111 0 2023-12-17T11:57:57.272 INFO:tasks.workunit.client.0.smithi002.stdout:6/834: chown d0/d1/d21/d56/d8c/d93/da5/f8d 84 1 2023-12-17T11:57:57.277 INFO:tasks.workunit.client.0.smithi002.stdout:6/835: dread d0/d1/d21/d56/f5a [0,4194304] 0 2023-12-17T11:57:57.281 INFO:tasks.workunit.client.0.smithi002.stdout:0/810: rename d0/d6/d26/d14/d19/d61/de3/f96 to d0/d6/d26/d14/d90/f105 0 2023-12-17T11:57:57.281 INFO:tasks.workunit.client.0.smithi002.stdout:4/782: mknod d0/d10/d14/d27/d57/cfd 0 2023-12-17T11:57:57.281 INFO:tasks.workunit.client.0.smithi002.stdout:0/811: getdents d0/d6/d26/d14/d19/d37/d86/dca 0 2023-12-17T11:57:57.282 INFO:tasks.workunit.client.0.smithi002.stdout:7/806: mkdir d6/d17/dc/d13/d37/d4f/de4/df1 0 2023-12-17T11:57:57.282 INFO:tasks.workunit.client.0.smithi002.stdout:7/807: chown d6/l85 39704991 1 2023-12-17T11:57:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/908: mknod d3/d8/c13a 0 2023-12-17T11:57:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:1/868: creat d3/d6/d9/d30/d9c/f119 x:0 0 0 2023-12-17T11:57:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:8/909: write d3/d7/d18/d74/d7b/f104 [784549,3708] 0 2023-12-17T11:57:57.293 INFO:tasks.workunit.client.0.smithi002.stdout:1/869: write d3/d6/d16/d61/f93 [700934,74206] 0 2023-12-17T11:57:57.294 INFO:tasks.workunit.client.0.smithi002.stdout:5/840: dwrite dc/d94/ded/d2d/f56 [0,4194304] 0 2023-12-17T11:57:57.294 INFO:tasks.workunit.client.0.smithi002.stdout:9/948: dwrite dc/d1d/d7c/d90/f145 [0,4194304] 0 2023-12-17T11:57:57.294 INFO:tasks.workunit.client.0.smithi002.stdout:4/783: creat d0/d10/d21/d33/dbc/ffe x:0 0 0 2023-12-17T11:57:57.295 INFO:tasks.workunit.client.1.smithi119.stdout:7/873: mknod d2/d4/d1f/c10b 0 2023-12-17T11:57:57.297 INFO:tasks.workunit.client.0.smithi002.stdout:0/812: mkdir d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/d106 0 2023-12-17T11:57:57.298 INFO:tasks.workunit.client.1.smithi119.stdout:8/739: creat d7/d12/d23/d9c/feb x:0 0 0 2023-12-17T11:57:57.299 INFO:tasks.workunit.client.0.smithi002.stdout:7/808: creat d6/d17/dc/d67/ff2 x:0 0 0 2023-12-17T11:57:57.299 INFO:tasks.workunit.client.0.smithi002.stdout:7/809: chown d6/d17/dc/d13/d21/d2e/d4a/daf 152010993 1 2023-12-17T11:57:57.307 INFO:tasks.workunit.client.1.smithi119.stdout:0/815: rename d2/d66/d2e/d44/l5c to d2/d66/d1f/d24/d50/dbd/dea/lf6 0 2023-12-17T11:57:57.310 INFO:tasks.workunit.client.0.smithi002.stdout:3/874: sync 2023-12-17T11:57:57.312 INFO:tasks.workunit.client.1.smithi119.stdout:3/878: dwrite d9/da/df/d41/fdd [4194304,4194304] 0 2023-12-17T11:57:57.312 INFO:tasks.workunit.client.1.smithi119.stdout:3/879: readlink d9/d11/d1e/leb 0 2023-12-17T11:57:57.312 INFO:tasks.workunit.client.1.smithi119.stdout:1/815: mkdir d3/db/d17/d24/d20/d40/d76/d96/d12e 0 2023-12-17T11:57:57.312 INFO:tasks.workunit.client.1.smithi119.stdout:9/871: mkdir d12/d1d/d28/d46/d50/d92/dae/d11b 0 2023-12-17T11:57:57.312 INFO:tasks.workunit.client.1.smithi119.stdout:1/816: fsync d3/db/d26/d8f/fe1 0 2023-12-17T11:57:57.315 INFO:tasks.workunit.client.0.smithi002.stdout:0/813: write d0/d6/fb [6398687,8938] 0 2023-12-17T11:57:57.315 INFO:tasks.workunit.client.0.smithi002.stdout:0/814: chown d0/d6/c1d 198586636 1 2023-12-17T11:57:57.315 INFO:tasks.workunit.client.0.smithi002.stdout:0/815: chown d0/d6/d26/d14/d90/d64/le8 6167055 1 2023-12-17T11:57:57.317 INFO:tasks.workunit.client.1.smithi119.stdout:8/740: mknod d7/da/d11/d60/cec 0 2023-12-17T11:57:57.317 INFO:tasks.workunit.client.1.smithi119.stdout:0/816: dread d2/d16/fab [0,4194304] 0 2023-12-17T11:57:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:8/910: rename d3/d7/d18/dde/d10b/d134 to d3/d7/d111/d13b 0 2023-12-17T11:57:57.323 INFO:tasks.workunit.client.0.smithi002.stdout:6/836: dwrite d0/d1/dc/f34 [0,4194304] 0 2023-12-17T11:57:57.325 INFO:tasks.workunit.client.0.smithi002.stdout:9/949: symlink dc/d1d/l153 0 2023-12-17T11:57:57.325 INFO:tasks.workunit.client.0.smithi002.stdout:9/950: write dc/d1d/d25/dd9/f100 [19743,123230] 0 2023-12-17T11:57:57.327 INFO:tasks.workunit.client.1.smithi119.stdout:5/916: creat d1/d70/d6b/f12f x:0 0 0 2023-12-17T11:57:57.330 INFO:tasks.workunit.client.1.smithi119.stdout:2/934: rename d6/d2b/d3f to d6/d9/d52/d53/d55/daf/d12e/d13c 0 2023-12-17T11:57:57.334 INFO:tasks.workunit.client.0.smithi002.stdout:7/810: creat d6/d17/dc/d13/d21/d2e/dd5/ff3 x:0 0 0 2023-12-17T11:57:57.336 INFO:tasks.workunit.client.1.smithi119.stdout:7/874: dwrite d2/d40/dc3/f52 [0,4194304] 0 2023-12-17T11:57:57.336 INFO:tasks.workunit.client.1.smithi119.stdout:7/875: chown d2/d4/d70 1044 1 2023-12-17T11:57:57.336 INFO:tasks.workunit.client.1.smithi119.stdout:7/876: chown d2/d4/d11/f2d 205333 1 2023-12-17T11:57:57.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/911: write d3/d8/d28/d31/fe0 [3776348,44006] 0 2023-12-17T11:57:57.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/912: stat d3/dca 0 2023-12-17T11:57:57.337 INFO:tasks.workunit.client.0.smithi002.stdout:8/913: readlink d3/d7/d6e/l78 0 2023-12-17T11:57:57.338 INFO:tasks.workunit.client.0.smithi002.stdout:3/875: unlink d9/d1b/d35/d41/d43/c8e 0 2023-12-17T11:57:57.340 INFO:tasks.workunit.client.1.smithi119.stdout:1/817: rmdir d3/db/d17/d24/d20/d40/d76/d96/d12e 0 2023-12-17T11:57:57.342 INFO:tasks.workunit.client.0.smithi002.stdout:0/816: rmdir d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7 39 2023-12-17T11:57:57.343 INFO:tasks.workunit.client.0.smithi002.stdout:1/870: dwrite d3/d6/d9/d37/d39/fb3 [4194304,4194304] 0 2023-12-17T11:57:57.343 INFO:tasks.workunit.client.0.smithi002.stdout:1/871: write d3/d2f/fe2 [732764,118159] 0 2023-12-17T11:57:57.345 INFO:tasks.workunit.client.1.smithi119.stdout:8/741: creat d7/da/d11/d26/d49/fed x:0 0 0 2023-12-17T11:57:57.345 INFO:tasks.workunit.client.1.smithi119.stdout:8/742: chown d7/da/d1a/f66 17099049 1 2023-12-17T11:57:57.346 INFO:tasks.workunit.client.1.smithi119.stdout:8/743: read d7/da/d1a/d8a/ddb/faf [152293,22800] 0 2023-12-17T11:57:57.347 INFO:tasks.workunit.client.1.smithi119.stdout:0/817: mkdir d2/df7 0 2023-12-17T11:57:57.347 INFO:tasks.workunit.client.1.smithi119.stdout:0/818: write d2/d16/f17 [2491234,4738] 0 2023-12-17T11:57:57.347 INFO:tasks.workunit.client.1.smithi119.stdout:0/819: dread - d2/d66/d1f/d24/d50/d5d/d80/fb4 zero size 2023-12-17T11:57:57.347 INFO:tasks.workunit.client.1.smithi119.stdout:0/820: fsync d2/fc8 0 2023-12-17T11:57:57.347 INFO:tasks.workunit.client.1.smithi119.stdout:0/821: fdatasync d2/dac/fb5 0 2023-12-17T11:57:57.350 INFO:tasks.workunit.client.0.smithi002.stdout:6/837: rmdir d0 39 2023-12-17T11:57:57.350 INFO:tasks.workunit.client.0.smithi002.stdout:6/838: fsync d0/d1/d21/fbf 0 2023-12-17T11:57:57.350 INFO:tasks.workunit.client.1.smithi119.stdout:5/917: mknod d1/d70/d85/d95/dc3/c130 0 2023-12-17T11:57:57.352 INFO:tasks.workunit.client.0.smithi002.stdout:9/951: link dc/d42/d4f/d9e/d104/c121 dc/d42/da0/d72/d93/d52/c154 0 2023-12-17T11:57:57.354 INFO:tasks.workunit.client.1.smithi119.stdout:2/935: unlink d6/d9/d52/d74/cc1 0 2023-12-17T11:57:57.357 INFO:tasks.workunit.client.0.smithi002.stdout:7/811: mknod d6/d17/db3/cf4 0 2023-12-17T11:57:57.357 INFO:tasks.workunit.client.1.smithi119.stdout:9/872: rename d12/d1d/d28/d46/d50/da3/le9 to d12/d1d/d28/d46/d6e/df5/l11c 0 2023-12-17T11:57:57.358 INFO:tasks.workunit.client.1.smithi119.stdout:9/873: dread - d12/dca/fce zero size 2023-12-17T11:57:57.361 INFO:tasks.workunit.client.1.smithi119.stdout:1/818: rmdir d3/db/d106/d11f/d123 0 2023-12-17T11:57:57.363 INFO:tasks.workunit.client.1.smithi119.stdout:3/880: dwrite d9/da/df/d41/fdd [4194304,4194304] 0 2023-12-17T11:57:57.363 INFO:tasks.workunit.client.1.smithi119.stdout:3/881: fsync d9/d35/f5e 0 2023-12-17T11:57:57.364 INFO:tasks.workunit.client.0.smithi002.stdout:8/914: unlink d3/d8/da/d44/cf8 0 2023-12-17T11:57:57.364 INFO:tasks.workunit.client.0.smithi002.stdout:8/915: chown d3/d8/da/d44/f3b 254 1 2023-12-17T11:57:57.367 INFO:tasks.workunit.client.1.smithi119.stdout:8/744: symlink d7/d18/d45/d9f/lee 0 2023-12-17T11:57:57.367 INFO:tasks.workunit.client.1.smithi119.stdout:8/745: write d7/f16 [4703634,70042] 0 2023-12-17T11:57:57.370 INFO:tasks.workunit.client.0.smithi002.stdout:3/876: unlink d9/d15/d52/cc9 0 2023-12-17T11:57:57.371 INFO:tasks.workunit.client.1.smithi119.stdout:3/882: dread d9/d11/d1e/f123 [0,4194304] 0 2023-12-17T11:57:57.373 INFO:tasks.workunit.client.0.smithi002.stdout:0/817: symlink d0/d6/d26/d14/d19/db1/l107 0 2023-12-17T11:57:57.373 INFO:tasks.workunit.client.1.smithi119.stdout:5/918: rmdir d1/d127 39 2023-12-17T11:57:57.373 INFO:tasks.workunit.client.1.smithi119.stdout:8/746: dread d7/da/fc6 [0,4194304] 0 2023-12-17T11:57:57.373 INFO:tasks.workunit.client.1.smithi119.stdout:8/747: chown d7/da/d11/ce0 59246 1 2023-12-17T11:57:57.376 INFO:tasks.workunit.client.1.smithi119.stdout:9/874: unlink d12/d1d/d28/d4d/f7a 0 2023-12-17T11:57:57.376 INFO:tasks.workunit.client.0.smithi002.stdout:1/872: mknod d3/d6/d16/d61/c11a 0 2023-12-17T11:57:57.378 INFO:tasks.workunit.client.1.smithi119.stdout:2/936: rename d6/f73 to d6/d38/f13d 0 2023-12-17T11:57:57.389 INFO:tasks.workunit.client.1.smithi119.stdout:1/819: creat d3/db/d26/f12f x:0 0 0 2023-12-17T11:57:57.392 INFO:tasks.workunit.client.0.smithi002.stdout:6/839: mkdir d0/d112 0 2023-12-17T11:57:57.392 INFO:tasks.workunit.client.0.smithi002.stdout:7/812: creat d6/d17/dc/d6c/dcb/deb/ff5 x:0 0 0 2023-12-17T11:57:57.392 INFO:tasks.workunit.client.0.smithi002.stdout:8/916: symlink d3/d7/d18/d74/d125/d65/da2/l13c 0 2023-12-17T11:57:57.393 INFO:tasks.workunit.client.0.smithi002.stdout:0/818: mkdir d0/d6/d108 0 2023-12-17T11:57:57.395 INFO:tasks.workunit.client.0.smithi002.stdout:2/827: dwrite d3/d50/f53 [0,4194304] 0 2023-12-17T11:57:57.395 INFO:tasks.workunit.client.0.smithi002.stdout:2/828: creat d3/d4/dbc/f123 x:0 0 0 2023-12-17T11:57:57.395 INFO:tasks.workunit.client.0.smithi002.stdout:7/813: read d6/d17/dc/d13/dd8/db0/fdc [84388,77584] 0 2023-12-17T11:57:57.398 INFO:tasks.workunit.client.1.smithi119.stdout:5/919: creat d1/d70/d6b/d77/dae/dba/de3/d11f/d129/f131 x:0 0 0 2023-12-17T11:57:57.398 INFO:tasks.workunit.client.1.smithi119.stdout:5/920: dread - d1/d44/d52/f8c zero size 2023-12-17T11:57:57.398 INFO:tasks.workunit.client.1.smithi119.stdout:5/921: truncate d1/d70/d6b/df1/f113 727240 0 2023-12-17T11:57:57.400 INFO:tasks.workunit.client.0.smithi002.stdout:8/917: creat d3/d7/d6e/d11a/f13d x:0 0 0 2023-12-17T11:57:57.401 INFO:tasks.workunit.client.1.smithi119.stdout:9/875: dread d12/d1d/f5d [0,4194304] 0 2023-12-17T11:57:57.401 INFO:tasks.workunit.client.0.smithi002.stdout:0/819: symlink d0/d6/d108/l109 0 2023-12-17T11:57:57.402 INFO:tasks.workunit.client.0.smithi002.stdout:0/820: creat d0/d6/d26/d14/d19/d37/d62/db8/ddd/f10a x:0 0 0 2023-12-17T11:57:57.405 INFO:tasks.workunit.client.1.smithi119.stdout:0/822: dwrite d2/d16/fbf [0,4194304] 0 2023-12-17T11:57:57.407 INFO:tasks.workunit.client.1.smithi119.stdout:2/937: mknod d6/d9/d52/d53/d55/daf/d12e/d13c/d5b/dfd/c13e 0 2023-12-17T11:57:57.409 INFO:tasks.workunit.client.1.smithi119.stdout:1/820: mknod d3/db/d17/d112/c130 0 2023-12-17T11:57:57.409 INFO:tasks.workunit.client.1.smithi119.stdout:1/821: dread - d3/db/d17/fd3 zero size 2023-12-17T11:57:57.410 INFO:tasks.workunit.client.1.smithi119.stdout:1/822: readlink d3/db/d17/d24/d20/d40/d76/d84/d119/l108 0 2023-12-17T11:57:57.410 INFO:tasks.workunit.client.1.smithi119.stdout:1/823: fdatasync d3/db/d17/d24/d20/dbd/dcb/ff3 0 2023-12-17T11:57:57.412 INFO:tasks.workunit.client.1.smithi119.stdout:9/876: mkdir d12/d1d/d28/d46/d50/d92/da1/d11d 0 2023-12-17T11:57:57.413 INFO:tasks.workunit.client.0.smithi002.stdout:7/814: dread d6/d17/dc/d67/d8b/d24/f43 [0,4194304] 0 2023-12-17T11:57:57.413 INFO:tasks.workunit.client.0.smithi002.stdout:7/815: creat d6/d17/dc/d13/dd8/dd0/ff6 x:0 0 0 2023-12-17T11:57:57.419 INFO:tasks.workunit.client.0.smithi002.stdout:2/829: creat d3/d4/d17/d19/d4d/d72/d83/f124 x:0 0 0 2023-12-17T11:57:57.419 INFO:tasks.workunit.client.0.smithi002.stdout:2/830: dread - d3/d4/d7/d14/faa zero size 2023-12-17T11:57:57.419 INFO:tasks.workunit.client.0.smithi002.stdout:2/831: dread - d3/d4/d7/d14/d34/f11d zero size 2023-12-17T11:57:57.419 INFO:tasks.workunit.client.0.smithi002.stdout:2/832: fsync d3/d50/df6/f102 0 2023-12-17T11:57:57.420 INFO:tasks.workunit.client.0.smithi002.stdout:9/952: dwrite dc/d1d/d7c/d90/dc0/f125 [0,4194304] 0 2023-12-17T11:57:57.422 INFO:tasks.workunit.client.0.smithi002.stdout:5/841: rename dc/d94/cf4 to dc/d17/d2f/d99/d108/c12a 0 2023-12-17T11:57:57.424 INFO:tasks.workunit.client.0.smithi002.stdout:1/873: getdents d3/d2f/d74/dbd 0 2023-12-17T11:57:57.428 INFO:tasks.workunit.client.0.smithi002.stdout:2/833: write d3/d4/ff [323899,97321] 0 2023-12-17T11:57:57.429 INFO:tasks.workunit.client.1.smithi119.stdout:2/938: mkdir d6/d9/d52/d53/d55/daf/d12e/d13c/d5b/dfd/d13f 0 2023-12-17T11:57:57.430 INFO:tasks.workunit.client.1.smithi119.stdout:0/823: dread d2/d16/f7c [0,4194304] 0 2023-12-17T11:57:57.430 INFO:tasks.workunit.client.1.smithi119.stdout:0/824: readlink d2/d66/d1f/d24/d50/l96 0 2023-12-17T11:57:57.433 INFO:tasks.workunit.client.1.smithi119.stdout:1/824: creat d3/db/d17/d24/d20/dba/f131 x:0 0 0 2023-12-17T11:57:57.433 INFO:tasks.workunit.client.1.smithi119.stdout:1/825: write d3/db/d17/d24/d20/d40/d76/d84/f103 [194330,91553] 0 2023-12-17T11:57:57.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/821: link d0/f13 d0/d6/d26/d14/f10b 0 2023-12-17T11:57:57.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/822: write d0/d15/d59/fd7 [265773,108474] 0 2023-12-17T11:57:57.438 INFO:tasks.workunit.client.0.smithi002.stdout:0/823: write d0/d6/d26/d14/f9f [846793,130816] 0 2023-12-17T11:57:57.440 INFO:tasks.workunit.client.1.smithi119.stdout:9/877: creat d12/d1d/d28/d46/d50/d92/daf/deb/f11e x:0 0 0 2023-12-17T11:57:57.440 INFO:tasks.workunit.client.1.smithi119.stdout:9/878: chown d12/d1d/d28/d46/dea/c110 0 1 2023-12-17T11:57:57.440 INFO:tasks.workunit.client.1.smithi119.stdout:9/879: readlink d12/d1d/d28/d46/d50/d92/dcc/l116 0 2023-12-17T11:57:57.441 INFO:tasks.workunit.client.1.smithi119.stdout:4/840: dwrite dd/d15/d4f/fbb [0,4194304] 0 2023-12-17T11:57:57.444 INFO:tasks.workunit.client.1.smithi119.stdout:0/825: creat d2/d66/d2e/ff8 x:0 0 0 2023-12-17T11:57:57.446 INFO:tasks.workunit.client.0.smithi002.stdout:1/874: dread d3/d6/f84 [0,4194304] 0 2023-12-17T11:57:57.446 INFO:tasks.workunit.client.0.smithi002.stdout:1/875: chown d3/d2f/d4d/d95/fc0 0 1 2023-12-17T11:57:57.446 INFO:tasks.workunit.client.0.smithi002.stdout:1/876: dread - d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/f105 zero size 2023-12-17T11:57:57.446 INFO:tasks.workunit.client.0.smithi002.stdout:1/877: write d3/d6/d16/f7a [1551978,51451] 0 2023-12-17T11:57:57.448 INFO:tasks.workunit.client.1.smithi119.stdout:1/826: mknod d3/d44/d89/d120/c132 0 2023-12-17T11:57:57.448 INFO:tasks.workunit.client.1.smithi119.stdout:1/827: chown d3/db/d2a/d127/d7e/ff6 644 1 2023-12-17T11:57:57.448 INFO:tasks.workunit.client.1.smithi119.stdout:1/828: fdatasync d3/db/d17/d24/d20/d40/f41 0 2023-12-17T11:57:57.452 INFO:tasks.workunit.client.1.smithi119.stdout:9/880: dread d12/d1d/d49/f5b [0,4194304] 0 2023-12-17T11:57:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:3/877: dwrite d9/f1d [0,4194304] 0 2023-12-17T11:57:57.454 INFO:tasks.workunit.client.0.smithi002.stdout:3/878: read - d9/d1b/d35/d41/d59/d65/f87 zero size 2023-12-17T11:57:57.456 INFO:tasks.workunit.client.0.smithi002.stdout:4/784: rename d0/d3e/d56/d65/d78/d85/da3/ca6 to d0/d3e/d47/cff 0 2023-12-17T11:57:57.458 INFO:tasks.workunit.client.1.smithi119.stdout:4/841: write dd/d11/d26/f9f [2007447,96971] 0 2023-12-17T11:57:57.458 INFO:tasks.workunit.client.1.smithi119.stdout:3/883: dwrite d9/d44/d8c/fad [0,4194304] 0 2023-12-17T11:57:57.459 INFO:tasks.workunit.client.1.smithi119.stdout:0/826: creat d2/d66/d2e/d44/d7b/dbc/df4/ff9 x:0 0 0 2023-12-17T11:57:57.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/834: symlink d3/d4/d7/d14/d42/l125 0 2023-12-17T11:57:57.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/835: read - d3/d4/d7/d14/d34/dde/f11c zero size 2023-12-17T11:57:57.461 INFO:tasks.workunit.client.0.smithi002.stdout:2/836: readlink d3/d4/d7/d14/d34/l49 0 2023-12-17T11:57:57.463 INFO:tasks.workunit.client.1.smithi119.stdout:1/829: unlink d3/db/d26/d19/c3b 0 2023-12-17T11:57:57.463 INFO:tasks.workunit.client.1.smithi119.stdout:1/830: dread - d3/db/d17/d24/d20/d40/d76/d84/d119/f122 zero size 2023-12-17T11:57:57.464 INFO:tasks.workunit.client.0.smithi002.stdout:2/837: write d3/d4/d7/d14/d1b/d5b/f63 [21263,4843] 0 2023-12-17T11:57:57.464 INFO:tasks.workunit.client.0.smithi002.stdout:2/838: truncate d3/d4/dbc/f123 144278 0 2023-12-17T11:57:57.464 INFO:tasks.workunit.client.0.smithi002.stdout:0/824: mkdir d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c 0 2023-12-17T11:57:57.465 INFO:tasks.workunit.client.1.smithi119.stdout:9/881: rename d12/d1d/d28/d46/dbb/f119 to d12/d1d/d28/d46/dc0/f11f 0 2023-12-17T11:57:57.465 INFO:tasks.workunit.client.1.smithi119.stdout:9/882: fdatasync d12/d1d/d28/d46/d50/d92/daf/deb/f11e 0 2023-12-17T11:57:57.469 INFO:tasks.workunit.client.1.smithi119.stdout:8/748: dwrite d7/d18/d45/d9e/fbd [0,4194304] 0 2023-12-17T11:57:57.469 INFO:tasks.workunit.client.1.smithi119.stdout:2/939: dwrite d6/d9/f60 [0,4194304] 0 2023-12-17T11:57:57.469 INFO:tasks.workunit.client.1.smithi119.stdout:2/940: fdatasync d6/d9/d52/d53/d55/daf/d12e/d13c/d5b/f6f 0 2023-12-17T11:57:57.469 INFO:tasks.workunit.client.1.smithi119.stdout:2/941: write d6/d2b/d4b/d5d/f7e [1725799,92642] 0 2023-12-17T11:57:57.475 INFO:tasks.workunit.client.1.smithi119.stdout:4/842: link dd/d15/d16/d3d/f84 dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/f107 0 2023-12-17T11:57:57.475 INFO:tasks.workunit.client.1.smithi119.stdout:4/843: write dd/d11/d2d/d9c/d55/fb7 [5080759,932] 0 2023-12-17T11:57:57.476 INFO:tasks.workunit.client.0.smithi002.stdout:3/879: read d9/d24/fa8 [1385594,130363] 0 2023-12-17T11:57:57.477 INFO:tasks.workunit.client.1.smithi119.stdout:3/884: mknod d9/da/c147 0 2023-12-17T11:57:57.477 INFO:tasks.workunit.client.1.smithi119.stdout:3/885: chown d9/da/c147 51369573 1 2023-12-17T11:57:57.479 INFO:tasks.workunit.client.1.smithi119.stdout:0/827: symlink d2/d66/d1f/d24/lfa 0 2023-12-17T11:57:57.485 INFO:tasks.workunit.client.1.smithi119.stdout:9/883: creat d12/d1d/d28/d4d/d73/f120 x:0 0 0 2023-12-17T11:57:57.485 INFO:tasks.workunit.client.1.smithi119.stdout:9/884: stat d12/d1d/d28/d46/d50/d92/daf/deb/f11e 0 2023-12-17T11:57:57.494 INFO:tasks.workunit.client.1.smithi119.stdout:8/749: link d7/da/d1a/d84/ca1 d7/d18/d45/d9f/d75/cef 0 2023-12-17T11:57:57.497 INFO:tasks.workunit.client.1.smithi119.stdout:2/942: creat d6/d2b/da3/f140 x:0 0 0 2023-12-17T11:57:57.498 INFO:tasks.workunit.client.0.smithi002.stdout:4/785: symlink d0/d10/l100 0 2023-12-17T11:57:57.499 INFO:tasks.workunit.client.0.smithi002.stdout:4/786: chown d0/d10/d21/d33 5740659 1 2023-12-17T11:57:57.500 INFO:tasks.workunit.client.0.smithi002.stdout:2/839: symlink d3/d4/d7/d14/d2e/d37/dce/l126 0 2023-12-17T11:57:57.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/880: link d9/d24/f25 d9/d1b/d35/d41/d59/d7c/f117 0 2023-12-17T11:57:57.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/881: fsync d9/d15/d71/fee 0 2023-12-17T11:57:57.503 INFO:tasks.workunit.client.0.smithi002.stdout:3/882: write d9/d15/d6a/ffe [1342971,66296] 0 2023-12-17T11:57:57.503 INFO:tasks.workunit.client.1.smithi119.stdout:3/886: getdents d9/d11/d1e/d55 0 2023-12-17T11:57:57.503 INFO:tasks.workunit.client.1.smithi119.stdout:3/887: write d9/da/df/d67/f89 [2700845,94843] 0 2023-12-17T11:57:57.507 INFO:tasks.workunit.client.1.smithi119.stdout:0/828: link d2/d66/d1f/d24/d50/c51 d2/d66/d2e/d44/d7b/d5/dc/d7f/cfb 0 2023-12-17T11:57:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:4/787: write d0/d10/f31 [2849347,86000] 0 2023-12-17T11:57:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:4/788: truncate d0/f8a 1556353 0 2023-12-17T11:57:57.511 INFO:tasks.workunit.client.0.smithi002.stdout:4/789: stat d0/d10/d14/d4e/fbb 0 2023-12-17T11:57:57.511 INFO:tasks.workunit.client.1.smithi119.stdout:1/831: getdents d3/d44/dfd/d64 0 2023-12-17T11:57:57.516 INFO:tasks.workunit.client.1.smithi119.stdout:9/885: link d12/d1d/f9e d12/d1d/d28/d4d/d73/d78/d8b/da0/f121 0 2023-12-17T11:57:57.516 INFO:tasks.workunit.client.1.smithi119.stdout:9/886: chown d12/d1d/d28/d46/d50/d92/dae/fb5 495 1 2023-12-17T11:57:57.519 INFO:tasks.workunit.client.0.smithi002.stdout:6/840: rename d0/d1/d21/d56/d8c/d93 to d0/d1/d6d/d83/d113 0 2023-12-17T11:57:57.520 INFO:tasks.workunit.client.1.smithi119.stdout:8/750: truncate d7/d18/f4f 2408715 0 2023-12-17T11:57:57.520 INFO:tasks.workunit.client.1.smithi119.stdout:8/751: chown d7/d12/d69/d98 21481 1 2023-12-17T11:57:57.521 INFO:tasks.workunit.client.1.smithi119.stdout:8/752: creat d7/d12/d69/d98/ff0 x:0 0 0 2023-12-17T11:57:57.523 INFO:tasks.workunit.client.1.smithi119.stdout:2/943: symlink d6/d9/d86/db0/l141 0 2023-12-17T11:57:57.523 INFO:tasks.workunit.client.1.smithi119.stdout:2/944: write d6/d38/f134 [589360,123801] 0 2023-12-17T11:57:57.523 INFO:tasks.workunit.client.1.smithi119.stdout:2/945: write d6/d2b/f117 [599306,50917] 0 2023-12-17T11:57:57.523 INFO:tasks.workunit.client.1.smithi119.stdout:2/946: read - d6/d2b/da3/f140 zero size 2023-12-17T11:57:57.523 INFO:tasks.workunit.client.1.smithi119.stdout:2/947: write d6/d9/d52/d5a/fce [572414,49578] 0 2023-12-17T11:57:57.524 INFO:tasks.workunit.client.0.smithi002.stdout:3/883: symlink d9/d1b/l118 0 2023-12-17T11:57:57.528 INFO:tasks.workunit.client.1.smithi119.stdout:4/844: rmdir dd/d11/d26/d86 39 2023-12-17T11:57:57.531 INFO:tasks.workunit.client.0.smithi002.stdout:4/790: creat d0/d3e/f101 x:0 0 0 2023-12-17T11:57:57.536 INFO:tasks.workunit.client.0.smithi002.stdout:8/918: rename d3/d7/d18/d3f/f60 to d3/d7/d18/d74/d7b/d11c/f13e 0 2023-12-17T11:57:57.537 INFO:tasks.workunit.client.1.smithi119.stdout:0/829: truncate d2/f6b 3931356 0 2023-12-17T11:57:57.545 INFO:tasks.workunit.client.0.smithi002.stdout:4/791: mknod d0/d3e/d56/d65/d78/d85/c102 0 2023-12-17T11:57:57.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/816: rename d6/d17/dc/d13/d3e/lde to d6/d17/dc/d13/d21/d2e/dd5/lf7 0 2023-12-17T11:57:57.550 INFO:tasks.workunit.client.0.smithi002.stdout:7/817: fsync d6/d17/dc/d13/d37/d4f/f9d 0 2023-12-17T11:57:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:9/953: rename dc/f21 to dc/d1d/d7c/d90/f155 0 2023-12-17T11:57:57.553 INFO:tasks.workunit.client.0.smithi002.stdout:9/954: chown dc/d42/d4f/dd5/c139 902 1 2023-12-17T11:57:57.554 INFO:tasks.workunit.client.0.smithi002.stdout:7/818: link d6/l58 d6/d17/dc/d67/lf8 0 2023-12-17T11:57:57.556 INFO:tasks.workunit.client.0.smithi002.stdout:4/792: dread d0/f6f [0,4194304] 0 2023-12-17T11:57:57.560 INFO:tasks.workunit.client.0.smithi002.stdout:9/955: getdents dc/d42/da0/d72/d93/dd0 0 2023-12-17T11:57:57.560 INFO:tasks.workunit.client.0.smithi002.stdout:1/878: rename d3/d2f/d74/d97/lb7 to d3/d2f/d74/dbe/l11b 0 2023-12-17T11:57:57.561 INFO:tasks.workunit.client.0.smithi002.stdout:1/879: creat d3/d2f/d4d/d95/d100/f11c x:0 0 0 2023-12-17T11:57:57.565 INFO:tasks.workunit.client.1.smithi119.stdout:1/832: symlink d3/db/d17/d24/d20/l133 0 2023-12-17T11:57:57.571 INFO:tasks.workunit.client.0.smithi002.stdout:9/956: link dc/d1d/d25/d85/dc2/ddd/dfa/d47/d4b/c151 dc/d42/d4f/d140/c156 0 2023-12-17T11:57:57.571 INFO:tasks.workunit.client.0.smithi002.stdout:9/957: chown dc/d42/f55 2127034640 1 2023-12-17T11:57:57.576 INFO:tasks.workunit.client.0.smithi002.stdout:0/825: rename d0/d6/d26/d14/d90/d64/ld1 to d0/d6/d26/df2/l10d 0 2023-12-17T11:57:57.576 INFO:tasks.workunit.client.0.smithi002.stdout:0/826: chown d0/d15/cbe 1856 1 2023-12-17T11:57:57.576 INFO:tasks.workunit.client.0.smithi002.stdout:3/884: dwrite d9/d1b/d35/d41/d59/d72/ff6 [0,4194304] 0 2023-12-17T11:57:57.576 INFO:tasks.workunit.client.0.smithi002.stdout:0/827: chown d0/d6/d26/d14/d19/d61 792 1 2023-12-17T11:57:57.579 INFO:tasks.workunit.client.1.smithi119.stdout:8/753: rename d7/d12/d69/d98/l9b to d7/da/d1a/d8a/ddb/dbf/lf1 0 2023-12-17T11:57:57.579 INFO:tasks.workunit.client.1.smithi119.stdout:8/754: write d7/d18/d15/d81/f8f [421725,50401] 0 2023-12-17T11:57:57.585 INFO:tasks.workunit.client.0.smithi002.stdout:1/880: unlink d3/d2f/d74/dbd/f78 0 2023-12-17T11:57:57.585 INFO:tasks.workunit.client.0.smithi002.stdout:1/881: fsync d3/d6/d9/d37/d39/d43/d4a/f111 0 2023-12-17T11:57:57.586 INFO:tasks.workunit.client.1.smithi119.stdout:2/948: write d6/d9/f20 [714179,39936] 0 2023-12-17T11:57:57.587 INFO:tasks.workunit.client.0.smithi002.stdout:6/841: dwrite d0/d1/d21/d56/d8c/fdd [0,4194304] 0 2023-12-17T11:57:57.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/919: dwrite d3/d7/d1a/ff5 [0,4194304] 0 2023-12-17T11:57:57.587 INFO:tasks.workunit.client.0.smithi002.stdout:8/920: chown d3/d7/d18/d74/d125/d90/cb6 50 1 2023-12-17T11:57:57.587 INFO:tasks.workunit.client.0.smithi002.stdout:6/842: truncate d0/d1/dc/d58/dae/ddb/fd0 4786210 0 2023-12-17T11:57:57.588 INFO:tasks.workunit.client.0.smithi002.stdout:6/843: write d0/d1/d6d/d83/d113/da5/fa6 [907821,72717] 0 2023-12-17T11:57:57.594 INFO:tasks.workunit.client.1.smithi119.stdout:1/833: creat d3/db/d106/f134 x:0 0 0 2023-12-17T11:57:57.596 INFO:tasks.workunit.client.0.smithi002.stdout:9/958: mkdir dc/d42/da0/d72/d93/dd0/dd4/df1/d157 0 2023-12-17T11:57:57.596 INFO:tasks.workunit.client.0.smithi002.stdout:3/885: mknod d9/d15/d52/d79/dd1/dd5/c119 0 2023-12-17T11:57:57.599 INFO:tasks.workunit.client.0.smithi002.stdout:1/882: link d3/d6/d16/d9f/c88 d3/d6/c11d 0 2023-12-17T11:57:57.603 INFO:tasks.workunit.client.1.smithi119.stdout:8/755: rename d7/da/d11/d26/f71 to d7/d12/ff2 0 2023-12-17T11:57:57.603 INFO:tasks.workunit.client.0.smithi002.stdout:7/819: dwrite d6/d17/dc/d67/f87 [0,4194304] 0 2023-12-17T11:57:57.605 INFO:tasks.workunit.client.1.smithi119.stdout:9/887: dwrite d12/fe3 [0,4194304] 0 2023-12-17T11:57:57.605 INFO:tasks.workunit.client.1.smithi119.stdout:9/888: readlink d12/d1d/d28/d4d/l7f 0 2023-12-17T11:57:57.606 INFO:tasks.workunit.client.1.smithi119.stdout:4/845: getdents dd/d15/d16/d5a/dbc 0 2023-12-17T11:57:57.606 INFO:tasks.workunit.client.1.smithi119.stdout:4/846: write dd/d11/d2d/d9c/d55/d81/db8/d78/fe8 [440223,106204] 0 2023-12-17T11:57:57.607 INFO:tasks.workunit.client.1.smithi119.stdout:4/847: write dd/f28 [5876207,109704] 0 2023-12-17T11:57:57.609 INFO:tasks.workunit.client.0.smithi002.stdout:8/921: dread d3/d7/d18/d74/d7b/d11c/db4/d117/f5f [0,4194304] 0 2023-12-17T11:57:57.609 INFO:tasks.workunit.client.1.smithi119.stdout:1/834: truncate d3/db/d17/d24/d20/d40/fdd 497043 0 2023-12-17T11:57:57.609 INFO:tasks.workunit.client.1.smithi119.stdout:1/835: write d3/db/d17/d24/f2e [3331337,25896] 0 2023-12-17T11:57:57.613 INFO:tasks.workunit.client.1.smithi119.stdout:8/756: mknod d7/d12/d23/cf3 0 2023-12-17T11:57:57.617 INFO:tasks.workunit.client.0.smithi002.stdout:9/959: link dc/fbc dc/d1d/d25/d85/dc2/d91/f158 0 2023-12-17T11:57:57.617 INFO:tasks.workunit.client.0.smithi002.stdout:3/886: rmdir d9/d24/d6f 39 2023-12-17T11:57:57.617 INFO:tasks.workunit.client.0.smithi002.stdout:3/887: write d9/d1b/d35/d41/d59/fef [1089779,103226] 0 2023-12-17T11:57:57.618 INFO:tasks.workunit.client.0.smithi002.stdout:3/888: creat d9/d1b/d35/df3/df8/f11a x:0 0 0 2023-12-17T11:57:57.626 INFO:tasks.workunit.client.1.smithi119.stdout:9/889: rmdir d12/d1d/d28/d46/d50/d92/dae/d11b 0 2023-12-17T11:57:57.628 INFO:tasks.workunit.client.0.smithi002.stdout:3/889: dread d9/d15/d52/ff2 [0,4194304] 0 2023-12-17T11:57:57.636 INFO:tasks.workunit.client.0.smithi002.stdout:5/842: sync 2023-12-17T11:57:57.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/793: dread d0/d3e/d56/f7c [0,4194304] 0 2023-12-17T11:57:57.638 INFO:tasks.workunit.client.0.smithi002.stdout:4/794: creat d0/d10/d14/d27/d57/d7d/f103 x:0 0 0 2023-12-17T11:57:57.641 INFO:tasks.workunit.client.0.smithi002.stdout:3/890: dread d9/d1b/d35/d41/d43/d4b/f57 [0,4194304] 0 2023-12-17T11:57:57.641 INFO:tasks.workunit.client.0.smithi002.stdout:2/840: dwrite d3/d4/d7/d14/d1b/d5b/f79 [0,4194304] 0 2023-12-17T11:57:57.645 INFO:tasks.workunit.client.0.smithi002.stdout:8/922: dread d3/d8/f11b [0,4194304] 0 2023-12-17T11:57:57.645 INFO:tasks.workunit.client.0.smithi002.stdout:6/844: symlink d0/d1/l114 0 2023-12-17T11:57:57.650 INFO:tasks.workunit.client.1.smithi119.stdout:2/949: dwrite d6/d9/d13/d1d/f37 [4194304,4194304] 0 2023-12-17T11:57:57.657 INFO:tasks.workunit.client.0.smithi002.stdout:4/795: write d0/d10/f39 [6158242,111389] 0 2023-12-17T11:57:57.657 INFO:tasks.workunit.client.0.smithi002.stdout:4/796: write d0/d10/d14/d27/d57/d7d/fb7 [237710,108336] 0 2023-12-17T11:57:57.657 INFO:tasks.workunit.client.0.smithi002.stdout:4/797: stat d0/d10/d14/f70 0 2023-12-17T11:57:57.660 INFO:tasks.workunit.client.1.smithi119.stdout:9/890: dread d12/dca/dbd/fc2 [0,4194304] 0 2023-12-17T11:57:57.662 INFO:tasks.workunit.client.0.smithi002.stdout:9/960: read dc/d1d/d25/d85/dc2/d91/db2/dbf/fc5 [680136,50510] 0 2023-12-17T11:57:57.662 INFO:tasks.workunit.client.0.smithi002.stdout:5/843: truncate dc/d17/d2f/d99/f9d 380140 0 2023-12-17T11:57:57.666 INFO:tasks.workunit.client.0.smithi002.stdout:2/841: symlink d3/l127 0 2023-12-17T11:57:57.668 INFO:tasks.workunit.client.0.smithi002.stdout:8/923: rmdir d3/dca 39 2023-12-17T11:57:57.670 INFO:tasks.workunit.client.0.smithi002.stdout:6/845: truncate d0/d1/dc/d17/d67/d6c/f80 121546 0 2023-12-17T11:57:57.672 INFO:tasks.workunit.client.1.smithi119.stdout:2/950: rename d6/d2b/d4b to d6/d2b/da3/d142 0 2023-12-17T11:57:57.674 INFO:tasks.workunit.client.0.smithi002.stdout:4/798: creat d0/d3e/dc8/dca/f104 x:0 0 0 2023-12-17T11:57:57.675 INFO:tasks.workunit.client.1.smithi119.stdout:9/891: getdents d12/d1d/d28/d46/d50 0 2023-12-17T11:57:57.677 INFO:tasks.workunit.client.0.smithi002.stdout:9/961: mkdir dc/d42/d4f/d140/d159 0 2023-12-17T11:57:57.680 INFO:tasks.workunit.client.1.smithi119.stdout:4/848: dwrite dd/d11/d2d/d9c/d55/d81/db8/d78/f89 [4194304,4194304] 0 2023-12-17T11:57:57.681 INFO:tasks.workunit.client.1.smithi119.stdout:8/757: dwrite d7/fb [0,4194304] 0 2023-12-17T11:57:57.682 INFO:tasks.workunit.client.0.smithi002.stdout:0/828: dwrite d0/d6/d26/d14/d19/d37/d91/dae/fb5 [0,4194304] 0 2023-12-17T11:57:57.684 INFO:tasks.workunit.client.0.smithi002.stdout:6/846: dread d0/d1/dc/d17/f79 [0,4194304] 0 2023-12-17T11:57:57.684 INFO:tasks.workunit.client.0.smithi002.stdout:6/847: write d0/d1/dc/d58/dae/ddb/dc6/ff6 [559230,105968] 0 2023-12-17T11:57:57.684 INFO:tasks.workunit.client.0.smithi002.stdout:6/848: creat d0/d1/dc/d17/d4c/f115 x:0 0 0 2023-12-17T11:57:57.684 INFO:tasks.workunit.client.0.smithi002.stdout:6/849: write d0/d1/dc/d17/dd6/d10c/dfe/f10b [4426064,88260] 0 2023-12-17T11:57:57.684 INFO:tasks.workunit.client.0.smithi002.stdout:6/850: fsync d0/d1/dc/d10/f86 0 2023-12-17T11:57:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:3/891: getdents d9/d15/d71 0 2023-12-17T11:57:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:8/924: symlink d3/d7/d18/d3f/l13f 0 2023-12-17T11:57:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:8/925: chown d3/d7/d18/d3f/f127 1953903755 1 2023-12-17T11:57:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:8/926: chown d3/d7/d18/d74/d7b/d11c/d7c 3672150 1 2023-12-17T11:57:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:4/799: truncate d0/d10/f94 1584886 0 2023-12-17T11:57:57.685 INFO:tasks.workunit.client.0.smithi002.stdout:4/800: read - d0/d6c/dda/de1/fe5 zero size 2023-12-17T11:57:57.690 INFO:tasks.workunit.client.0.smithi002.stdout:9/962: rename dc/d42/da0/d72/d93/d76/l12c to dc/d42/da0/d72/d93/dd0/dd4/df1/d157/l15a 0 2023-12-17T11:57:57.690 INFO:tasks.workunit.client.0.smithi002.stdout:9/963: chown dc/d1d/d25/d85/dc2/ddd/dfa/f33 119080 1 2023-12-17T11:57:57.692 INFO:tasks.workunit.client.1.smithi119.stdout:4/849: mkdir dd/d11/d2d/d9c/d55/d81/d88/d91/d108 0 2023-12-17T11:57:57.692 INFO:tasks.workunit.client.0.smithi002.stdout:5/844: write dc/d94/ded/d2d/d5b/f8a [1631571,98261] 0 2023-12-17T11:57:57.694 INFO:tasks.workunit.client.0.smithi002.stdout:1/883: dwrite d3/d6/d9/d37/d39/d43/fa4 [0,4194304] 0 2023-12-17T11:57:57.698 INFO:tasks.workunit.client.1.smithi119.stdout:4/850: rename dd/d4b/l8b to dd/d15/d16/d20/l109 0 2023-12-17T11:57:57.701 INFO:tasks.workunit.client.0.smithi002.stdout:5/845: dread dc/d1a/f46 [0,4194304] 0 2023-12-17T11:57:57.709 INFO:tasks.workunit.client.0.smithi002.stdout:2/842: dwrite d3/d4/d7/d14/d1b/d5b/de3/f116 [0,4194304] 0 2023-12-17T11:57:57.709 INFO:tasks.workunit.client.0.smithi002.stdout:2/843: fdatasync d3/d50/fc0 0 2023-12-17T11:57:57.753 INFO:tasks.workunit.client.1.smithi119.stdout:2/951: dwrite d6/d9/d13/d34/d56/f10a [0,4194304] 0 2023-12-17T11:57:57.753 INFO:tasks.workunit.client.1.smithi119.stdout:2/952: readlink d6/d2b/da3/d142/l13a 0 2023-12-17T11:57:57.756 INFO:tasks.workunit.client.1.smithi119.stdout:4/851: dwrite dd/d11/d2d/d9c/d55/d81/d88/d91/fae [0,4194304] 0 2023-12-17T11:57:57.756 INFO:tasks.workunit.client.1.smithi119.stdout:4/852: readlink dd/d15/d16/d20/l109 0 2023-12-17T11:57:57.756 INFO:tasks.workunit.client.1.smithi119.stdout:4/853: chown dd/d15/d16/d5a/fcf 193289428 1 2023-12-17T11:57:57.756 INFO:tasks.workunit.client.0.smithi002.stdout:0/829: unlink d0/l9e 0 2023-12-17T11:57:57.758 INFO:tasks.workunit.client.1.smithi119.stdout:9/892: dread d12/d1d/d28/d4d/f5e [0,4194304] 0 2023-12-17T11:57:57.762 INFO:tasks.workunit.client.0.smithi002.stdout:6/851: truncate d0/d1/dc/d58/dae/ddb/dc6/f107 1610198 0 2023-12-17T11:57:57.762 INFO:tasks.workunit.client.0.smithi002.stdout:6/852: chown d0/d1/d21/d56 210487 1 2023-12-17T11:57:57.766 INFO:tasks.workunit.client.0.smithi002.stdout:8/927: mknod d3/d8/c140 0 2023-12-17T11:57:57.770 INFO:tasks.workunit.client.0.smithi002.stdout:4/801: link d0/d3e/d56/l87 d0/d3e/l105 0 2023-12-17T11:57:57.771 INFO:tasks.workunit.client.1.smithi119.stdout:2/953: write d6/d9/d13/d34/d56/f10e [3918687,127488] 0 2023-12-17T11:57:57.771 INFO:tasks.workunit.client.1.smithi119.stdout:2/954: fsync d6/d9/d52/d53/d55/daf/d12e/d13c/d5b/f6f 0 2023-12-17T11:57:57.771 INFO:tasks.workunit.client.1.smithi119.stdout:2/955: dread - d6/d9/d52/d53/d55/d58/d6b/f111 zero size 2023-12-17T11:57:57.773 INFO:tasks.workunit.client.1.smithi119.stdout:4/854: mknod dd/d11/d2d/d9c/d55/d81/db8/dbd/c10a 0 2023-12-17T11:57:57.775 INFO:tasks.workunit.client.1.smithi119.stdout:9/893: read d12/d1d/d28/d4d/d73/d78/fa9 [2793818,27637] 0 2023-12-17T11:57:57.775 INFO:tasks.workunit.client.1.smithi119.stdout:9/894: truncate d12/dca/fce 963818 0 2023-12-17T11:57:57.777 INFO:tasks.workunit.client.0.smithi002.stdout:3/892: dwrite d9/d1b/d35/d41/d43/f97 [0,4194304] 0 2023-12-17T11:57:57.778 INFO:tasks.workunit.client.0.smithi002.stdout:3/893: chown d9/d1b/d35/d41/d59/d7c/d109 97202 1 2023-12-17T11:57:57.778 INFO:tasks.workunit.client.0.smithi002.stdout:3/894: chown d9/d1b/d4f/d88/fb3 343 1 2023-12-17T11:57:57.778 INFO:tasks.workunit.client.0.smithi002.stdout:9/964: creat dc/d42/d4f/d9e/de2/f15b x:0 0 0 2023-12-17T11:57:57.783 INFO:tasks.workunit.client.0.smithi002.stdout:1/884: creat d3/d6/d9/d37/f11e x:0 0 0 2023-12-17T11:57:57.783 INFO:tasks.workunit.client.0.smithi002.stdout:1/885: dread - d3/d6/d9/d37/d39/d43/d8f/f118 zero size 2023-12-17T11:57:57.786 INFO:tasks.workunit.client.1.smithi119.stdout:9/895: link d12/f17 d12/d1d/d28/d46/dea/f122 0 2023-12-17T11:57:57.788 INFO:tasks.workunit.client.0.smithi002.stdout:5/846: creat dc/d94/ded/d2d/f12b x:0 0 0 2023-12-17T11:57:57.788 INFO:tasks.workunit.client.0.smithi002.stdout:5/847: chown dc/d94/ff9 9184735 1 2023-12-17T11:57:57.788 INFO:tasks.workunit.client.0.smithi002.stdout:5/848: stat dc/l1d 0 2023-12-17T11:57:57.798 INFO:tasks.workunit.client.1.smithi119.stdout:6/769: sync 2023-12-17T11:57:57.798 INFO:tasks.workunit.client.1.smithi119.stdout:6/770: chown d2/d2b/l6b 6807 1 2023-12-17T11:57:57.804 INFO:tasks.workunit.client.1.smithi119.stdout:9/896: write d12/d1d/d28/d46/d6e/fb6 [3966692,47584] 0 2023-12-17T11:57:57.804 INFO:tasks.workunit.client.1.smithi119.stdout:6/771: mknod d2/d41/cef 0 2023-12-17T11:57:57.804 INFO:tasks.workunit.client.0.smithi002.stdout:2/844: getdents d3/d4/d7/d14/d1b/d5b 0 2023-12-17T11:57:57.804 INFO:tasks.workunit.client.0.smithi002.stdout:0/830: link d0/d6/d26/f35 d0/d6/d26/d14/f10e 0 2023-12-17T11:57:57.807 INFO:tasks.workunit.client.0.smithi002.stdout:6/853: mkdir d0/d1/d6d/d83/d113/d116 0 2023-12-17T11:57:57.809 INFO:tasks.workunit.client.1.smithi119.stdout:9/897: symlink d12/d1d/l123 0 2023-12-17T11:57:57.814 INFO:tasks.workunit.client.0.smithi002.stdout:4/802: dwrite d0/d10/f11 [0,4194304] 0 2023-12-17T11:57:57.814 INFO:tasks.workunit.client.0.smithi002.stdout:4/803: write d0/f19 [1467198,23042] 0 2023-12-17T11:57:57.814 INFO:tasks.workunit.client.1.smithi119.stdout:6/772: getdents d2/d2b/d43/d5e/d92/da8 0 2023-12-17T11:57:57.823 INFO:tasks.workunit.client.1.smithi119.stdout:8/758: dwrite d7/da/d1a/f66 [0,4194304] 0 2023-12-17T11:57:57.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/831: write d0/d6/d26/d14/d19/d61/de3/f46 [1199653,2979] 0 2023-12-17T11:57:57.829 INFO:tasks.workunit.client.0.smithi002.stdout:9/965: creat dc/d42/da0/d82/d118/f15c x:0 0 0 2023-12-17T11:57:57.829 INFO:tasks.workunit.client.0.smithi002.stdout:1/886: rename d3/f83 to d3/d6/d16/d28/f11f 0 2023-12-17T11:57:57.829 INFO:tasks.workunit.client.0.smithi002.stdout:0/832: readlink d0/d6/d26/d14/d19/d37/dcf/l43 0 2023-12-17T11:57:57.829 INFO:tasks.workunit.client.0.smithi002.stdout:6/854: unlink d0/d1/d6d/d83/d113/da5/dbc/fcc 0 2023-12-17T11:57:57.829 INFO:tasks.workunit.client.0.smithi002.stdout:6/855: read d0/d1/dc/d17/d3c/fa3 [1798619,129138] 0 2023-12-17T11:57:57.830 INFO:tasks.workunit.client.0.smithi002.stdout:6/856: chown d0/d1/dc/d17/d67/d6c/f80 183184 1 2023-12-17T11:57:57.830 INFO:tasks.workunit.client.0.smithi002.stdout:6/857: creat d0/d1/d21/d56/d8c/f117 x:0 0 0 2023-12-17T11:57:57.830 INFO:tasks.workunit.client.0.smithi002.stdout:6/858: chown d0/d1/d5b/dda/f10a 263629916 1 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/849: dwrite dc/d94/ded/dad/f102 [0,4194304] 0 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/850: fdatasync dc/d17/d2f/d99/d108/f122 0 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/851: dread - dc/d1a/d53/da9/f129 zero size 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/852: write dc/d94/ded/d2d/f56 [4357434,76834] 0 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/853: write dc/d94/ded/d75/f88 [563376,49682] 0 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/854: chown dc/l27 140672 1 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:5/855: chown dc/d1a/l24 22918 1 2023-12-17T11:57:57.836 INFO:tasks.workunit.client.0.smithi002.stdout:4/804: creat d0/d10/d14/f106 x:0 0 0 2023-12-17T11:57:57.837 INFO:tasks.workunit.client.1.smithi119.stdout:8/759: mknod d7/da/d11/d26/d49/cf4 0 2023-12-17T11:57:57.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/859: dread d0/d1/d6d/d83/d113/da5/fa6 [0,4194304] 0 2023-12-17T11:57:57.837 INFO:tasks.workunit.client.0.smithi002.stdout:6/860: fdatasync d0/d1/dc/d17/d40/f5f 0 2023-12-17T11:57:57.838 INFO:tasks.workunit.client.0.smithi002.stdout:9/966: getdents dc/d42/d4f/d9e 0 2023-12-17T11:57:57.838 INFO:tasks.workunit.client.1.smithi119.stdout:6/773: dread d2/f26 [0,4194304] 0 2023-12-17T11:57:57.839 INFO:tasks.workunit.client.1.smithi119.stdout:8/760: mknod d7/d18/d15/d81/cf5 0 2023-12-17T11:57:57.841 INFO:tasks.workunit.client.0.smithi002.stdout:1/887: unlink d3/d6/d16/d61/c64 0 2023-12-17T11:57:57.843 INFO:tasks.workunit.client.1.smithi119.stdout:6/774: symlink d2/d2b/d43/lf0 0 2023-12-17T11:57:57.843 INFO:tasks.workunit.client.1.smithi119.stdout:6/775: truncate d2/d2b/d43/de6/d17/fd8 5183468 0 2023-12-17T11:57:57.846 INFO:tasks.workunit.client.0.smithi002.stdout:0/833: rename d0/d6/d26/d14/d19/d37/d91/dae/le5 to d0/d6/d26/d14/d19/d37/d62/db8/l10f 0 2023-12-17T11:57:57.849 INFO:tasks.workunit.client.1.smithi119.stdout:6/776: creat d2/d9b/ff1 x:0 0 0 2023-12-17T11:57:57.856 INFO:tasks.workunit.client.1.smithi119.stdout:9/898: dwrite d12/d1d/d28/d46/f59 [0,4194304] 0 2023-12-17T11:57:57.857 INFO:tasks.workunit.client.0.smithi002.stdout:4/805: mknod d0/d10/d21/d33/d96/c107 0 2023-12-17T11:57:57.858 INFO:tasks.workunit.client.0.smithi002.stdout:4/806: fdatasync d0/d10/f25 0 2023-12-17T11:57:57.859 INFO:tasks.workunit.client.1.smithi119.stdout:6/777: rename d2/d9b/f9c to d2/d2b/d43/de6/ff2 0 2023-12-17T11:57:57.859 INFO:tasks.workunit.client.1.smithi119.stdout:9/899: creat d12/d1d/d28/d46/d50/d92/dae/f124 x:0 0 0 2023-12-17T11:57:57.859 INFO:tasks.workunit.client.1.smithi119.stdout:9/900: truncate d12/d65/fa8 783783 0 2023-12-17T11:57:57.861 INFO:tasks.workunit.client.0.smithi002.stdout:7/820: sync 2023-12-17T11:57:57.864 INFO:tasks.workunit.client.0.smithi002.stdout:6/861: chown d0/d1/c18 2076109 1 2023-12-17T11:57:57.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/967: creat dc/d42/d4f/d140/f15d x:0 0 0 2023-12-17T11:57:57.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/968: creat dc/d1d/d7c/d90/de4/f15e x:0 0 0 2023-12-17T11:57:57.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/969: write dc/d42/da0/d72/d93/d76/f94 [835739,7518] 0 2023-12-17T11:57:57.869 INFO:tasks.workunit.client.0.smithi002.stdout:9/970: chown dc/d1d 8694 1 2023-12-17T11:57:57.871 INFO:tasks.workunit.client.1.smithi119.stdout:9/901: symlink d12/d65/d102/l125 0 2023-12-17T11:57:57.883 INFO:tasks.workunit.client.1.smithi119.stdout:6/778: dread d2/d2b/d43/de6/f4b [0,4194304] 0 2023-12-17T11:57:57.884 INFO:tasks.workunit.client.1.smithi119.stdout:9/902: mkdir d12/d1d/d49/ddb/ddd/d126 0 2023-12-17T11:57:57.886 INFO:tasks.workunit.client.0.smithi002.stdout:7/821: creat d6/d99/ff9 x:0 0 0 2023-12-17T11:57:57.888 INFO:tasks.workunit.client.0.smithi002.stdout:2/845: rename d3/d4/d17/l2a to d3/d4/d7/d14/d1b/l128 0 2023-12-17T11:57:57.888 INFO:tasks.workunit.client.0.smithi002.stdout:2/846: truncate d3/d4/d17/d19/d8d/fb7 1029388 0 2023-12-17T11:57:57.888 INFO:tasks.workunit.client.0.smithi002.stdout:2/847: chown d3/d4/d8b/ld6 157426 1 2023-12-17T11:57:57.890 INFO:tasks.workunit.client.0.smithi002.stdout:2/848: read d3/d4/d7/d14/f82 [70429,49905] 0 2023-12-17T11:57:57.892 INFO:tasks.workunit.client.0.smithi002.stdout:7/822: getdents d6/d17/dc/d13/dd8/dd0/dd2 0 2023-12-17T11:57:57.892 INFO:tasks.workunit.client.0.smithi002.stdout:7/823: write d6/d17/dc/d67/d8b/dbd/f78 [2391697,16616] 0 2023-12-17T11:57:57.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/849: read d3/d4/d7/d14/d34/f46 [179260,37773] 0 2023-12-17T11:57:57.892 INFO:tasks.workunit.client.0.smithi002.stdout:2/850: write d3/d4/d17/d19/d4d/d72/d77/da7/fe1 [24423,63213] 0 2023-12-17T11:57:57.895 INFO:tasks.workunit.client.1.smithi119.stdout:9/903: creat d12/d1d/d28/d46/d50/d92/dae/dc9/f127 x:0 0 0 2023-12-17T11:57:57.898 INFO:tasks.workunit.client.0.smithi002.stdout:9/971: write dc/d42/da0/d72/d93/d52/f89 [705707,85966] 0 2023-12-17T11:57:57.901 INFO:tasks.workunit.client.1.smithi119.stdout:4/855: dwrite dd/d11/f14 [0,4194304] 0 2023-12-17T11:57:57.905 INFO:tasks.workunit.client.1.smithi119.stdout:4/856: mknod dd/d15/c10b 0 2023-12-17T11:57:57.905 INFO:tasks.workunit.client.0.smithi002.stdout:2/851: symlink d3/d4/l129 0 2023-12-17T11:57:57.905 INFO:tasks.workunit.client.0.smithi002.stdout:5/856: rename dc/ldb to dc/d94/ded/d5a/d96/l12c 0 2023-12-17T11:57:57.905 INFO:tasks.workunit.client.0.smithi002.stdout:9/972: mkdir dc/d1d/d25/d85/dc2/df8/d15f 0 2023-12-17T11:57:57.907 INFO:tasks.workunit.client.0.smithi002.stdout:6/862: rename d0/d1/d28/dde/d105 to d0/d1/dc/d17/dd6/d10c/d118 0 2023-12-17T11:57:57.908 INFO:tasks.workunit.client.1.smithi119.stdout:9/904: dread d12/d1d/f9e [0,4194304] 0 2023-12-17T11:57:57.908 INFO:tasks.workunit.client.1.smithi119.stdout:9/905: write d12/d1d/d28/d46/d6e/fe6 [120659,72367] 0 2023-12-17T11:57:57.908 INFO:tasks.workunit.client.1.smithi119.stdout:6/779: write d2/d2b/d43/de6/d17/f37 [1334981,42906] 0 2023-12-17T11:57:57.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/888: dwrite d3/d6/d9/f57 [8388608,4194304] 0 2023-12-17T11:57:57.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/889: creat d3/d6/d9/d37/d39/d43/d4a/deb/f120 x:0 0 0 2023-12-17T11:57:57.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/890: fdatasync d3/d6/d9/d37/d39/d43/d8f/fbf 0 2023-12-17T11:57:57.914 INFO:tasks.workunit.client.0.smithi002.stdout:1/891: write d3/d6/d9/d30/f4c [2584728,40884] 0 2023-12-17T11:57:57.917 INFO:tasks.workunit.client.0.smithi002.stdout:7/824: dread d6/d17/dc/d13/d21/f8f [0,4194304] 0 2023-12-17T11:57:57.918 INFO:tasks.workunit.client.0.smithi002.stdout:0/834: dwrite d0/d6/d26/d14/d19/d37/d62/f52 [0,4194304] 0 2023-12-17T11:57:57.921 INFO:tasks.workunit.client.1.smithi119.stdout:4/857: creat dd/d15/d4f/f10c x:0 0 0 2023-12-17T11:57:57.921 INFO:tasks.workunit.client.1.smithi119.stdout:4/858: fdatasync dd/d11/d2d/d9c/d55/d81/d88/d91/fae 0 2023-12-17T11:57:57.922 INFO:tasks.workunit.client.0.smithi002.stdout:6/863: mknod d0/d1/d6d/d83/da2/c119 0 2023-12-17T11:57:57.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/973: write dc/d32/f7a [2167350,27979] 0 2023-12-17T11:57:57.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/974: fsync dc/d42/da0/d72/d93/f29 0 2023-12-17T11:57:57.923 INFO:tasks.workunit.client.0.smithi002.stdout:9/975: dread - dc/d42/d4f/d9e/de2/f15b zero size 2023-12-17T11:57:57.924 INFO:tasks.workunit.client.1.smithi119.stdout:6/780: truncate d2/d2b/d43/de6/d17/f5f 543328 0 2023-12-17T11:57:57.928 INFO:tasks.workunit.client.1.smithi119.stdout:4/859: rename dd/d15/d16/f45 to dd/d11/d2d/d9c/d55/d81/d88/d91/f10d 0 2023-12-17T11:57:57.928 INFO:tasks.workunit.client.1.smithi119.stdout:4/860: truncate f2 744911 0 2023-12-17T11:57:57.928 INFO:tasks.workunit.client.1.smithi119.stdout:4/861: readlink dd/d11/d26/d86/le2 0 2023-12-17T11:57:57.930 INFO:tasks.workunit.client.1.smithi119.stdout:4/862: creat dd/d15/d16/d3d/f10e x:0 0 0 2023-12-17T11:57:57.930 INFO:tasks.workunit.client.1.smithi119.stdout:4/863: chown dd/d15/d16/d20/c6f 3 1 2023-12-17T11:57:57.930 INFO:tasks.workunit.client.1.smithi119.stdout:4/864: chown dd/d11/c17 632878848 1 2023-12-17T11:57:57.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/892: mkdir d3/d2f/d74/dbd/d121 0 2023-12-17T11:57:57.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/893: write d3/d2f/d4d/f5e [960453,57536] 0 2023-12-17T11:57:57.936 INFO:tasks.workunit.client.0.smithi002.stdout:9/976: mknod dc/d42/da0/d72/d93/c160 0 2023-12-17T11:57:57.938 INFO:tasks.workunit.client.0.smithi002.stdout:1/894: mknod d3/d6/d9/d30/d87/c122 0 2023-12-17T11:57:57.938 INFO:tasks.workunit.client.0.smithi002.stdout:1/895: chown d3/d6/d16/d28/f69 102349 1 2023-12-17T11:57:57.938 INFO:tasks.workunit.client.0.smithi002.stdout:1/896: truncate d3/d6/d9/d30/f56 4654018 0 2023-12-17T11:57:57.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/857: rename dc/d17/d2f/d99 to dc/d94/ded/dad/d12d 0 2023-12-17T11:57:57.940 INFO:tasks.workunit.client.0.smithi002.stdout:5/858: fsync dc/d17/f26 0 2023-12-17T11:57:57.940 INFO:tasks.workunit.client.0.smithi002.stdout:9/977: symlink dc/d42/d4f/d140/d159/l161 0 2023-12-17T11:57:57.947 INFO:tasks.workunit.client.0.smithi002.stdout:9/978: mknod dc/d1d/d7c/c162 0 2023-12-17T11:57:57.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/825: rename d6/d17/dc/d13/d21/d6e to d6/d17/dc/d67/d8b/dbd/dce/ddf/dfa 0 2023-12-17T11:57:57.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/826: write d6/d17/dc/d6c/dcb/deb/ff5 [914907,11319] 0 2023-12-17T11:57:57.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/827: creat d6/d17/dc/d13/d21/d2e/dd5/ffb x:0 0 0 2023-12-17T11:57:57.953 INFO:tasks.workunit.client.0.smithi002.stdout:7/828: creat d6/d17/db3/ffc x:0 0 0 2023-12-17T11:57:57.954 INFO:tasks.workunit.client.0.smithi002.stdout:7/829: mkdir d6/d17/dc/d13/dd8/db0/dfd 0 2023-12-17T11:57:57.962 INFO:tasks.workunit.client.1.smithi119.stdout:4/865: write dd/d11/d2d/d9c/d55/d81/da1/fb9 [856322,121625] 0 2023-12-17T11:57:57.963 INFO:tasks.workunit.client.1.smithi119.stdout:4/866: chown dd/d4b/d6a/lc1 14 1 2023-12-17T11:57:57.964 INFO:tasks.workunit.client.1.smithi119.stdout:7/877: sync 2023-12-17T11:57:57.965 INFO:tasks.workunit.client.1.smithi119.stdout:4/867: symlink dd/d15/d16/d3d/dab/l10f 0 2023-12-17T11:57:57.968 INFO:tasks.workunit.client.1.smithi119.stdout:4/868: creat dd/d11/d2d/d9c/d55/d81/db8/d78/dcc/f110 x:0 0 0 2023-12-17T11:57:57.968 INFO:tasks.workunit.client.1.smithi119.stdout:4/869: read - dd/d15/d16/d3d/f10e zero size 2023-12-17T11:57:57.968 INFO:tasks.workunit.client.1.smithi119.stdout:4/870: chown dd/d11/d2d/d9c/d55/d81/f97 54226 1 2023-12-17T11:57:57.969 INFO:tasks.workunit.client.1.smithi119.stdout:4/871: write dd/d11/d2d/f68 [390625,102937] 0 2023-12-17T11:57:57.971 INFO:tasks.workunit.client.0.smithi002.stdout:8/928: dwrite d3/d7/d18/d74/d125/d90/fd5 [0,4194304] 0 2023-12-17T11:57:57.971 INFO:tasks.workunit.client.0.smithi002.stdout:8/929: fsync d3/d8/da/d44/da4/fbe 0 2023-12-17T11:57:57.971 INFO:tasks.workunit.client.0.smithi002.stdout:2/852: dread d3/d4/d7/d14/d9b/f10d [0,4194304] 0 2023-12-17T11:57:57.972 INFO:tasks.workunit.client.1.smithi119.stdout:7/878: truncate d2/f35 191828 0 2023-12-17T11:57:57.972 INFO:tasks.workunit.client.0.smithi002.stdout:3/895: sync 2023-12-17T11:57:57.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/896: fsync d9/d1b/d35/d41/d59/d7c/db7/fcb 0 2023-12-17T11:57:57.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/897: chown d9/d1b/d35/d41/d59/d65/da9/d8f/f90 73 1 2023-12-17T11:57:57.973 INFO:tasks.workunit.client.0.smithi002.stdout:3/898: write d9/d1b/fc7 [15313,114986] 0 2023-12-17T11:57:57.973 INFO:tasks.workunit.client.1.smithi119.stdout:4/872: getdents dd/d11/d26 0 2023-12-17T11:57:57.979 INFO:tasks.workunit.client.0.smithi002.stdout:3/899: link d9/d15/d6a/lca d9/d1b/d35/d41/d59/d65/da9/l11b 0 2023-12-17T11:57:57.979 INFO:tasks.workunit.client.0.smithi002.stdout:3/900: readlink d9/d1b/d4f/d88/lcc 0 2023-12-17T11:57:57.979 INFO:tasks.workunit.client.0.smithi002.stdout:3/901: write d9/d1b/d35/d41/d59/d7c/f5f [1511141,62916] 0 2023-12-17T11:57:57.979 INFO:tasks.workunit.client.0.smithi002.stdout:2/853: rmdir d3/d4/d7/d14/d34/dde 39 2023-12-17T11:57:57.979 INFO:tasks.workunit.client.0.smithi002.stdout:2/854: chown d3/d4/d17/d19/d4d/d72/d83/lab 60254 1 2023-12-17T11:57:57.981 INFO:tasks.workunit.client.0.smithi002.stdout:3/902: mkdir d9/d1b/d35/d41/d59/d7c/d11c 0 2023-12-17T11:57:57.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/855: symlink d3/d4/d7/d14/d2e/d37/dce/l12a 0 2023-12-17T11:57:57.981 INFO:tasks.workunit.client.0.smithi002.stdout:2/856: fsync d3/d4/d7/d14/d34/dde/f10f 0 2023-12-17T11:57:57.982 INFO:tasks.workunit.client.0.smithi002.stdout:3/903: creat d9/d1b/d35/d41/f11d x:0 0 0 2023-12-17T11:57:57.985 INFO:tasks.workunit.client.0.smithi002.stdout:5/859: dwrite dc/d1a/f48 [0,4194304] 0 2023-12-17T11:57:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/860: unlink dc/d1a/l24 0 2023-12-17T11:57:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/861: write dc/d1a/faa [860505,54557] 0 2023-12-17T11:57:57.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/862: chown dc/d8e 890670 1 2023-12-17T11:57:57.991 INFO:tasks.workunit.client.0.smithi002.stdout:5/863: rmdir dc/d94/ded/d5a/d96 39 2023-12-17T11:57:57.994 INFO:tasks.workunit.client.0.smithi002.stdout:5/864: symlink dc/d1a/d53/da9/db3/l12e 0 2023-12-17T11:57:57.997 INFO:tasks.workunit.client.0.smithi002.stdout:3/904: dread d9/d1b/fe5 [0,4194304] 0 2023-12-17T11:57:57.999 INFO:tasks.workunit.client.0.smithi002.stdout:3/905: creat d9/d1b/d35/d41/d43/d4b/d92/f11e x:0 0 0 2023-12-17T11:57:57.999 INFO:tasks.workunit.client.0.smithi002.stdout:3/906: truncate d9/d1b/fc7 881448 0 2023-12-17T11:57:57.999 INFO:tasks.workunit.client.0.smithi002.stdout:3/907: fdatasync d9/d1b/d35/d41/d43/d73/fd6 0 2023-12-17T11:57:58.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/908: creat d9/d15/d52/d85/db9/f11f x:0 0 0 2023-12-17T11:57:58.003 INFO:tasks.workunit.client.0.smithi002.stdout:3/909: mknod d9/d1b/d35/d41/d43/d4b/d92/d103/c120 0 2023-12-17T11:57:58.003 INFO:tasks.workunit.client.0.smithi002.stdout:1/897: dread d3/d6/d9/d37/d39/fa6 [0,4194304] 0 2023-12-17T11:57:58.003 INFO:tasks.workunit.client.0.smithi002.stdout:1/898: dread - d3/d6/d16/d28/fca zero size 2023-12-17T11:57:58.003 INFO:tasks.workunit.client.0.smithi002.stdout:1/899: stat d3/d2f/fe2 0 2023-12-17T11:57:58.003 INFO:tasks.workunit.client.0.smithi002.stdout:1/900: write d3/d6/d9/d30/f54 [932262,33538] 0 2023-12-17T11:57:58.004 INFO:tasks.workunit.client.0.smithi002.stdout:1/901: symlink d3/d6/d9/d30/l123 0 2023-12-17T11:57:58.012 INFO:tasks.workunit.client.0.smithi002.stdout:3/910: dread d9/d1b/d35/d41/d43/d4b/f57 [0,4194304] 0 2023-12-17T11:57:58.015 INFO:tasks.workunit.client.0.smithi002.stdout:3/911: symlink d9/d1b/d35/l121 0 2023-12-17T11:57:58.020 INFO:tasks.workunit.client.1.smithi119.stdout:7/879: dwrite d2/d40/f5a [4194304,4194304] 0 2023-12-17T11:57:58.021 INFO:tasks.workunit.client.1.smithi119.stdout:7/880: creat d2/d4/d11/d2c/d68/d6a/f10c x:0 0 0 2023-12-17T11:57:58.021 INFO:tasks.workunit.client.1.smithi119.stdout:7/881: chown d2/d4/d11/d2c/d68/db4/lf7 27040 1 2023-12-17T11:57:58.062 INFO:tasks.workunit.client.0.smithi002.stdout:9/979: write dc/d42/da0/f119 [244656,93337] 0 2023-12-17T11:57:58.062 INFO:tasks.workunit.client.0.smithi002.stdout:6/864: write d0/d1/dc/d17/d40/f4f [3785609,91281] 0 2023-12-17T11:57:58.062 INFO:tasks.workunit.client.0.smithi002.stdout:0/835: dwrite d0/d6/d26/d14/d19/d37/d62/fc7 [0,4194304] 0 2023-12-17T11:57:58.066 INFO:tasks.workunit.client.0.smithi002.stdout:3/912: dwrite d9/d1b/d35/d41/d59/d65/f87 [0,4194304] 0 2023-12-17T11:57:58.072 INFO:tasks.workunit.client.1.smithi119.stdout:7/882: dwrite d2/d40/dc3/fb3 [0,4194304] 0 2023-12-17T11:57:58.074 INFO:tasks.workunit.client.0.smithi002.stdout:8/930: dwrite d3/d8/da/f46 [4194304,4194304] 0 2023-12-17T11:57:58.074 INFO:tasks.workunit.client.0.smithi002.stdout:6/865: dread d0/d1/d6d/d83/d113/da5/f8d [0,4194304] 0 2023-12-17T11:57:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:5/865: truncate dc/d1a/f48 3155627 0 2023-12-17T11:57:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:5/866: fdatasync dc/d17/d2f/fb8 0 2023-12-17T11:57:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:5/867: fsync dc/d1a/d53/da9/f129 0 2023-12-17T11:57:58.079 INFO:tasks.workunit.client.0.smithi002.stdout:8/931: link d3/d7/d18/d74/d125/d65/da2/fea d3/d8/f141 0 2023-12-17T11:57:58.082 INFO:tasks.workunit.client.0.smithi002.stdout:7/830: dwrite d6/d17/f48 [0,4194304] 0 2023-12-17T11:57:58.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/980: dread dc/d1d/f78 [0,4194304] 0 2023-12-17T11:57:58.085 INFO:tasks.workunit.client.0.smithi002.stdout:9/981: write dc/d1d/d25/dd9/f100 [372587,84279] 0 2023-12-17T11:57:58.094 INFO:tasks.workunit.client.1.smithi119.stdout:7/883: rename d2/d4/f16 to d2/d4/d1f/f10d 0 2023-12-17T11:57:58.094 INFO:tasks.workunit.client.0.smithi002.stdout:8/932: read d3/d7/d18/d74/d7b/d11c/d7c/f89 [1169005,118863] 0 2023-12-17T11:57:58.094 INFO:tasks.workunit.client.0.smithi002.stdout:8/933: chown d3/d8/da/l118 1121 1 2023-12-17T11:57:58.096 INFO:tasks.workunit.client.0.smithi002.stdout:5/868: rmdir dc/d1a/d53 39 2023-12-17T11:57:58.097 INFO:tasks.workunit.client.1.smithi119.stdout:7/884: mknod d2/d4/d11/d2c/d68/d98/dd1/c10e 0 2023-12-17T11:57:58.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/869: write dc/d94/ded/dad/d12d/fe1 [78256,125739] 0 2023-12-17T11:57:58.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/870: stat dc/d94/ded/ce8 0 2023-12-17T11:57:58.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/871: chown dc/d17 1 1 2023-12-17T11:57:58.098 INFO:tasks.workunit.client.0.smithi002.stdout:5/872: fsync dc/d1a/d47/f49 0 2023-12-17T11:57:58.101 INFO:tasks.workunit.client.1.smithi119.stdout:7/885: symlink d2/d4/d11/d2c/d68/d98/dd1/l10f 0 2023-12-17T11:57:58.105 INFO:tasks.workunit.client.1.smithi119.stdout:7/886: mknod d2/d4/d11/d2c/c110 0 2023-12-17T11:57:58.105 INFO:tasks.workunit.client.1.smithi119.stdout:7/887: chown d2/d4/d70/f9d 20 1 2023-12-17T11:57:58.105 INFO:tasks.workunit.client.0.smithi002.stdout:3/913: dwrite d9/d1b/d35/d41/d59/d7c/fed [0,4194304] 0 2023-12-17T11:57:58.105 INFO:tasks.workunit.client.0.smithi002.stdout:3/914: creat d9/d1b/d35/d41/d59/d65/da9/f122 x:0 0 0 2023-12-17T11:57:58.107 INFO:tasks.workunit.client.1.smithi119.stdout:7/888: creat d2/d4/d11/d2c/d55/d67/f111 x:0 0 0 2023-12-17T11:57:58.112 INFO:tasks.workunit.client.0.smithi002.stdout:9/982: rename dc/d42/da0/d82/lc9 to dc/d42/da0/d12a/l163 0 2023-12-17T11:57:58.112 INFO:tasks.workunit.client.0.smithi002.stdout:8/934: mknod d3/d7/d18/d74/d7b/d12b/c142 0 2023-12-17T11:57:58.112 INFO:tasks.workunit.client.0.smithi002.stdout:9/983: chown dc/d42/da0/d72/d93/dd0/dd4 15814 1 2023-12-17T11:57:58.112 INFO:tasks.workunit.client.0.smithi002.stdout:5/873: creat dc/d94/f12f x:0 0 0 2023-12-17T11:57:58.112 INFO:tasks.workunit.client.0.smithi002.stdout:9/984: write dc/d32/f7a [1815870,130097] 0 2023-12-17T11:57:58.112 INFO:tasks.workunit.client.0.smithi002.stdout:5/874: creat dc/d94/ded/dad/f130 x:0 0 0 2023-12-17T11:57:58.113 INFO:tasks.workunit.client.0.smithi002.stdout:7/831: dread d6/f3b [0,4194304] 0 2023-12-17T11:57:58.116 INFO:tasks.workunit.client.0.smithi002.stdout:3/915: creat d9/d24/d6f/f123 x:0 0 0 2023-12-17T11:57:58.120 INFO:tasks.workunit.client.0.smithi002.stdout:4/807: sync 2023-12-17T11:57:58.120 INFO:tasks.workunit.client.0.smithi002.stdout:8/935: rename d3/d7/d18/d3f/d49/l137 to d3/d7/d18/d3f/l143 0 2023-12-17T11:57:58.122 INFO:tasks.workunit.client.0.smithi002.stdout:3/916: stat d9/d1b/d35/d41/d59/d72/lb4 0 2023-12-17T11:57:58.123 INFO:tasks.workunit.client.0.smithi002.stdout:3/917: write d9/d24/d6f/fb6 [1418613,119491] 0 2023-12-17T11:57:58.125 INFO:tasks.workunit.client.0.smithi002.stdout:5/875: rename dc/d94/ded/d5a/cc5 to dc/d94/ded/d5a/d68/c131 0 2023-12-17T11:57:58.125 INFO:tasks.workunit.client.0.smithi002.stdout:5/876: readlink dc/d17/d2f/lc6 0 2023-12-17T11:57:58.127 INFO:tasks.workunit.client.1.smithi119.stdout:5/922: sync 2023-12-17T11:57:58.127 INFO:tasks.workunit.client.1.smithi119.stdout:5/923: creat d1/d70/d85/d95/dc3/f132 x:0 0 0 2023-12-17T11:57:58.130 INFO:tasks.workunit.client.0.smithi002.stdout:3/918: dread d9/d1b/d4f/fb1 [0,4194304] 0 2023-12-17T11:57:58.139 INFO:tasks.workunit.client.0.smithi002.stdout:1/902: dwrite d3/d6/d9/d30/f1a [8388608,4194304] 0 2023-12-17T11:57:58.140 INFO:tasks.workunit.client.0.smithi002.stdout:5/877: write dc/d17/d2f/f7a [131542,104514] 0 2023-12-17T11:57:58.141 INFO:tasks.workunit.client.0.smithi002.stdout:8/936: dread d3/d7/d1a/ff5 [0,4194304] 0 2023-12-17T11:57:58.143 INFO:tasks.workunit.client.0.smithi002.stdout:1/903: symlink d3/d6/d9/l124 0 2023-12-17T11:57:58.147 INFO:tasks.workunit.client.0.smithi002.stdout:1/904: getdents d3/d2f/d4d/d95 0 2023-12-17T11:57:58.148 INFO:tasks.workunit.client.0.smithi002.stdout:1/905: truncate d3/d6/d9/d30/d9c/f119 652097 0 2023-12-17T11:57:58.149 INFO:tasks.workunit.client.0.smithi002.stdout:8/937: rename d3/d7/d18/d74/d125 to d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144 0 2023-12-17T11:57:58.150 INFO:tasks.workunit.client.0.smithi002.stdout:1/906: getdents d3/d6/d9/d37/d39/d43/d4a/d7b/daa 0 2023-12-17T11:57:58.153 INFO:tasks.workunit.client.0.smithi002.stdout:1/907: mknod d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/d113/c125 0 2023-12-17T11:57:58.153 INFO:tasks.workunit.client.0.smithi002.stdout:1/908: fdatasync d3/d6/d16/f106 0 2023-12-17T11:57:58.153 INFO:tasks.workunit.client.0.smithi002.stdout:1/909: fdatasync d3/d2f/d4d/d95/f10d 0 2023-12-17T11:57:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/866: dwrite d0/d1/fd [0,4194304] 0 2023-12-17T11:57:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/867: chown d0/d1/dc/d17/d67/d6c/f80 64330540 1 2023-12-17T11:57:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/868: chown d0/d1/d21/d56/d60/f85 77 1 2023-12-17T11:57:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:6/869: write d0/d1/d5b/fd1 [277269,107911] 0 2023-12-17T11:57:58.165 INFO:tasks.workunit.client.0.smithi002.stdout:0/836: dread d0/d6/d26/d14/d90/f105 [0,4194304] 0 2023-12-17T11:57:58.166 INFO:tasks.workunit.client.0.smithi002.stdout:5/878: write dc/d94/fce [253444,89810] 0 2023-12-17T11:57:58.166 INFO:tasks.workunit.client.0.smithi002.stdout:5/879: fsync dc/d94/ded/d75/fff 0 2023-12-17T11:57:58.173 INFO:tasks.workunit.client.0.smithi002.stdout:1/910: write d3/d6/d16/d61/f6f [342603,102494] 0 2023-12-17T11:57:58.173 INFO:tasks.workunit.client.0.smithi002.stdout:6/870: mkdir d0/d1/dc/d17/d67/d6c/d11a 0 2023-12-17T11:57:58.173 INFO:tasks.workunit.client.0.smithi002.stdout:1/911: creat d3/d6/d9/d37/d39/d43/d4a/deb/f126 x:0 0 0 2023-12-17T11:57:58.173 INFO:tasks.workunit.client.0.smithi002.stdout:1/912: creat d3/d6/d9/d37/d39/d43/d8f/f127 x:0 0 0 2023-12-17T11:57:58.175 INFO:tasks.workunit.client.0.smithi002.stdout:8/938: write d3/d8/f42 [3327252,6151] 0 2023-12-17T11:57:58.176 INFO:tasks.workunit.client.0.smithi002.stdout:6/871: rename d0/d1/d6d/cf5 to d0/d1/dc/d17/dd6/c11b 0 2023-12-17T11:57:58.177 INFO:tasks.workunit.client.0.smithi002.stdout:7/832: dwrite d6/d17/dc/d67/d8b/dbd/dce/ddf/dfa/f7e [4194304,4194304] 0 2023-12-17T11:57:58.180 INFO:tasks.workunit.client.0.smithi002.stdout:8/939: rename d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/cb3 to d3/d8/da/d44/c145 0 2023-12-17T11:57:58.182 INFO:tasks.workunit.client.0.smithi002.stdout:7/833: creat d6/d99/da1/db9/ffe x:0 0 0 2023-12-17T11:57:58.184 INFO:tasks.workunit.client.0.smithi002.stdout:7/834: mknod d6/d17/dc/d6c/dcb/deb/cff 0 2023-12-17T11:57:58.184 INFO:tasks.workunit.client.0.smithi002.stdout:7/835: write d6/d17/dc/d13/d21/f62 [545485,47720] 0 2023-12-17T11:57:58.188 INFO:tasks.workunit.client.0.smithi002.stdout:2/857: sync 2023-12-17T11:57:58.188 INFO:tasks.workunit.client.0.smithi002.stdout:2/858: creat d3/d4/d7/d14/d9b/f12b x:0 0 0 2023-12-17T11:57:58.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/985: dread dc/d1d/d25/d85/dc2/ff2 [0,4194304] 0 2023-12-17T11:57:58.191 INFO:tasks.workunit.client.0.smithi002.stdout:9/986: chown dc/d1d/d25/d85/dc2/ddd/dfa/f146 0 1 2023-12-17T11:57:58.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/880: read dc/d94/ded/d2d/f56 [2863192,60885] 0 2023-12-17T11:57:58.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/881: stat dc/d94/f101 0 2023-12-17T11:57:58.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/882: chown dc/d8e/c11d 416847846 1 2023-12-17T11:57:58.197 INFO:tasks.workunit.client.0.smithi002.stdout:5/883: write dc/d1a/d53/ffa [1085621,31084] 0 2023-12-17T11:57:58.199 INFO:tasks.workunit.client.0.smithi002.stdout:2/859: creat d3/d4/f12c x:0 0 0 2023-12-17T11:57:58.203 INFO:tasks.workunit.client.0.smithi002.stdout:4/808: dwrite d0/d3e/d56/d65/d78/fe4 [0,4194304] 0 2023-12-17T11:57:58.203 INFO:tasks.workunit.client.0.smithi002.stdout:3/919: dread d9/d15/fa5 [0,4194304] 0 2023-12-17T11:57:58.203 INFO:tasks.workunit.client.0.smithi002.stdout:2/860: mkdir d3/d4/d7/d14/d2e/d37/d11e/d12d 0 2023-12-17T11:57:58.207 INFO:tasks.workunit.client.0.smithi002.stdout:4/809: rename d0/d3e/d56 to d0/d10/d14/d27/d69/d108 0 2023-12-17T11:57:58.210 INFO:tasks.workunit.client.0.smithi002.stdout:1/913: write d3/d2f/d4d/d95/fc0 [3616657,54485] 0 2023-12-17T11:57:58.211 INFO:tasks.workunit.client.0.smithi002.stdout:1/914: mknod d3/d6/d9/d30/c128 0 2023-12-17T11:57:58.212 INFO:tasks.workunit.client.1.smithi119.stdout:3/888: sync 2023-12-17T11:57:58.212 INFO:tasks.workunit.client.1.smithi119.stdout:3/889: creat d9/d11/d1e/d9f/f148 x:0 0 0 2023-12-17T11:57:58.215 INFO:tasks.workunit.client.1.smithi119.stdout:3/890: mkdir d9/da/df/d41/d33/d3a/d90/d11b/d149 0 2023-12-17T11:57:58.217 INFO:tasks.workunit.client.1.smithi119.stdout:3/891: creat d9/d35/dbd/dfb/f14a x:0 0 0 2023-12-17T11:57:58.221 INFO:tasks.workunit.client.1.smithi119.stdout:3/892: unlink d9/da/df/lf5 0 2023-12-17T11:57:58.221 INFO:tasks.workunit.client.1.smithi119.stdout:3/893: chown d9/d11/d1e/d55/d65/ddf/f112 5442175 1 2023-12-17T11:57:58.221 INFO:tasks.workunit.client.1.smithi119.stdout:3/894: truncate d9/da/f118 817652 0 2023-12-17T11:57:58.221 INFO:tasks.workunit.client.1.smithi119.stdout:3/895: creat d9/da/df/d41/d33/db4/f14b x:0 0 0 2023-12-17T11:57:58.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/861: read d3/d4/f5 [673285,2651] 0 2023-12-17T11:57:58.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/862: creat d3/d4/dbc/f12e x:0 0 0 2023-12-17T11:57:58.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/863: truncate d3/feb 375671 0 2023-12-17T11:57:58.229 INFO:tasks.workunit.client.0.smithi002.stdout:2/864: unlink d3/d4/d7/d14/l59 0 2023-12-17T11:57:58.230 INFO:tasks.workunit.client.0.smithi002.stdout:2/865: write d3/d4/d7/d14/d42/f47 [385801,9475] 0 2023-12-17T11:57:58.234 INFO:tasks.workunit.client.0.smithi002.stdout:4/810: dread d0/d10/f31 [0,4194304] 0 2023-12-17T11:57:58.234 INFO:tasks.workunit.client.0.smithi002.stdout:4/811: chown d0/d10/d14/l4a 1 1 2023-12-17T11:57:58.234 INFO:tasks.workunit.client.0.smithi002.stdout:4/812: truncate d0/f43 4498431 0 2023-12-17T11:57:58.239 INFO:tasks.workunit.client.0.smithi002.stdout:4/813: rename d0/d10/f15 to d0/d3e/d41/f109 0 2023-12-17T11:57:58.239 INFO:tasks.workunit.client.0.smithi002.stdout:4/814: stat d0/d10/d14/d27/d57/de7 0 2023-12-17T11:57:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/836: dwrite d6/d17/dc/fe8 [0,4194304] 0 2023-12-17T11:57:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:8/940: dwrite d3/d7/d18/d74/fe7 [0,4194304] 0 2023-12-17T11:57:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:8/941: chown d3/d8/da/f93 2033 1 2023-12-17T11:57:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:8/942: fdatasync d3/d7/d18/d3f/d49/fd3 0 2023-12-17T11:57:58.250 INFO:tasks.workunit.client.0.smithi002.stdout:7/837: write d6/d17/dc/d13/d21/d2e/fb5 [771555,104142] 0 2023-12-17T11:57:58.251 INFO:tasks.workunit.client.0.smithi002.stdout:4/815: mknod d0/d10/d14/d4e/c10a 0 2023-12-17T11:57:58.257 INFO:tasks.workunit.client.0.smithi002.stdout:8/943: link d3/d7/d18/d74/d7b/d11c/db4/d117/f66 d3/d7/d18/d3f/d49/f146 0 2023-12-17T11:57:58.258 INFO:tasks.workunit.client.1.smithi119.stdout:3/896: dwrite d9/d44/d8c/fad [0,4194304] 0 2023-12-17T11:57:58.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/838: mknod d6/d17/dc/d13/d21/d2e/d4a/daf/db1/c100 0 2023-12-17T11:57:58.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/839: fdatasync d6/d17/f47 0 2023-12-17T11:57:58.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/840: dread - d6/d17/dc/d13/d21/d2e/dd5/ff3 zero size 2023-12-17T11:57:58.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/841: fsync d6/d17/dc/d13/dd8/db0/fdc 0 2023-12-17T11:57:58.266 INFO:tasks.workunit.client.0.smithi002.stdout:7/842: readlink d6/d17/dc/d13/d37/d4f/l5e 0 2023-12-17T11:57:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:8/944: symlink d3/d7/d18/d74/d7b/d11c/db4/l147 0 2023-12-17T11:57:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/945: fdatasync d3/d7/d1a/ff9 0 2023-12-17T11:57:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/946: chown d3/d8/c140 327 1 2023-12-17T11:57:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/947: stat d3/d7/d111/f119 0 2023-12-17T11:57:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:8/948: truncate d3/d7/d18/d3f/d49/f10f 706833 0 2023-12-17T11:57:58.271 INFO:tasks.workunit.client.0.smithi002.stdout:7/843: symlink d6/d17/dc/d13/d21/d2e/d4a/l101 0 2023-12-17T11:57:58.272 INFO:tasks.workunit.client.0.smithi002.stdout:4/816: getdents d0/d6c/dda/de1 0 2023-12-17T11:57:58.277 INFO:tasks.workunit.client.0.smithi002.stdout:7/844: mknod d6/d17/dc/c102 0 2023-12-17T11:57:58.277 INFO:tasks.workunit.client.0.smithi002.stdout:8/949: creat d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/d90/df3/f148 x:0 0 0 2023-12-17T11:57:58.279 INFO:tasks.workunit.client.0.smithi002.stdout:4/817: rename d0/d10/d14/d4e/f80 to d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/f10b 0 2023-12-17T11:57:58.279 INFO:tasks.workunit.client.0.smithi002.stdout:4/818: chown d0/d10/d21/d33/ca1 0 1 2023-12-17T11:57:58.279 INFO:tasks.workunit.client.0.smithi002.stdout:9/987: dwrite dc/d1d/d25/d85/dc2/ddd/dfa/d47/f48 [0,4194304] 0 2023-12-17T11:57:58.280 INFO:tasks.workunit.client.0.smithi002.stdout:3/920: dwrite d9/d15/d52/d79/dab/f113 [0,4194304] 0 2023-12-17T11:57:58.280 INFO:tasks.workunit.client.0.smithi002.stdout:3/921: chown d9/d24/l2e 28686 1 2023-12-17T11:57:58.286 INFO:tasks.workunit.client.0.smithi002.stdout:7/845: mkdir d6/d81/d103 0 2023-12-17T11:57:58.287 INFO:tasks.workunit.client.0.smithi002.stdout:8/950: mknod d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d133/c149 0 2023-12-17T11:57:58.289 INFO:tasks.workunit.client.0.smithi002.stdout:2/866: dwrite d3/feb [0,4194304] 0 2023-12-17T11:57:58.292 INFO:tasks.workunit.client.0.smithi002.stdout:3/922: creat d9/d1b/d35/d41/d59/d7c/d109/f124 x:0 0 0 2023-12-17T11:57:58.292 INFO:tasks.workunit.client.0.smithi002.stdout:7/846: creat d6/d99/da1/f104 x:0 0 0 2023-12-17T11:57:58.302 INFO:tasks.workunit.client.0.smithi002.stdout:3/923: dread d9/d24/d6f/d84/f86 [0,4194304] 0 2023-12-17T11:57:58.302 INFO:tasks.workunit.client.0.smithi002.stdout:3/924: creat d9/d1b/d35/d41/d59/d7c/db7/f125 x:0 0 0 2023-12-17T11:57:58.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/925: rename d9/d1b/d35/d41/f42 to d9/d1b/d35/d41/d43/d4b/d92/f126 0 2023-12-17T11:57:58.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/926: write d9/d1b/d35/df3/df8/f11a [840965,45073] 0 2023-12-17T11:57:58.313 INFO:tasks.workunit.client.0.smithi002.stdout:3/927: getdents d9/d1b/d35/d41 0 2023-12-17T11:57:58.313 INFO:tasks.workunit.client.1.smithi119.stdout:3/897: dwrite d9/d35/dbd/f100 [0,4194304] 0 2023-12-17T11:57:58.314 INFO:tasks.workunit.client.1.smithi119.stdout:3/898: mkdir d9/d35/dbd/dfb/d14c 0 2023-12-17T11:57:58.314 INFO:tasks.workunit.client.0.smithi002.stdout:2/867: dread d3/d4/d7/d14/d2e/f7b [0,4194304] 0 2023-12-17T11:57:58.315 INFO:tasks.workunit.client.1.smithi119.stdout:3/899: creat d9/d35/dbd/f14d x:0 0 0 2023-12-17T11:57:58.316 INFO:tasks.workunit.client.1.smithi119.stdout:3/900: truncate d9/da/df/d41/d33/db4/f96 561307 0 2023-12-17T11:57:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/868: symlink d3/d4/d17/d19/d4d/d72/d77/da7/l12f 0 2023-12-17T11:57:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/869: chown d3/d4/d7/d14/d34/f6c 138 1 2023-12-17T11:57:58.317 INFO:tasks.workunit.client.0.smithi002.stdout:2/870: dread - d3/d4/dbc/f12e zero size 2023-12-17T11:57:58.323 INFO:tasks.workunit.client.0.smithi002.stdout:3/928: dread d9/d15/d6a/ffe [0,4194304] 0 2023-12-17T11:57:58.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/929: symlink d9/d1b/d4f/d88/l127 0 2023-12-17T11:57:58.325 INFO:tasks.workunit.client.0.smithi002.stdout:3/930: mknod d9/d15/d52/d85/dd9/c128 0 2023-12-17T11:57:58.325 INFO:tasks.workunit.client.0.smithi002.stdout:3/931: chown d9/d15/d52/d85/dd9 12840802 1 2023-12-17T11:57:58.325 INFO:tasks.workunit.client.0.smithi002.stdout:3/932: chown d9/cd 79475 1 2023-12-17T11:57:58.342 INFO:tasks.workunit.client.0.smithi002.stdout:7/847: dread d6/d17/f61 [0,4194304] 0 2023-12-17T11:57:58.342 INFO:tasks.workunit.client.0.smithi002.stdout:4/819: dwrite d0/d5a/fd6 [0,4194304] 0 2023-12-17T11:57:58.348 INFO:tasks.workunit.client.0.smithi002.stdout:7/848: mkdir d6/d17/dc/d13/d37/d4f/de4/d105 0 2023-12-17T11:57:58.352 INFO:tasks.workunit.client.0.smithi002.stdout:8/951: dwrite d3/d7/d1a/fd9 [0,4194304] 0 2023-12-17T11:57:58.352 INFO:tasks.workunit.client.0.smithi002.stdout:8/952: creat d3/d7/d18/d74/d7b/f14a x:0 0 0 2023-12-17T11:57:58.353 INFO:tasks.workunit.client.0.smithi002.stdout:6/872: sync 2023-12-17T11:57:58.353 INFO:tasks.workunit.client.0.smithi002.stdout:0/837: sync 2023-12-17T11:57:58.353 INFO:tasks.workunit.client.0.smithi002.stdout:0/838: chown d0/d6/d26/d14/f3f 15496969 1 2023-12-17T11:57:58.355 INFO:tasks.workunit.client.0.smithi002.stdout:8/953: truncate d3/d8/da/f46 2307770 0 2023-12-17T11:57:58.365 INFO:tasks.workunit.client.0.smithi002.stdout:8/954: dread d3/d8/da/f9f [0,4194304] 0 2023-12-17T11:57:58.374 INFO:tasks.workunit.client.0.smithi002.stdout:0/839: dread d0/d6/d26/d14/d19/d61/f73 [0,4194304] 0 2023-12-17T11:57:58.374 INFO:tasks.workunit.client.0.smithi002.stdout:7/849: dread d6/f3b [0,4194304] 0 2023-12-17T11:57:58.385 INFO:tasks.workunit.client.0.smithi002.stdout:0/840: creat d0/d6/d26/d14/d90/d64/dab/dfc/f110 x:0 0 0 2023-12-17T11:57:58.385 INFO:tasks.workunit.client.0.smithi002.stdout:7/850: link d6/d17/dc/f8d d6/d17/dc/d67/d8b/f106 0 2023-12-17T11:57:58.385 INFO:tasks.workunit.client.0.smithi002.stdout:0/841: readlink d0/d6/d26/l4a 0 2023-12-17T11:57:58.386 INFO:tasks.workunit.client.0.smithi002.stdout:0/842: symlink d0/d6/d26/d14/d19/d37/d62/l111 0 2023-12-17T11:57:58.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/933: dwrite d9/d1b/d4f/d88/fb3 [0,4194304] 0 2023-12-17T11:57:58.389 INFO:tasks.workunit.client.0.smithi002.stdout:3/934: fsync d9/d1b/d35/d41/d59/d7c/db7/f108 0 2023-12-17T11:57:58.408 INFO:tasks.workunit.client.0.smithi002.stdout:6/873: dwrite d0/d1/d5b/dda/f10a [0,4194304] 0 2023-12-17T11:57:58.408 INFO:tasks.workunit.client.0.smithi002.stdout:6/874: creat d0/d1/dc/d17/d3c/f11c x:0 0 0 2023-12-17T11:57:58.408 INFO:tasks.workunit.client.0.smithi002.stdout:6/875: chown d0/d1/dc/f54 145 1 2023-12-17T11:57:58.408 INFO:tasks.workunit.client.0.smithi002.stdout:6/876: chown d0/d1/d6d/d83/d113 3381 1 2023-12-17T11:57:58.413 INFO:tasks.workunit.client.0.smithi002.stdout:6/877: creat d0/d1/dc/d17/dd6/d10c/f11d x:0 0 0 2023-12-17T11:57:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/871: dwrite d3/d4/f12c [0,4194304] 0 2023-12-17T11:57:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/872: chown d3/d4/d17/d19/d4d/fe7 1014607 1 2023-12-17T11:57:58.420 INFO:tasks.workunit.client.0.smithi002.stdout:2/873: creat d3/d4/d7/d14/d9b/f130 x:0 0 0 2023-12-17T11:57:58.421 INFO:tasks.workunit.client.0.smithi002.stdout:3/935: dread d9/f14 [0,4194304] 0 2023-12-17T11:57:58.422 INFO:tasks.workunit.client.0.smithi002.stdout:7/851: dwrite d6/d17/f47 [0,4194304] 0 2023-12-17T11:57:58.426 INFO:tasks.workunit.client.1.smithi119.stdout:0/830: sync 2023-12-17T11:57:58.426 INFO:tasks.workunit.client.1.smithi119.stdout:1/836: sync 2023-12-17T11:57:58.426 INFO:tasks.workunit.client.1.smithi119.stdout:1/837: stat d3/d44/dfd/d64/f75 0 2023-12-17T11:57:58.428 INFO:tasks.workunit.client.1.smithi119.stdout:0/831: rename d2/d66/d2e/d44/l8f to d2/d66/d2e/d44/df0/dc3/lfc 0 2023-12-17T11:57:58.428 INFO:tasks.workunit.client.1.smithi119.stdout:0/832: stat d2/d16/d35/f6c 0 2023-12-17T11:57:58.429 INFO:tasks.workunit.client.1.smithi119.stdout:0/833: mknod d2/d66/d2e/cfd 0 2023-12-17T11:57:58.429 INFO:tasks.workunit.client.1.smithi119.stdout:0/834: write d2/d16/d35/f6c [1060411,86030] 0 2023-12-17T11:57:58.429 INFO:tasks.workunit.client.1.smithi119.stdout:0/835: chown d2/d66/f1c 1078 1 2023-12-17T11:57:58.429 INFO:tasks.workunit.client.1.smithi119.stdout:0/836: truncate d2/dac/fad 243389 0 2023-12-17T11:57:58.430 INFO:tasks.workunit.client.0.smithi002.stdout:2/874: creat d3/d4/d7/d14/d2e/d37/dce/f131 x:0 0 0 2023-12-17T11:57:58.430 INFO:tasks.workunit.client.1.smithi119.stdout:0/837: rmdir d2/d66/d1f/d24/d50/d5d/d80 39 2023-12-17T11:57:58.433 INFO:tasks.workunit.client.1.smithi119.stdout:1/838: dread d3/d44/dfd/f51 [0,4194304] 0 2023-12-17T11:57:58.436 INFO:tasks.workunit.client.0.smithi002.stdout:7/852: rename d6/d17/f65 to d6/d99/da1/db9/f107 0 2023-12-17T11:57:58.436 INFO:tasks.workunit.client.0.smithi002.stdout:9/988: sync 2023-12-17T11:57:58.436 INFO:tasks.workunit.client.0.smithi002.stdout:9/989: write dc/d42/da0/d72/d93/d76/fc1 [1477792,41173] 0 2023-12-17T11:57:58.436 INFO:tasks.workunit.client.1.smithi119.stdout:0/838: symlink d2/d66/d2e/lfe 0 2023-12-17T11:57:58.439 INFO:tasks.workunit.client.1.smithi119.stdout:1/839: creat d3/db/d26/d19/f135 x:0 0 0 2023-12-17T11:57:58.439 INFO:tasks.workunit.client.1.smithi119.stdout:1/840: truncate d3/db/d17/d24/d20/d40/d76/d84/ffb 401192 0 2023-12-17T11:57:58.439 INFO:tasks.workunit.client.1.smithi119.stdout:1/841: dread - d3/db/d17/d24/d20/dba/f131 zero size 2023-12-17T11:57:58.439 INFO:tasks.workunit.client.0.smithi002.stdout:2/875: unlink d3/d4/d7/d14/d9b/fd1 0 2023-12-17T11:57:58.443 INFO:tasks.workunit.client.1.smithi119.stdout:1/842: link d3/db/d2a/f66 d3/db/d17/d24/d20/d40/f136 0 2023-12-17T11:57:58.453 INFO:tasks.workunit.client.0.smithi002.stdout:7/853: dread d6/d17/f79 [0,4194304] 0 2023-12-17T11:57:58.453 INFO:tasks.workunit.client.0.smithi002.stdout:7/854: write d6/d17/dc/d13/d37/f3c [1047076,83980] 0 2023-12-17T11:57:58.453 INFO:tasks.workunit.client.0.smithi002.stdout:7/855: chown d6/d17/dc/d13/dd8/db0/fdc 21 1 2023-12-17T11:57:58.455 INFO:tasks.workunit.client.0.smithi002.stdout:7/856: symlink d6/d17/dc/d13/dd8/dd0/dd2/l108 0 2023-12-17T11:57:58.456 INFO:tasks.workunit.client.0.smithi002.stdout:4/820: dwrite d0/d10/d14/d4e/f53 [0,4194304] 0 2023-12-17T11:57:58.466 INFO:tasks.workunit.client.0.smithi002.stdout:7/857: rmdir d6/d17/dc/d13/d37/d4f/de4/df1 0 2023-12-17T11:57:58.471 INFO:tasks.workunit.client.0.smithi002.stdout:3/936: dwrite d9/f14 [8388608,4194304] 0 2023-12-17T11:57:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:0/843: dread d0/d6/d26/d14/f53 [0,4194304] 0 2023-12-17T11:57:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:0/844: chown d0/d6/d26/d14/d19/db1/l107 11 1 2023-12-17T11:57:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:4/821: symlink d0/d6c/dda/l10c 0 2023-12-17T11:57:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:3/937: truncate d9/d15/d52/d79/dab/fdb 267030 0 2023-12-17T11:57:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:3/938: creat d9/d40/f129 x:0 0 0 2023-12-17T11:57:58.484 INFO:tasks.workunit.client.0.smithi002.stdout:3/939: write d9/d15/f10c [477198,29855] 0 2023-12-17T11:57:58.486 INFO:tasks.workunit.client.0.smithi002.stdout:0/845: creat d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/f112 x:0 0 0 2023-12-17T11:57:58.486 INFO:tasks.workunit.client.0.smithi002.stdout:0/846: read - d0/d6/d26/d14/d6d/d7e/fdc zero size 2023-12-17T11:57:58.490 INFO:tasks.workunit.client.0.smithi002.stdout:1/915: sync 2023-12-17T11:57:58.490 INFO:tasks.workunit.client.0.smithi002.stdout:5/884: sync 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:1/916: getdents d3/d6/d9/d37/d39/d43/d4a/d7b/daa 0 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:1/917: chown d3/d2f/fb4 1244 1 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:1/918: creat d3/d6/d9/d37/d39/d43/d4a/d7b/dde/f129 x:0 0 0 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:5/885: write dc/f125 [920093,125525] 0 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:5/886: stat dc/d1a/d53/da9/f129 0 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:0/847: creat d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/d106/f113 x:0 0 0 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:0/848: creat d0/d6/d26/d14/f114 x:0 0 0 2023-12-17T11:57:58.491 INFO:tasks.workunit.client.0.smithi002.stdout:6/878: dread d0/d1/dc/f39 [0,4194304] 0 2023-12-17T11:57:58.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/822: getdents d0/d10/d14 0 2023-12-17T11:57:58.494 INFO:tasks.workunit.client.0.smithi002.stdout:8/955: dwrite d3/d7/f63 [0,4194304] 0 2023-12-17T11:57:58.498 INFO:tasks.workunit.client.0.smithi002.stdout:8/956: symlink d3/d7/d18/d74/d7b/d11c/db4/d117/db0/l14b 0 2023-12-17T11:57:58.500 INFO:tasks.workunit.client.0.smithi002.stdout:6/879: rename d0/d1/d21/d56 to d0/d1/d6d/d83/da2/d11e 0 2023-12-17T11:57:58.504 INFO:tasks.workunit.client.1.smithi119.stdout:0/839: dwrite d2/d66/d2e/f8a [0,4194304] 0 2023-12-17T11:57:58.505 INFO:tasks.workunit.client.1.smithi119.stdout:0/840: chown d2/d66/d2e/c49 2967 1 2023-12-17T11:57:58.505 INFO:tasks.workunit.client.1.smithi119.stdout:0/841: creat d2/fff x:0 0 0 2023-12-17T11:57:58.505 INFO:tasks.workunit.client.0.smithi002.stdout:6/880: mknod d0/d1/d6d/d83/d113/c11f 0 2023-12-17T11:57:58.505 INFO:tasks.workunit.client.0.smithi002.stdout:1/919: dread d3/d6/d16/d28/f69 [4194304,4194304] 0 2023-12-17T11:57:58.506 INFO:tasks.workunit.client.0.smithi002.stdout:1/920: fsync d3/d6/f3e 0 2023-12-17T11:57:58.506 INFO:tasks.workunit.client.0.smithi002.stdout:1/921: readlink d3/d6/d16/d61/l82 0 2023-12-17T11:57:58.507 INFO:tasks.workunit.client.1.smithi119.stdout:1/843: dwrite d3/d44/dfd/d64/f10e [0,4194304] 0 2023-12-17T11:57:58.507 INFO:tasks.workunit.client.1.smithi119.stdout:1/844: write d3/db/d17/d24/d20/dba/f131 [290069,105688] 0 2023-12-17T11:57:58.510 INFO:tasks.workunit.client.0.smithi002.stdout:6/881: rename d0/d1/d6d/d83/d113/l10f to d0/d1/dc/d17/dd6/d10c/l120 0 2023-12-17T11:57:58.510 INFO:tasks.workunit.client.0.smithi002.stdout:3/940: dread d9/d15/d71/f10a [0,4194304] 0 2023-12-17T11:57:58.512 INFO:tasks.workunit.client.0.smithi002.stdout:8/957: write d3/d8/da/f46 [103230,85759] 0 2023-12-17T11:57:58.521 INFO:tasks.workunit.client.1.smithi119.stdout:1/845: symlink d3/d44/dfd/d64/db2/l137 0 2023-12-17T11:57:58.522 INFO:tasks.workunit.client.0.smithi002.stdout:4/823: write d0/d10/f25 [2549721,97990] 0 2023-12-17T11:57:58.522 INFO:tasks.workunit.client.0.smithi002.stdout:3/941: rmdir d9/d1b/d35/d41/d59/d65/da9/d8f 39 2023-12-17T11:57:58.522 INFO:tasks.workunit.client.0.smithi002.stdout:1/922: symlink d3/d6/d9/d37/d39/d43/d4a/l12a 0 2023-12-17T11:57:58.522 INFO:tasks.workunit.client.0.smithi002.stdout:3/942: fsync d9/d1b/d35/d41/f11d 0 2023-12-17T11:57:58.524 INFO:tasks.workunit.client.1.smithi119.stdout:0/842: read d2/d16/f6f [2934239,91562] 0 2023-12-17T11:57:58.526 INFO:tasks.workunit.client.0.smithi002.stdout:7/858: dwrite d6/d17/dc/d13/d21/d2e/fb5 [0,4194304] 0 2023-12-17T11:57:58.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/924: sync 2023-12-17T11:57:58.528 INFO:tasks.workunit.client.1.smithi119.stdout:0/843: getdents d2/dac/dcf 0 2023-12-17T11:57:58.528 INFO:tasks.workunit.client.1.smithi119.stdout:8/761: sync 2023-12-17T11:57:58.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/925: readlink d1/d70/d6b/d77/dae/dba/de3/d86/l92 0 2023-12-17T11:57:58.528 INFO:tasks.workunit.client.1.smithi119.stdout:8/762: chown d7/da/d11/d26/d49/f78 104 1 2023-12-17T11:57:58.528 INFO:tasks.workunit.client.1.smithi119.stdout:5/926: write d1/d44/f124 [194999,104197] 0 2023-12-17T11:57:58.532 INFO:tasks.workunit.client.0.smithi002.stdout:3/943: creat d9/d15/d52/d85/f12a x:0 0 0 2023-12-17T11:57:58.533 INFO:tasks.workunit.client.0.smithi002.stdout:8/958: truncate d3/d8/da/d44/f3b 1763473 0 2023-12-17T11:57:58.534 INFO:tasks.workunit.client.0.smithi002.stdout:6/882: dread d0/d1/d6d/d83/d113/da5/dbc/dc4/fd9 [0,4194304] 0 2023-12-17T11:57:58.534 INFO:tasks.workunit.client.0.smithi002.stdout:6/883: stat d0/d1/dc/d58/f10d 0 2023-12-17T11:57:58.535 INFO:tasks.workunit.client.1.smithi119.stdout:5/927: mknod d1/da7/d71/d97/df0/d103/d12c/c133 0 2023-12-17T11:57:58.545 INFO:tasks.workunit.client.1.smithi119.stdout:1/846: dread d3/db/d17/d24/d20/d40/f41 [0,4194304] 0 2023-12-17T11:57:58.545 INFO:tasks.workunit.client.1.smithi119.stdout:1/847: chown d3/db/f12a 977358 1 2023-12-17T11:57:58.545 INFO:tasks.workunit.client.1.smithi119.stdout:2/956: sync 2023-12-17T11:57:58.546 INFO:tasks.workunit.client.1.smithi119.stdout:5/928: symlink d1/da7/d71/d97/l134 0 2023-12-17T11:57:58.549 INFO:tasks.workunit.client.0.smithi002.stdout:1/923: write d3/d2f/fb4 [6241750,6356] 0 2023-12-17T11:57:58.551 INFO:tasks.workunit.client.1.smithi119.stdout:9/906: sync 2023-12-17T11:57:58.551 INFO:tasks.workunit.client.1.smithi119.stdout:8/763: truncate d7/d18/d45/f56 632519 0 2023-12-17T11:57:58.551 INFO:tasks.workunit.client.1.smithi119.stdout:9/907: chown d12/d1d/d28/d4d/f5e 2550 1 2023-12-17T11:57:58.553 INFO:tasks.workunit.client.0.smithi002.stdout:7/859: mkdir d6/d17/dc/d13/d21/d2e/d4a/d109 0 2023-12-17T11:57:58.555 INFO:tasks.workunit.client.0.smithi002.stdout:0/849: dwrite d0/d6/d26/d14/d19/d37/d86/f98 [0,4194304] 0 2023-12-17T11:57:58.555 INFO:tasks.workunit.client.0.smithi002.stdout:0/850: chown d0/d6/d26/d14/f53 47 1 2023-12-17T11:57:58.556 INFO:tasks.workunit.client.1.smithi119.stdout:1/848: symlink d3/db/d26/d19/l138 0 2023-12-17T11:57:58.556 INFO:tasks.workunit.client.1.smithi119.stdout:2/957: rmdir d6/d9/d13/d34/d70 39 2023-12-17T11:57:58.556 INFO:tasks.workunit.client.1.smithi119.stdout:7/889: sync 2023-12-17T11:57:58.560 INFO:tasks.workunit.client.1.smithi119.stdout:7/890: creat d2/d4/d11/d2c/d68/d6a/f112 x:0 0 0 2023-12-17T11:57:58.560 INFO:tasks.workunit.client.1.smithi119.stdout:6/781: sync 2023-12-17T11:57:58.561 INFO:tasks.workunit.client.1.smithi119.stdout:6/782: creat d2/d2b/d43/d76/dbd/ff3 x:0 0 0 2023-12-17T11:57:58.561 INFO:tasks.workunit.client.1.smithi119.stdout:3/901: sync 2023-12-17T11:57:58.562 INFO:tasks.workunit.client.0.smithi002.stdout:3/944: getdents d9/d15/d71/dbb/dc6 0 2023-12-17T11:57:58.563 INFO:tasks.workunit.client.0.smithi002.stdout:3/945: dread - d9/d15/d71/fee zero size 2023-12-17T11:57:58.563 INFO:tasks.workunit.client.1.smithi119.stdout:6/783: creat d2/da3/ff4 x:0 0 0 2023-12-17T11:57:58.563 INFO:tasks.workunit.client.1.smithi119.stdout:4/873: sync 2023-12-17T11:57:58.564 INFO:tasks.workunit.client.0.smithi002.stdout:8/959: rename d3/d7/d6e/l8d to d3/d8/d28/l14c 0 2023-12-17T11:57:58.569 INFO:tasks.workunit.client.1.smithi119.stdout:3/902: getdents d9/d11/d1e/d55/d77 0 2023-12-17T11:57:58.571 INFO:tasks.workunit.client.1.smithi119.stdout:6/784: rename d2/d2b/c88 to d2/d2b/d43/d76/d8d/cf5 0 2023-12-17T11:57:58.573 INFO:tasks.workunit.client.1.smithi119.stdout:1/849: dread d3/db/d2a/d127/d7e/da1/ff5 [0,4194304] 0 2023-12-17T11:57:58.574 INFO:tasks.workunit.client.1.smithi119.stdout:4/874: link f2 dd/d11/d26/f111 0 2023-12-17T11:57:58.574 INFO:tasks.workunit.client.1.smithi119.stdout:4/875: read dd/d15/f5c [400686,42872] 0 2023-12-17T11:57:58.575 INFO:tasks.workunit.client.0.smithi002.stdout:0/851: creat d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/f115 x:0 0 0 2023-12-17T11:57:58.577 INFO:tasks.workunit.client.0.smithi002.stdout:4/824: dwrite d0/d10/d14/d27/d57/f7b [0,4194304] 0 2023-12-17T11:57:58.577 INFO:tasks.workunit.client.0.smithi002.stdout:4/825: truncate d0/d10/f31 5188444 0 2023-12-17T11:57:58.579 INFO:tasks.workunit.client.1.smithi119.stdout:3/903: rmdir d9/d35/dbd/dfb/d107/d98/de5 39 2023-12-17T11:57:58.586 INFO:tasks.workunit.client.1.smithi119.stdout:0/844: dwrite d2/d16/d35/f6c [0,4194304] 0 2023-12-17T11:57:58.586 INFO:tasks.workunit.client.0.smithi002.stdout:7/860: rename d6/d17/dc/d13/d37/d4f/l5e to d6/l10a 0 2023-12-17T11:57:58.588 INFO:tasks.workunit.client.1.smithi119.stdout:6/785: creat d2/d2b/d43/d76/d8d/ff6 x:0 0 0 2023-12-17T11:57:58.590 INFO:tasks.workunit.client.0.smithi002.stdout:8/960: symlink d3/d7/d18/d74/d7b/d12b/l14d 0 2023-12-17T11:57:58.593 INFO:tasks.workunit.client.1.smithi119.stdout:4/876: getdents dd/d15/d16/d20 0 2023-12-17T11:57:58.594 INFO:tasks.workunit.client.0.smithi002.stdout:1/924: truncate d3/d2f/fb9 2109407 0 2023-12-17T11:57:58.595 INFO:tasks.workunit.client.1.smithi119.stdout:1/850: dread d3/db/d17/d24/f32 [0,4194304] 0 2023-12-17T11:57:58.595 INFO:tasks.workunit.client.1.smithi119.stdout:1/851: readlink d3/db/d17/d24/d20/l133 0 2023-12-17T11:57:58.595 INFO:tasks.workunit.client.1.smithi119.stdout:1/852: truncate d3/db/f5f 817261 0 2023-12-17T11:57:58.596 INFO:tasks.workunit.client.1.smithi119.stdout:3/904: mknod d9/d11/d1e/d9f/dde/c14e 0 2023-12-17T11:57:58.598 INFO:tasks.workunit.client.0.smithi002.stdout:6/884: dwrite d0/d1/dc/d17/dd6/d10c/f11d [0,4194304] 0 2023-12-17T11:57:58.602 INFO:tasks.workunit.client.0.smithi002.stdout:0/852: mknod d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/d106/c116 0 2023-12-17T11:57:58.606 INFO:tasks.workunit.client.0.smithi002.stdout:2/876: sync 2023-12-17T11:57:58.607 INFO:tasks.workunit.client.0.smithi002.stdout:9/990: sync 2023-12-17T11:57:58.607 INFO:tasks.workunit.client.0.smithi002.stdout:9/991: dread - dc/d42/d4f/d140/f15d zero size 2023-12-17T11:57:58.607 INFO:tasks.workunit.client.1.smithi119.stdout:0/845: mknod d2/dac/dcf/c100 0 2023-12-17T11:57:58.610 INFO:tasks.workunit.client.1.smithi119.stdout:4/877: mknod dd/d11/d26/c112 0 2023-12-17T11:57:58.610 INFO:tasks.workunit.client.0.smithi002.stdout:7/861: symlink d6/d99/l10b 0 2023-12-17T11:57:58.611 INFO:tasks.workunit.client.0.smithi002.stdout:7/862: write d6/d17/dc/d13/d21/d2e/dd5/ffb [623393,80979] 0 2023-12-17T11:57:58.611 INFO:tasks.workunit.client.0.smithi002.stdout:7/863: chown d6/d99/da1/db9 38 1 2023-12-17T11:57:58.621 INFO:tasks.workunit.client.1.smithi119.stdout:0/846: mkdir d2/d66/d2e/d44/d7b/d5/d3f/d101 0 2023-12-17T11:57:58.622 INFO:tasks.workunit.client.1.smithi119.stdout:4/878: mknod dd/d11/d2d/d9c/d55/d81/db8/dbd/dec/c113 0 2023-12-17T11:57:58.623 INFO:tasks.workunit.client.1.smithi119.stdout:4/879: chown dd/d11 937440 1 2023-12-17T11:57:58.628 INFO:tasks.workunit.client.0.smithi002.stdout:6/885: write d0/d1/dc0/fc7 [1918163,87749] 0 2023-12-17T11:57:58.630 INFO:tasks.workunit.client.1.smithi119.stdout:4/880: truncate dd/d11/f74 469652 0 2023-12-17T11:57:58.638 INFO:tasks.workunit.client.1.smithi119.stdout:4/881: rename dd/d11/d26/c112 to dd/d11/d2d/d9c/d55/d81/db8/dbd/dec/c114 0 2023-12-17T11:57:58.649 INFO:tasks.workunit.client.0.smithi002.stdout:9/992: dread dc/d42/fb0 [0,4194304] 0 2023-12-17T11:57:58.652 INFO:tasks.workunit.client.0.smithi002.stdout:4/826: rmdir d0 39 2023-12-17T11:57:58.653 INFO:tasks.workunit.client.0.smithi002.stdout:4/827: write d0/d10/d14/d27/d69/d108/f77 [3341238,99203] 0 2023-12-17T11:57:58.653 INFO:tasks.workunit.client.0.smithi002.stdout:4/828: chown d0/d10/d21/d33/lb5 7363 1 2023-12-17T11:57:58.655 INFO:tasks.workunit.client.1.smithi119.stdout:6/786: dwrite d2/f9 [4194304,4194304] 0 2023-12-17T11:57:58.658 INFO:tasks.workunit.client.1.smithi119.stdout:5/929: dwrite d1/d25/f6c [0,4194304] 0 2023-12-17T11:57:58.661 INFO:tasks.workunit.client.0.smithi002.stdout:2/877: link d3/d4/d7/d14/d2e/l30 d3/d50/df6/l132 0 2023-12-17T11:57:58.662 INFO:tasks.workunit.client.1.smithi119.stdout:9/908: dwrite d12/d1d/f31 [4194304,4194304] 0 2023-12-17T11:57:58.662 INFO:tasks.workunit.client.1.smithi119.stdout:9/909: chown d12/l21 7 1 2023-12-17T11:57:58.663 INFO:tasks.workunit.client.1.smithi119.stdout:9/910: fsync d12/d1d/d28/f3d 0 2023-12-17T11:57:58.663 INFO:tasks.workunit.client.1.smithi119.stdout:9/911: stat d12/d1d/d49/d85/dd2 0 2023-12-17T11:57:58.663 INFO:tasks.workunit.client.1.smithi119.stdout:7/891: dwrite d2/d4/d70/f87 [0,4194304] 0 2023-12-17T11:57:58.667 INFO:tasks.workunit.client.0.smithi002.stdout:9/993: symlink dc/d42/da0/d72/l164 0 2023-12-17T11:57:58.668 INFO:tasks.workunit.client.0.smithi002.stdout:6/886: dread d0/d1/d6d/d83/da2/d11e/d8c/fdd [0,4194304] 0 2023-12-17T11:57:58.668 INFO:tasks.workunit.client.0.smithi002.stdout:1/925: dwrite d3/d6/d9/d30/f41 [0,4194304] 0 2023-12-17T11:57:58.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/994: write dc/d42/f107 [716264,111790] 0 2023-12-17T11:57:58.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/995: truncate dc/d42/da0/d72/ff4 671889 0 2023-12-17T11:57:58.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/996: chown dc/d42/da0/d72/d93/d52/la8 15372 1 2023-12-17T11:57:58.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/997: fdatasync dc/f14 0 2023-12-17T11:57:58.671 INFO:tasks.workunit.client.0.smithi002.stdout:9/998: truncate dc/d42/da0/d72/d93/d76/f94 1274644 0 2023-12-17T11:57:58.674 INFO:tasks.workunit.client.0.smithi002.stdout:4/829: rmdir d0/d3e/dc8/dcd 39 2023-12-17T11:57:58.682 INFO:tasks.workunit.client.0.smithi002.stdout:3/946: rename d9/d1b/d35/d41/d59/d7c/d109 to d9/d15/d12b 0 2023-12-17T11:57:58.682 INFO:tasks.workunit.client.0.smithi002.stdout:3/947: chown d9/l9d 4 1 2023-12-17T11:57:58.686 INFO:tasks.workunit.client.0.smithi002.stdout:1/926: write d3/d6/d16/d28/f69 [4830567,99797] 0 2023-12-17T11:57:58.686 INFO:tasks.workunit.client.0.smithi002.stdout:8/961: dwrite d3/d7/f63 [4194304,4194304] 0 2023-12-17T11:57:58.688 INFO:tasks.workunit.client.1.smithi119.stdout:9/912: link d12/d1d/d28/d46/d50/d92/dae/fe7 d12/d1d/d28/d46/d50/d92/daf/deb/dee/f128 0 2023-12-17T11:57:58.693 INFO:tasks.workunit.client.1.smithi119.stdout:1/853: dwrite d3/db/d2a/d127/d7e/da1/ff5 [0,4194304] 0 2023-12-17T11:57:58.695 INFO:tasks.workunit.client.1.smithi119.stdout:6/787: dread d2/d2b/d43/de6/d17/f5f [0,4194304] 0 2023-12-17T11:57:58.700 INFO:tasks.workunit.client.1.smithi119.stdout:0/847: dwrite d2/d66/d1f/d24/d50/d5d/f64 [0,4194304] 0 2023-12-17T11:57:58.700 INFO:tasks.workunit.client.1.smithi119.stdout:9/913: creat d12/d65/d102/f129 x:0 0 0 2023-12-17T11:57:58.701 INFO:tasks.workunit.client.0.smithi002.stdout:3/948: dread d9/d1b/f7b [0,4194304] 0 2023-12-17T11:57:58.701 INFO:tasks.workunit.client.0.smithi002.stdout:7/864: dwrite d6/d17/f48 [4194304,4194304] 0 2023-12-17T11:57:58.704 INFO:tasks.workunit.client.0.smithi002.stdout:6/887: creat d0/d1/d6d/d83/d113/da5/dbc/dc4/f121 x:0 0 0 2023-12-17T11:57:58.704 INFO:tasks.workunit.client.1.smithi119.stdout:9/914: fdatasync d12/d1d/d28/d46/d50/d92/daf/deb/dee/f128 0 2023-12-17T11:57:58.705 INFO:tasks.workunit.client.0.smithi002.stdout:0/853: dwrite d0/d6/d26/d14/d19/d37/f39 [0,4194304] 0 2023-12-17T11:57:58.708 INFO:tasks.workunit.client.1.smithi119.stdout:5/930: dwrite d1/d44/f124 [0,4194304] 0 2023-12-17T11:57:58.709 INFO:tasks.workunit.client.1.smithi119.stdout:5/931: chown d1/f6d 4002468 1 2023-12-17T11:57:58.709 INFO:tasks.workunit.client.1.smithi119.stdout:5/932: chown d1/da7/d71/ff8 124547 1 2023-12-17T11:57:58.710 INFO:tasks.workunit.client.0.smithi002.stdout:4/830: rename d0/d10/d14/dae to d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/d10d 0 2023-12-17T11:57:58.711 INFO:tasks.workunit.client.1.smithi119.stdout:4/882: dwrite dd/d15/d16/d3d/f77 [0,4194304] 0 2023-12-17T11:57:58.712 INFO:tasks.workunit.client.1.smithi119.stdout:3/905: dwrite d9/d1c/f4d [0,4194304] 0 2023-12-17T11:57:58.713 INFO:tasks.workunit.client.1.smithi119.stdout:1/854: unlink d3/db/d17/d24/d20/d40/d76/d84/l9b 0 2023-12-17T11:57:58.713 INFO:tasks.workunit.client.1.smithi119.stdout:1/855: chown d3/db/d26/cec 1639 1 2023-12-17T11:57:58.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/927: creat d3/f12b x:0 0 0 2023-12-17T11:57:58.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/928: stat d3/d6/d9/d37/d39/d43/d4a/d7b/cee 0 2023-12-17T11:57:58.714 INFO:tasks.workunit.client.0.smithi002.stdout:1/929: fdatasync d3/d6/d9/d37/d39/d43/d4a/f111 0 2023-12-17T11:57:58.715 INFO:tasks.workunit.client.1.smithi119.stdout:0/848: symlink d2/d66/l102 0 2023-12-17T11:57:58.720 INFO:tasks.workunit.client.0.smithi002.stdout:3/949: truncate d9/d15/d71/f10a 2308771 0 2023-12-17T11:57:58.723 INFO:tasks.workunit.client.0.smithi002.stdout:2/878: dwrite d3/d4/d17/d19/f24 [0,4194304] 0 2023-12-17T11:57:58.723 INFO:tasks.workunit.client.0.smithi002.stdout:2/879: fdatasync d3/d4/dbc/ffb 0 2023-12-17T11:57:58.723 INFO:tasks.workunit.client.0.smithi002.stdout:7/865: rmdir d6/d17/dc/d8e 39 2023-12-17T11:57:58.726 INFO:tasks.workunit.client.0.smithi002.stdout:6/888: getdents d0/d1/dc/d17/dd6/d10c/dfe 0 2023-12-17T11:57:58.726 INFO:tasks.workunit.client.0.smithi002.stdout:6/889: dread - d0/d1/dc/d58/f10d zero size 2023-12-17T11:57:58.726 INFO:tasks.workunit.client.0.smithi002.stdout:6/890: readlink d0/d1/d6d/d83/da2/d11e/d60/la4 0 2023-12-17T11:57:58.726 INFO:tasks.workunit.client.1.smithi119.stdout:5/933: mkdir d1/da7/d10b/d135 0 2023-12-17T11:57:58.727 INFO:tasks.workunit.client.1.smithi119.stdout:5/934: write d1/d70/d6b/df1/f11d [322976,62463] 0 2023-12-17T11:57:58.727 INFO:tasks.workunit.client.0.smithi002.stdout:6/891: write d0/d1/d5b/fd1 [39430,1351] 0 2023-12-17T11:57:58.730 INFO:tasks.workunit.client.0.smithi002.stdout:5/887: sync 2023-12-17T11:57:58.731 INFO:tasks.workunit.client.1.smithi119.stdout:9/915: dwrite d12/d1d/d28/d4d/d73/d78/fa9 [4194304,4194304] 0 2023-12-17T11:57:58.733 INFO:tasks.workunit.client.0.smithi002.stdout:0/854: rmdir d0/d15/d59/d102 0 2023-12-17T11:57:58.735 INFO:tasks.workunit.client.0.smithi002.stdout:9/999: getdents dc/d1d/d25/d85/dc2/df8 0 2023-12-17T11:57:58.738 INFO:tasks.workunit.client.0.smithi002.stdout:8/962: rename d3/d7/ff2 to d3/d7/d6e/daa/f14e 0 2023-12-17T11:57:58.739 INFO:tasks.workunit.client.1.smithi119.stdout:3/906: truncate d9/d35/f58 1476411 0 2023-12-17T11:57:58.739 INFO:tasks.workunit.client.1.smithi119.stdout:3/907: getdents d9/da/df/d67/d13f 0 2023-12-17T11:57:58.742 INFO:tasks.workunit.client.0.smithi002.stdout:4/831: getdents d0/d10/d14/d27/d57 0 2023-12-17T11:57:58.743 INFO:tasks.workunit.client.1.smithi119.stdout:1/856: mknod d3/db/d17/d24/d20/d6c/db7/de4/c139 0 2023-12-17T11:57:58.743 INFO:tasks.workunit.client.1.smithi119.stdout:1/857: stat d3/db/d17/d24/d20/dbd/dcb/l10c 0 2023-12-17T11:57:58.745 INFO:tasks.workunit.client.1.smithi119.stdout:0/849: mknod d2/d66/d2e/d44/d7b/d5/c103 0 2023-12-17T11:57:58.747 INFO:tasks.workunit.client.1.smithi119.stdout:5/935: mknod d1/da7/d71/d97/db3/c136 0 2023-12-17T11:57:58.749 INFO:tasks.workunit.client.0.smithi002.stdout:1/930: creat d3/d2f/d74/d97/f12c x:0 0 0 2023-12-17T11:57:58.752 INFO:tasks.workunit.client.1.smithi119.stdout:1/858: mkdir d3/db/d26/d8f/dd1/d13a 0 2023-12-17T11:57:58.752 INFO:tasks.workunit.client.0.smithi002.stdout:6/892: truncate d0/d1/d21/f2d 1915593 0 2023-12-17T11:57:58.753 INFO:tasks.workunit.client.1.smithi119.stdout:1/859: read d3/db/d2a/d127/d7e/da1/fb5 [387988,126837] 0 2023-12-17T11:57:58.755 INFO:tasks.workunit.client.0.smithi002.stdout:5/888: truncate dc/d94/ded/d2d/dcf/f92 717388 0 2023-12-17T11:57:58.757 INFO:tasks.workunit.client.1.smithi119.stdout:0/850: creat d2/d16/d35/de9/f104 x:0 0 0 2023-12-17T11:57:58.761 INFO:tasks.workunit.client.1.smithi119.stdout:1/860: link d3/db/d17/d24/d20/d40/d76/d84/ffb d3/d44/d89/d120/f13b 0 2023-12-17T11:57:58.762 INFO:tasks.workunit.client.1.smithi119.stdout:7/892: dwrite d2/d40/dc3/dca/dd9/ffa [0,4194304] 0 2023-12-17T11:57:58.762 INFO:tasks.workunit.client.1.smithi119.stdout:7/893: stat d2/d4/d11/d2c/d68 0 2023-12-17T11:57:58.765 INFO:tasks.workunit.client.0.smithi002.stdout:8/963: symlink d3/d7/d18/d74/d7b/d11c/db4/l14f 0 2023-12-17T11:57:58.767 INFO:tasks.workunit.client.1.smithi119.stdout:0/851: symlink d2/d66/d1f/d24/d50/dbd/dea/l105 0 2023-12-17T11:57:58.767 INFO:tasks.workunit.client.1.smithi119.stdout:0/852: creat d2/d66/d2e/d44/d7b/dbc/df4/f106 x:0 0 0 2023-12-17T11:57:58.767 INFO:tasks.workunit.client.1.smithi119.stdout:0/853: write d2/d16/d35/de9/f104 [795583,46436] 0 2023-12-17T11:57:58.767 INFO:tasks.workunit.client.0.smithi002.stdout:7/866: rmdir d6/d17/dc/d6c/dcb/deb 39 2023-12-17T11:57:58.776 INFO:tasks.workunit.client.0.smithi002.stdout:4/832: dread d0/d10/d14/d27/d69/d108/d99/f9f [0,4194304] 0 2023-12-17T11:57:58.779 INFO:tasks.workunit.client.0.smithi002.stdout:6/893: rmdir d0/d1/d21 39 2023-12-17T11:57:58.780 INFO:tasks.workunit.client.1.smithi119.stdout:5/936: dread d1/d44/f74 [0,4194304] 0 2023-12-17T11:57:58.786 INFO:tasks.workunit.client.1.smithi119.stdout:6/788: dwrite d2/d2b/f63 [4194304,4194304] 0 2023-12-17T11:57:58.790 INFO:tasks.workunit.client.0.smithi002.stdout:5/889: symlink dc/d94/d107/l132 0 2023-12-17T11:57:58.795 INFO:tasks.workunit.client.0.smithi002.stdout:1/931: getdents d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3 0 2023-12-17T11:57:58.798 INFO:tasks.workunit.client.0.smithi002.stdout:3/950: dwrite d9/d1b/d35/d41/d59/d7c/f5f [0,4194304] 0 2023-12-17T11:57:58.799 INFO:tasks.workunit.client.0.smithi002.stdout:2/880: dwrite d3/d4/f6 [4194304,4194304] 0 2023-12-17T11:57:58.800 INFO:tasks.workunit.client.0.smithi002.stdout:6/894: unlink d0/d1/dc/d17/dd7/cf3 0 2023-12-17T11:57:58.803 INFO:tasks.workunit.client.0.smithi002.stdout:4/833: creat d0/d10/d14/d27/d69/d108/d65/d78/f10e x:0 0 0 2023-12-17T11:57:58.806 INFO:tasks.workunit.client.1.smithi119.stdout:4/883: dwrite dd/f71 [0,4194304] 0 2023-12-17T11:57:58.806 INFO:tasks.workunit.client.1.smithi119.stdout:4/884: read - dd/d15/d4f/f8d zero size 2023-12-17T11:57:58.807 INFO:tasks.workunit.client.1.smithi119.stdout:1/861: creat d3/db/d2a/d127/d7e/f13c x:0 0 0 2023-12-17T11:57:58.810 INFO:tasks.workunit.client.0.smithi002.stdout:5/890: mknod dc/d17/d2f/c133 0 2023-12-17T11:57:58.810 INFO:tasks.workunit.client.0.smithi002.stdout:7/867: write d6/d17/dc/d13/d21/d2e/fae [1740320,28358] 0 2023-12-17T11:57:58.813 INFO:tasks.workunit.client.1.smithi119.stdout:5/937: rmdir d1/da7/d71/d76 39 2023-12-17T11:57:58.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/834: mkdir d0/d10/d14/d4e/d10f 0 2023-12-17T11:57:58.815 INFO:tasks.workunit.client.1.smithi119.stdout:6/789: creat d2/d2b/d43/dcb/ff7 x:0 0 0 2023-12-17T11:57:58.816 INFO:tasks.workunit.client.0.smithi002.stdout:7/868: symlink d6/d17/dc/d13/d37/l10c 0 2023-12-17T11:57:58.819 INFO:tasks.workunit.client.1.smithi119.stdout:3/908: dwrite d9/da/fd4 [4194304,4194304] 0 2023-12-17T11:57:58.820 INFO:tasks.workunit.client.0.smithi002.stdout:3/951: getdents d9/d1b/d35/df3/df8 0 2023-12-17T11:57:58.823 INFO:tasks.workunit.client.1.smithi119.stdout:4/885: mknod dd/d11/d2d/d9c/d55/d81/d88/c115 0 2023-12-17T11:57:58.823 INFO:tasks.workunit.client.1.smithi119.stdout:4/886: creat dd/d11/d2d/d9c/d55/d81/d88/d91/f116 x:0 0 0 2023-12-17T11:57:58.824 INFO:tasks.workunit.client.1.smithi119.stdout:9/916: dwrite d12/d65/f7d [4194304,4194304] 0 2023-12-17T11:57:58.824 INFO:tasks.workunit.client.1.smithi119.stdout:9/917: dread - d12/d1d/d28/d46/d50/d92/dae/dc9/f127 zero size 2023-12-17T11:57:58.824 INFO:tasks.workunit.client.1.smithi119.stdout:9/918: dread - d12/f97 zero size 2023-12-17T11:57:58.825 INFO:tasks.workunit.client.0.smithi002.stdout:0/855: dwrite d0/d6/d26/d14/d19/d37/d62/db8/ddd/ff9 [0,4194304] 0 2023-12-17T11:57:58.825 INFO:tasks.workunit.client.0.smithi002.stdout:0/856: readlink d0/d6/d26/d14/d19/d37/dcf/l43 0 2023-12-17T11:57:58.826 INFO:tasks.workunit.client.0.smithi002.stdout:4/835: symlink d0/d10/d14/d4e/l110 0 2023-12-17T11:57:58.826 INFO:tasks.workunit.client.0.smithi002.stdout:4/836: fsync d0/d10/f39 0 2023-12-17T11:57:58.826 INFO:tasks.workunit.client.1.smithi119.stdout:7/894: getdents d2/d4/d11/d2c/d68/d6a 0 2023-12-17T11:57:58.826 INFO:tasks.workunit.client.1.smithi119.stdout:7/895: write d2/d4/d11/d2c/d68/d99/d6c/def/fe3 [3950,126308] 0 2023-12-17T11:57:58.826 INFO:tasks.workunit.client.1.smithi119.stdout:7/896: truncate d2/d4/d11/d2c/d55/d67/ff8 289611 0 2023-12-17T11:57:58.828 INFO:tasks.workunit.client.0.smithi002.stdout:3/952: creat d9/d1b/d35/d41/d43/d4b/f12c x:0 0 0 2023-12-17T11:57:58.830 INFO:tasks.workunit.client.0.smithi002.stdout:1/932: dread d3/d2f/d74/dbd/fd7 [0,4194304] 0 2023-12-17T11:57:58.830 INFO:tasks.workunit.client.1.smithi119.stdout:5/938: getdents d1/da7/d71/d76 0 2023-12-17T11:57:58.834 INFO:tasks.workunit.client.1.smithi119.stdout:6/790: mkdir d2/d2b/d43/dcb/df8 0 2023-12-17T11:57:58.839 INFO:tasks.workunit.client.0.smithi002.stdout:4/837: rename d0/d10/d14/f4c to d0/d10/d21/d33/d96/f111 0 2023-12-17T11:57:58.841 INFO:tasks.workunit.client.0.smithi002.stdout:3/953: mknod d9/d1b/d35/df3/df8/c12d 0 2023-12-17T11:57:58.846 INFO:tasks.workunit.client.1.smithi119.stdout:9/919: creat d12/d1d/d49/ddb/df3/f12a x:0 0 0 2023-12-17T11:57:58.848 INFO:tasks.workunit.client.0.smithi002.stdout:1/933: link d3/d6/d9/f3c d3/d6/d9/d37/f12d 0 2023-12-17T11:57:58.848 INFO:tasks.workunit.client.0.smithi002.stdout:1/934: write d3/d2f/d4d/f6b [464088,31355] 0 2023-12-17T11:57:58.848 INFO:tasks.workunit.client.0.smithi002.stdout:1/935: stat d3/d6/d9/d37/d39/d43/d4a/f5f 0 2023-12-17T11:57:58.848 INFO:tasks.workunit.client.1.smithi119.stdout:8/764: sync 2023-12-17T11:57:58.849 INFO:tasks.workunit.client.1.smithi119.stdout:8/765: chown d7/da/d11/d26/d49/f8d 48 1 2023-12-17T11:57:58.851 INFO:tasks.workunit.client.1.smithi119.stdout:2/958: sync 2023-12-17T11:57:58.852 INFO:tasks.workunit.client.1.smithi119.stdout:2/959: creat d6/d38/f143 x:0 0 0 2023-12-17T11:57:58.852 INFO:tasks.workunit.client.1.smithi119.stdout:5/939: unlink d1/d70/d85/d95/dc3/f12d 0 2023-12-17T11:57:58.853 INFO:tasks.workunit.client.0.smithi002.stdout:3/954: rmdir d9/d15/d71 39 2023-12-17T11:57:58.859 INFO:tasks.workunit.client.1.smithi119.stdout:6/791: truncate d2/d2b/d43/f58 1685694 0 2023-12-17T11:57:58.859 INFO:tasks.workunit.client.1.smithi119.stdout:9/920: unlink d12/d1d/d49/f52 0 2023-12-17T11:57:58.860 INFO:tasks.workunit.client.0.smithi002.stdout:1/936: truncate d3/d6/d9/d37/d39/fb3 193730 0 2023-12-17T11:57:58.860 INFO:tasks.workunit.client.1.smithi119.stdout:2/960: write d6/d9/d86/f105 [43027,82948] 0 2023-12-17T11:57:58.860 INFO:tasks.workunit.client.1.smithi119.stdout:2/961: fsync d6/d9/d52/d53/d55/d58/da5/d133/de6/fed 0 2023-12-17T11:57:58.866 INFO:tasks.workunit.client.0.smithi002.stdout:3/955: rename d9/d24/cdf to d9/d24/d6f/c12e 0 2023-12-17T11:57:58.869 INFO:tasks.workunit.client.1.smithi119.stdout:7/897: rmdir d2/d4/d11/d2c/d68/d98 39 2023-12-17T11:57:58.869 INFO:tasks.workunit.client.1.smithi119.stdout:7/898: stat d2/d4/c44 0 2023-12-17T11:57:58.869 INFO:tasks.workunit.client.1.smithi119.stdout:7/899: fdatasync d2/d4/d11/d3c/ff2 0 2023-12-17T11:57:58.876 INFO:tasks.workunit.client.0.smithi002.stdout:0/857: dread d0/d6/d26/d14/f53 [0,4194304] 0 2023-12-17T11:57:58.877 INFO:tasks.workunit.client.0.smithi002.stdout:0/858: readlink d0/d6/d26/d14/l83 0 2023-12-17T11:57:58.877 INFO:tasks.workunit.client.0.smithi002.stdout:0/859: fdatasync d0/f13 0 2023-12-17T11:57:58.877 INFO:tasks.workunit.client.0.smithi002.stdout:0/860: chown d0/d6/d26/d14/d19/d37/dcf/faa 214596 1 2023-12-17T11:57:58.877 INFO:tasks.workunit.client.0.smithi002.stdout:0/861: chown d0/d6/d26/d14/d19/d2b/c95 789198037 1 2023-12-17T11:57:58.883 INFO:tasks.workunit.client.1.smithi119.stdout:9/921: symlink d12/dca/dbd/l12b 0 2023-12-17T11:57:58.884 INFO:tasks.workunit.client.1.smithi119.stdout:9/922: creat d12/d1d/d49/d85/dd2/f12c x:0 0 0 2023-12-17T11:57:58.885 INFO:tasks.workunit.client.1.smithi119.stdout:9/923: write d12/d1d/f36 [9373493,71489] 0 2023-12-17T11:57:58.888 INFO:tasks.workunit.client.1.smithi119.stdout:7/900: symlink d2/d4/d11/d3c/l113 0 2023-12-17T11:57:58.893 INFO:tasks.workunit.client.1.smithi119.stdout:2/962: dread d6/d2b/f87 [0,4194304] 0 2023-12-17T11:57:58.896 INFO:tasks.workunit.client.1.smithi119.stdout:8/766: rename d7/d18/d15/d64/ca0 to d7/d18/cf6 0 2023-12-17T11:57:58.898 INFO:tasks.workunit.client.0.smithi002.stdout:2/881: dwrite d3/d4/d7/d14/d2e/d37/d3f/d10e/f117 [0,4194304] 0 2023-12-17T11:57:58.903 INFO:tasks.workunit.client.0.smithi002.stdout:1/937: truncate d3/d6/d9/f3c 1743792 0 2023-12-17T11:57:58.904 INFO:tasks.workunit.client.1.smithi119.stdout:9/924: link d12/d65/f72 d12/d1d/d28/d46/d115/f12d 0 2023-12-17T11:57:58.906 INFO:tasks.workunit.client.0.smithi002.stdout:3/956: symlink d9/d15/d52/d79/l12f 0 2023-12-17T11:57:58.906 INFO:tasks.workunit.client.1.smithi119.stdout:7/901: rmdir d2/d4/d11/d2c/d68/d98 39 2023-12-17T11:57:58.906 INFO:tasks.workunit.client.1.smithi119.stdout:7/902: chown d2/d4/d11/d2c/d68/d99/c6f 27060909 1 2023-12-17T11:57:58.908 INFO:tasks.workunit.client.1.smithi119.stdout:2/963: truncate d6/f8a 948978 0 2023-12-17T11:57:58.909 INFO:tasks.workunit.client.0.smithi002.stdout:5/891: dwrite dc/d17/d2f/f110 [0,4194304] 0 2023-12-17T11:57:58.910 INFO:tasks.workunit.client.1.smithi119.stdout:4/887: dwrite dd/d11/d2d/d9c/d55/d81/db8/d78/f98 [0,4194304] 0 2023-12-17T11:57:58.911 INFO:tasks.workunit.client.1.smithi119.stdout:0/854: dwrite d2/dac/fad [0,4194304] 0 2023-12-17T11:57:58.912 INFO:tasks.workunit.client.1.smithi119.stdout:4/888: write dd/d4b/fac [500816,42374] 0 2023-12-17T11:57:58.913 INFO:tasks.workunit.client.0.smithi002.stdout:5/892: creat dc/d94/f134 x:0 0 0 2023-12-17T11:57:58.913 INFO:tasks.workunit.client.0.smithi002.stdout:5/893: write dc/d94/ded/ff7 [770453,49913] 0 2023-12-17T11:57:58.913 INFO:tasks.workunit.client.0.smithi002.stdout:6/895: dwrite d0/d1/dc/fed [0,4194304] 0 2023-12-17T11:57:58.913 INFO:tasks.workunit.client.1.smithi119.stdout:6/792: dwrite d2/d61/fb9 [8388608,4194304] 0 2023-12-17T11:57:58.914 INFO:tasks.workunit.client.1.smithi119.stdout:6/793: fdatasync d2/f9 0 2023-12-17T11:57:58.914 INFO:tasks.workunit.client.1.smithi119.stdout:6/794: creat d2/d2b/ff9 x:0 0 0 2023-12-17T11:57:58.914 INFO:tasks.workunit.client.1.smithi119.stdout:6/795: chown d2/d61/d8a/f9a 58432929 1 2023-12-17T11:57:58.914 INFO:tasks.workunit.client.1.smithi119.stdout:6/796: creat d2/d61/d8a/ffa x:0 0 0 2023-12-17T11:57:58.914 INFO:tasks.workunit.client.0.smithi002.stdout:2/882: mkdir d3/d50/df6/d133 0 2023-12-17T11:57:58.915 INFO:tasks.workunit.client.0.smithi002.stdout:3/957: link d9/d1b/d35/d41/d59/d65/da9/lcf d9/d15/d71/dbb/dc6/l130 0 2023-12-17T11:57:58.922 INFO:tasks.workunit.client.0.smithi002.stdout:1/938: dread d3/d6/d16/d28/f69 [0,4194304] 0 2023-12-17T11:57:58.925 INFO:tasks.workunit.client.1.smithi119.stdout:5/940: rename d1/d70/d6b/d77/f107 to d1/da7/d71/d97/f137 0 2023-12-17T11:57:58.925 INFO:tasks.workunit.client.1.smithi119.stdout:5/941: stat d1/d70/da3/d120 0 2023-12-17T11:57:58.925 INFO:tasks.workunit.client.1.smithi119.stdout:5/942: readlink d1/d44/d52/l58 0 2023-12-17T11:57:58.925 INFO:tasks.workunit.client.1.smithi119.stdout:5/943: readlink d1/d44/d52/lcb 0 2023-12-17T11:57:58.925 INFO:tasks.workunit.client.1.smithi119.stdout:5/944: write d1/da7/d71/d97/df0/d103/d12c/f101 [595041,102438] 0 2023-12-17T11:57:58.926 INFO:tasks.workunit.client.0.smithi002.stdout:7/869: dwrite d6/d17/db3/ffc [0,4194304] 0 2023-12-17T11:57:58.926 INFO:tasks.workunit.client.1.smithi119.stdout:8/767: mkdir d7/da/d1a/d84/df7 0 2023-12-17T11:57:58.930 INFO:tasks.workunit.client.1.smithi119.stdout:9/925: mkdir d12/d65/d12e 0 2023-12-17T11:57:58.934 INFO:tasks.workunit.client.1.smithi119.stdout:7/903: truncate d2/d4/d11/d2c/d68/d99/f37 1281164 0 2023-12-17T11:57:58.939 INFO:tasks.workunit.client.0.smithi002.stdout:3/958: getdents d9/d1b/d35/d41/d43/d73/d89 0 2023-12-17T11:57:58.939 INFO:tasks.workunit.client.0.smithi002.stdout:3/959: truncate d9/d24/fa8 5048698 0 2023-12-17T11:57:58.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/894: dread dc/d17/d2f/f3a [0,4194304] 0 2023-12-17T11:57:58.939 INFO:tasks.workunit.client.0.smithi002.stdout:5/895: read dc/d94/fce [311812,84197] 0 2023-12-17T11:57:58.940 INFO:tasks.workunit.client.1.smithi119.stdout:2/964: creat d6/d9/d52/d53/d55/daf/f144 x:0 0 0 2023-12-17T11:57:58.940 INFO:tasks.workunit.client.1.smithi119.stdout:2/965: chown d6/d9/d52/d53/d55/f7d 102 1 2023-12-17T11:57:58.940 INFO:tasks.workunit.client.0.smithi002.stdout:1/939: rename d3/d6/d16/d61/f86 to d3/d6/d9/d37/d39/d43/d4a/d7b/daa/d115/f12e 0 2023-12-17T11:57:58.952 INFO:tasks.workunit.client.0.smithi002.stdout:0/862: dwrite d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/f112 [0,4194304] 0 2023-12-17T11:57:58.954 INFO:tasks.workunit.client.1.smithi119.stdout:0/855: mkdir d2/d66/d107 0 2023-12-17T11:57:58.954 INFO:tasks.workunit.client.1.smithi119.stdout:0/856: write d2/d66/d2e/d44/fb9 [1232833,117948] 0 2023-12-17T11:57:58.956 INFO:tasks.workunit.client.1.smithi119.stdout:4/889: stat dd/d11/c17 0 2023-12-17T11:57:58.960 INFO:tasks.workunit.client.0.smithi002.stdout:2/883: getdents d3/d4/d17/d19/d4d/d72/d77 0 2023-12-17T11:57:58.960 INFO:tasks.workunit.client.0.smithi002.stdout:2/884: truncate d3/d4/d7/d14/d2e/d37/dce/f131 959142 0 2023-12-17T11:57:58.961 INFO:tasks.workunit.client.0.smithi002.stdout:4/838: dwrite d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/d10d/fde [0,4194304] 0 2023-12-17T11:57:58.961 INFO:tasks.workunit.client.0.smithi002.stdout:4/839: write d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/d10d/fdf [434439,44429] 0 2023-12-17T11:57:58.967 INFO:tasks.workunit.client.1.smithi119.stdout:6/797: mknod d2/d2b/d43/d5e/d92/da8/cfb 0 2023-12-17T11:57:58.967 INFO:tasks.workunit.client.1.smithi119.stdout:6/798: truncate d2/d2b/d43/dcb/fd0 262676 0 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/870: rename d6/d17/dc/d13/dd8/ld9 to d6/d17/dc/d13/d37/d4f/l10d 0 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/871: fdatasync d6/d17/dc/d67/d8b/d24/f43 0 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/872: fsync d6/d17/dc/f76 0 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/873: readlink d6/d17/dc/d13/l38 0 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/874: dread - d6/d99/da1/f104 zero size 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:7/875: fdatasync d6/d17/dc/d13/f57 0 2023-12-17T11:57:58.968 INFO:tasks.workunit.client.0.smithi002.stdout:1/940: unlink d3/d6/d9/d30/f41 0 2023-12-17T11:57:58.974 INFO:tasks.workunit.client.1.smithi119.stdout:5/945: unlink d1/da7/f121 0 2023-12-17T11:57:58.974 INFO:tasks.workunit.client.1.smithi119.stdout:5/946: creat d1/d70/d6b/df1/f138 x:0 0 0 2023-12-17T11:57:58.975 INFO:tasks.workunit.client.1.smithi119.stdout:5/947: chown d1/cd4 0 1 2023-12-17T11:57:58.975 INFO:tasks.workunit.client.1.smithi119.stdout:5/948: stat d1/d70/d85/d95/dc3/cd3 0 2023-12-17T11:57:58.981 INFO:tasks.workunit.client.1.smithi119.stdout:8/768: mknod d7/da/d1a/d8a/ddb/dbf/cf8 0 2023-12-17T11:57:58.981 INFO:tasks.workunit.client.1.smithi119.stdout:8/769: chown d7/d12/d23/db4 878 1 2023-12-17T11:57:58.995 INFO:tasks.workunit.client.1.smithi119.stdout:9/926: symlink d12/d1d/d49/l12f 0 2023-12-17T11:57:58.995 INFO:tasks.workunit.client.1.smithi119.stdout:9/927: chown d12/d1d/d28/d46/d50/f60 435010262 1 2023-12-17T11:57:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:6/896: dwrite d0/d1/dc/d17/dd6/feb [0,4194304] 0 2023-12-17T11:57:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/896: rmdir dc/d94/ded/dad 39 2023-12-17T11:57:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/897: dread - dc/f109 zero size 2023-12-17T11:57:58.998 INFO:tasks.workunit.client.0.smithi002.stdout:5/898: chown dc/d94/ded/d5a/d96/fec 74 1 2023-12-17T11:57:59.001 INFO:tasks.workunit.client.0.smithi002.stdout:2/885: read d3/d4/d17/d19/d8d/fb7 [842395,41629] 0 2023-12-17T11:57:59.003 INFO:tasks.workunit.client.0.smithi002.stdout:4/840: dread d0/d10/d14/f98 [0,4194304] 0 2023-12-17T11:57:59.005 INFO:tasks.workunit.client.0.smithi002.stdout:0/863: rename d0/d6/d26/d14/d90/f78 to d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/f117 0 2023-12-17T11:57:59.007 INFO:tasks.workunit.client.0.smithi002.stdout:3/960: dwrite d9/d24/d6f/f123 [0,4194304] 0 2023-12-17T11:57:59.008 INFO:tasks.workunit.client.1.smithi119.stdout:6/799: getdents d2/d2b/d43/de6 0 2023-12-17T11:57:59.015 INFO:tasks.workunit.client.1.smithi119.stdout:8/770: mkdir d7/d18/d45/d9f/d7b/df9 0 2023-12-17T11:57:59.015 INFO:tasks.workunit.client.1.smithi119.stdout:8/771: dread - d7/d12/fe6 zero size 2023-12-17T11:57:59.015 INFO:tasks.workunit.client.1.smithi119.stdout:8/772: chown d7/d18/d45/d9f/d75/l82 190231358 1 2023-12-17T11:57:59.017 INFO:tasks.workunit.client.1.smithi119.stdout:9/928: mknod d12/d1d/d28/d46/d50/c130 0 2023-12-17T11:57:59.017 INFO:tasks.workunit.client.1.smithi119.stdout:9/929: fsync d12/d1d/f36 0 2023-12-17T11:57:59.021 INFO:tasks.workunit.client.1.smithi119.stdout:8/773: write d7/da/fd8 [403886,6452] 0 2023-12-17T11:57:59.021 INFO:tasks.workunit.client.1.smithi119.stdout:8/774: creat d7/d18/d15/d81/d8e/ffa x:0 0 0 2023-12-17T11:57:59.025 INFO:tasks.workunit.client.0.smithi002.stdout:6/897: mknod d0/d1/dc/d58/c122 0 2023-12-17T11:57:59.025 INFO:tasks.workunit.client.0.smithi002.stdout:3/961: mkdir d9/d1b/d35/d41/d131 0 2023-12-17T11:57:59.026 INFO:tasks.workunit.client.0.smithi002.stdout:0/864: link d0/d6/d26/d14/d19/d61/de3/la5 d0/d6/d26/d14/d19/d37/d62/db8/ddd/l118 0 2023-12-17T11:57:59.026 INFO:tasks.workunit.client.1.smithi119.stdout:8/775: rename d7/d18/d45/le3 to d7/d18/d45/d9f/d75/lfb 0 2023-12-17T11:57:59.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/841: dread d0/d10/d21/f49 [4194304,4194304] 0 2023-12-17T11:57:59.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/842: write d0/d10/d21/f54 [836288,2849] 0 2023-12-17T11:57:59.027 INFO:tasks.workunit.client.0.smithi002.stdout:4/843: chown d0/d10/l1f 434716961 1 2023-12-17T11:57:59.027 INFO:tasks.workunit.client.0.smithi002.stdout:8/964: sync 2023-12-17T11:57:59.029 INFO:tasks.workunit.client.0.smithi002.stdout:6/898: mknod d0/d1/d6d/d83/da2/d11e/d8c/dce/c123 0 2023-12-17T11:57:59.030 INFO:tasks.workunit.client.0.smithi002.stdout:0/865: mknod d0/d15/d59/c119 0 2023-12-17T11:57:59.031 INFO:tasks.workunit.client.1.smithi119.stdout:8/776: mkdir d7/da/d1a/d8a/ddb/dbf/dfc 0 2023-12-17T11:57:59.033 INFO:tasks.workunit.client.0.smithi002.stdout:6/899: link d0/d1/dc/d17/d67/d6c/d7f/lb0 d0/d1/d6d/l124 0 2023-12-17T11:57:59.034 INFO:tasks.workunit.client.1.smithi119.stdout:2/966: dwrite d6/d2b/f87 [0,4194304] 0 2023-12-17T11:57:59.035 INFO:tasks.workunit.client.1.smithi119.stdout:5/949: dwrite d1/da7/fe1 [0,4194304] 0 2023-12-17T11:57:59.035 INFO:tasks.workunit.client.1.smithi119.stdout:5/950: chown d1/d70/d85/l88 787876 1 2023-12-17T11:57:59.036 INFO:tasks.workunit.client.1.smithi119.stdout:8/777: mkdir d7/d18/d45/d9f/d7b/df9/dfd 0 2023-12-17T11:57:59.038 INFO:tasks.workunit.client.0.smithi002.stdout:0/866: rename d0/d6/d26/d14/d19/d37/dcf/c100 to d0/d6/d26/d14/c11a 0 2023-12-17T11:57:59.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/899: write dc/d17/d1c/fae [3197254,102862] 0 2023-12-17T11:57:59.041 INFO:tasks.workunit.client.0.smithi002.stdout:5/900: chown dc/d94/ded/dad/f130 333 1 2023-12-17T11:57:59.043 INFO:tasks.workunit.client.0.smithi002.stdout:0/867: rename d0/d6/d26/d14/d19/d37/d62/d77/la1 to d0/d6/d26/d14/d19/d37/d62/d77/l11b 0 2023-12-17T11:57:59.044 INFO:tasks.workunit.client.1.smithi119.stdout:0/857: dwrite d2/d16/fd1 [0,4194304] 0 2023-12-17T11:57:59.044 INFO:tasks.workunit.client.0.smithi002.stdout:7/876: dwrite d6/d17/f47 [4194304,4194304] 0 2023-12-17T11:57:59.046 INFO:tasks.workunit.client.0.smithi002.stdout:4/844: dread d0/d10/d14/d27/d69/d108/f9a [0,4194304] 0 2023-12-17T11:57:59.047 INFO:tasks.workunit.client.1.smithi119.stdout:5/951: creat d1/d70/f139 x:0 0 0 2023-12-17T11:57:59.047 INFO:tasks.workunit.client.1.smithi119.stdout:5/952: truncate d1/da7/d71/d97/f137 293251 0 2023-12-17T11:57:59.047 INFO:tasks.workunit.client.1.smithi119.stdout:5/953: write d1/d70/d6b/f87 [525812,96401] 0 2023-12-17T11:57:59.051 INFO:tasks.workunit.client.0.smithi002.stdout:7/877: creat d6/d17/dc/d67/d8b/f10e x:0 0 0 2023-12-17T11:57:59.053 INFO:tasks.workunit.client.0.smithi002.stdout:4/845: creat d0/d10/d14/d27/d69/d108/f112 x:0 0 0 2023-12-17T11:57:59.053 INFO:tasks.workunit.client.0.smithi002.stdout:4/846: write d0/d10/d14/f106 [437634,67143] 0 2023-12-17T11:57:59.053 INFO:tasks.workunit.client.0.smithi002.stdout:8/965: write d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/f54 [4116066,114407] 0 2023-12-17T11:57:59.055 INFO:tasks.workunit.client.1.smithi119.stdout:0/858: rename d2/d66/d2e/d44/d7b/d5/dc/d7f/fc4 to d2/dcc/f108 0 2023-12-17T11:57:59.056 INFO:tasks.workunit.client.1.smithi119.stdout:2/967: dread d6/d9/f2a [0,4194304] 0 2023-12-17T11:57:59.056 INFO:tasks.workunit.client.0.smithi002.stdout:4/847: chown d0/d10/d21/c46 0 1 2023-12-17T11:57:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:4/848: mkdir d0/d10/d21/d33/d96/d113 0 2023-12-17T11:57:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:4/849: write d0/d10/df8/ff9 [305111,19406] 0 2023-12-17T11:57:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:4/850: write d0/d10/d14/f52 [5093495,92201] 0 2023-12-17T11:57:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:6/900: dread d0/d1/dc/d10/f86 [0,4194304] 0 2023-12-17T11:57:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:8/966: getdents d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112 0 2023-12-17T11:57:59.062 INFO:tasks.workunit.client.0.smithi002.stdout:8/967: chown d3/d8/da/d44/f102 57703 1 2023-12-17T11:57:59.065 INFO:tasks.workunit.client.1.smithi119.stdout:5/954: read d1/d70/d6b/fc4 [1812975,17877] 0 2023-12-17T11:57:59.067 INFO:tasks.workunit.client.0.smithi002.stdout:3/962: dread d9/d1b/d35/d41/d43/d73/f10e [0,4194304] 0 2023-12-17T11:57:59.072 INFO:tasks.workunit.client.1.smithi119.stdout:5/955: dread d1/d44/d52/f78 [0,4194304] 0 2023-12-17T11:57:59.072 INFO:tasks.workunit.client.1.smithi119.stdout:5/956: creat d1/d70/d6b/f13a x:0 0 0 2023-12-17T11:57:59.075 INFO:tasks.workunit.client.1.smithi119.stdout:5/957: creat d1/d44/f13b x:0 0 0 2023-12-17T11:57:59.077 INFO:tasks.workunit.client.1.smithi119.stdout:6/800: dwrite d2/d2b/d43/de6/d17/f7c [4194304,4194304] 0 2023-12-17T11:57:59.078 INFO:tasks.workunit.client.1.smithi119.stdout:6/801: creat d2/d7e/dbc/ddb/ffc x:0 0 0 2023-12-17T11:57:59.078 INFO:tasks.workunit.client.0.smithi002.stdout:3/963: read d9/d15/d52/d85/dd9/f106 [511952,5312] 0 2023-12-17T11:57:59.079 INFO:tasks.workunit.client.1.smithi119.stdout:6/802: mkdir d2/dba/dfd 0 2023-12-17T11:57:59.090 INFO:tasks.workunit.client.0.smithi002.stdout:6/901: rmdir d0/d1/dc 39 2023-12-17T11:57:59.096 INFO:tasks.workunit.client.1.smithi119.stdout:0/859: dread d2/d66/d2e/d44/d7b/d5/d3f/f5e [0,4194304] 0 2023-12-17T11:57:59.102 INFO:tasks.workunit.client.0.smithi002.stdout:8/968: dread d3/d8/d28/d31/f34 [0,4194304] 0 2023-12-17T11:57:59.102 INFO:tasks.workunit.client.0.smithi002.stdout:8/969: truncate d3/d7/d6e/d11a/f13d 155476 0 2023-12-17T11:57:59.103 INFO:tasks.workunit.client.0.smithi002.stdout:5/901: dread dc/d94/ded/d75/fff [0,4194304] 0 2023-12-17T11:57:59.104 INFO:tasks.workunit.client.1.smithi119.stdout:9/930: dwrite d12/d1d/d28/d4d/d73/d78/d8b/da0/f121 [0,4194304] 0 2023-12-17T11:57:59.108 INFO:tasks.workunit.client.0.smithi002.stdout:3/964: dread d9/d1b/d35/d41/d59/d7c/f117 [0,4194304] 0 2023-12-17T11:57:59.113 INFO:tasks.workunit.client.1.smithi119.stdout:6/803: dread d2/f11 [0,4194304] 0 2023-12-17T11:57:59.116 INFO:tasks.workunit.client.0.smithi002.stdout:0/868: dwrite d0/d6/d26/d14/d6d/d7e/fdc [0,4194304] 0 2023-12-17T11:57:59.129 INFO:tasks.workunit.client.0.smithi002.stdout:2/886: dwrite d3/d4/d8b/fdc [0,4194304] 0 2023-12-17T11:57:59.130 INFO:tasks.workunit.client.1.smithi119.stdout:8/778: dwrite d7/da/f41 [4194304,4194304] 0 2023-12-17T11:57:59.130 INFO:tasks.workunit.client.0.smithi002.stdout:4/851: dwrite d0/d10/d14/d27/d69/d108/d99/f9f [0,4194304] 0 2023-12-17T11:57:59.154 INFO:tasks.workunit.client.0.smithi002.stdout:5/902: dwrite dc/d1a/f46 [0,4194304] 0 2023-12-17T11:57:59.159 INFO:tasks.workunit.client.0.smithi002.stdout:8/970: mkdir d3/d7/d111/d13b/d150 0 2023-12-17T11:57:59.161 INFO:tasks.workunit.client.0.smithi002.stdout:1/941: dwrite d3/d2f/fb9 [0,4194304] 0 2023-12-17T11:57:59.162 INFO:tasks.workunit.client.0.smithi002.stdout:3/965: creat d9/d15/d71/d82/f132 x:0 0 0 2023-12-17T11:57:59.165 INFO:tasks.workunit.client.1.smithi119.stdout:9/931: dwrite d12/d1d/d28/d46/d50/d92/da1/fd0 [0,4194304] 0 2023-12-17T11:57:59.165 INFO:tasks.workunit.client.1.smithi119.stdout:9/932: chown d12/d1d/d28/l2a 6767 1 2023-12-17T11:57:59.165 INFO:tasks.workunit.client.1.smithi119.stdout:9/933: fdatasync d12/d1d/d49/f56 0 2023-12-17T11:57:59.165 INFO:tasks.workunit.client.1.smithi119.stdout:9/934: truncate d12/d1d/f5d 4313327 0 2023-12-17T11:57:59.166 INFO:tasks.workunit.client.0.smithi002.stdout:7/878: dwrite d6/d17/dc/d13/d21/d2e/fae [0,4194304] 0 2023-12-17T11:57:59.172 INFO:tasks.workunit.client.0.smithi002.stdout:7/879: write d6/d17/dc/d13/d21/d2e/d4a/daf/db1/fb4 [230538,58135] 0 2023-12-17T11:57:59.172 INFO:tasks.workunit.client.0.smithi002.stdout:0/869: symlink d0/d6/d26/d14/d19/d37/d91/dae/l11c 0 2023-12-17T11:57:59.173 INFO:tasks.workunit.client.1.smithi119.stdout:0/860: mknod d2/d66/d107/c109 0 2023-12-17T11:57:59.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/887: rmdir d3/d4/d7/d14/d2e/d37/dce/df1 39 2023-12-17T11:57:59.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/888: write d3/d50/f8f [4216146,88171] 0 2023-12-17T11:57:59.178 INFO:tasks.workunit.client.0.smithi002.stdout:4/852: dwrite d0/d10/d14/d27/d69/d108/d99/f9f [0,4194304] 0 2023-12-17T11:57:59.178 INFO:tasks.workunit.client.1.smithi119.stdout:6/804: mkdir d2/d2b/d43/d76/d8d/dc2/dfe 0 2023-12-17T11:57:59.179 INFO:tasks.workunit.client.1.smithi119.stdout:8/779: mknod d7/d18/d45/d9f/cfe 0 2023-12-17T11:57:59.179 INFO:tasks.workunit.client.1.smithi119.stdout:8/780: fdatasync d7/da/f41 0 2023-12-17T11:57:59.179 INFO:tasks.workunit.client.1.smithi119.stdout:8/781: chown d7/da/d1a 116469 1 2023-12-17T11:57:59.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/902: mknod d0/d1/dc/d17/d4c/c125 0 2023-12-17T11:57:59.186 INFO:tasks.workunit.client.0.smithi002.stdout:6/903: fdatasync d0/d1/dc/d58/dae/ddb/dc6/f107 0 2023-12-17T11:57:59.187 INFO:tasks.workunit.client.1.smithi119.stdout:9/935: symlink d12/d1d/d28/d4d/d73/l131 0 2023-12-17T11:57:59.190 INFO:tasks.workunit.client.0.smithi002.stdout:8/971: creat d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/d90/f151 x:0 0 0 2023-12-17T11:57:59.193 INFO:tasks.workunit.client.1.smithi119.stdout:9/936: mknod d12/d1d/d49/dad/c132 0 2023-12-17T11:57:59.195 INFO:tasks.workunit.client.0.smithi002.stdout:0/870: truncate d0/d15/f27 1871328 0 2023-12-17T11:57:59.202 INFO:tasks.workunit.client.0.smithi002.stdout:2/889: link d3/d4/d7/d14/d2e/cef d3/dd4/c134 0 2023-12-17T11:57:59.203 INFO:tasks.workunit.client.1.smithi119.stdout:9/937: symlink d12/d1d/d28/d4d/l133 0 2023-12-17T11:57:59.203 INFO:tasks.workunit.client.1.smithi119.stdout:9/938: chown d12/d1d/d28/d46/d50/d92/dae/f105 1931149 1 2023-12-17T11:57:59.204 INFO:tasks.workunit.client.1.smithi119.stdout:9/939: creat d12/d1d/d28/d86/d8f/f134 x:0 0 0 2023-12-17T11:57:59.204 INFO:tasks.workunit.client.1.smithi119.stdout:9/940: chown d12/d1d/d28/d86/d8f 9 1 2023-12-17T11:57:59.206 INFO:tasks.workunit.client.0.smithi002.stdout:4/853: rmdir d0/d10/d14/d27/d57/d7d 39 2023-12-17T11:57:59.210 INFO:tasks.workunit.client.0.smithi002.stdout:0/871: dread d0/d15/f23 [4194304,4194304] 0 2023-12-17T11:57:59.213 INFO:tasks.workunit.client.1.smithi119.stdout:9/941: creat d12/d65/d12e/f135 x:0 0 0 2023-12-17T11:57:59.214 INFO:tasks.workunit.client.0.smithi002.stdout:3/966: dwrite d9/d15/d71/d82/f132 [0,4194304] 0 2023-12-17T11:57:59.218 INFO:tasks.workunit.client.1.smithi119.stdout:9/942: unlink d12/d1d/d28/d46/dc0/f11f 0 2023-12-17T11:57:59.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/903: truncate dc/d1a/f46 3437077 0 2023-12-17T11:57:59.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: pgmap v32: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 263 MiB/s rd, 329 MiB/s wr, 476 op/s 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:58 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:59.228 INFO:tasks.workunit.client.0.smithi002.stdout:1/942: getdents d3/d6/d9/d30 0 2023-12-17T11:57:59.231 INFO:tasks.workunit.client.1.smithi119.stdout:6/805: dwrite d2/d2b/d43/de6/d17/fa4 [0,4194304] 0 2023-12-17T11:57:59.231 INFO:tasks.workunit.client.1.smithi119.stdout:6/806: write d2/da3/ff4 [797669,79263] 0 2023-12-17T11:57:59.236 INFO:tasks.workunit.client.1.smithi119.stdout:8/782: dwrite d7/d18/f3d [4194304,4194304] 0 2023-12-17T11:57:59.241 INFO:tasks.workunit.client.1.smithi119.stdout:8/783: symlink d7/d18/d45/d9f/d7b/df9/dfd/lff 0 2023-12-17T11:57:59.245 INFO:tasks.workunit.client.1.smithi119.stdout:8/784: mkdir d7/da/d11/d100 0 2023-12-17T11:57:59.246 INFO:tasks.workunit.client.1.smithi119.stdout:8/785: chown d7/d12/d69/d98/fb1 0 1 2023-12-17T11:57:59.246 INFO:tasks.workunit.client.1.smithi119.stdout:0/861: dwrite d2/d66/d1f/f22 [4194304,4194304] 0 2023-12-17T11:57:59.247 INFO:tasks.workunit.client.1.smithi119.stdout:0/862: chown d2/d16/f6f 123 1 2023-12-17T11:57:59.248 INFO:tasks.workunit.client.1.smithi119.stdout:6/807: write d2/d2b/d43/de6/d17/f7c [4097060,89347] 0 2023-12-17T11:57:59.249 INFO:tasks.workunit.client.1.smithi119.stdout:6/808: stat d2/dba 0 2023-12-17T11:57:59.249 INFO:tasks.workunit.client.1.smithi119.stdout:6/809: write d2/d2b/d43/de6/f55 [236810,95572] 0 2023-12-17T11:57:59.250 INFO:tasks.workunit.client.0.smithi002.stdout:2/890: creat d3/d4/d7/d14/d2e/d37/d11e/d12d/f135 x:0 0 0 2023-12-17T11:57:59.253 INFO:tasks.workunit.client.1.smithi119.stdout:8/786: creat d7/da/d1a/d8a/ddb/f101 x:0 0 0 2023-12-17T11:57:59.255 INFO:tasks.workunit.client.0.smithi002.stdout:0/872: link d0/d6/la d0/d6/d26/df2/l11d 0 2023-12-17T11:57:59.257 INFO:tasks.workunit.client.1.smithi119.stdout:9/943: dwrite d12/dca/ff8 [0,4194304] 0 2023-12-17T11:57:59.259 INFO:tasks.workunit.client.1.smithi119.stdout:0/863: symlink d2/d66/d1f/d24/d50/d5d/l10a 0 2023-12-17T11:57:59.259 INFO:tasks.workunit.client.1.smithi119.stdout:0/864: write d2/d66/f1c [813888,20752] 0 2023-12-17T11:57:59.262 INFO:tasks.workunit.client.0.smithi002.stdout:3/967: creat d9/d24/f133 x:0 0 0 2023-12-17T11:57:59.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/904: unlink dc/d1a/d47/c78 0 2023-12-17T11:57:59.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/905: truncate dc/d1a/d53/ffb 1010978 0 2023-12-17T11:57:59.265 INFO:tasks.workunit.client.0.smithi002.stdout:5/906: write dc/d94/ded/d5a/f5f [1760732,29654] 0 2023-12-17T11:57:59.266 INFO:tasks.workunit.client.1.smithi119.stdout:8/787: chown d7/d18/d15/c63 11162 1 2023-12-17T11:57:59.266 INFO:tasks.workunit.client.1.smithi119.stdout:8/788: chown d7/da/d11/l4d 6 1 2023-12-17T11:57:59.276 INFO:tasks.workunit.client.1.smithi119.stdout:9/944: dread d12/d1d/d49/f56 [0,4194304] 0 2023-12-17T11:57:59.276 INFO:tasks.workunit.client.1.smithi119.stdout:9/945: chown d12/l2d 866785 1 2023-12-17T11:57:59.276 INFO:tasks.workunit.client.1.smithi119.stdout:9/946: truncate d12/d1d/d79/f80 1869326 0 2023-12-17T11:57:59.279 INFO:tasks.workunit.client.1.smithi119.stdout:3/909: sync 2023-12-17T11:57:59.283 INFO:tasks.workunit.client.0.smithi002.stdout:3/968: unlink d9/d1b/d35/le1 0 2023-12-17T11:57:59.288 INFO:tasks.workunit.client.1.smithi119.stdout:1/862: sync 2023-12-17T11:57:59.288 INFO:tasks.workunit.client.1.smithi119.stdout:1/863: read d3/db/d26/f1d [7601721,126396] 0 2023-12-17T11:57:59.288 INFO:tasks.workunit.client.1.smithi119.stdout:1/864: truncate d3/db/d17/d24/f117 289719 0 2023-12-17T11:57:59.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/904: rename d0/d1/d6d/d83/d113/da5/dbc/dc4 to d0/d1/d6d/d83/da2/d126 0 2023-12-17T11:57:59.289 INFO:tasks.workunit.client.0.smithi002.stdout:6/905: write d0/d1/d5b/dda/f10a [4549625,20529] 0 2023-12-17T11:57:59.291 INFO:tasks.workunit.client.0.smithi002.stdout:2/891: symlink d3/d4/d7/l136 0 2023-12-17T11:57:59.292 INFO:tasks.workunit.client.0.smithi002.stdout:3/969: stat d9/d24/d6f/laf 0 2023-12-17T11:57:59.296 INFO:tasks.workunit.client.0.smithi002.stdout:8/972: rename d3/d7/d6e/fb1 to d3/d8/da/d44/f152 0 2023-12-17T11:57:59.297 INFO:tasks.workunit.client.0.smithi002.stdout:5/907: write dc/d17/f87 [340549,113782] 0 2023-12-17T11:57:59.298 INFO:tasks.workunit.client.1.smithi119.stdout:0/865: mknod d2/d66/d2e/d44/d7b/d5/d3f/d101/c10b 0 2023-12-17T11:57:59.298 INFO:tasks.workunit.client.1.smithi119.stdout:0/866: fsync d2/ff2 0 2023-12-17T11:57:59.301 INFO:tasks.workunit.client.1.smithi119.stdout:5/958: sync 2023-12-17T11:57:59.301 INFO:tasks.workunit.client.1.smithi119.stdout:7/904: sync 2023-12-17T11:57:59.301 INFO:tasks.workunit.client.1.smithi119.stdout:7/905: chown d2/d40/da7 1 1 2023-12-17T11:57:59.301 INFO:tasks.workunit.client.1.smithi119.stdout:7/906: chown d2/d4/d11/d2c/c3b 24 1 2023-12-17T11:57:59.301 INFO:tasks.workunit.client.1.smithi119.stdout:9/947: link d12/d1d/d28/d4d/f8c d12/d1d/d28/d4d/d73/d78/d8b/da0/f136 0 2023-12-17T11:57:59.303 INFO:tasks.workunit.client.1.smithi119.stdout:1/865: mknod d3/db/d106/d11f/c13d 0 2023-12-17T11:57:59.305 INFO:tasks.workunit.client.0.smithi002.stdout:8/973: mknod d3/d7/d18/d74/d7b/d11c/c153 0 2023-12-17T11:57:59.305 INFO:tasks.workunit.client.0.smithi002.stdout:6/906: rename d0/d1/dc/d17/f79 to d0/d1/dc/d17/d40/f127 0 2023-12-17T11:57:59.306 INFO:tasks.workunit.client.1.smithi119.stdout:3/910: dread d9/d11/d1e/d9f/dde/ff2 [0,4194304] 0 2023-12-17T11:57:59.307 INFO:tasks.workunit.client.1.smithi119.stdout:3/911: chown d9/da/fbc 173151 1 2023-12-17T11:57:59.308 INFO:tasks.workunit.client.0.smithi002.stdout:2/892: dread d3/d4/d7/d14/fa8 [0,4194304] 0 2023-12-17T11:57:59.310 INFO:tasks.workunit.client.0.smithi002.stdout:1/943: dwrite d3/d5c/f5d [0,4194304] 0 2023-12-17T11:57:59.310 INFO:tasks.workunit.client.0.smithi002.stdout:1/944: fsync d3/d6/f2b 0 2023-12-17T11:57:59.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/873: write d0/d15/f27 [1380912,18157] 0 2023-12-17T11:57:59.310 INFO:tasks.workunit.client.0.smithi002.stdout:0/874: dread - d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/d106/f113 zero size 2023-12-17T11:57:59.311 INFO:tasks.workunit.client.1.smithi119.stdout:7/907: symlink d2/d4/d11/l114 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/945: creat d3/d2f/d74/f12f x:0 0 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/946: stat d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3/f107 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.0.smithi002.stdout:1/947: fsync d3/d6/d9/d30/d9c/fec 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:2/968: sync 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:9/948: mknod d12/d1d/d28/d46/d6e/df5/c137 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:1/866: dread d3/db/d17/d24/d20/f7f [0,4194304] 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:9/949: write d12/d1d/d49/f57 [352073,126943] 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:4/890: sync 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:0/867: link d2/dac/cf3 d2/d66/d2e/d44/df0/c10c 0 2023-12-17T11:57:59.319 INFO:tasks.workunit.client.1.smithi119.stdout:0/868: fdatasync d2/d66/d1f/fdf 0 2023-12-17T11:57:59.320 INFO:tasks.workunit.client.1.smithi119.stdout:0/869: stat d2/d16/d35/de9/cf5 0 2023-12-17T11:57:59.320 INFO:tasks.workunit.client.0.smithi002.stdout:0/875: mknod d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/c11e 0 2023-12-17T11:57:59.323 INFO:tasks.workunit.client.1.smithi119.stdout:7/908: creat d2/d40/da7/f115 x:0 0 0 2023-12-17T11:57:59.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/970: write d9/d1b/d35/d41/d59/d7c/f5f [3888948,96515] 0 2023-12-17T11:57:59.324 INFO:tasks.workunit.client.0.smithi002.stdout:3/971: truncate d9/d24/d6f/f91 1527301 0 2023-12-17T11:57:59.338 INFO:tasks.workunit.client.0.smithi002.stdout:8/974: getdents d3/d8 0 2023-12-17T11:57:59.339 INFO:tasks.workunit.client.0.smithi002.stdout:1/948: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3/d130 0 2023-12-17T11:57:59.340 INFO:tasks.workunit.client.1.smithi119.stdout:0/870: write d2/dac/fad [950788,24027] 0 2023-12-17T11:57:59.340 INFO:tasks.workunit.client.1.smithi119.stdout:0/871: chown d2/d66/d2e/d44/d7b/d5/l1b 65339 1 2023-12-17T11:57:59.350 INFO:tasks.workunit.client.0.smithi002.stdout:0/876: mkdir d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/d11f 0 2023-12-17T11:57:59.350 INFO:tasks.workunit.client.0.smithi002.stdout:8/975: symlink d3/d7/d18/d74/d7b/d11c/db4/d117/l154 0 2023-12-17T11:57:59.350 INFO:tasks.workunit.client.0.smithi002.stdout:8/976: fdatasync d3/d7/d6e/daa/f14e 0 2023-12-17T11:57:59.352 INFO:tasks.workunit.client.1.smithi119.stdout:0/872: rmdir d2/d66/d2e/d44/d7b/d5 39 2023-12-17T11:57:59.354 INFO:tasks.workunit.client.1.smithi119.stdout:2/969: dread d6/d9/d13/d34/d56/f10e [0,4194304] 0 2023-12-17T11:57:59.362 INFO:tasks.workunit.client.1.smithi119.stdout:1/867: write d3/d44/dfd/d64/f7c [3985553,16207] 0 2023-12-17T11:57:59.365 INFO:tasks.workunit.client.0.smithi002.stdout:6/907: dwrite d0/d1/dc/d17/dd7/f109 [0,4194304] 0 2023-12-17T11:57:59.365 INFO:tasks.workunit.client.0.smithi002.stdout:1/949: getdents d3/d2f/d4d 0 2023-12-17T11:57:59.370 INFO:tasks.workunit.client.1.smithi119.stdout:2/970: rmdir d6/d9/d52/d53/d55/daf/d12e/d13c/da8 39 2023-12-17T11:57:59.371 INFO:tasks.workunit.client.1.smithi119.stdout:2/971: chown d6/f8a 12020 1 2023-12-17T11:57:59.371 INFO:tasks.workunit.client.1.smithi119.stdout:2/972: creat d6/d9/d13/f145 x:0 0 0 2023-12-17T11:57:59.371 INFO:tasks.workunit.client.1.smithi119.stdout:8/789: dwrite d7/d12/d23/f38 [4194304,4194304] 0 2023-12-17T11:57:59.371 INFO:tasks.workunit.client.1.smithi119.stdout:8/790: truncate d7/d12/ff2 955044 0 2023-12-17T11:57:59.375 INFO:tasks.workunit.client.1.smithi119.stdout:1/868: creat d3/db/d2a/de5/f13e x:0 0 0 2023-12-17T11:57:59.383 INFO:tasks.workunit.client.1.smithi119.stdout:4/891: write dd/f1b [6029075,73668] 0 2023-12-17T11:57:59.383 INFO:tasks.workunit.client.1.smithi119.stdout:8/791: mkdir d7/d102 0 2023-12-17T11:57:59.384 INFO:tasks.workunit.client.0.smithi002.stdout:6/908: link d0/d1/d6d/l6f d0/d1/d21/l128 0 2023-12-17T11:57:59.384 INFO:tasks.workunit.client.0.smithi002.stdout:7/880: sync 2023-12-17T11:57:59.384 INFO:tasks.workunit.client.0.smithi002.stdout:7/881: write d6/d99/da1/db9/f107 [803234,2125] 0 2023-12-17T11:57:59.384 INFO:tasks.workunit.client.0.smithi002.stdout:7/882: chown d6/d17/dc 1711499 1 2023-12-17T11:57:59.385 INFO:tasks.workunit.client.0.smithi002.stdout:1/950: rename d3/d2f/d74/dbd/cae to d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/d113/c131 0 2023-12-17T11:57:59.385 INFO:tasks.workunit.client.1.smithi119.stdout:8/792: mknod d7/da/d1a/d84/c103 0 2023-12-17T11:57:59.388 INFO:tasks.workunit.client.0.smithi002.stdout:0/877: write d0/d6/d26/d14/f10b [4610574,121328] 0 2023-12-17T11:57:59.389 INFO:tasks.workunit.client.0.smithi002.stdout:7/883: unlink d6/d17/dc/d67/d8b/f106 0 2023-12-17T11:57:59.389 INFO:tasks.workunit.client.0.smithi002.stdout:7/884: dread - d6/d17/dc/d6c/fc7 zero size 2023-12-17T11:57:59.389 INFO:tasks.workunit.client.0.smithi002.stdout:6/909: rename d0/c7c to d0/d1/dc/d10/c129 0 2023-12-17T11:57:59.389 INFO:tasks.workunit.client.0.smithi002.stdout:7/885: creat d6/d17/dc/d13/dd8/dd0/f10f x:0 0 0 2023-12-17T11:57:59.389 INFO:tasks.workunit.client.1.smithi119.stdout:8/793: mkdir d7/da/d1a/d84/d104 0 2023-12-17T11:57:59.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/951: creat d3/d2f/d74/dbe/dd8/f132 x:0 0 0 2023-12-17T11:57:59.391 INFO:tasks.workunit.client.0.smithi002.stdout:1/952: fsync d3/d6/fe 0 2023-12-17T11:57:59.392 INFO:tasks.workunit.client.1.smithi119.stdout:2/973: dread d6/d9/d52/d53/d55/daf/d12e/d13c/f98 [0,4194304] 0 2023-12-17T11:57:59.392 INFO:tasks.workunit.client.1.smithi119.stdout:8/794: mkdir d7/da/d1a/d84/d104/d105 0 2023-12-17T11:57:59.392 INFO:tasks.workunit.client.1.smithi119.stdout:8/795: chown d7/d18/d45/d9e/fbd 55797 1 2023-12-17T11:57:59.393 INFO:tasks.workunit.client.0.smithi002.stdout:6/910: creat d0/d1/dc/d17/f12a x:0 0 0 2023-12-17T11:57:59.394 INFO:tasks.workunit.client.1.smithi119.stdout:7/909: dread d2/d40/dc3/dca/dd9/ff4 [0,4194304] 0 2023-12-17T11:57:59.394 INFO:tasks.workunit.client.1.smithi119.stdout:5/959: dwrite d1/da7/d71/d76/fab [0,4194304] 0 2023-12-17T11:57:59.394 INFO:tasks.workunit.client.1.smithi119.stdout:5/960: write d1/d127/f12a [1289113,69165] 0 2023-12-17T11:57:59.394 INFO:tasks.workunit.client.1.smithi119.stdout:2/974: symlink d6/d9/d13/d34/d88/d139/l146 0 2023-12-17T11:57:59.394 INFO:tasks.workunit.client.1.smithi119.stdout:5/961: truncate d1/d25/f2c 5149364 0 2023-12-17T11:57:59.395 INFO:tasks.workunit.client.1.smithi119.stdout:5/962: chown d1/d44/la5 7235689 1 2023-12-17T11:57:59.397 INFO:tasks.workunit.client.1.smithi119.stdout:8/796: mkdir d7/da/d11/d26/d49/d106 0 2023-12-17T11:57:59.398 INFO:tasks.workunit.client.0.smithi002.stdout:0/878: dread d0/d6/d26/d14/d6d/d7e/f80 [0,4194304] 0 2023-12-17T11:57:59.403 INFO:tasks.workunit.client.0.smithi002.stdout:7/886: read d6/d17/dc/d13/d37/d4f/f63 [2024939,54607] 0 2023-12-17T11:57:59.404 INFO:tasks.workunit.client.0.smithi002.stdout:7/887: creat d6/d17/dc/d13/d21/d2e/dd5/f110 x:0 0 0 2023-12-17T11:57:59.404 INFO:tasks.workunit.client.0.smithi002.stdout:7/888: fdatasync d6/d17/dc/d13/f30 0 2023-12-17T11:57:59.404 INFO:tasks.workunit.client.0.smithi002.stdout:7/889: truncate d6/d17/dc/d13/dd8/dd0/f10f 467106 0 2023-12-17T11:57:59.404 INFO:tasks.workunit.client.0.smithi002.stdout:7/890: fdatasync d6/d17/dc/fe8 0 2023-12-17T11:57:59.404 INFO:tasks.workunit.client.0.smithi002.stdout:7/891: write d6/d17/db3/fe3 [257099,115347] 0 2023-12-17T11:57:59.405 INFO:tasks.workunit.client.0.smithi002.stdout:1/953: creat d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dcd/de3/d130/f133 x:0 0 0 2023-12-17T11:57:59.405 INFO:tasks.workunit.client.0.smithi002.stdout:5/908: dwrite dc/d94/ded/d2d/d5b/fa2 [0,4194304] 0 2023-12-17T11:57:59.405 INFO:tasks.workunit.client.0.smithi002.stdout:5/909: write dc/d94/ded/d2d/f11a [751759,121023] 0 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: pgmap v32: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 263 MiB/s rd, 329 MiB/s wr, 476 op/s 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:57:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:58 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:59.410 INFO:tasks.workunit.client.0.smithi002.stdout:4/854: dwrite d0/d10/d14/d27/d69/d108/d65/f67 [0,4194304] 0 2023-12-17T11:57:59.411 INFO:tasks.workunit.client.1.smithi119.stdout:2/975: link d6/d9/d13/d34/d88/l8b d6/d2b/da3/d142/d5d/d11c/l147 0 2023-12-17T11:57:59.412 INFO:tasks.workunit.client.1.smithi119.stdout:2/976: stat d6/d2b/da3/d142/d5d/d11c/ce5 0 2023-12-17T11:57:59.415 INFO:tasks.workunit.client.1.smithi119.stdout:8/797: rename d7/d18/d45/f83 to d7/da/d1a/d84/d104/d105/f107 0 2023-12-17T11:57:59.415 INFO:tasks.workunit.client.1.smithi119.stdout:6/810: dwrite d2/f98 [0,4194304] 0 2023-12-17T11:57:59.415 INFO:tasks.workunit.client.1.smithi119.stdout:8/798: fsync d7/d18/d45/d9e/fbd 0 2023-12-17T11:57:59.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/911: rename d0/d1/dc/d17/f42 to d0/d1/d28/f12b 0 2023-12-17T11:57:59.417 INFO:tasks.workunit.client.0.smithi002.stdout:0/879: getdents d0/d6/d26/d14/d19/d37/d62/d77/dee 0 2023-12-17T11:57:59.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/912: dread - d0/d1/d28/dde/f102 zero size 2023-12-17T11:57:59.417 INFO:tasks.workunit.client.0.smithi002.stdout:6/913: chown d0/c7 67 1 2023-12-17T11:57:59.421 INFO:tasks.workunit.client.1.smithi119.stdout:5/963: write d1/d70/d6b/d77/dae/dba/de3/fa1 [47858,14454] 0 2023-12-17T11:57:59.421 INFO:tasks.workunit.client.1.smithi119.stdout:5/964: chown d1/d70/d6b/d77/dae/dba/de3/d11f/d129/f131 1387 1 2023-12-17T11:57:59.421 INFO:tasks.workunit.client.1.smithi119.stdout:2/977: creat d6/d9/d52/d53/d55/daf/d12e/d13c/da8/d122/f148 x:0 0 0 2023-12-17T11:57:59.421 INFO:tasks.workunit.client.1.smithi119.stdout:2/978: chown d6/d2b/l123 246108 1 2023-12-17T11:57:59.424 INFO:tasks.workunit.client.1.smithi119.stdout:9/950: dwrite d12/d1d/f27 [0,4194304] 0 2023-12-17T11:57:59.428 INFO:tasks.workunit.client.1.smithi119.stdout:8/799: mkdir d7/d18/d45/d9f/d7b/d108 0 2023-12-17T11:57:59.435 INFO:tasks.workunit.client.1.smithi119.stdout:3/912: dwrite d9/da/df/d41/d33/d3a/fc8 [4194304,4194304] 0 2023-12-17T11:57:59.435 INFO:tasks.workunit.client.1.smithi119.stdout:3/913: truncate d9/d44/db7/f116 338673 0 2023-12-17T11:57:59.435 INFO:tasks.workunit.client.1.smithi119.stdout:3/914: chown d9/d59/dae/l11a 201139 1 2023-12-17T11:57:59.435 INFO:tasks.workunit.client.0.smithi002.stdout:8/977: dwrite d3/d7/d18/d74/d7b/d11c/d7c/f9b [0,4194304] 0 2023-12-17T11:57:59.436 INFO:tasks.workunit.client.0.smithi002.stdout:8/978: creat d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/d90/f155 x:0 0 0 2023-12-17T11:57:59.439 INFO:tasks.workunit.client.1.smithi119.stdout:2/979: symlink d6/d9/d52/d53/d55/daf/d12e/l149 0 2023-12-17T11:57:59.440 INFO:tasks.workunit.client.0.smithi002.stdout:7/892: mknod d6/d17/dc/d13/dd8/db0/dfd/c111 0 2023-12-17T11:57:59.440 INFO:tasks.workunit.client.0.smithi002.stdout:1/954: write d3/d6/d9/d37/d39/d43/d4a/fc9 [1636217,93309] 0 2023-12-17T11:57:59.443 INFO:tasks.workunit.client.1.smithi119.stdout:6/811: write d2/d2b/d43/de6/f30 [41127,75443] 0 2023-12-17T11:57:59.443 INFO:tasks.workunit.client.1.smithi119.stdout:0/873: dwrite d2/d66/d2e/d44/df0/fa7 [0,4194304] 0 2023-12-17T11:57:59.447 INFO:tasks.workunit.client.1.smithi119.stdout:9/951: rmdir d12/d1d/d49/d85/df6 0 2023-12-17T11:57:59.451 INFO:tasks.workunit.client.1.smithi119.stdout:3/915: mknod d9/d11/d1e/d55/df3/d129/c14f 0 2023-12-17T11:57:59.451 INFO:tasks.workunit.client.1.smithi119.stdout:3/916: truncate d9/da/df/d41/d33/db4/f14b 824261 0 2023-12-17T11:57:59.451 INFO:tasks.workunit.client.1.smithi119.stdout:3/917: dread - d9/da/f91 zero size 2023-12-17T11:57:59.453 INFO:tasks.workunit.client.1.smithi119.stdout:6/812: symlink d2/d2b/d43/d76/dbd/lff 0 2023-12-17T11:57:59.453 INFO:tasks.workunit.client.1.smithi119.stdout:6/813: chown d2/d2b/d43/de6/f1f 0 1 2023-12-17T11:57:59.456 INFO:tasks.workunit.client.1.smithi119.stdout:2/980: creat d6/d9/d86/db0/d12a/f14a x:0 0 0 2023-12-17T11:57:59.458 INFO:tasks.workunit.client.1.smithi119.stdout:1/869: dwrite d3/db/d17/d24/d20/dbd/dcb/ff3 [0,4194304] 0 2023-12-17T11:57:59.459 INFO:tasks.workunit.client.1.smithi119.stdout:4/892: dwrite f8 [0,4194304] 0 2023-12-17T11:57:59.459 INFO:tasks.workunit.client.1.smithi119.stdout:4/893: read dd/d11/f74 [25996,80802] 0 2023-12-17T11:57:59.459 INFO:tasks.workunit.client.1.smithi119.stdout:4/894: write dd/d11/f103 [852965,68129] 0 2023-12-17T11:57:59.459 INFO:tasks.workunit.client.1.smithi119.stdout:4/895: chown dd/d11/d2d/d9c/d55/d81/db8/c49 723 1 2023-12-17T11:57:59.459 INFO:tasks.workunit.client.1.smithi119.stdout:7/910: dwrite d2/d4/d11/d3c/f9e [0,4194304] 0 2023-12-17T11:57:59.460 INFO:tasks.workunit.client.1.smithi119.stdout:0/874: link d2/d16/fbf d2/dcc/f10d 0 2023-12-17T11:57:59.460 INFO:tasks.workunit.client.1.smithi119.stdout:0/875: write d2/d66/fba [4246352,81242] 0 2023-12-17T11:57:59.463 INFO:tasks.workunit.client.1.smithi119.stdout:3/918: rename d9/da/df/d41/d113 to d9/d11/d1e/d9f/d150 0 2023-12-17T11:57:59.468 INFO:tasks.workunit.client.0.smithi002.stdout:6/914: dwrite d0/d1/d6d/d83/d113/da5/f68 [0,4194304] 0 2023-12-17T11:57:59.469 INFO:tasks.workunit.client.1.smithi119.stdout:6/814: mkdir d2/d2b/d100 0 2023-12-17T11:57:59.472 INFO:tasks.workunit.client.1.smithi119.stdout:2/981: mknod d6/d2b/da3/dc0/c14b 0 2023-12-17T11:57:59.473 INFO:tasks.workunit.client.0.smithi002.stdout:7/893: write d6/d17/f47 [4936477,126396] 0 2023-12-17T11:57:59.475 INFO:tasks.workunit.client.0.smithi002.stdout:4/855: symlink d0/d10/d14/d27/d57/l114 0 2023-12-17T11:57:59.475 INFO:tasks.workunit.client.0.smithi002.stdout:4/856: chown d0/d10/df8/ff9 10 1 2023-12-17T11:57:59.477 INFO:tasks.workunit.client.1.smithi119.stdout:5/965: dwrite d1/d25/f68 [0,4194304] 0 2023-12-17T11:57:59.482 INFO:tasks.workunit.client.1.smithi119.stdout:3/919: write d9/d1c/f4d [896127,65030] 0 2023-12-17T11:57:59.482 INFO:tasks.workunit.client.1.smithi119.stdout:3/920: write d9/d11/d1e/d9f/f148 [36,52789] 0 2023-12-17T11:57:59.484 INFO:tasks.workunit.client.1.smithi119.stdout:1/870: creat d3/db/d17/d24/d20/d40/d76/d96/f13f x:0 0 0 2023-12-17T11:57:59.488 INFO:tasks.workunit.client.1.smithi119.stdout:4/896: mknod dd/d15/d16/d3d/dab/db1/c117 0 2023-12-17T11:57:59.490 INFO:tasks.workunit.client.0.smithi002.stdout:8/979: mknod d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/d65/c156 0 2023-12-17T11:57:59.490 INFO:tasks.workunit.client.0.smithi002.stdout:8/980: fdatasync d3/d7/d6e/fd1 0 2023-12-17T11:57:59.490 INFO:tasks.workunit.client.0.smithi002.stdout:4/857: write d0/d10/d14/d4e/f9c [1611070,68730] 0 2023-12-17T11:57:59.490 INFO:tasks.workunit.client.0.smithi002.stdout:5/910: getdents dc/d1a/d7c 0 2023-12-17T11:57:59.490 INFO:tasks.workunit.client.0.smithi002.stdout:5/911: stat dc/f109 0 2023-12-17T11:57:59.491 INFO:tasks.workunit.client.1.smithi119.stdout:7/911: mkdir d2/d40/dc3/dc8/d116 0 2023-12-17T11:57:59.493 INFO:tasks.workunit.client.1.smithi119.stdout:0/876: creat d2/d66/d1f/d24/d50/dbd/f10e x:0 0 0 2023-12-17T11:57:59.496 INFO:tasks.workunit.client.0.smithi002.stdout:1/955: creat d3/d6/d9/d37/d39/d43/d4a/d10a/f134 x:0 0 0 2023-12-17T11:57:59.496 INFO:tasks.workunit.client.0.smithi002.stdout:1/956: chown d3/d2f/d74/dbe/lf2 7301 1 2023-12-17T11:57:59.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/894: unlink d6/d17/dc/f76 0 2023-12-17T11:57:59.496 INFO:tasks.workunit.client.0.smithi002.stdout:7/895: chown d6/d99/da1 5 1 2023-12-17T11:57:59.498 INFO:tasks.workunit.client.0.smithi002.stdout:0/880: dwrite d0/d6/d26/d14/d6d/d7e/fdc [0,4194304] 0 2023-12-17T11:57:59.502 INFO:tasks.workunit.client.1.smithi119.stdout:2/982: dread d6/f33 [0,4194304] 0 2023-12-17T11:57:59.502 INFO:tasks.workunit.client.1.smithi119.stdout:8/800: dwrite d7/fb [0,4194304] 0 2023-12-17T11:57:59.504 INFO:tasks.workunit.client.0.smithi002.stdout:4/858: rename d0/d5a/f71 to d0/d10/d14/d27/d69/d108/d65/d78/f115 0 2023-12-17T11:57:59.511 INFO:tasks.workunit.client.0.smithi002.stdout:0/881: creat d0/d6/d26/d14/d19/d37/dcf/f120 x:0 0 0 2023-12-17T11:57:59.514 INFO:tasks.workunit.client.1.smithi119.stdout:6/815: unlink d2/d2b/d43/d76/d8d/cd3 0 2023-12-17T11:57:59.524 INFO:tasks.workunit.client.1.smithi119.stdout:4/897: unlink dd/d11/d2d/cb6 0 2023-12-17T11:57:59.524 INFO:tasks.workunit.client.1.smithi119.stdout:4/898: fdatasync dd/d15/d16/d20/d82/fa5 0 2023-12-17T11:57:59.525 INFO:tasks.workunit.client.0.smithi002.stdout:6/915: dwrite d0/d1/dc/f34 [0,4194304] 0 2023-12-17T11:57:59.525 INFO:tasks.workunit.client.0.smithi002.stdout:6/916: getdents d0/d1/dc/d17/d67/d6c/d9f 0 2023-12-17T11:57:59.527 INFO:tasks.workunit.client.1.smithi119.stdout:7/912: rename d2/d4/d11/d2c/d68/d98/fae to d2/d5b/f117 0 2023-12-17T11:57:59.527 INFO:tasks.workunit.client.1.smithi119.stdout:7/913: write d2/d4/d11/d3c/fdb [250295,112335] 0 2023-12-17T11:57:59.530 INFO:tasks.workunit.client.0.smithi002.stdout:6/917: truncate d0/d1/dc/d17/fa0 3581960 0 2023-12-17T11:57:59.536 INFO:tasks.workunit.client.1.smithi119.stdout:0/877: read d2/d66/d2e/d44/df0/fa7 [503042,63593] 0 2023-12-17T11:57:59.538 INFO:tasks.workunit.client.0.smithi002.stdout:0/882: write d0/d6/d26/d14/d19/d37/dcf/f71 [238596,117667] 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.0.smithi002.stdout:0/883: chown d0/d6/d26/d14/d90/f105 1139 1 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.0.smithi002.stdout:0/884: fdatasync d0/d6/d26/d14/d19/d37/dcf/f120 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.0.smithi002.stdout:0/885: truncate d0/d6/d26/d14/d19/d37/f4d 495970 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.0.smithi002.stdout:0/886: write d0/d6/d26/d14/d19/d2b/fea [639834,33772] 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.1.smithi119.stdout:6/816: link d2/d2b/l6b d2/d7e/dbc/ddb/l101 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.1.smithi119.stdout:8/801: creat d7/d18/d45/f109 x:0 0 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.1.smithi119.stdout:6/817: dread - d2/d61/d8a/ffa zero size 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.1.smithi119.stdout:6/818: creat d2/d2b/d43/d76/d8d/dc2/f102 x:0 0 0 2023-12-17T11:57:59.539 INFO:tasks.workunit.client.1.smithi119.stdout:6/819: write d2/d2b/d43/d5e/fd4 [1298620,11728] 0 2023-12-17T11:57:59.540 INFO:tasks.workunit.client.1.smithi119.stdout:1/871: rmdir d3/db/d26/d5e 39 2023-12-17T11:57:59.540 INFO:tasks.workunit.client.1.smithi119.stdout:7/914: creat d2/d4/d11/d2c/d55/d103/f118 x:0 0 0 2023-12-17T11:57:59.540 INFO:tasks.workunit.client.1.smithi119.stdout:2/983: dread d6/d9/d13/d34/f99 [0,4194304] 0 2023-12-17T11:57:59.540 INFO:tasks.workunit.client.1.smithi119.stdout:4/899: write dd/d11/f103 [424464,80513] 0 2023-12-17T11:57:59.540 INFO:tasks.workunit.client.0.smithi002.stdout:0/887: symlink d0/d15/d59/l121 0 2023-12-17T11:57:59.542 INFO:tasks.workunit.client.1.smithi119.stdout:8/802: mknod d7/d18/d45/d9f/d7b/df9/dfd/c10a 0 2023-12-17T11:57:59.542 INFO:tasks.workunit.client.1.smithi119.stdout:8/803: stat d7/d18/d15 0 2023-12-17T11:57:59.543 INFO:tasks.workunit.client.0.smithi002.stdout:4/859: dread d0/d5a/f76 [0,4194304] 0 2023-12-17T11:57:59.544 INFO:tasks.workunit.client.1.smithi119.stdout:3/921: dwrite d9/d35/dbd/dfb/d107/dd3/f12b [0,4194304] 0 2023-12-17T11:57:59.544 INFO:tasks.workunit.client.1.smithi119.stdout:8/804: write d7/d12/ff2 [16660,120945] 0 2023-12-17T11:57:59.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/957: dwrite d3/d2f/d4d/d95/d100/f10f [0,4194304] 0 2023-12-17T11:57:59.545 INFO:tasks.workunit.client.0.smithi002.stdout:1/958: write d3/d6/d9/d37/d39/d43/d4a/d7b/dde/f10e [697192,95922] 0 2023-12-17T11:57:59.549 INFO:tasks.workunit.client.0.smithi002.stdout:8/981: dread d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/d65/da2/fb5 [0,4194304] 0 2023-12-17T11:57:59.550 INFO:tasks.workunit.client.1.smithi119.stdout:1/872: dread d3/db/d26/d19/f70 [0,4194304] 0 2023-12-17T11:57:59.554 INFO:tasks.workunit.client.0.smithi002.stdout:4/860: creat d0/d10/d21/d33/d96/f116 x:0 0 0 2023-12-17T11:57:59.555 INFO:tasks.workunit.client.1.smithi119.stdout:7/915: mknod d2/d4/d11/d2c/d68/d77/c119 0 2023-12-17T11:57:59.555 INFO:tasks.workunit.client.1.smithi119.stdout:7/916: write d2/d4/f29 [428938,38836] 0 2023-12-17T11:57:59.557 INFO:tasks.workunit.client.1.smithi119.stdout:8/805: dread d7/d12/fba [0,4194304] 0 2023-12-17T11:57:59.559 INFO:tasks.workunit.client.1.smithi119.stdout:2/984: mkdir d6/d9/d52/d53/d55/daf/d12e/d13c/d5b/dfd/d14c 0 2023-12-17T11:57:59.561 INFO:tasks.workunit.client.1.smithi119.stdout:0/878: write d2/d66/d1f/f22 [4798955,17479] 0 2023-12-17T11:57:59.561 INFO:tasks.workunit.client.1.smithi119.stdout:0/879: write d2/d66/d2e/d44/d7b/fd4 [83457,119255] 0 2023-12-17T11:57:59.562 INFO:tasks.workunit.client.1.smithi119.stdout:0/880: write d2/d66/d2e/d44/d7b/d5/dc/faa [442389,126315] 0 2023-12-17T11:57:59.562 INFO:tasks.workunit.client.1.smithi119.stdout:0/881: write d2/d66/fd8 [208521,77672] 0 2023-12-17T11:57:59.562 INFO:tasks.workunit.client.1.smithi119.stdout:0/882: fdatasync d2/d66/d2e/d44/df0/fd9 0 2023-12-17T11:57:59.563 INFO:tasks.workunit.client.1.smithi119.stdout:8/806: write d7/d12/fba [567039,79660] 0 2023-12-17T11:57:59.569 INFO:tasks.workunit.client.0.smithi002.stdout:2/893: sync 2023-12-17T11:57:59.569 INFO:tasks.workunit.client.0.smithi002.stdout:3/972: sync 2023-12-17T11:57:59.571 INFO:tasks.workunit.client.0.smithi002.stdout:4/861: truncate d0/d10/d21/f49 927833 0 2023-12-17T11:57:59.571 INFO:tasks.workunit.client.0.smithi002.stdout:4/862: write d0/d10/d14/d27/d69/d108/d65/d78/f10e [1035331,107510] 0 2023-12-17T11:57:59.571 INFO:tasks.workunit.client.0.smithi002.stdout:4/863: dread - d0/d10/d14/d27/d69/d108/d65/d78/d85/f93 zero size 2023-12-17T11:57:59.575 INFO:tasks.workunit.client.1.smithi119.stdout:3/922: symlink d9/da/df/d41/l151 0 2023-12-17T11:57:59.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/900: read dd/d15/d16/d3d/f4c [925080,3175] 0 2023-12-17T11:57:59.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/901: truncate dd/d15/d16/d3d/f84 1174891 0 2023-12-17T11:57:59.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/902: chown dd/d15/d16/d20/d82/l9b 97345 1 2023-12-17T11:57:59.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/903: write dd/d11/d2d/d9c/d55/d81/d88/d91/f116 [98616,51221] 0 2023-12-17T11:57:59.575 INFO:tasks.workunit.client.1.smithi119.stdout:4/904: truncate dd/d15/fe7 126638 0 2023-12-17T11:57:59.576 INFO:tasks.workunit.client.0.smithi002.stdout:6/918: dread d0/d1/d6d/d83/d113/da5/f8d [0,4194304] 0 2023-12-17T11:57:59.577 INFO:tasks.workunit.client.0.smithi002.stdout:6/919: stat d0/d1/dc/d17/d67/d6c 0 2023-12-17T11:57:59.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/920: chown d0/d1/d6d/d83/d113/da5/f97 3058 1 2023-12-17T11:57:59.578 INFO:tasks.workunit.client.0.smithi002.stdout:6/921: fsync d0/d1/dc/f8 0 2023-12-17T11:57:59.583 INFO:tasks.workunit.client.1.smithi119.stdout:7/917: symlink d2/d40/dc3/dc8/d116/l11a 0 2023-12-17T11:57:59.584 INFO:tasks.workunit.client.0.smithi002.stdout:7/896: dwrite d6/d17/dc/d13/dd8/dd0/ff6 [0,4194304] 0 2023-12-17T11:57:59.584 INFO:tasks.workunit.client.0.smithi002.stdout:7/897: write d6/d17/dc/d13/dd8/db0/fdc [873229,8972] 0 2023-12-17T11:57:59.591 INFO:tasks.workunit.client.1.smithi119.stdout:2/985: mknod d6/d9/d13/d34/d70/dff/c14d 0 2023-12-17T11:57:59.597 INFO:tasks.workunit.client.0.smithi002.stdout:2/894: write d3/d4/d43/fdf [2382905,107672] 0 2023-12-17T11:57:59.597 INFO:tasks.workunit.client.0.smithi002.stdout:6/922: unlink d0/d1/dc/d17/dd6/fc2 0 2023-12-17T11:57:59.597 INFO:tasks.workunit.client.0.smithi002.stdout:3/973: write d9/d15/f19 [4642994,53897] 0 2023-12-17T11:57:59.599 INFO:tasks.workunit.client.0.smithi002.stdout:3/974: chown d9/d1b/d35/d41/d59/d72/lb4 20 1 2023-12-17T11:57:59.599 INFO:tasks.workunit.client.0.smithi002.stdout:3/975: fdatasync d9/d15/d52/fc8 0 2023-12-17T11:57:59.602 INFO:tasks.workunit.client.0.smithi002.stdout:2/895: symlink d3/d4/d7/d14/d42/d8a/dd8/l137 0 2023-12-17T11:57:59.602 INFO:tasks.workunit.client.0.smithi002.stdout:2/896: truncate d3/d4/d7/d14/f48 799180 0 2023-12-17T11:57:59.604 INFO:tasks.workunit.client.1.smithi119.stdout:8/807: readlink d7/d18/d15/l40 0 2023-12-17T11:57:59.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/898: write d6/d17/dc/d67/d8b/d24/f43 [2640021,27235] 0 2023-12-17T11:57:59.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/899: creat d6/d17/dc/d67/d8b/d24/da3/f112 x:0 0 0 2023-12-17T11:57:59.608 INFO:tasks.workunit.client.0.smithi002.stdout:7/900: write d6/d17/fe2 [684309,66894] 0 2023-12-17T11:57:59.610 INFO:tasks.workunit.client.1.smithi119.stdout:1/873: dwrite d3/db/d17/f30 [0,4194304] 0 2023-12-17T11:57:59.613 INFO:tasks.workunit.client.0.smithi002.stdout:2/897: truncate d3/d4/d7/fa1 4902166 0 2023-12-17T11:57:59.614 INFO:tasks.workunit.client.1.smithi119.stdout:4/905: creat dd/d11/d2d/d9c/d55/d81/d88/d105/f118 x:0 0 0 2023-12-17T11:57:59.614 INFO:tasks.workunit.client.1.smithi119.stdout:4/906: chown dd/d11/d26 1644 1 2023-12-17T11:57:59.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/888: dwrite d0/d15/d59/fd7 [0,4194304] 0 2023-12-17T11:57:59.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/889: write d0/d6/d26/d14/d19/d37/d86/feb [392242,94796] 0 2023-12-17T11:57:59.615 INFO:tasks.workunit.client.0.smithi002.stdout:0/890: chown d0/d6/d26/d14/cfd 15853 1 2023-12-17T11:57:59.619 INFO:tasks.workunit.client.0.smithi002.stdout:6/923: write d0/d1/d5b/dda/f10a [1820860,55648] 0 2023-12-17T11:57:59.624 INFO:tasks.workunit.client.0.smithi002.stdout:1/959: dwrite d3/d6/d9/d37/d39/d43/d4a/f5f [0,4194304] 0 2023-12-17T11:57:59.624 INFO:tasks.workunit.client.0.smithi002.stdout:7/901: mknod d6/d17/dc/d6c/c113 0 2023-12-17T11:57:59.624 INFO:tasks.workunit.client.1.smithi119.stdout:3/923: dwrite d9/da/df/d41/fdd [8388608,4194304] 0 2023-12-17T11:57:59.625 INFO:tasks.workunit.client.0.smithi002.stdout:2/898: mkdir d3/d56/d138 0 2023-12-17T11:57:59.625 INFO:tasks.workunit.client.0.smithi002.stdout:2/899: write d3/d4/d7/f1a [2164125,65647] 0 2023-12-17T11:57:59.625 INFO:tasks.workunit.client.0.smithi002.stdout:2/900: fdatasync d3/d56/fa0 0 2023-12-17T11:57:59.625 INFO:tasks.workunit.client.0.smithi002.stdout:2/901: fdatasync d3/d4/d17/d19/d4d/d72/d83/f124 0 2023-12-17T11:57:59.626 INFO:tasks.workunit.client.0.smithi002.stdout:7/902: write d6/d17/dc/d13/dd8/dd0/f10f [316017,114291] 0 2023-12-17T11:57:59.631 INFO:tasks.workunit.client.0.smithi002.stdout:0/891: rename d0/d6/d26/d14/d19/d37/d86/dca/cd8 to d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/d11f/c122 0 2023-12-17T11:57:59.631 INFO:tasks.workunit.client.0.smithi002.stdout:0/892: chown d0/d6/d26/d14/d19/d37/d62/f52 7 1 2023-12-17T11:57:59.631 INFO:tasks.workunit.client.0.smithi002.stdout:0/893: fsync d0/d6/d26/d14/f114 0 2023-12-17T11:57:59.632 INFO:tasks.workunit.client.1.smithi119.stdout:8/808: dread d7/d12/d69/f74 [0,4194304] 0 2023-12-17T11:57:59.634 INFO:tasks.workunit.client.1.smithi119.stdout:6/820: truncate d2/d2b/d43/d5e/fd4 2325331 0 2023-12-17T11:57:59.635 INFO:tasks.workunit.client.0.smithi002.stdout:6/924: creat d0/d1/dc/d17/d40/f12c x:0 0 0 2023-12-17T11:57:59.647 INFO:tasks.workunit.client.1.smithi119.stdout:3/924: dread d9/da/df/fce [0,4194304] 0 2023-12-17T11:57:59.664 INFO:tasks.workunit.client.1.smithi119.stdout:3/925: dread d9/da/df/d41/d33/f62 [0,4194304] 0 2023-12-17T11:57:59.665 INFO:tasks.workunit.client.1.smithi119.stdout:7/918: rename d2/d40/dc3/dca/le6 to d2/d40/dc3/dca/d104/l11b 0 2023-12-17T11:57:59.665 INFO:tasks.workunit.client.1.smithi119.stdout:7/919: chown d2/d4/d11/d2c/lf9 2 1 2023-12-17T11:57:59.668 INFO:tasks.workunit.client.1.smithi119.stdout:2/986: getdents d6/d2b/da3/d142/d5d/d11c/deb 0 2023-12-17T11:57:59.672 INFO:tasks.workunit.client.1.smithi119.stdout:0/883: getdents d2/dac 0 2023-12-17T11:57:59.673 INFO:tasks.workunit.client.0.smithi002.stdout:2/902: truncate d3/d4/d7/d14/d1b/f26 1067398 0 2023-12-17T11:57:59.673 INFO:tasks.workunit.client.0.smithi002.stdout:2/903: creat d3/d4/dbc/f139 x:0 0 0 2023-12-17T11:57:59.675 INFO:tasks.workunit.client.0.smithi002.stdout:7/903: unlink d6/d17/dc/d13/d21/d2e/d4a/f92 0 2023-12-17T11:57:59.675 INFO:tasks.workunit.client.0.smithi002.stdout:7/904: creat d6/d81/f114 x:0 0 0 2023-12-17T11:57:59.676 INFO:tasks.workunit.client.0.smithi002.stdout:3/976: dwrite d9/d40/f129 [0,4194304] 0 2023-12-17T11:57:59.677 INFO:tasks.workunit.client.0.smithi002.stdout:3/977: write d9/d15/d52/d85/fd8 [194983,99077] 0 2023-12-17T11:57:59.677 INFO:tasks.workunit.client.0.smithi002.stdout:3/978: fdatasync d9/d15/f66 0 2023-12-17T11:57:59.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/960: rename d3/d6/fa2 to d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/f135 0 2023-12-17T11:57:59.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/961: truncate d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/f105 490122 0 2023-12-17T11:57:59.681 INFO:tasks.workunit.client.0.smithi002.stdout:1/962: read d3/d6/d9/f3c [62480,37350] 0 2023-12-17T11:57:59.685 INFO:tasks.workunit.client.1.smithi119.stdout:4/907: rmdir dd/d11/d2d/d9c/d55 39 2023-12-17T11:57:59.686 INFO:tasks.workunit.client.0.smithi002.stdout:0/894: rmdir d0/d6/d26/d14/d19/d61/df0 0 2023-12-17T11:57:59.688 INFO:tasks.workunit.client.1.smithi119.stdout:8/809: mknod d7/d18/d45/d9f/d7b/c10b 0 2023-12-17T11:57:59.693 INFO:tasks.workunit.client.1.smithi119.stdout:3/926: write d9/da/df/d41/d33/d3a/d90/f94 [3922612,23532] 0 2023-12-17T11:57:59.696 INFO:tasks.workunit.client.1.smithi119.stdout:7/920: rename d2/d4/d11/d3c/d75/fb1 to d2/d4/d1f/f11c 0 2023-12-17T11:57:59.696 INFO:tasks.workunit.client.0.smithi002.stdout:7/905: mkdir d6/d17/dc/d6c/d93/d115 0 2023-12-17T11:57:59.696 INFO:tasks.workunit.client.0.smithi002.stdout:7/906: fdatasync d6/d17/dc/d67/d8b/dbd/f78 0 2023-12-17T11:57:59.696 INFO:tasks.workunit.client.0.smithi002.stdout:7/907: chown d6/d17/dc/d13/d3e/fd4 1720 1 2023-12-17T11:57:59.697 INFO:tasks.workunit.client.1.smithi119.stdout:0/884: dread d2/d16/f7c [0,4194304] 0 2023-12-17T11:57:59.697 INFO:tasks.workunit.client.1.smithi119.stdout:0/885: stat d2/dcc/fce 0 2023-12-17T11:57:59.697 INFO:tasks.workunit.client.1.smithi119.stdout:2/987: creat d6/d9/d86/db0/f14e x:0 0 0 2023-12-17T11:57:59.699 INFO:tasks.workunit.client.0.smithi002.stdout:2/904: dread d3/d4/d7/d14/d9b/f10d [0,4194304] 0 2023-12-17T11:57:59.700 INFO:tasks.workunit.client.0.smithi002.stdout:2/905: creat d3/d56/f13a x:0 0 0 2023-12-17T11:57:59.700 INFO:tasks.workunit.client.0.smithi002.stdout:6/925: dwrite d0/d1/d6d/d83/da2/d126/fd9 [0,4194304] 0 2023-12-17T11:57:59.700 INFO:tasks.workunit.client.1.smithi119.stdout:1/874: truncate d3/d44/dfd/d64/db2/fe3 3081445 0 2023-12-17T11:57:59.700 INFO:tasks.workunit.client.1.smithi119.stdout:1/875: fsync d3/db/d17/d24/d20/d40/f5b 0 2023-12-17T11:57:59.701 INFO:tasks.workunit.client.0.smithi002.stdout:1/963: dread d3/d6/d9/d37/d39/fb3 [0,4194304] 0 2023-12-17T11:57:59.701 INFO:tasks.workunit.client.0.smithi002.stdout:1/964: read d3/d6/d16/f31 [131798,37569] 0 2023-12-17T11:57:59.701 INFO:tasks.workunit.client.0.smithi002.stdout:1/965: chown d3/d6/d16/lf3 996904 1 2023-12-17T11:57:59.701 INFO:tasks.workunit.client.0.smithi002.stdout:0/895: write d0/d6/d26/d14/f3f [2606391,23061] 0 2023-12-17T11:57:59.711 INFO:tasks.workunit.client.1.smithi119.stdout:7/921: unlink d2/d4/d11/d2c/d55/f6e 0 2023-12-17T11:57:59.711 INFO:tasks.workunit.client.1.smithi119.stdout:2/988: unlink d6/d9/d52/d53/d55/daf/d12e/d13c/da8/l124 0 2023-12-17T11:57:59.711 INFO:tasks.workunit.client.1.smithi119.stdout:7/922: fdatasync d2/d40/da7/f115 0 2023-12-17T11:57:59.711 INFO:tasks.workunit.client.1.smithi119.stdout:4/908: creat dd/d11/d2d/d9c/d55/f119 x:0 0 0 2023-12-17T11:57:59.712 INFO:tasks.workunit.client.1.smithi119.stdout:4/909: readlink dd/d15/ldc 0 2023-12-17T11:57:59.712 INFO:tasks.workunit.client.1.smithi119.stdout:4/910: truncate dd/d11/d26/fed 706295 0 2023-12-17T11:57:59.712 INFO:tasks.workunit.client.1.smithi119.stdout:0/886: truncate d2/d66/d2e/d44/df0/fa7 2878989 0 2023-12-17T11:57:59.712 INFO:tasks.workunit.client.0.smithi002.stdout:3/979: symlink d9/d15/d71/dbb/dc6/l134 0 2023-12-17T11:57:59.712 INFO:tasks.workunit.client.0.smithi002.stdout:3/980: chown d9/d24/d6f/lf0 50 1 2023-12-17T11:57:59.717 INFO:tasks.workunit.client.1.smithi119.stdout:1/876: truncate d3/db/d17/d24/f32 2517080 0 2023-12-17T11:57:59.723 INFO:tasks.workunit.client.1.smithi119.stdout:7/923: symlink d2/d4/d11/d2c/d55/l11d 0 2023-12-17T11:57:59.725 INFO:tasks.workunit.client.1.smithi119.stdout:4/911: getdents dd/d4b/d6a 0 2023-12-17T11:57:59.726 INFO:tasks.workunit.client.0.smithi002.stdout:1/966: read d3/d2f/d4d/d95/d100/f10f [929112,85419] 0 2023-12-17T11:57:59.730 INFO:tasks.workunit.client.1.smithi119.stdout:3/927: write d9/da/df/f17 [1839707,41005] 0 2023-12-17T11:57:59.731 INFO:tasks.workunit.client.1.smithi119.stdout:3/928: creat d9/d35/dbd/f152 x:0 0 0 2023-12-17T11:57:59.731 INFO:tasks.workunit.client.1.smithi119.stdout:0/887: creat d2/d66/d2e/d44/df0/dc3/f10f x:0 0 0 2023-12-17T11:57:59.732 INFO:tasks.workunit.client.0.smithi002.stdout:3/981: dread d9/d1b/fa7 [0,4194304] 0 2023-12-17T11:57:59.735 INFO:tasks.workunit.client.0.smithi002.stdout:2/906: mkdir d3/d4/d7/d14/d1b/d13b 0 2023-12-17T11:57:59.737 INFO:tasks.workunit.client.1.smithi119.stdout:7/924: symlink d2/d40/dc3/dc8/d116/l11e 0 2023-12-17T11:57:59.740 INFO:tasks.workunit.client.0.smithi002.stdout:6/926: rename d0/d1/dc/fed to d0/d1/d6d/d83/f12d 0 2023-12-17T11:57:59.740 INFO:tasks.workunit.client.0.smithi002.stdout:6/927: write d0/d1/d6d/d83/d113/da5/fa6 [1670908,90187] 0 2023-12-17T11:57:59.741 INFO:tasks.workunit.client.1.smithi119.stdout:4/912: symlink dd/d11/d2d/d9c/d55/d81/d88/l11a 0 2023-12-17T11:57:59.748 INFO:tasks.workunit.client.0.smithi002.stdout:1/967: mkdir d3/d6/d9/d37/d39/d43/d4a/d7b/d136 0 2023-12-17T11:57:59.749 INFO:tasks.workunit.client.1.smithi119.stdout:3/929: unlink d9/da/df/d41/d33/d3a/c9a 0 2023-12-17T11:57:59.753 INFO:tasks.workunit.client.0.smithi002.stdout:3/982: unlink d9/d1b/d4f/f68 0 2023-12-17T11:57:59.756 INFO:tasks.workunit.client.1.smithi119.stdout:1/877: write d3/fcf [1019335,29049] 0 2023-12-17T11:57:59.760 INFO:tasks.workunit.client.1.smithi119.stdout:0/888: mknod d2/dcc/c110 0 2023-12-17T11:57:59.761 INFO:tasks.workunit.client.1.smithi119.stdout:7/925: mknod d2/d40/c11f 0 2023-12-17T11:57:59.765 INFO:tasks.workunit.client.0.smithi002.stdout:3/983: symlink d9/d1b/d35/d41/l135 0 2023-12-17T11:57:59.765 INFO:tasks.workunit.client.1.smithi119.stdout:7/926: rename d2/d4/d11/d3c/d75/dda to d2/d40/d120 0 2023-12-17T11:57:59.767 INFO:tasks.workunit.client.1.smithi119.stdout:8/810: dwrite d7/da/d1a/fdc [0,4194304] 0 2023-12-17T11:57:59.768 INFO:tasks.workunit.client.1.smithi119.stdout:0/889: mknod d2/d66/d2e/d44/d7b/d5/c111 0 2023-12-17T11:57:59.771 INFO:tasks.workunit.client.0.smithi002.stdout:7/908: dwrite d6/d17/dc/d13/d37/f3c [0,4194304] 0 2023-12-17T11:57:59.771 INFO:tasks.workunit.client.0.smithi002.stdout:7/909: write d6/d17/dc/d13/d37/d4f/faa [4950438,73541] 0 2023-12-17T11:57:59.772 INFO:tasks.workunit.client.0.smithi002.stdout:7/910: read - d6/d99/da1/db9/ffe zero size 2023-12-17T11:57:59.772 INFO:tasks.workunit.client.0.smithi002.stdout:7/911: stat d6/d17/dc/d67/d8b/dbd/dce/ddf/dfa/f7e 0 2023-12-17T11:57:59.773 INFO:tasks.workunit.client.1.smithi119.stdout:7/927: creat d2/d4/d11/f121 x:0 0 0 2023-12-17T11:57:59.775 INFO:tasks.workunit.client.0.smithi002.stdout:0/896: dwrite d0/d6/d26/d14/d19/d37/d62/db8/ddd/f10a [0,4194304] 0 2023-12-17T11:57:59.775 INFO:tasks.workunit.client.0.smithi002.stdout:0/897: read d0/d15/f32 [1330547,47355] 0 2023-12-17T11:57:59.775 INFO:tasks.workunit.client.0.smithi002.stdout:3/984: unlink d9/d15/f32 0 2023-12-17T11:57:59.779 INFO:tasks.workunit.client.0.smithi002.stdout:7/912: unlink d6/d17/dc/d13/d21/ca5 0 2023-12-17T11:57:59.779 INFO:tasks.workunit.client.0.smithi002.stdout:7/913: read d6/d17/f1a [2064329,116399] 0 2023-12-17T11:57:59.780 INFO:tasks.workunit.client.1.smithi119.stdout:8/811: creat d7/d18/d45/d9f/d7b/df9/dfd/f10c x:0 0 0 2023-12-17T11:57:59.783 INFO:tasks.workunit.client.0.smithi002.stdout:7/914: truncate d6/d17/dc/d13/d21/d2e/fc6 704798 0 2023-12-17T11:57:59.783 INFO:tasks.workunit.client.0.smithi002.stdout:5/912: sync 2023-12-17T11:57:59.783 INFO:tasks.workunit.client.1.smithi119.stdout:4/913: dwrite dd/d11/d2d/d9c/d55/d81/db8/dbd/dec/f101 [0,4194304] 0 2023-12-17T11:57:59.784 INFO:tasks.workunit.client.1.smithi119.stdout:0/890: rename d2/d66/d2e/d44/d7b/d5/dc/d7f to d2/d66/d1f/d24/d50/dbd/dea/d112 0 2023-12-17T11:57:59.784 INFO:tasks.workunit.client.1.smithi119.stdout:0/891: fsync d2/d16/d35/d39/f76 0 2023-12-17T11:57:59.784 INFO:tasks.workunit.client.0.smithi002.stdout:8/982: sync 2023-12-17T11:57:59.787 INFO:tasks.workunit.client.0.smithi002.stdout:2/907: dwrite d3/f115 [0,4194304] 0 2023-12-17T11:57:59.790 INFO:tasks.workunit.client.0.smithi002.stdout:0/898: link d0/d6/d26/d14/l83 d0/d6/d26/d14/d19/d2b/l123 0 2023-12-17T11:57:59.794 INFO:tasks.workunit.client.0.smithi002.stdout:3/985: link d9/d1b/d35/df3/df8/fff d9/d15/d52/d79/f136 0 2023-12-17T11:57:59.795 INFO:tasks.workunit.client.0.smithi002.stdout:4/864: sync 2023-12-17T11:57:59.797 INFO:tasks.workunit.client.1.smithi119.stdout:3/930: dread d9/da/df/f17 [0,4194304] 0 2023-12-17T11:57:59.799 INFO:tasks.workunit.client.0.smithi002.stdout:5/913: symlink dc/d94/ded/d5a/d96/d6c/da0/l135 0 2023-12-17T11:57:59.801 INFO:tasks.workunit.client.1.smithi119.stdout:8/812: getdents d7/d18/d15/d81 0 2023-12-17T11:57:59.805 INFO:tasks.workunit.client.0.smithi002.stdout:8/983: truncate d3/d8/da/f46 1412512 0 2023-12-17T11:57:59.808 INFO:tasks.workunit.client.1.smithi119.stdout:4/914: getdents dd/d15/d16/d5a 0 2023-12-17T11:57:59.810 INFO:tasks.workunit.client.1.smithi119.stdout:0/892: dread d2/d16/f7d [4194304,4194304] 0 2023-12-17T11:57:59.812 INFO:tasks.workunit.client.0.smithi002.stdout:2/908: rename d3/d4/c6b to d3/d4/d7/d14/d2e/d37/d3f/c13c 0 2023-12-17T11:57:59.812 INFO:tasks.workunit.client.0.smithi002.stdout:2/909: chown d3/d56/c64 0 1 2023-12-17T11:57:59.815 INFO:tasks.workunit.client.0.smithi002.stdout:0/899: creat d0/dd3/f124 x:0 0 0 2023-12-17T11:57:59.815 INFO:tasks.workunit.client.0.smithi002.stdout:0/900: truncate d0/d6/d26/d14/d90/ff6 551332 0 2023-12-17T11:57:59.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/865: write d0/fb2 [295449,4335] 0 2023-12-17T11:57:59.817 INFO:tasks.workunit.client.1.smithi119.stdout:3/931: unlink d9/da/df/d41/d33/d3a/d90/fff 0 2023-12-17T11:57:59.819 INFO:tasks.workunit.client.1.smithi119.stdout:8/813: creat d7/d18/d45/d9f/d7b/df9/f10d x:0 0 0 2023-12-17T11:57:59.823 INFO:tasks.workunit.client.1.smithi119.stdout:0/893: link d2/d66/cc7 d2/d66/d1f/d24/d50/d5d/d80/c113 0 2023-12-17T11:57:59.823 INFO:tasks.workunit.client.1.smithi119.stdout:0/894: truncate d2/d66/d2e/d44/d7b/d5/d3f/f5e 4976781 0 2023-12-17T11:57:59.823 INFO:tasks.workunit.client.1.smithi119.stdout:0/895: fsync d2/d66/fd8 0 2023-12-17T11:57:59.824 INFO:tasks.workunit.client.1.smithi119.stdout:3/932: mkdir d9/da/df/d41/d33/db4/d153 0 2023-12-17T11:57:59.826 INFO:tasks.workunit.client.0.smithi002.stdout:5/914: rmdir dc/d94/ded/dad/d12d 39 2023-12-17T11:57:59.826 INFO:tasks.workunit.client.0.smithi002.stdout:5/915: write dc/d1a/d53/fde [997325,79254] 0 2023-12-17T11:57:59.826 INFO:tasks.workunit.client.0.smithi002.stdout:5/916: readlink dc/d8e/dd6/l10a 0 2023-12-17T11:57:59.826 INFO:tasks.workunit.client.0.smithi002.stdout:5/917: read - dc/d1a/f105 zero size 2023-12-17T11:57:59.826 INFO:tasks.workunit.client.0.smithi002.stdout:5/918: truncate dc/d1a/f105 771320 0 2023-12-17T11:57:59.827 INFO:tasks.workunit.client.1.smithi119.stdout:8/814: creat d7/da/d11/d26/f10e x:0 0 0 2023-12-17T11:57:59.827 INFO:tasks.workunit.client.1.smithi119.stdout:8/815: fsync d7/d18/d45/d9f/d75/f90 0 2023-12-17T11:57:59.828 INFO:tasks.workunit.client.1.smithi119.stdout:7/928: rename d2/d4/d1f/f10d to d2/d4/d70/f122 0 2023-12-17T11:57:59.828 INFO:tasks.workunit.client.1.smithi119.stdout:7/929: read - d2/d4/d11/d2c/d68/d99/d6c/def/db6/fbb zero size 2023-12-17T11:57:59.829 INFO:tasks.workunit.client.1.smithi119.stdout:1/878: dwrite d3/d44/d89/fb9 [0,4194304] 0 2023-12-17T11:57:59.829 INFO:tasks.workunit.client.1.smithi119.stdout:2/989: dwrite d6/d9/d13/d34/d88/fd4 [0,4194304] 0 2023-12-17T11:57:59.829 INFO:tasks.workunit.client.1.smithi119.stdout:1/879: stat d3/db/d17/d24/d20/d6c/db7/fff 0 2023-12-17T11:57:59.829 INFO:tasks.workunit.client.1.smithi119.stdout:2/990: chown d6/d9/f2a 115000 1 2023-12-17T11:57:59.829 INFO:tasks.workunit.client.1.smithi119.stdout:1/880: chown d3/db/d17/d24/d20/d40/d76/d96/d99/fa6 2 1 2023-12-17T11:57:59.830 INFO:tasks.workunit.client.0.smithi002.stdout:1/968: dwrite d3/d6/d9/d37/d39/d43/d4a/d7b/daa/dc2/f105 [0,4194304] 0 2023-12-17T11:57:59.831 INFO:tasks.workunit.client.1.smithi119.stdout:4/915: dread dd/d11/d26/f111 [0,4194304] 0 2023-12-17T11:57:59.832 INFO:tasks.workunit.client.0.smithi002.stdout:8/984: getdents d3/d8/d28 0 2023-12-17T11:57:59.833 INFO:tasks.workunit.client.0.smithi002.stdout:8/985: write d3/d8/da/d44/f152 [61678,113299] 0 2023-12-17T11:57:59.833 INFO:tasks.workunit.client.0.smithi002.stdout:8/986: read - d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/f122 zero size 2023-12-17T11:57:59.833 INFO:tasks.workunit.client.0.smithi002.stdout:3/986: rename d9/d15/d52/ff2 to d9/d24/f137 0 2023-12-17T11:57:59.834 INFO:tasks.workunit.client.1.smithi119.stdout:7/930: stat d2/f35 0 2023-12-17T11:57:59.834 INFO:tasks.workunit.client.1.smithi119.stdout:7/931: write d2/d4/d11/d2c/d68/d98/fe4 [112773,28418] 0 2023-12-17T11:57:59.835 INFO:tasks.workunit.client.1.smithi119.stdout:0/896: dread d2/f28 [4194304,4194304] 0 2023-12-17T11:57:59.836 INFO:tasks.workunit.client.0.smithi002.stdout:2/910: symlink d3/d4/d17/d19/d4d/l13d 0 2023-12-17T11:57:59.836 INFO:tasks.workunit.client.1.smithi119.stdout:3/933: symlink d9/d35/dbd/dfb/d107/l154 0 2023-12-17T11:57:59.836 INFO:tasks.workunit.client.1.smithi119.stdout:3/934: chown d9/d11/d1e/l39 0 1 2023-12-17T11:57:59.837 INFO:tasks.workunit.client.0.smithi002.stdout:4/866: rmdir d0/d3e/d41 39 2023-12-17T11:57:59.837 INFO:tasks.workunit.client.0.smithi002.stdout:4/867: chown d0/d10/d21/f49 5310 1 2023-12-17T11:57:59.841 INFO:tasks.workunit.client.0.smithi002.stdout:5/919: symlink dc/d94/ded/d5a/d96/l136 0 2023-12-17T11:57:59.841 INFO:tasks.workunit.client.0.smithi002.stdout:5/920: stat dc/d17/f26 0 2023-12-17T11:57:59.847 INFO:tasks.workunit.client.0.smithi002.stdout:2/911: dread d3/d4/d17/d19/d4d/d72/d77/da7/fe1 [0,4194304] 0 2023-12-17T11:57:59.848 INFO:tasks.workunit.client.1.smithi119.stdout:1/881: dread d3/d44/dfd/f4a [0,4194304] 0 2023-12-17T11:57:59.848 INFO:tasks.workunit.client.1.smithi119.stdout:1/882: write d3/db/d17/d24/d20/d40/d76/d84/f103 [343429,95506] 0 2023-12-17T11:57:59.850 INFO:tasks.workunit.client.1.smithi119.stdout:8/816: dread d7/fab [0,4194304] 0 2023-12-17T11:57:59.850 INFO:tasks.workunit.client.1.smithi119.stdout:8/817: chown d7/c97 10316456 1 2023-12-17T11:57:59.850 INFO:tasks.workunit.client.0.smithi002.stdout:3/987: mkdir d9/d15/d52/d85/d138 0 2023-12-17T11:57:59.851 INFO:tasks.workunit.client.0.smithi002.stdout:3/988: truncate d9/d1b/d35/df3/ff9 985501 0 2023-12-17T11:57:59.852 INFO:tasks.workunit.client.1.smithi119.stdout:2/991: creat d6/d2b/da3/d142/f14f x:0 0 0 2023-12-17T11:57:59.857 INFO:tasks.workunit.client.1.smithi119.stdout:4/916: truncate dd/d11/d2d/d9c/d55/d81/db8/d78/faf 148202 0 2023-12-17T11:57:59.862 INFO:tasks.workunit.client.0.smithi002.stdout:5/921: write dc/d17/d2f/f110 [3922357,99435] 0 2023-12-17T11:57:59.862 INFO:tasks.workunit.client.0.smithi002.stdout:5/922: write dc/d94/ded/d5a/d96/fc1 [711118,26933] 0 2023-12-17T11:57:59.862 INFO:tasks.workunit.client.0.smithi002.stdout:5/923: write dc/d1a/d7c/ff8 [5179636,81964] 0 2023-12-17T11:57:59.863 INFO:tasks.workunit.client.0.smithi002.stdout:0/901: rename d0/d6/d26/d14/d19/d37/d62/db8/ddd/ff9 to d0/d6/d26/d14/d90/d64/dab/f125 0 2023-12-17T11:57:59.865 INFO:tasks.workunit.client.0.smithi002.stdout:4/868: dread d0/f8a [0,4194304] 0 2023-12-17T11:57:59.866 INFO:tasks.workunit.client.1.smithi119.stdout:7/932: symlink d2/d4/d11/d2c/d68/d6a/l123 0 2023-12-17T11:57:59.866 INFO:tasks.workunit.client.1.smithi119.stdout:7/933: read - d2/d4/d11/f121 zero size 2023-12-17T11:57:59.869 INFO:tasks.workunit.client.1.smithi119.stdout:3/935: mkdir d9/da/df/de1/d155 0 2023-12-17T11:57:59.872 INFO:tasks.workunit.client.1.smithi119.stdout:1/883: mkdir d3/db/d17/d24/d20/d6c/db7/d140 0 2023-12-17T11:57:59.877 INFO:tasks.workunit.client.1.smithi119.stdout:8/818: unlink d7/da/d1a/c20 0 2023-12-17T11:57:59.880 INFO:tasks.workunit.client.0.smithi002.stdout:8/987: dwrite d3/d7/d18/d74/d7b/f14a [0,4194304] 0 2023-12-17T11:57:59.880 INFO:tasks.workunit.client.0.smithi002.stdout:8/988: chown d3/d7/d111/f119 1234 1 2023-12-17T11:57:59.882 INFO:tasks.workunit.client.0.smithi002.stdout:1/969: dwrite d3/d6/d9/d37/d39/d43/d4a/d10a/f134 [0,4194304] 0 2023-12-17T11:57:59.885 INFO:tasks.workunit.client.1.smithi119.stdout:4/917: truncate dd/d11/d2d/d9c/d55/d81/da1/fb9 103557 0 2023-12-17T11:57:59.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/912: unlink d3/d4/d17/d19/f67 0 2023-12-17T11:57:59.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/913: readlink d3/d4/d7/d14/l39 0 2023-12-17T11:57:59.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/914: chown d3/d4/d43/f4f 114081531 1 2023-12-17T11:57:59.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/915: dread - d3/d4/d7/d14/d34/fff zero size 2023-12-17T11:57:59.886 INFO:tasks.workunit.client.0.smithi002.stdout:2/916: chown d3/d4/d17/d19/d8d/l10c 39 1 2023-12-17T11:57:59.887 INFO:tasks.workunit.client.0.smithi002.stdout:2/917: chown d3/d4/d7/d14/d1b/d5b/l98 3 1 2023-12-17T11:57:59.887 INFO:tasks.workunit.client.0.smithi002.stdout:0/902: creat d0/d6/d26/d14/d19/d61/de3/f126 x:0 0 0 2023-12-17T11:57:59.888 INFO:tasks.workunit.client.1.smithi119.stdout:0/897: dwrite d2/d66/d1f/f57 [4194304,4194304] 0 2023-12-17T11:57:59.889 INFO:tasks.workunit.client.0.smithi002.stdout:4/869: link d0/ca d0/d10/d14/d27/d69/d108/d99/c117 0 2023-12-17T11:57:59.891 INFO:tasks.workunit.client.1.smithi119.stdout:7/934: symlink d2/d4/d70/l124 0 2023-12-17T11:57:59.894 INFO:tasks.workunit.client.1.smithi119.stdout:3/936: link d9/d35/dbd/f152 d9/d11/d1e/d55/df3/d129/f156 0 2023-12-17T11:57:59.894 INFO:tasks.workunit.client.1.smithi119.stdout:3/937: write d9/d35/dca/f120 [6521379,57728] 0 2023-12-17T11:57:59.896 INFO:tasks.workunit.client.1.smithi119.stdout:1/884: mknod d3/db/d26/d8f/dd1/d13a/c141 0 2023-12-17T11:57:59.897 INFO:tasks.workunit.client.0.smithi002.stdout:1/970: write d3/d6/d16/dcf/ff0 [1843658,24498] 0 2023-12-17T11:57:59.903 INFO:tasks.workunit.client.1.smithi119.stdout:0/898: symlink d2/d66/d2e/d44/d7b/l114 0 2023-12-17T11:57:59.903 INFO:tasks.workunit.client.1.smithi119.stdout:0/899: chown d2/d66/d2e/d44/d7b/d5/dc/f7e 103142 1 2023-12-17T11:57:59.904 INFO:tasks.workunit.client.0.smithi002.stdout:8/989: mknod d3/d7/d18/d74/d7b/d11c/db4/c157 0 2023-12-17T11:57:59.906 INFO:tasks.workunit.client.1.smithi119.stdout:7/935: creat d2/d40/dc3/dc8/f125 x:0 0 0 2023-12-17T11:57:59.912 INFO:tasks.workunit.client.1.smithi119.stdout:3/938: rename d9/d44/c13a to d9/da/df/d41/d33/d3a/d90/c157 0 2023-12-17T11:57:59.915 INFO:tasks.workunit.client.1.smithi119.stdout:1/885: unlink d3/db/d17/d24/d20/dba/l113 0 2023-12-17T11:57:59.916 INFO:tasks.workunit.client.0.smithi002.stdout:5/924: rmdir dc/d94 39 2023-12-17T11:57:59.918 INFO:tasks.workunit.client.1.smithi119.stdout:8/819: mkdir d7/d18/d15/d10f 0 2023-12-17T11:57:59.918 INFO:tasks.workunit.client.1.smithi119.stdout:8/820: chown d7/d18/d45/d9f/d7b/fb6 251 1 2023-12-17T11:57:59.918 INFO:tasks.workunit.client.1.smithi119.stdout:8/821: dread - d7/da/d11/d60/f8b zero size 2023-12-17T11:57:59.919 INFO:tasks.workunit.client.0.smithi002.stdout:2/918: mknod d3/d4/d17/d19/d4d/d72/d77/c13e 0 2023-12-17T11:57:59.919 INFO:tasks.workunit.client.0.smithi002.stdout:2/919: dread - d3/d4/d7/d14/d2e/d37/f85 zero size 2023-12-17T11:57:59.922 INFO:tasks.workunit.client.1.smithi119.stdout:9/952: sync 2023-12-17T11:57:59.923 INFO:tasks.workunit.client.1.smithi119.stdout:9/953: chown d12/d1d/d28/d4d/d73/d78/lbc 6947732 1 2023-12-17T11:57:59.923 INFO:tasks.workunit.client.1.smithi119.stdout:9/954: dread - d12/d1d/d28/d46/d50/d92/daf/deb/f11e zero size 2023-12-17T11:57:59.923 INFO:tasks.workunit.client.1.smithi119.stdout:5/966: sync 2023-12-17T11:57:59.923 INFO:tasks.workunit.client.1.smithi119.stdout:6/821: sync 2023-12-17T11:57:59.923 INFO:tasks.workunit.client.1.smithi119.stdout:6/822: chown d2/d2b/d43/dcb/fd0 66308 1 2023-12-17T11:57:59.923 INFO:tasks.workunit.client.1.smithi119.stdout:7/936: dread d2/f3 [0,4194304] 0 2023-12-17T11:57:59.927 INFO:tasks.workunit.client.0.smithi002.stdout:5/925: creat dc/d1a/d61/f137 x:0 0 0 2023-12-17T11:57:59.928 INFO:tasks.workunit.client.0.smithi002.stdout:1/971: rmdir d3/d6/d9/d37/d39/d43/d4a/deb 39 2023-12-17T11:57:59.929 INFO:tasks.workunit.client.0.smithi002.stdout:1/972: truncate d3/d6/d16/d61/f7c 952946 0 2023-12-17T11:57:59.929 INFO:tasks.workunit.client.0.smithi002.stdout:1/973: write d3/d2f/d74/d97/f12c [849309,94972] 0 2023-12-17T11:57:59.931 INFO:tasks.workunit.client.0.smithi002.stdout:5/926: creat dc/d17/dd2/f138 x:0 0 0 2023-12-17T11:57:59.931 INFO:tasks.workunit.client.0.smithi002.stdout:1/974: rename d3/d6/d9/d37/d39/f8c to d3/d6/d9/ded/f137 0 2023-12-17T11:57:59.933 INFO:tasks.workunit.client.1.smithi119.stdout:4/918: rmdir dd/d11/d2d/d9c/d55 39 2023-12-17T11:57:59.933 INFO:tasks.workunit.client.1.smithi119.stdout:4/919: fsync dd/d11/d2d/d9c/d55/d81/d88/d105/f118 0 2023-12-17T11:57:59.934 INFO:tasks.workunit.client.0.smithi002.stdout:1/975: truncate d3/d6/d9/d30/f54 702076 0 2023-12-17T11:57:59.934 INFO:tasks.workunit.client.0.smithi002.stdout:8/990: dread d3/d7/d18/d74/d7b/d11c/d7c/fbd [0,4194304] 0 2023-12-17T11:57:59.934 INFO:tasks.workunit.client.0.smithi002.stdout:8/991: truncate d3/d7/d18/d74/d7b/f14a 4289687 0 2023-12-17T11:57:59.935 INFO:tasks.workunit.client.1.smithi119.stdout:1/886: mkdir d3/db/d17/d24/d20/d40/d76/d142 0 2023-12-17T11:57:59.936 INFO:tasks.workunit.client.0.smithi002.stdout:5/927: mknod dc/d1a/d53/da9/c139 0 2023-12-17T11:57:59.936 INFO:tasks.workunit.client.0.smithi002.stdout:5/928: fdatasync fa 0 2023-12-17T11:57:59.936 INFO:tasks.workunit.client.0.smithi002.stdout:5/929: fdatasync dc/d1a/f22 0 2023-12-17T11:57:59.937 INFO:tasks.workunit.client.1.smithi119.stdout:6/823: rename d2/d7e/d93/c99 to d2/d2b/d43/dcb/c103 0 2023-12-17T11:57:59.937 INFO:tasks.workunit.client.1.smithi119.stdout:6/824: truncate d2/d61/f94 978957 0 2023-12-17T11:57:59.940 INFO:tasks.workunit.client.0.smithi002.stdout:1/976: rename d3/d2f/d4d/d95/d100/f10b to d3/d6/d9/d37/d39/d43/d4a/d7b/daa/f138 0 2023-12-17T11:57:59.940 INFO:tasks.workunit.client.0.smithi002.stdout:5/930: mknod dc/d1a/d53/da9/db3/c13a 0 2023-12-17T11:57:59.941 INFO:tasks.workunit.client.0.smithi002.stdout:5/931: readlink dc/d94/ded/d2d/d5b/le5 0 2023-12-17T11:57:59.941 INFO:tasks.workunit.client.0.smithi002.stdout:5/932: getdents dc/d94/ded/d5a/d68/d97/ddd/d126 0 2023-12-17T11:57:59.941 INFO:tasks.workunit.client.0.smithi002.stdout:2/920: dread d3/d4/d7/d14/d42/ff5 [0,4194304] 0 2023-12-17T11:57:59.941 INFO:tasks.workunit.client.0.smithi002.stdout:2/921: readlink d3/d4/d17/d19/d4d/d72/d83/ldb 0 2023-12-17T11:57:59.941 INFO:tasks.workunit.client.0.smithi002.stdout:2/922: chown d3/d56/l120 12459397 1 2023-12-17T11:57:59.942 INFO:tasks.workunit.client.1.smithi119.stdout:4/920: creat dd/d15/d16/d5a/dbc/f11b x:0 0 0 2023-12-17T11:57:59.942 INFO:tasks.workunit.client.1.smithi119.stdout:1/887: symlink d3/db/d17/d24/d20/dba/l143 0 2023-12-17T11:57:59.944 INFO:tasks.workunit.client.0.smithi002.stdout:0/903: dwrite d0/d6/d26/d14/d19/d37/dcf/faa [0,4194304] 0 2023-12-17T11:57:59.944 INFO:tasks.workunit.client.1.smithi119.stdout:6/825: mkdir d2/d2b/d43/d76/d8d/dc2/d104 0 2023-12-17T11:57:59.946 INFO:tasks.workunit.client.0.smithi002.stdout:1/977: write d3/d6/d9/f13 [5048179,39342] 0 2023-12-17T11:57:59.947 INFO:tasks.workunit.client.0.smithi002.stdout:1/978: fsync d3/d6/d9/d37/d39/d43/d8f/f127 0 2023-12-17T11:57:59.947 INFO:tasks.workunit.client.0.smithi002.stdout:5/933: creat dc/d94/ded/d5a/d96/f13b x:0 0 0 2023-12-17T11:57:59.948 INFO:tasks.workunit.client.1.smithi119.stdout:1/888: symlink d3/db/d17/d24/d20/d40/d76/d96/d99/l144 0 2023-12-17T11:57:59.949 INFO:tasks.workunit.client.0.smithi002.stdout:2/923: mknod d3/d4/d7/d14/d34/dde/c13f 0 2023-12-17T11:57:59.952 INFO:tasks.workunit.client.1.smithi119.stdout:9/955: write d12/fe3 [104765,6343] 0 2023-12-17T11:57:59.952 INFO:tasks.workunit.client.1.smithi119.stdout:9/956: stat d12/d1d/d28/d46/d50/d92 0 2023-12-17T11:57:59.952 INFO:tasks.workunit.client.1.smithi119.stdout:1/889: symlink d3/db/d26/d5e/l145 0 2023-12-17T11:57:59.959 INFO:tasks.workunit.client.1.smithi119.stdout:0/900: dwrite d2/d66/d2e/d44/df0/fe4 [0,4194304] 0 2023-12-17T11:57:59.959 INFO:tasks.workunit.client.1.smithi119.stdout:0/901: fsync d2/dac/fc1 0 2023-12-17T11:57:59.959 INFO:tasks.workunit.client.1.smithi119.stdout:9/957: symlink d12/d1d/d28/d46/d50/d92/daf/deb/l138 0 2023-12-17T11:57:59.959 INFO:tasks.workunit.client.1.smithi119.stdout:9/958: fsync d12/d1d/d28/d46/d50/d92/daf/deb/f11e 0 2023-12-17T11:57:59.960 INFO:tasks.workunit.client.1.smithi119.stdout:9/959: write d12/d1d/d28/d46/d50/f60 [1232456,119867] 0 2023-12-17T11:57:59.962 INFO:tasks.workunit.client.1.smithi119.stdout:1/890: symlink d3/db/d26/l146 0 2023-12-17T11:57:59.962 INFO:tasks.workunit.client.1.smithi119.stdout:1/891: readlink d3/db/d26/d8f/la5 0 2023-12-17T11:57:59.963 INFO:tasks.workunit.client.1.smithi119.stdout:3/939: dwrite d9/da/fa7 [0,4194304] 0 2023-12-17T11:57:59.969 INFO:tasks.workunit.client.1.smithi119.stdout:0/902: symlink d2/l115 0 2023-12-17T11:57:59.976 INFO:tasks.workunit.client.1.smithi119.stdout:9/960: symlink d12/d1d/d28/d46/dc0/l139 0 2023-12-17T11:57:59.976 INFO:tasks.workunit.client.0.smithi002.stdout:0/904: creat d0/d6/d26/d14/d90/d64/f127 x:0 0 0 2023-12-17T11:57:59.977 INFO:tasks.workunit.client.0.smithi002.stdout:0/905: write d0/d6/d26/d14/d90/d64/f127 [795239,62023] 0 2023-12-17T11:57:59.978 INFO:tasks.workunit.client.1.smithi119.stdout:1/892: creat d3/db/d17/d24/d91/f147 x:0 0 0 2023-12-17T11:57:59.981 INFO:tasks.workunit.client.1.smithi119.stdout:3/940: symlink d9/da/df/d41/l158 0 2023-12-17T11:57:59.981 INFO:tasks.workunit.client.1.smithi119.stdout:3/941: rename d9/da to d9/da/df/d67/d13f/d159 22 2023-12-17T11:57:59.987 INFO:tasks.workunit.client.1.smithi119.stdout:9/961: mkdir d12/d1d/d28/d46/d50/d92/dae/dc9/d13a 0 2023-12-17T11:57:59.987 INFO:tasks.workunit.client.1.smithi119.stdout:1/893: mknod d3/db/d106/c148 0 2023-12-17T11:57:59.988 INFO:tasks.workunit.client.1.smithi119.stdout:3/942: creat d9/da/df/f15a x:0 0 0 2023-12-17T11:57:59.988 INFO:tasks.workunit.client.1.smithi119.stdout:3/943: fsync d9/da/df/d41/d33/db4/fe0 0 2023-12-17T11:57:59.993 INFO:tasks.workunit.client.1.smithi119.stdout:0/903: rmdir d2/d16 39 2023-12-17T11:57:59.994 INFO:tasks.workunit.client.1.smithi119.stdout:3/944: rename d9/da/df/d41/d33/d3a/f40 to d9/d11/d1e/d55/d77/d135/f15b 0 2023-12-17T11:57:59.995 INFO:tasks.workunit.client.1.smithi119.stdout:8/822: dwrite d7/da/d11/d26/f32 [0,4194304] 0 2023-12-17T11:57:59.997 INFO:tasks.workunit.client.1.smithi119.stdout:1/894: getdents d3/db 0 2023-12-17T11:57:59.997 INFO:tasks.workunit.client.0.smithi002.stdout:0/906: dread d0/d6/d26/d14/d19/d37/d91/fbb [0,4194304] 0 2023-12-17T11:58:00.001 INFO:tasks.workunit.client.1.smithi119.stdout:0/904: rename d2/d66/d2e/d44/df0/c10c to d2/d66/d2e/c116 0 2023-12-17T11:58:00.001 INFO:tasks.workunit.client.0.smithi002.stdout:3/989: sync 2023-12-17T11:58:00.001 INFO:tasks.workunit.client.0.smithi002.stdout:6/928: sync 2023-12-17T11:58:00.002 INFO:tasks.workunit.client.0.smithi002.stdout:6/929: truncate d0/d1/dc/d58/dae/ddb/fd0 5187003 0 2023-12-17T11:58:00.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/915: sync 2023-12-17T11:58:00.002 INFO:tasks.workunit.client.0.smithi002.stdout:7/916: chown d6/d17/dc/d13/d3e/c82 79 1 2023-12-17T11:58:00.003 INFO:tasks.workunit.client.1.smithi119.stdout:3/945: creat d9/d11/d1e/d55/d65/ddf/d139/d146/f15c x:0 0 0 2023-12-17T11:58:00.003 INFO:tasks.workunit.client.1.smithi119.stdout:3/946: chown d9/da/dcc/db8/f136 28179058 1 2023-12-17T11:58:00.005 INFO:tasks.workunit.client.0.smithi002.stdout:6/930: symlink d0/d1/d6d/d83/da2/d11e/d60/l12e 0 2023-12-17T11:58:00.006 INFO:tasks.workunit.client.1.smithi119.stdout:8/823: symlink d7/d18/d15/d10f/l110 0 2023-12-17T11:58:00.006 INFO:tasks.workunit.client.1.smithi119.stdout:9/962: read d12/d1d/f9e [1647726,6210] 0 2023-12-17T11:58:00.010 INFO:tasks.workunit.client.1.smithi119.stdout:0/905: mkdir d2/d66/dbb/dcd/d117 0 2023-12-17T11:58:00.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/990: dread d9/d1b/d35/d41/d59/d72/ffd [0,4194304] 0 2023-12-17T11:58:00.011 INFO:tasks.workunit.client.0.smithi002.stdout:3/991: readlink d9/d24/d6f/d84/lbe 0 2023-12-17T11:58:00.012 INFO:tasks.workunit.client.1.smithi119.stdout:3/947: creat d9/da/df/d41/d33/db4/d137/f15d x:0 0 0 2023-12-17T11:58:00.019 INFO:tasks.workunit.client.0.smithi002.stdout:1/979: dread d3/d6/d9/d37/d39/d43/f50 [0,4194304] 0 2023-12-17T11:58:00.020 INFO:tasks.workunit.client.1.smithi119.stdout:8/824: rename d7/d18/d15/d64/dc5 to d7/da/d1a/d84/d111 0 2023-12-17T11:58:00.022 INFO:tasks.workunit.client.1.smithi119.stdout:0/906: symlink d2/d66/l118 0 2023-12-17T11:58:00.027 INFO:tasks.workunit.client.1.smithi119.stdout:3/948: rename d9/da/df/f17 to d9/d35/dbd/dfb/d14c/f15e 0 2023-12-17T11:58:00.028 INFO:tasks.workunit.client.1.smithi119.stdout:0/907: write d2/d66/d2e/d44/d7b/d5/dc/f7e [3040921,95787] 0 2023-12-17T11:58:00.029 INFO:tasks.workunit.client.1.smithi119.stdout:9/963: dread d12/d1d/d28/d46/dea/dcf/f101 [0,4194304] 0 2023-12-17T11:58:00.029 INFO:tasks.workunit.client.1.smithi119.stdout:9/964: stat d12/d1d/d28/d4d/f6c 0 2023-12-17T11:58:00.029 INFO:tasks.workunit.client.1.smithi119.stdout:9/965: fdatasync d12/d1d/f5d 0 2023-12-17T11:58:00.032 INFO:tasks.workunit.client.1.smithi119.stdout:0/908: mknod d2/dac/dcf/c119 0 2023-12-17T11:58:00.036 INFO:tasks.workunit.client.0.smithi002.stdout:5/934: dwrite dc/d94/ded/dad/d12d/fef [0,4194304] 0 2023-12-17T11:58:00.037 INFO:tasks.workunit.client.0.smithi002.stdout:7/917: dread d6/d17/db3/ffc [0,4194304] 0 2023-12-17T11:58:00.040 INFO:tasks.workunit.client.0.smithi002.stdout:5/935: link dc/d94/ded/d2d/d5b/fa2 dc/d17/dc0/f13c 0 2023-12-17T11:58:00.044 INFO:tasks.workunit.client.0.smithi002.stdout:7/918: rename d6/d81/d103 to d6/d17/dc/d13/d21/d116 0 2023-12-17T11:58:00.045 INFO:tasks.workunit.client.0.smithi002.stdout:5/936: getdents dc/d1a/d47 0 2023-12-17T11:58:00.049 INFO:tasks.workunit.client.1.smithi119.stdout:7/937: dwrite d2/d4/d11/d2c/d68/f84 [0,4194304] 0 2023-12-17T11:58:00.050 INFO:tasks.workunit.client.0.smithi002.stdout:7/919: rmdir d6/d17/dc/d13/d21/d2e/d4a/daf/dec 0 2023-12-17T11:58:00.050 INFO:tasks.workunit.client.0.smithi002.stdout:5/937: symlink dc/d94/l13d 0 2023-12-17T11:58:00.050 INFO:tasks.workunit.client.0.smithi002.stdout:5/938: write dc/d94/ded/d2d/f56 [5251996,74643] 0 2023-12-17T11:58:00.051 INFO:tasks.workunit.client.0.smithi002.stdout:5/939: readlink dc/l100 0 2023-12-17T11:58:00.051 INFO:tasks.workunit.client.0.smithi002.stdout:5/940: chown dc/d94/ded/d2d/d5b/fe2 9729248 1 2023-12-17T11:58:00.051 INFO:tasks.workunit.client.0.smithi002.stdout:5/941: dread - dc/d94/ded/dad/f130 zero size 2023-12-17T11:58:00.051 INFO:tasks.workunit.client.0.smithi002.stdout:5/942: chown dc/d94/l13d 113383198 1 2023-12-17T11:58:00.053 INFO:tasks.workunit.client.0.smithi002.stdout:8/992: dwrite d3/d7/d18/d3f/d49/f10f [0,4194304] 0 2023-12-17T11:58:00.059 INFO:tasks.workunit.client.0.smithi002.stdout:3/992: write d9/d1b/d4f/fb1 [4549,72079] 0 2023-12-17T11:58:00.060 INFO:tasks.workunit.client.0.smithi002.stdout:7/920: write d6/d17/dc/d67/d8b/d24/da3/fb6 [1627176,7530] 0 2023-12-17T11:58:00.061 INFO:tasks.workunit.client.0.smithi002.stdout:7/921: fsync d6/d17/dc/d13/d21/d2e/f5a 0 2023-12-17T11:58:00.072 INFO:tasks.workunit.client.0.smithi002.stdout:0/907: dwrite d0/d6/d26/d14/d19/d61/de3/f126 [0,4194304] 0 2023-12-17T11:58:00.077 INFO:tasks.workunit.client.1.smithi119.stdout:1/895: dwrite d3/db/d26/d19/f70 [0,4194304] 0 2023-12-17T11:58:00.083 INFO:tasks.workunit.client.0.smithi002.stdout:8/993: rename d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d144/f54 to d3/d7/d18/d74/f158 0 2023-12-17T11:58:00.083 INFO:tasks.workunit.client.0.smithi002.stdout:8/994: stat d3/d7/d18/d3f/l9e 0 2023-12-17T11:58:00.084 INFO:tasks.workunit.client.0.smithi002.stdout:2/924: dwrite d3/d4/d7/d14/d1b/d5b/f97 [0,4194304] 0 2023-12-17T11:58:00.086 INFO:tasks.workunit.client.0.smithi002.stdout:5/943: dread dc/d17/d1c/fae [0,4194304] 0 2023-12-17T11:58:00.088 INFO:tasks.workunit.client.1.smithi119.stdout:1/896: dread d3/d44/dfd/f4a [0,4194304] 0 2023-12-17T11:58:00.088 INFO:tasks.workunit.client.1.smithi119.stdout:1/897: chown d3/db/d17/d24/d20/d40/d76/de9 23216313 1 2023-12-17T11:58:00.088 INFO:tasks.workunit.client.1.smithi119.stdout:1/898: chown d3/l4f 771 1 2023-12-17T11:58:00.088 INFO:tasks.workunit.client.1.smithi119.stdout:1/899: readlink d3/db/d2a/de5/led 0 2023-12-17T11:58:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:5/944: dread - dc/d94/f134 zero size 2023-12-17T11:58:00.088 INFO:tasks.workunit.client.0.smithi002.stdout:7/922: symlink d6/d17/dc/d13/l117 0 2023-12-17T11:58:00.089 INFO:tasks.workunit.client.0.smithi002.stdout:7/923: chown d6/d17/dc/d13/d37/d4f/l10d 0 1 2023-12-17T11:58:00.089 INFO:tasks.workunit.client.0.smithi002.stdout:3/993: rename d9/c98 to d9/d1b/d35/c139 0 2023-12-17T11:58:00.093 INFO:tasks.workunit.client.0.smithi002.stdout:7/924: unlink d6/d17/f61 0 2023-12-17T11:58:00.099 INFO:tasks.workunit.client.0.smithi002.stdout:3/994: mkdir d9/d1b/d35/d41/d59/d65/d13a 0 2023-12-17T11:58:00.099 INFO:tasks.workunit.client.0.smithi002.stdout:6/931: dwrite d0/d1/dc/d17/d67/ff4 [0,4194304] 0 2023-12-17T11:58:00.099 INFO:tasks.workunit.client.0.smithi002.stdout:0/908: rename d0/d6/d26/d8f/l9a to d0/d6/d26/d14/l128 0 2023-12-17T11:58:00.100 INFO:tasks.workunit.client.1.smithi119.stdout:1/900: write d3/f12 [2837086,69080] 0 2023-12-17T11:58:00.100 INFO:tasks.workunit.client.1.smithi119.stdout:1/901: chown d3/db/d26 7764 1 2023-12-17T11:58:00.100 INFO:tasks.workunit.client.1.smithi119.stdout:1/902: write d3/db/d17/d24/d20/f50 [3207520,15748] 0 2023-12-17T11:58:00.100 INFO:tasks.workunit.client.1.smithi119.stdout:1/903: creat d3/db/d2a/de5/f149 x:0 0 0 2023-12-17T11:58:00.103 INFO:tasks.workunit.client.1.smithi119.stdout:1/904: read d3/db/d2a/d127/d7e/f94 [59342,4957] 0 2023-12-17T11:58:00.104 INFO:tasks.workunit.client.0.smithi002.stdout:6/932: rename d0/d1/d6d/d83/d113/d116 to d0/d1/dc/d58/dae/d12f 0 2023-12-17T11:58:00.104 INFO:tasks.workunit.client.0.smithi002.stdout:6/933: dread - d0/d1/dc/d17/f12a zero size 2023-12-17T11:58:00.104 INFO:tasks.workunit.client.0.smithi002.stdout:6/934: stat d0/d1/d28/dab/d10e 0 2023-12-17T11:58:00.108 INFO:tasks.workunit.client.1.smithi119.stdout:1/905: rename d3/db/d17/d24/f32 to d3/d44/dfd/d105/f14a 0 2023-12-17T11:58:00.108 INFO:tasks.workunit.client.1.smithi119.stdout:1/906: read - d3/db/d26/d19/ff1 zero size 2023-12-17T11:58:00.109 INFO:tasks.workunit.client.1.smithi119.stdout:7/938: dwrite d2/d40/dc3/dca/dd9/ffa [0,4194304] 0 2023-12-17T11:58:00.110 INFO:tasks.workunit.client.0.smithi002.stdout:6/935: creat d0/d1/d6d/d83/da2/d11e/f130 x:0 0 0 2023-12-17T11:58:00.113 INFO:tasks.workunit.client.1.smithi119.stdout:1/907: truncate d3/db/d2a/d127/d7e/da1/fe7 1144911 0 2023-12-17T11:58:00.113 INFO:tasks.workunit.client.1.smithi119.stdout:1/908: chown d3/db/d26/d19/lab 1098478 1 2023-12-17T11:58:00.114 INFO:tasks.workunit.client.0.smithi002.stdout:1/980: dwrite d3/d6/d9/d37/d39/d43/d8f/f118 [0,4194304] 0 2023-12-17T11:58:00.115 INFO:tasks.workunit.client.0.smithi002.stdout:6/936: getdents d0 0 2023-12-17T11:58:00.115 INFO:tasks.workunit.client.0.smithi002.stdout:6/937: readlink d0/d1/d21/l3b 0 2023-12-17T11:58:00.116 INFO:tasks.workunit.client.1.smithi119.stdout:0/909: dwrite d2/d16/f17 [0,4194304] 0 2023-12-17T11:58:00.116 INFO:tasks.workunit.client.1.smithi119.stdout:0/910: readlink d2/d66/l102 0 2023-12-17T11:58:00.118 INFO:tasks.workunit.client.0.smithi002.stdout:0/909: dread d0/d15/d59/fd7 [0,4194304] 0 2023-12-17T11:58:00.118 INFO:tasks.workunit.client.1.smithi119.stdout:7/939: mkdir d2/d4/d11/d126 0 2023-12-17T11:58:00.120 INFO:tasks.workunit.client.1.smithi119.stdout:1/909: getdents d3/d44/dfd 0 2023-12-17T11:58:00.125 INFO:tasks.workunit.client.1.smithi119.stdout:0/911: truncate d2/f6b 2921732 0 2023-12-17T11:58:00.126 INFO:tasks.workunit.client.1.smithi119.stdout:0/912: dread - d2/d66/d2e/ff8 zero size 2023-12-17T11:58:00.126 INFO:tasks.workunit.client.1.smithi119.stdout:7/940: read d2/d4/d11/d2c/d68/d99/f30 [701221,18095] 0 2023-12-17T11:58:00.126 INFO:tasks.workunit.client.1.smithi119.stdout:7/941: chown d2/d4 7476214 1 2023-12-17T11:58:00.127 INFO:tasks.workunit.client.0.smithi002.stdout:6/938: mknod d0/d1/dc/d17/d67/c131 0 2023-12-17T11:58:00.127 INFO:tasks.workunit.client.0.smithi002.stdout:6/939: fdatasync d0/d1/d28/fe9 0 2023-12-17T11:58:00.128 INFO:tasks.workunit.client.0.smithi002.stdout:6/940: fsync d0/d1/dc/d17/f91 0 2023-12-17T11:58:00.128 INFO:tasks.workunit.client.0.smithi002.stdout:6/941: chown d0/d1/d28/l88 887463231 1 2023-12-17T11:58:00.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/942: symlink d0/d1/d21/l132 0 2023-12-17T11:58:00.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/943: creat d0/d1/d28/dab/f133 x:0 0 0 2023-12-17T11:58:00.131 INFO:tasks.workunit.client.0.smithi002.stdout:6/944: stat d0/d1/d6d/d83/da2/d126/f121 0 2023-12-17T11:58:00.132 INFO:tasks.workunit.client.0.smithi002.stdout:6/945: write d0/d1/d28/dde/f102 [339060,130912] 0 2023-12-17T11:58:00.132 INFO:tasks.workunit.client.1.smithi119.stdout:1/910: rename d3/d44/lad to d3/db/d106/d11f/l14b 0 2023-12-17T11:58:00.132 INFO:tasks.workunit.client.1.smithi119.stdout:1/911: rename d3/db to d3/db/d2a/d14c 22 2023-12-17T11:58:00.133 INFO:tasks.workunit.client.1.smithi119.stdout:7/942: mkdir d2/d40/dc3/d127 0 2023-12-17T11:58:00.137 INFO:tasks.workunit.client.1.smithi119.stdout:9/966: dwrite d12/d1d/d28/d46/d50/d92/fbe [0,4194304] 0 2023-12-17T11:58:00.137 INFO:tasks.workunit.client.1.smithi119.stdout:9/967: chown d12/d1d/c4c 325823484 1 2023-12-17T11:58:00.137 INFO:tasks.workunit.client.1.smithi119.stdout:9/968: dread - d12/d1d/d79/db1/fc8 zero size 2023-12-17T11:58:00.137 INFO:tasks.workunit.client.1.smithi119.stdout:1/912: rename d3/db/d26/d8f/fe1 to d3/db/d17/d24/d20/d40/d76/d96/f14d 0 2023-12-17T11:58:00.137 INFO:tasks.workunit.client.1.smithi119.stdout:7/943: mknod d2/d40/d120/c128 0 2023-12-17T11:58:00.137 INFO:tasks.workunit.client.0.smithi002.stdout:4/870: sync 2023-12-17T11:58:00.138 INFO:tasks.workunit.client.0.smithi002.stdout:4/871: write d0/d10/d14/d27/d69/fd2 [545568,107993] 0 2023-12-17T11:58:00.143 INFO:tasks.workunit.client.0.smithi002.stdout:4/872: write d0/d10/d14/d27/d69/d108/d65/ff6 [812175,125323] 0 2023-12-17T11:58:00.144 INFO:tasks.workunit.client.1.smithi119.stdout:1/913: mkdir d3/d44/dfd/d64/db2/d14e 0 2023-12-17T11:58:00.150 INFO:tasks.workunit.client.1.smithi119.stdout:7/944: mkdir d2/d40/da7/d129 0 2023-12-17T11:58:00.154 INFO:tasks.workunit.client.0.smithi002.stdout:6/946: dread d0/d1/dc/d17/d3c/f47 [0,4194304] 0 2023-12-17T11:58:00.156 INFO:tasks.workunit.client.0.smithi002.stdout:6/947: unlink d0/d1/dc/d17/d3c/f94 0 2023-12-17T11:58:00.157 INFO:tasks.workunit.client.0.smithi002.stdout:6/948: dread - d0/d1/dc/d17/ffc zero size 2023-12-17T11:58:00.157 INFO:tasks.workunit.client.0.smithi002.stdout:6/949: write d0/d1/d6d/d83/d113/da5/f8d [520676,69922] 0 2023-12-17T11:58:00.161 INFO:tasks.workunit.client.0.smithi002.stdout:7/925: dwrite d6/d17/dc/d13/d37/d4f/f80 [0,4194304] 0 2023-12-17T11:58:00.161 INFO:tasks.workunit.client.0.smithi002.stdout:7/926: chown d6/d17/f48 6078 1 2023-12-17T11:58:00.161 INFO:tasks.workunit.client.0.smithi002.stdout:7/927: readlink d6/d17/dc/d13/la2 0 2023-12-17T11:58:00.161 INFO:tasks.workunit.client.0.smithi002.stdout:6/950: symlink d0/d1/dc/d17/dd6/l134 0 2023-12-17T11:58:00.164 INFO:tasks.workunit.client.0.smithi002.stdout:2/925: dread d3/d4/d7/d14/d1b/d5b/de3/f116 [0,4194304] 0 2023-12-17T11:58:00.164 INFO:tasks.workunit.client.0.smithi002.stdout:2/926: creat d3/d4/d17/d19/d8d/f140 x:0 0 0 2023-12-17T11:58:00.164 INFO:tasks.workunit.client.0.smithi002.stdout:8/995: dread d3/d7/d1a/f6a [0,4194304] 0 2023-12-17T11:58:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/927: write d3/d4/dbc/f100 [784115,3280] 0 2023-12-17T11:58:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/928: getdents d3/d4/d7/d14/d1b/d5b 0 2023-12-17T11:58:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:2/929: getdents d3/d4/d8b/da6 0 2023-12-17T11:58:00.165 INFO:tasks.workunit.client.0.smithi002.stdout:8/996: creat d3/d7/d114/f159 x:0 0 0 2023-12-17T11:58:00.165 INFO:tasks.workunit.client.1.smithi119.stdout:7/945: dread d2/d4/d11/f3d [0,4194304] 0 2023-12-17T11:58:00.165 INFO:tasks.workunit.client.1.smithi119.stdout:7/946: write d2/d4/d11/d2c/d68/d99/d6c/f7c [833944,94578] 0 2023-12-17T11:58:00.170 INFO:tasks.workunit.client.0.smithi002.stdout:7/928: rename d6/d17/dc/d67/d8b/d24/fca to d6/d17/dc/d13/d21/d2e/d4a/daf/db1/f118 0 2023-12-17T11:58:00.172 INFO:tasks.workunit.client.0.smithi002.stdout:8/997: write d3/d7/d6e/daa/f14e [481963,96581] 0 2023-12-17T11:58:00.176 INFO:tasks.workunit.client.1.smithi119.stdout:7/947: mknod d2/d4/d11/d2c/d68/d98/c12a 0 2023-12-17T11:58:00.177 INFO:tasks.workunit.client.1.smithi119.stdout:7/948: fdatasync d2/d4/d11/d2c/d68/d77/f79 0 2023-12-17T11:58:00.178 INFO:tasks.workunit.client.0.smithi002.stdout:7/929: symlink d6/d17/dc/d13/d21/d116/l119 0 2023-12-17T11:58:00.180 INFO:tasks.workunit.client.0.smithi002.stdout:5/945: dwrite dc/d1a/faa [0,4194304] 0 2023-12-17T11:58:00.185 INFO:tasks.workunit.client.0.smithi002.stdout:8/998: symlink d3/d7/d18/d74/d7b/d11c/l15a 0 2023-12-17T11:58:00.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/946: creat dc/d94/ded/d5a/d68/f13e x:0 0 0 2023-12-17T11:58:00.188 INFO:tasks.workunit.client.0.smithi002.stdout:5/947: chown dc/d1a/fa5 230277 1 2023-12-17T11:58:00.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/948: chown dc/d94/ded/d75/fff 7560770 1 2023-12-17T11:58:00.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/949: readlink dc/d94/ded/l57 0 2023-12-17T11:58:00.189 INFO:tasks.workunit.client.0.smithi002.stdout:5/950: chown dc/d94/ded/d2d/d5b/fcb 9 1 2023-12-17T11:58:00.189 INFO:tasks.workunit.client.0.smithi002.stdout:8/999: mknod d3/d7/d18/d74/d7b/d11c/db4/d117/db0/d112/d133/c15b 0 2023-12-17T11:58:00.198 INFO:tasks.workunit.client.1.smithi119.stdout:2/992: sync 2023-12-17T11:58:00.205 INFO:tasks.workunit.client.0.smithi002.stdout:3/995: dwrite d9/d1b/d35/d41/d43/d73/f104 [0,4194304] 0 2023-12-17T11:58:00.205 INFO:tasks.workunit.client.0.smithi002.stdout:3/996: write d9/d24/f81 [3073924,56539] 0 2023-12-17T11:58:00.208 INFO:tasks.workunit.client.0.smithi002.stdout:3/997: symlink d9/l13b 0 2023-12-17T11:58:00.209 INFO:tasks.workunit.client.0.smithi002.stdout:3/998: mknod d9/d1b/d35/d41/d59/d7c/d11c/c13c 0 2023-12-17T11:58:00.213 INFO:tasks.workunit.client.0.smithi002.stdout:0/910: dwrite d0/d6/d26/d14/d19/d37/d62/d77/fa0 [4194304,4194304] 0 2023-12-17T11:58:00.214 INFO:tasks.workunit.client.0.smithi002.stdout:5/951: dread dc/f125 [0,4194304] 0 2023-12-17T11:58:00.214 INFO:tasks.workunit.client.0.smithi002.stdout:1/981: dwrite d3/d6/d9/d37/d39/d43/fa4 [0,4194304] 0 2023-12-17T11:58:00.217 INFO:tasks.workunit.client.0.smithi002.stdout:5/952: mknod dc/d94/ded/d5a/d68/d97/c13f 0 2023-12-17T11:58:00.217 INFO:tasks.workunit.client.0.smithi002.stdout:5/953: dread - dc/d1a/d53/da9/f10c zero size 2023-12-17T11:58:00.218 INFO:tasks.workunit.client.1.smithi119.stdout:9/969: dwrite d12/d1d/d28/d46/dbb/fd5 [0,4194304] 0 2023-12-17T11:58:00.220 INFO:tasks.workunit.client.1.smithi119.stdout:0/913: dwrite d2/d66/fba [0,4194304] 0 2023-12-17T11:58:00.221 INFO:tasks.workunit.client.0.smithi002.stdout:5/954: symlink dc/d1a/d53/l140 0 2023-12-17T11:58:00.221 INFO:tasks.workunit.client.1.smithi119.stdout:9/970: mkdir d12/d1d/d28/d46/d6e/df5/d13b 0 2023-12-17T11:58:00.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:59 smithi002 ceph-mon[107131]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:58:00.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:59 smithi002 ceph-mon[107131]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:59 smithi002 ceph-mon[107131]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:59 smithi002 ceph-mon[107131]: Upgrade: Need to upgrade myself (mgr.smithi119.nzblpy) 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:57:59 smithi002 ceph-mon[107131]: Upgrade: Need to upgrade myself (mgr.smithi119.nzblpy) 2023-12-17T11:58:00.228 INFO:tasks.workunit.client.1.smithi119.stdout:9/971: link d12/fdf d12/d1d/d28/d46/d50/d92/dae/dc9/f13c 0 2023-12-17T11:58:00.228 INFO:tasks.workunit.client.1.smithi119.stdout:9/972: write d12/d1d/f9e [1143920,125111] 0 2023-12-17T11:58:00.232 INFO:tasks.workunit.client.0.smithi002.stdout:1/982: write d3/d6/d9/ded/f137 [1167587,8727] 0 2023-12-17T11:58:00.234 INFO:tasks.workunit.client.1.smithi119.stdout:7/949: dread d2/d5b/f117 [0,4194304] 0 2023-12-17T11:58:00.236 INFO:tasks.workunit.client.1.smithi119.stdout:1/914: dwrite d3/d44/dfd/d64/f100 [0,4194304] 0 2023-12-17T11:58:00.238 INFO:tasks.workunit.client.1.smithi119.stdout:7/950: symlink d2/d40/dc3/d127/l12b 0 2023-12-17T11:58:00.241 INFO:tasks.workunit.client.1.smithi119.stdout:1/915: mkdir d3/db/d17/d24/d20/d40/d76/d96/d99/d9d/d14f 0 2023-12-17T11:58:00.242 INFO:tasks.workunit.client.1.smithi119.stdout:0/914: dread d2/d66/d2e/d44/d7b/d5/d3f/f5e [0,4194304] 0 2023-12-17T11:58:00.242 INFO:tasks.workunit.client.1.smithi119.stdout:0/915: truncate d2/d66/d2e/d44/d7b/dbc/df4/ff9 381234 0 2023-12-17T11:58:00.243 INFO:tasks.workunit.client.0.smithi002.stdout:4/873: dwrite d0/d10/d14/d4e/fbe [0,4194304] 0 2023-12-17T11:58:00.243 INFO:tasks.workunit.client.0.smithi002.stdout:0/911: write d0/d6/d26/d14/d19/d37/fa8 [2873814,125371] 0 2023-12-17T11:58:00.245 INFO:tasks.workunit.client.1.smithi119.stdout:7/951: mkdir d2/d40/dc3/dca/dd9/d12c 0 2023-12-17T11:58:00.253 INFO:tasks.workunit.client.0.smithi002.stdout:6/951: write d0/d1/dc/d58/dae/ddb/fd0 [514864,39691] 0 2023-12-17T11:58:00.253 INFO:tasks.workunit.client.0.smithi002.stdout:6/952: truncate d0/d1/d28/dde/f102 956032 0 2023-12-17T11:58:00.254 INFO:tasks.workunit.client.1.smithi119.stdout:1/916: getdents d3/db/d17/d112 0 2023-12-17T11:58:00.254 INFO:tasks.workunit.client.1.smithi119.stdout:0/916: truncate d2/d16/f17 2953969 0 2023-12-17T11:58:00.258 INFO:tasks.workunit.client.0.smithi002.stdout:7/930: dwrite d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:58:00.258 INFO:tasks.workunit.client.0.smithi002.stdout:6/953: creat d0/d1/dc/d17/dd6/d10c/dfe/f135 x:0 0 0 2023-12-17T11:58:00.267 INFO:tasks.workunit.client.1.smithi119.stdout:7/952: dread d2/d4/d11/d2c/d68/d99/d6c/def/f62 [0,4194304] 0 2023-12-17T11:58:00.267 INFO:tasks.workunit.client.0.smithi002.stdout:7/931: creat d6/d17/dc/d13/de1/f11a x:0 0 0 2023-12-17T11:58:00.270 INFO:tasks.workunit.client.0.smithi002.stdout:4/874: dread d0/fb2 [0,4194304] 0 2023-12-17T11:58:00.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/875: rename d0/d6c/dda/led to d0/d10/d14/d27/d69/d108/l118 0 2023-12-17T11:58:00.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/876: chown d0/d10/d14/d27/d57/cfd 2 1 2023-12-17T11:58:00.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/877: stat d0/d10/d14/d27/d57/c95 0 2023-12-17T11:58:00.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/878: stat d0/d10/d14/l4a 0 2023-12-17T11:58:00.275 INFO:tasks.workunit.client.0.smithi002.stdout:4/879: write d0/d10/d21/f49 [1123955,5860] 0 2023-12-17T11:58:00.275 INFO:tasks.workunit.client.1.smithi119.stdout:2/993: dwrite d6/d2b/da3/d142/d5d/d11c/deb/f132 [0,4194304] 0 2023-12-17T11:58:00.276 INFO:tasks.workunit.client.1.smithi119.stdout:5/967: sync 2023-12-17T11:58:00.276 INFO:tasks.workunit.client.1.smithi119.stdout:5/968: stat d1/da7/d71/d97/fa4 0 2023-12-17T11:58:00.277 INFO:tasks.workunit.client.1.smithi119.stdout:5/969: creat d1/d70/f13c x:0 0 0 2023-12-17T11:58:00.277 INFO:tasks.workunit.client.1.smithi119.stdout:5/970: fsync d1/d70/d6b/fc4 0 2023-12-17T11:58:00.277 INFO:tasks.workunit.client.1.smithi119.stdout:4/921: sync 2023-12-17T11:58:00.277 INFO:tasks.workunit.client.1.smithi119.stdout:6/826: sync 2023-12-17T11:58:00.277 INFO:tasks.workunit.client.1.smithi119.stdout:6/827: fsync d2/fa1 0 2023-12-17T11:58:00.277 INFO:tasks.workunit.client.1.smithi119.stdout:6/828: creat d2/d2b/d43/dcb/f105 x:0 0 0 2023-12-17T11:58:00.278 INFO:tasks.workunit.client.1.smithi119.stdout:9/973: dwrite d12/d1d/d28/d46/d6e/f6f [0,4194304] 0 2023-12-17T11:58:00.279 INFO:tasks.workunit.client.1.smithi119.stdout:7/953: mknod d2/d40/dc3/dca/dd9/c12d 0 2023-12-17T11:58:00.280 INFO:tasks.workunit.client.0.smithi002.stdout:2/930: dwrite d3/d4/d7/d14/d2e/f6d [0,4194304] 0 2023-12-17T11:58:00.281 INFO:tasks.workunit.client.1.smithi119.stdout:8/825: sync 2023-12-17T11:58:00.286 INFO:tasks.workunit.client.1.smithi119.stdout:2/994: creat d6/d9/d52/d53/d55/d58/da5/d133/d109/f150 x:0 0 0 2023-12-17T11:58:00.286 INFO:tasks.workunit.client.1.smithi119.stdout:3/949: sync 2023-12-17T11:58:00.286 INFO:tasks.workunit.client.1.smithi119.stdout:3/950: stat d9/da/df/d41/d33/db4/fe0 0 2023-12-17T11:58:00.290 INFO:tasks.workunit.client.1.smithi119.stdout:5/971: symlink d1/da7/d71/d97/df0/l13d 0 2023-12-17T11:58:00.295 INFO:tasks.workunit.client.1.smithi119.stdout:6/829: mknod d2/d2b/d43/dcb/df8/c106 0 2023-12-17T11:58:00.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/931: rename d3/d4/d7/d14/d2e/d37/fea to d3/d4/d17/d19/d8d/f141 0 2023-12-17T11:58:00.301 INFO:tasks.workunit.client.0.smithi002.stdout:6/954: read d0/d1/d6d/d83/d113/da5/f97 [1054315,36953] 0 2023-12-17T11:58:00.302 INFO:tasks.workunit.client.1.smithi119.stdout:4/922: write dd/d11/d2d/d9c/d55/fb7 [1222190,124274] 0 2023-12-17T11:58:00.303 INFO:tasks.workunit.client.0.smithi002.stdout:4/880: mkdir d0/d10/d21/d119 0 2023-12-17T11:58:00.303 INFO:tasks.workunit.client.0.smithi002.stdout:4/881: chown d0/d10/d14/d4e/c8d 133 1 2023-12-17T11:58:00.305 INFO:tasks.workunit.client.1.smithi119.stdout:9/974: mknod d12/d1d/d28/d46/dff/c13d 0 2023-12-17T11:58:00.305 INFO:tasks.workunit.client.1.smithi119.stdout:8/826: unlink d7/d18/f5b 0 2023-12-17T11:58:00.305 INFO:tasks.workunit.client.1.smithi119.stdout:2/995: creat d6/d9/d52/d53/d55/d58/f151 x:0 0 0 2023-12-17T11:58:00.305 INFO:tasks.workunit.client.1.smithi119.stdout:2/996: creat d6/d38/f152 x:0 0 0 2023-12-17T11:58:00.305 INFO:tasks.workunit.client.1.smithi119.stdout:2/997: chown d6/d38/f94 57813 1 2023-12-17T11:58:00.305 INFO:tasks.workunit.client.0.smithi002.stdout:1/983: dwrite d3/d6/d16/f47 [0,4194304] 0 2023-12-17T11:58:00.306 INFO:tasks.workunit.client.0.smithi002.stdout:3/999: dwrite d9/d15/d52/fc8 [0,4194304] 0 2023-12-17T11:58:00.308 INFO:tasks.workunit.client.0.smithi002.stdout:6/955: creat d0/d1/dc/d17/d8f/f136 x:0 0 0 2023-12-17T11:58:00.309 INFO:tasks.workunit.client.1.smithi119.stdout:3/951: creat d9/da/df/d41/d33/d3a/f15f x:0 0 0 2023-12-17T11:58:00.313 INFO:tasks.workunit.client.0.smithi002.stdout:0/912: dwrite d0/d6/d26/d14/d19/d37/f99 [0,4194304] 0 2023-12-17T11:58:00.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/882: getdents d0/d10/d14/d27/d69/d108/d65/d78/d85 0 2023-12-17T11:58:00.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/883: chown d0/d10/d14/d27/d69/d108/f77 251568821 1 2023-12-17T11:58:00.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/884: chown d0/d10/df8/ff9 656 1 2023-12-17T11:58:00.314 INFO:tasks.workunit.client.1.smithi119.stdout:5/972: symlink d1/d70/d6b/d77/dae/dba/de3/l13e 0 2023-12-17T11:58:00.315 INFO:tasks.workunit.client.1.smithi119.stdout:5/973: write d1/d36/f91 [1908184,22332] 0 2023-12-17T11:58:00.315 INFO:tasks.workunit.client.1.smithi119.stdout:5/974: fsync d1/fca 0 2023-12-17T11:58:00.324 INFO:tasks.workunit.client.1.smithi119.stdout:2/998: symlink d6/d2b/l153 0 2023-12-17T11:58:00.324 INFO:tasks.workunit.client.1.smithi119.stdout:2/999: chown d6/d9/d52/d53/fcd 17 1 2023-12-17T11:58:00.329 INFO:tasks.workunit.client.1.smithi119.stdout:9/975: rename d12/d1d/d28/d46/d50/d92 to d12/d1d/d79/db1/d13e 0 2023-12-17T11:58:00.334 INFO:tasks.workunit.client.1.smithi119.stdout:9/976: rename d12/d1d/d28/d46/dea/c9c to d12/d1d/d28/d46/dea/c13f 0 2023-12-17T11:58:00.334 INFO:tasks.workunit.client.1.smithi119.stdout:9/977: chown d12/d1d/d28/d46/dff/c13d 88388 1 2023-12-17T11:58:00.334 INFO:tasks.workunit.client.1.smithi119.stdout:6/830: write d2/d2b/d43/de6/d17/f7c [7141273,78243] 0 2023-12-17T11:58:00.334 INFO:tasks.workunit.client.1.smithi119.stdout:6/831: chown d2/d61/d8a/dcf 1879286 1 2023-12-17T11:58:00.336 INFO:tasks.workunit.client.1.smithi119.stdout:9/978: mknod d12/d1d/d28/d86/c140 0 2023-12-17T11:58:00.336 INFO:tasks.workunit.client.1.smithi119.stdout:9/979: write d12/d1d/d28/d4d/f5e [7339845,68724] 0 2023-12-17T11:58:00.337 INFO:tasks.workunit.client.1.smithi119.stdout:6/832: link d2/d2b/d43/d76/d8d/ff6 d2/d7e/dbc/f107 0 2023-12-17T11:58:00.338 INFO:tasks.workunit.client.1.smithi119.stdout:6/833: creat d2/d2b/d43/d5e/db3/f108 x:0 0 0 2023-12-17T11:58:00.338 INFO:tasks.workunit.client.1.smithi119.stdout:6/834: creat d2/d2b/d43/dcb/f109 x:0 0 0 2023-12-17T11:58:00.338 INFO:tasks.workunit.client.1.smithi119.stdout:6/835: chown d2/d2b/d43/d76/dbd/fe0 7918537 1 2023-12-17T11:58:00.338 INFO:tasks.workunit.client.1.smithi119.stdout:6/836: chown d2/d61/fb9 4220369 1 2023-12-17T11:58:00.339 INFO:tasks.workunit.client.0.smithi002.stdout:6/956: write d0/d1/d28/dab/fac [762251,84425] 0 2023-12-17T11:58:00.340 INFO:tasks.workunit.client.1.smithi119.stdout:9/980: mkdir d12/d1d/d28/d46/dbb/d141 0 2023-12-17T11:58:00.345 INFO:tasks.workunit.client.0.smithi002.stdout:6/957: creat d0/d1/d6d/d83/d113/da5/dbc/f137 x:0 0 0 2023-12-17T11:58:00.345 INFO:tasks.workunit.client.0.smithi002.stdout:6/958: truncate d0/d1/d6d/d83/da2/fb9 657885 0 2023-12-17T11:58:00.345 INFO:tasks.workunit.client.0.smithi002.stdout:6/959: readlink d0/d1/dc/d17/d67/d6c/d7f/la1 0 2023-12-17T11:58:00.345 INFO:tasks.workunit.client.0.smithi002.stdout:6/960: dread - d0/d1/dc/d17/ffc zero size 2023-12-17T11:58:00.345 INFO:tasks.workunit.client.0.smithi002.stdout:6/961: creat d0/d1/d6d/d83/d113/da5/dbc/f138 x:0 0 0 2023-12-17T11:58:00.345 INFO:tasks.workunit.client.1.smithi119.stdout:6/837: rename d2/d2b/d43/d76/d8d/ff6 to d2/d41/f10a 0 2023-12-17T11:58:00.347 INFO:tasks.workunit.client.1.smithi119.stdout:9/981: mknod d12/d1d/d79/db1/d13e/c142 0 2023-12-17T11:58:00.351 INFO:tasks.workunit.client.1.smithi119.stdout:0/917: dwrite d2/d16/d35/d39/f76 [0,4194304] 0 2023-12-17T11:58:00.358 INFO:tasks.workunit.client.0.smithi002.stdout:2/932: write d3/d4/d17/d19/d8d/fb7 [196803,56683] 0 2023-12-17T11:58:00.362 INFO:tasks.workunit.client.1.smithi119.stdout:9/982: dread d12/d1d/d28/d46/dea/dcf/f101 [0,4194304] 0 2023-12-17T11:58:00.362 INFO:tasks.workunit.client.1.smithi119.stdout:9/983: fdatasync d12/d1d/d28/d46/f66 0 2023-12-17T11:58:00.364 INFO:tasks.workunit.client.1.smithi119.stdout:9/984: rename d12/d1d/d28/d46/dea/laa to d12/d1d/d49/l143 0 2023-12-17T11:58:00.365 INFO:tasks.workunit.client.0.smithi002.stdout:6/962: dread d0/d1/dc/d17/dd6/d10c/f11d [0,4194304] 0 2023-12-17T11:58:00.367 INFO:tasks.workunit.client.0.smithi002.stdout:7/932: dwrite d6/d17/dc/d13/f30 [0,4194304] 0 2023-12-17T11:58:00.368 INFO:tasks.workunit.client.0.smithi002.stdout:6/963: creat d0/d1/dc/d58/f139 x:0 0 0 2023-12-17T11:58:00.368 INFO:tasks.workunit.client.0.smithi002.stdout:6/964: write d0/d1/dc/fbe [830783,95039] 0 2023-12-17T11:58:00.369 INFO:tasks.workunit.client.1.smithi119.stdout:5/975: fdatasync d1/d36/f91 0 2023-12-17T11:58:00.371 INFO:tasks.workunit.client.0.smithi002.stdout:6/965: rename d0/d1/dc/d17/f91 to d0/d1/d6d/d83/da2/d11e/f13a 0 2023-12-17T11:58:00.374 INFO:tasks.workunit.client.0.smithi002.stdout:6/966: creat d0/d1/dc/d17/dd6/f13b x:0 0 0 2023-12-17T11:58:00.374 INFO:tasks.workunit.client.1.smithi119.stdout:5/976: mkdir d1/d70/da3/d13f 0 2023-12-17T11:58:00.376 INFO:tasks.workunit.client.0.smithi002.stdout:6/967: rmdir d0/d1/d28/dde 39 2023-12-17T11:58:00.378 INFO:tasks.workunit.client.0.smithi002.stdout:6/968: mknod d0/d1/dc/d58/c13c 0 2023-12-17T11:58:00.378 INFO:tasks.workunit.client.0.smithi002.stdout:6/969: fsync d0/d1/dc/d17/dd6/feb 0 2023-12-17T11:58:00.379 INFO:tasks.workunit.client.1.smithi119.stdout:0/918: dread d2/d16/d35/f6c [0,4194304] 0 2023-12-17T11:58:00.380 INFO:tasks.workunit.client.1.smithi119.stdout:4/923: dwrite dd/d15/d16/d5a/dbc/ff6 [0,4194304] 0 2023-12-17T11:58:00.385 INFO:tasks.workunit.client.1.smithi119.stdout:0/919: rename d2/d66/d1f/d24/d50/dbd/dea/d112 to d2/d16/d11a 0 2023-12-17T11:58:00.386 INFO:tasks.workunit.client.1.smithi119.stdout:0/920: chown d2/d66/d2e/d44/df0/f83 3 1 2023-12-17T11:58:00.386 INFO:tasks.workunit.client.1.smithi119.stdout:4/924: creat dd/d15/d16/d5a/f11c x:0 0 0 2023-12-17T11:58:00.387 INFO:tasks.workunit.client.0.smithi002.stdout:2/933: dread d3/d4/d7/d14/d2e/d37/d3f/d10e/f117 [0,4194304] 0 2023-12-17T11:58:00.387 INFO:tasks.workunit.client.1.smithi119.stdout:4/925: symlink dd/d15/d16/d20/l11d 0 2023-12-17T11:58:00.390 INFO:tasks.workunit.client.1.smithi119.stdout:3/952: dwrite d9/da/df/f15a [0,4194304] 0 2023-12-17T11:58:00.390 INFO:tasks.workunit.client.1.smithi119.stdout:4/926: read dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/fef [125431,24035] 0 2023-12-17T11:58:00.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/934: mknod d3/d4/d8b/c142 0 2023-12-17T11:58:00.390 INFO:tasks.workunit.client.0.smithi002.stdout:2/935: stat d3/d4/d7/d14/d34/f46 0 2023-12-17T11:58:00.391 INFO:tasks.workunit.client.1.smithi119.stdout:4/927: chown dd/d15/d16/d3d/f4c 47 1 2023-12-17T11:58:00.393 INFO:tasks.workunit.client.0.smithi002.stdout:6/970: dread d0/f48 [0,4194304] 0 2023-12-17T11:58:00.396 INFO:tasks.workunit.client.1.smithi119.stdout:0/921: dread d2/d16/d35/d39/f4a [0,4194304] 0 2023-12-17T11:58:00.397 INFO:tasks.workunit.client.1.smithi119.stdout:3/953: creat d9/da/df/de1/d155/f160 x:0 0 0 2023-12-17T11:58:00.397 INFO:tasks.workunit.client.1.smithi119.stdout:8/827: dwrite d7/f16 [0,4194304] 0 2023-12-17T11:58:00.397 INFO:tasks.workunit.client.1.smithi119.stdout:8/828: chown d7/d12/f33 2563 1 2023-12-17T11:58:00.397 INFO:tasks.workunit.client.1.smithi119.stdout:8/829: stat d7/da/d11/f87 0 2023-12-17T11:58:00.398 INFO:tasks.workunit.client.1.smithi119.stdout:8/830: creat d7/da/d1a/d8a/ddb/dbf/f112 x:0 0 0 2023-12-17T11:58:00.398 INFO:tasks.workunit.client.1.smithi119.stdout:8/831: fdatasync d7/d12/fbe 0 2023-12-17T11:58:00.399 INFO:tasks.workunit.client.0.smithi002.stdout:6/971: creat d0/d1/dc/d17/d3c/f13d x:0 0 0 2023-12-17T11:58:00.402 INFO:tasks.workunit.client.1.smithi119.stdout:3/954: creat d9/d59/dae/f161 x:0 0 0 2023-12-17T11:58:00.402 INFO:tasks.workunit.client.1.smithi119.stdout:3/955: write d9/d1c/ff8 [1268109,102984] 0 2023-12-17T11:58:00.403 INFO:tasks.workunit.client.0.smithi002.stdout:4/885: dwrite d0/d10/d14/d27/d69/d108/d65/ff6 [0,4194304] 0 2023-12-17T11:58:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:59 smithi119 ceph-mon[117414]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T11:58:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:59 smithi119 ceph-mon[117414]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T11:58:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:59 smithi119 ceph-mon[117414]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:58:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:59 smithi119 ceph-mon[117414]: Upgrade: Need to upgrade myself (mgr.smithi119.nzblpy) 2023-12-17T11:58:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:57:59 smithi119 ceph-mon[117414]: Upgrade: Need to upgrade myself (mgr.smithi119.nzblpy) 2023-12-17T11:58:00.409 INFO:tasks.workunit.client.0.smithi002.stdout:6/972: mknod d0/d1/d6d/d83/c13e 0 2023-12-17T11:58:00.409 INFO:tasks.workunit.client.0.smithi002.stdout:6/973: truncate d0/d1/dc/d17/ffc 224741 0 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:8/832: getdents d7/d18/d15/d10f 0 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:8/833: chown d7/c97 46 1 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:8/834: truncate d7/da/d11/faa 4259914 0 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:8/835: write d7/d12/d69/f24 [2183321,119340] 0 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:5/977: dwrite d1/d70/d6b/d77/fe2 [0,4194304] 0 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:3/956: creat d9/d11/d1e/d55/df3/f162 x:0 0 0 2023-12-17T11:58:00.417 INFO:tasks.workunit.client.1.smithi119.stdout:3/957: dread - d9/d35/dbd/dfb/f14a zero size 2023-12-17T11:58:00.423 INFO:tasks.workunit.client.0.smithi002.stdout:6/974: getdents d0/d1 0 2023-12-17T11:58:00.430 INFO:tasks.workunit.client.1.smithi119.stdout:5/978: rename d1/d36/l59 to d1/da7/d71/d97/df0/d103/l140 0 2023-12-17T11:58:00.430 INFO:tasks.workunit.client.1.smithi119.stdout:5/979: fsync d1/da7/d71/d97/df0/d103/d12c/f101 0 2023-12-17T11:58:00.430 INFO:tasks.workunit.client.1.smithi119.stdout:5/980: readlink d1/d36/d3a/l43 0 2023-12-17T11:58:00.432 INFO:tasks.workunit.client.1.smithi119.stdout:9/985: dwrite d12/dca/f10d [0,4194304] 0 2023-12-17T11:58:00.435 INFO:tasks.workunit.client.1.smithi119.stdout:3/958: symlink d9/d11/d1e/d55/d65/ddf/l163 0 2023-12-17T11:58:00.435 INFO:tasks.workunit.client.1.smithi119.stdout:3/959: truncate d9/da/df/d67/f89 4810299 0 2023-12-17T11:58:00.436 INFO:tasks.workunit.client.1.smithi119.stdout:5/981: creat d1/d25/f141 x:0 0 0 2023-12-17T11:58:00.436 INFO:tasks.workunit.client.1.smithi119.stdout:5/982: write d1/d70/d6b/f87 [1820632,3327] 0 2023-12-17T11:58:00.436 INFO:tasks.workunit.client.1.smithi119.stdout:5/983: getdents d1/d36/d3a 0 2023-12-17T11:58:00.440 INFO:tasks.workunit.client.1.smithi119.stdout:3/960: truncate d9/da/df/fce 3463730 0 2023-12-17T11:58:00.441 INFO:tasks.workunit.client.1.smithi119.stdout:5/984: symlink d1/da7/d71/d97/df0/d103/d12c/l142 0 2023-12-17T11:58:00.441 INFO:tasks.workunit.client.1.smithi119.stdout:5/985: write d1/d70/d6b/df1/f113 [1408788,117173] 0 2023-12-17T11:58:00.444 INFO:tasks.workunit.client.1.smithi119.stdout:3/961: getdents d9/d11/d1e/d55/d77/d135 0 2023-12-17T11:58:00.444 INFO:tasks.workunit.client.0.smithi002.stdout:7/933: dwrite d6/d17/dc/d67/d8b/dbd/f78 [0,4194304] 0 2023-12-17T11:58:00.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/986: rename d1/l14 to d1/d70/d6b/d77/dae/dba/de3/d86/dda/l143 0 2023-12-17T11:58:00.447 INFO:tasks.workunit.client.1.smithi119.stdout:5/987: fdatasync d1/da7/d10b/f126 0 2023-12-17T11:58:00.449 INFO:tasks.workunit.client.1.smithi119.stdout:3/962: mkdir d9/d35/dbd/dfb/d14c/d164 0 2023-12-17T11:58:00.451 INFO:tasks.workunit.client.1.smithi119.stdout:3/963: unlink d9/da/df/d41/d33/d3a/f15f 0 2023-12-17T11:58:00.451 INFO:tasks.workunit.client.0.smithi002.stdout:6/975: dread d0/d1/dc0/fd2 [0,4194304] 0 2023-12-17T11:58:00.452 INFO:tasks.workunit.client.0.smithi002.stdout:6/976: fdatasync d0/d1/d6d/d83/faf 0 2023-12-17T11:58:00.456 INFO:tasks.workunit.client.0.smithi002.stdout:6/977: mknod d0/d1/d6d/d83/da2/c13f 0 2023-12-17T11:58:00.457 INFO:tasks.workunit.client.0.smithi002.stdout:6/978: stat d0/d1/dc/d58/lba 0 2023-12-17T11:58:00.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/955: sync 2023-12-17T11:58:00.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/956: creat dc/d17/dc0/f141 x:0 0 0 2023-12-17T11:58:00.459 INFO:tasks.workunit.client.0.smithi002.stdout:5/957: truncate dc/d1a/d53/da9/f11b 569965 0 2023-12-17T11:58:00.460 INFO:tasks.workunit.client.1.smithi119.stdout:4/928: dwrite dd/d15/d16/d3d/dab/db1/fb2 [0,4194304] 0 2023-12-17T11:58:00.460 INFO:tasks.workunit.client.1.smithi119.stdout:4/929: write dd/d15/d16/ff4 [631251,1748] 0 2023-12-17T11:58:00.462 INFO:tasks.workunit.client.0.smithi002.stdout:6/979: creat d0/d1/dc/d10/f140 x:0 0 0 2023-12-17T11:58:00.464 INFO:tasks.workunit.client.0.smithi002.stdout:4/886: dwrite d0/d10/d21/f42 [0,4194304] 0 2023-12-17T11:58:00.464 INFO:tasks.workunit.client.0.smithi002.stdout:4/887: fsync d0/d6c/fe3 0 2023-12-17T11:58:00.464 INFO:tasks.workunit.client.1.smithi119.stdout:8/836: dwrite d7/da/d1a/d8a/ddb/dbf/fe9 [0,4194304] 0 2023-12-17T11:58:00.465 INFO:tasks.workunit.client.1.smithi119.stdout:5/988: read d1/f8 [7223521,24251] 0 2023-12-17T11:58:00.465 INFO:tasks.workunit.client.1.smithi119.stdout:8/837: readlink d7/d18/d45/d9f/d75/l82 0 2023-12-17T11:58:00.465 INFO:tasks.workunit.client.1.smithi119.stdout:8/838: fsync d7/da/d1a/d8a/ddb/faf 0 2023-12-17T11:58:00.465 INFO:tasks.workunit.client.1.smithi119.stdout:0/922: dwrite d2/d66/d2e/d44/d7b/d5/dc/f7e [0,4194304] 0 2023-12-17T11:58:00.466 INFO:tasks.workunit.client.0.smithi002.stdout:4/888: rename d0/d10/f31 to d0/d3e/da5/f11a 0 2023-12-17T11:58:00.479 INFO:tasks.workunit.client.1.smithi119.stdout:8/839: link d7/f16 d7/da/d1a/d8a/ddb/dbf/dfc/f113 0 2023-12-17T11:58:00.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/989: dread d1/f30 [0,4194304] 0 2023-12-17T11:58:00.479 INFO:tasks.workunit.client.1.smithi119.stdout:5/990: chown d1/d70/d6b/d77/dae/dba/de3/d86/dda/ce6 240 1 2023-12-17T11:58:00.480 INFO:tasks.workunit.client.1.smithi119.stdout:5/991: truncate d1/da7/d10b/f126 916160 0 2023-12-17T11:58:00.489 INFO:tasks.workunit.client.0.smithi002.stdout:4/889: dread d0/d3e/d41/fef [0,4194304] 0 2023-12-17T11:58:00.489 INFO:tasks.workunit.client.1.smithi119.stdout:8/840: mknod d7/d12/d23/db4/c114 0 2023-12-17T11:58:00.494 INFO:tasks.workunit.client.0.smithi002.stdout:4/890: symlink d0/d10/d14/d27/d69/d108/l11b 0 2023-12-17T11:58:00.497 INFO:tasks.workunit.client.0.smithi002.stdout:4/891: symlink d0/d10/d21/d33/dbc/l11c 0 2023-12-17T11:58:00.500 INFO:tasks.workunit.client.0.smithi002.stdout:4/892: creat d0/d10/d21/d119/f11d x:0 0 0 2023-12-17T11:58:00.502 INFO:tasks.workunit.client.1.smithi119.stdout:1/917: sync 2023-12-17T11:58:00.502 INFO:tasks.workunit.client.0.smithi002.stdout:7/934: dwrite d6/d17/dc/d13/d37/d4f/f80 [0,4194304] 0 2023-12-17T11:58:00.503 INFO:tasks.workunit.client.0.smithi002.stdout:7/935: fsync d6/d17/dc/d67/d8b/f35 0 2023-12-17T11:58:00.506 INFO:tasks.workunit.client.0.smithi002.stdout:7/936: unlink d6/d17/dc/d13/d37/l60 0 2023-12-17T11:58:00.506 INFO:tasks.workunit.client.0.smithi002.stdout:7/937: chown d6/d17/dc/d67/c25 526 1 2023-12-17T11:58:00.506 INFO:tasks.workunit.client.0.smithi002.stdout:7/938: write d6/d17/dc/d13/d37/d4f/f63 [1720738,42943] 0 2023-12-17T11:58:00.514 INFO:tasks.workunit.client.1.smithi119.stdout:0/923: dwrite d2/d66/d2e/d44/df0/fa7 [0,4194304] 0 2023-12-17T11:58:00.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/958: dwrite fa [0,4194304] 0 2023-12-17T11:58:00.517 INFO:tasks.workunit.client.0.smithi002.stdout:5/959: chown dc/d94/ded/d5a/d68/l124 1946412 1 2023-12-17T11:58:00.521 INFO:tasks.workunit.client.1.smithi119.stdout:0/924: write d2/d16/fbf [4548334,33982] 0 2023-12-17T11:58:00.521 INFO:tasks.workunit.client.1.smithi119.stdout:0/925: chown d2/d66/d1f/d24 118436 1 2023-12-17T11:58:00.523 INFO:tasks.workunit.client.0.smithi002.stdout:5/960: rename dc/d94/ded/d5a/d96/l39 to dc/d1a/d53/da9/db3/l142 0 2023-12-17T11:58:00.535 INFO:tasks.workunit.client.0.smithi002.stdout:6/980: dwrite d0/d1/dc/d10/f86 [0,4194304] 0 2023-12-17T11:58:00.535 INFO:tasks.workunit.client.1.smithi119.stdout:8/841: write d7/d18/f4e [2115095,63115] 0 2023-12-17T11:58:00.539 INFO:tasks.workunit.client.1.smithi119.stdout:4/930: dwrite dd/d15/d16/f51 [4194304,4194304] 0 2023-12-17T11:58:00.539 INFO:tasks.workunit.client.1.smithi119.stdout:4/931: write dd/d11/f103 [248370,55962] 0 2023-12-17T11:58:00.540 INFO:tasks.workunit.client.1.smithi119.stdout:4/932: truncate dd/d11/f74 855332 0 2023-12-17T11:58:00.540 INFO:tasks.workunit.client.1.smithi119.stdout:4/933: creat dd/d15/d16/d3d/f11e x:0 0 0 2023-12-17T11:58:00.540 INFO:tasks.workunit.client.1.smithi119.stdout:9/986: dwrite d12/d1d/d28/d46/d50/fb0 [0,4194304] 0 2023-12-17T11:58:00.540 INFO:tasks.workunit.client.1.smithi119.stdout:8/842: link d7/d18/d45/d9f/d7b/lb0 d7/d18/d45/d9f/d7b/d108/l115 0 2023-12-17T11:58:00.540 INFO:tasks.workunit.client.1.smithi119.stdout:8/843: chown d7/l9 31600 1 2023-12-17T11:58:00.540 INFO:tasks.workunit.client.0.smithi002.stdout:6/981: link d0/d1/dc/d10/c5e d0/d1/d6d/c141 0 2023-12-17T11:58:00.544 INFO:tasks.workunit.client.1.smithi119.stdout:0/926: dread d2/f67 [0,4194304] 0 2023-12-17T11:58:00.545 INFO:tasks.workunit.client.1.smithi119.stdout:9/987: dread d12/d1d/d79/db1/d13e/daf/deb/dee/f128 [0,4194304] 0 2023-12-17T11:58:00.547 INFO:tasks.workunit.client.1.smithi119.stdout:8/844: dread d7/da/fc6 [0,4194304] 0 2023-12-17T11:58:00.549 INFO:tasks.workunit.client.1.smithi119.stdout:5/992: dwrite d1/d36/d3a/f4b [0,4194304] 0 2023-12-17T11:58:00.549 INFO:tasks.workunit.client.1.smithi119.stdout:5/993: chown d1/f8 119587413 1 2023-12-17T11:58:00.550 INFO:tasks.workunit.client.1.smithi119.stdout:1/918: dwrite d3/db/d17/f30 [4194304,4194304] 0 2023-12-17T11:58:00.551 INFO:tasks.workunit.client.1.smithi119.stdout:4/934: mkdir dd/d11/d2d/d9c/d55/d11f 0 2023-12-17T11:58:00.551 INFO:tasks.workunit.client.1.smithi119.stdout:4/935: fsync dd/f1b 0 2023-12-17T11:58:00.552 INFO:tasks.workunit.client.1.smithi119.stdout:0/927: symlink d2/d66/d2e/d44/d7b/d5/d3f/l11b 0 2023-12-17T11:58:00.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/961: read dc/d1a/faa [2755068,118834] 0 2023-12-17T11:58:00.553 INFO:tasks.workunit.client.0.smithi002.stdout:5/962: chown dc/d17/d2f/d82 2758720 1 2023-12-17T11:58:00.554 INFO:tasks.workunit.client.1.smithi119.stdout:8/845: chown d7/d18/d45/f6d 16 1 2023-12-17T11:58:00.555 INFO:tasks.workunit.client.1.smithi119.stdout:5/994: link d1/da7/d71/f84 d1/d36/f144 0 2023-12-17T11:58:00.555 INFO:tasks.workunit.client.1.smithi119.stdout:5/995: write d1/da7/d71/d76/d83/dd1/fd8 [723123,79707] 0 2023-12-17T11:58:00.555 INFO:tasks.workunit.client.1.smithi119.stdout:5/996: fdatasync d1/d70/d6b/d77/dae/dba/de3/d86/f66 0 2023-12-17T11:58:00.556 INFO:tasks.workunit.client.1.smithi119.stdout:5/997: chown d1/d36 2332 1 2023-12-17T11:58:00.557 INFO:tasks.workunit.client.1.smithi119.stdout:1/919: mknod d3/d44/dfd/d64/c150 0 2023-12-17T11:58:00.558 INFO:tasks.workunit.client.1.smithi119.stdout:0/928: mknod d2/d66/d1f/d24/d50/dbd/dea/c11c 0 2023-12-17T11:58:00.559 INFO:tasks.workunit.client.1.smithi119.stdout:8/846: mknod d7/d18/d45/d9f/d7b/df9/c116 0 2023-12-17T11:58:00.559 INFO:tasks.workunit.client.1.smithi119.stdout:8/847: readlink d7/da/d11/l4d 0 2023-12-17T11:58:00.561 INFO:tasks.workunit.client.1.smithi119.stdout:5/998: getdents d1/d70/d6b/d77 0 2023-12-17T11:58:00.564 INFO:tasks.workunit.client.1.smithi119.stdout:1/920: rename d3/db/d26/d19/f1e to d3/db/d17/d24/d20/d40/d76/d142/f151 0 2023-12-17T11:58:00.564 INFO:tasks.workunit.client.1.smithi119.stdout:1/921: truncate d3/db/d17/d24/d20/dbd/dcb/ff3 5220759 0 2023-12-17T11:58:00.565 INFO:tasks.workunit.client.0.smithi002.stdout:4/893: dwrite d0/d10/d14/f70 [0,4194304] 0 2023-12-17T11:58:00.565 INFO:tasks.workunit.client.1.smithi119.stdout:0/929: mkdir d2/d66/d1f/d24/d11d 0 2023-12-17T11:58:00.566 INFO:tasks.workunit.client.1.smithi119.stdout:0/930: creat d2/d66/d2e/d44/df0/dc3/f11e x:0 0 0 2023-12-17T11:58:00.566 INFO:tasks.workunit.client.1.smithi119.stdout:8/848: symlink d7/da/d1a/l117 0 2023-12-17T11:58:00.568 INFO:tasks.workunit.client.0.smithi002.stdout:5/963: read dc/d1a/f48 [1000922,38851] 0 2023-12-17T11:58:00.568 INFO:tasks.workunit.client.0.smithi002.stdout:5/964: chown dc/d94/ded/d2d/f12b 79 1 2023-12-17T11:58:00.568 INFO:tasks.workunit.client.1.smithi119.stdout:5/999: creat d1/d70/da3/d120/f145 x:0 0 0 2023-12-17T11:58:00.570 INFO:tasks.workunit.client.1.smithi119.stdout:1/922: truncate d3/db/d17/d24/d20/d40/d76/d84/f103 30259 0 2023-12-17T11:58:00.570 INFO:tasks.workunit.client.1.smithi119.stdout:1/923: chown d3/db/d26/d5e/fe0 191854 1 2023-12-17T11:58:00.577 INFO:tasks.workunit.client.1.smithi119.stdout:0/931: mkdir d2/d66/d1f/d24/dc9/d11f 0 2023-12-17T11:58:00.577 INFO:tasks.workunit.client.1.smithi119.stdout:0/932: getdents d2/dac 0 2023-12-17T11:58:00.579 INFO:tasks.workunit.client.0.smithi002.stdout:5/965: link dc/d8e/dd6/l10a dc/d94/ded/d5a/d96/l143 0 2023-12-17T11:58:00.581 INFO:tasks.workunit.client.1.smithi119.stdout:1/924: truncate d3/d44/dfd/d64/f98 19191 0 2023-12-17T11:58:00.581 INFO:tasks.workunit.client.1.smithi119.stdout:1/925: readlink d3/db/lf8 0 2023-12-17T11:58:00.585 INFO:tasks.workunit.client.1.smithi119.stdout:0/933: creat d2/d16/d35/f120 x:0 0 0 2023-12-17T11:58:00.585 INFO:tasks.workunit.client.0.smithi002.stdout:6/982: dwrite d0/d1/dc/d17/f2e [4194304,4194304] 0 2023-12-17T11:58:00.585 INFO:tasks.workunit.client.0.smithi002.stdout:5/966: unlink dc/d1a/d53/da9/db3/l142 0 2023-12-17T11:58:00.590 INFO:tasks.workunit.client.1.smithi119.stdout:1/926: creat d3/db/d106/d11f/f152 x:0 0 0 2023-12-17T11:58:00.591 INFO:tasks.workunit.client.1.smithi119.stdout:9/988: dwrite d12/dca/ff8 [0,4194304] 0 2023-12-17T11:58:00.591 INFO:tasks.workunit.client.1.smithi119.stdout:9/989: dread - d12/d1d/d28/d4d/d73/dda/f113 zero size 2023-12-17T11:58:00.595 INFO:tasks.workunit.client.0.smithi002.stdout:6/983: symlink d0/d1/d28/l142 0 2023-12-17T11:58:00.596 INFO:tasks.workunit.client.1.smithi119.stdout:4/936: dwrite dd/d15/d4f/f6b [0,4194304] 0 2023-12-17T11:58:00.599 INFO:tasks.workunit.client.0.smithi002.stdout:5/967: creat dc/d94/ded/d2d/dcf/d10d/f144 x:0 0 0 2023-12-17T11:58:00.603 INFO:tasks.workunit.client.1.smithi119.stdout:9/990: dread d12/d1d/d79/db1/d13e/dae/fb5 [0,4194304] 0 2023-12-17T11:58:00.603 INFO:tasks.workunit.client.1.smithi119.stdout:0/934: dread d2/d66/d1f/f20 [0,4194304] 0 2023-12-17T11:58:00.604 INFO:tasks.workunit.client.1.smithi119.stdout:4/937: unlink dd/d11/d2d/d9c/d55/d81/d88/ceb 0 2023-12-17T11:58:00.607 INFO:tasks.workunit.client.0.smithi002.stdout:5/968: rename dc/d94/ded/d5a/d96/l3f to dc/d17/d2f/d82/l145 0 2023-12-17T11:58:00.608 INFO:tasks.workunit.client.0.smithi002.stdout:5/969: chown dc/d94/ff9 30780903 1 2023-12-17T11:58:00.610 INFO:tasks.workunit.client.1.smithi119.stdout:9/991: rmdir d12/d1d/d28/d46/d6e/df5/d13b 0 2023-12-17T11:58:00.610 INFO:tasks.workunit.client.1.smithi119.stdout:9/992: fsync d12/d1d/d28/d46/d50/f60 0 2023-12-17T11:58:00.610 INFO:tasks.workunit.client.0.smithi002.stdout:5/970: write dc/d17/f84 [47011,96543] 0 2023-12-17T11:58:00.612 INFO:tasks.workunit.client.0.smithi002.stdout:6/984: dread d0/d1/dc/d17/dd7/f109 [0,4194304] 0 2023-12-17T11:58:00.612 INFO:tasks.workunit.client.1.smithi119.stdout:0/935: rename d2/d16/f7d to d2/d66/d2e/d44/d7b/d5/d3f/f121 0 2023-12-17T11:58:00.617 INFO:tasks.workunit.client.1.smithi119.stdout:9/993: symlink d12/d1d/d79/db1/d13e/l144 0 2023-12-17T11:58:00.617 INFO:tasks.workunit.client.1.smithi119.stdout:8/849: dwrite d7/d18/d15/d81/d8e/fcd [0,4194304] 0 2023-12-17T11:58:00.621 INFO:tasks.workunit.client.0.smithi002.stdout:5/971: link dc/d94/ded/d5a/d96/d6c/da0/cd9 dc/d17/d1c/c146 0 2023-12-17T11:58:00.621 INFO:tasks.workunit.client.0.smithi002.stdout:6/985: getdents d0/d1/dc/d17/d67/d6c/d7f 0 2023-12-17T11:58:00.621 INFO:tasks.workunit.client.0.smithi002.stdout:4/894: dwrite d0/d3e/dc8/dcd/dd5/ffb [0,4194304] 0 2023-12-17T11:58:00.624 INFO:tasks.workunit.client.0.smithi002.stdout:5/972: symlink dc/d1a/l147 0 2023-12-17T11:58:00.627 INFO:tasks.workunit.client.1.smithi119.stdout:4/938: write dd/d15/d16/d3d/dab/db1/fb2 [2899632,54875] 0 2023-12-17T11:58:00.628 INFO:tasks.workunit.client.1.smithi119.stdout:4/939: fdatasync dd/d15/d16/d5a/fcf 0 2023-12-17T11:58:00.633 INFO:tasks.workunit.client.1.smithi119.stdout:0/936: dread d2/d66/d1f/d24/d50/fa3 [0,4194304] 0 2023-12-17T11:58:00.634 INFO:tasks.workunit.client.1.smithi119.stdout:9/994: mkdir d12/d1d/d28/d46/d115/d145 0 2023-12-17T11:58:00.634 INFO:tasks.workunit.client.1.smithi119.stdout:9/995: stat d12/d1d/d28/d46/dff/c13d 0 2023-12-17T11:58:00.637 INFO:tasks.workunit.client.1.smithi119.stdout:8/850: write d7/da/f3f [5605798,83458] 0 2023-12-17T11:58:00.638 INFO:tasks.workunit.client.0.smithi002.stdout:6/986: dread d0/d1/d6d/d83/d113/da5/f97 [0,4194304] 0 2023-12-17T11:58:00.639 INFO:tasks.workunit.client.1.smithi119.stdout:1/927: dwrite d3/db/d17/d24/d20/d40/d76/d96/d99/fa6 [4194304,4194304] 0 2023-12-17T11:58:00.639 INFO:tasks.workunit.client.1.smithi119.stdout:1/928: creat d3/db/d17/d24/d20/dba/f153 x:0 0 0 2023-12-17T11:58:00.639 INFO:tasks.workunit.client.1.smithi119.stdout:1/929: fdatasync d3/db/d17/d24/d20/f2d 0 2023-12-17T11:58:00.661 INFO:tasks.workunit.client.0.smithi002.stdout:5/973: unlink dc/d94/ded/cd5 0 2023-12-17T11:58:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/974: creat dc/d1a/d47/f148 x:0 0 0 2023-12-17T11:58:00.664 INFO:tasks.workunit.client.0.smithi002.stdout:5/975: truncate dc/d94/ded/d75/fff 4698335 0 2023-12-17T11:58:00.666 INFO:tasks.workunit.client.0.smithi002.stdout:6/987: dread d0/d1/d6d/d83/da2/d126/fd9 [0,4194304] 0 2023-12-17T11:58:00.666 INFO:tasks.workunit.client.0.smithi002.stdout:6/988: fsync d0/d1/d6d/d83/da2/d11e/d60/f85 0 2023-12-17T11:58:00.668 INFO:tasks.workunit.client.0.smithi002.stdout:5/976: getdents dc/d94/ded/dad 0 2023-12-17T11:58:00.673 INFO:tasks.workunit.client.0.smithi002.stdout:5/977: mknod dc/d94/ded/d2d/d5b/c149 0 2023-12-17T11:58:00.676 INFO:tasks.workunit.client.1.smithi119.stdout:4/940: rmdir dd/d11/d2d/d9c/d55/d81/d88/d105 39 2023-12-17T11:58:00.676 INFO:tasks.workunit.client.1.smithi119.stdout:9/996: mkdir d12/d1d/d49/d146 0 2023-12-17T11:58:00.678 INFO:tasks.workunit.client.0.smithi002.stdout:4/895: dwrite d0/d10/d14/d27/d69/d108/d65/d78/f10e [0,4194304] 0 2023-12-17T11:58:00.678 INFO:tasks.workunit.client.0.smithi002.stdout:4/896: write d0/d10/d14/d27/d69/d108/d65/ffc [4970925,34028] 0 2023-12-17T11:58:00.688 INFO:tasks.workunit.client.1.smithi119.stdout:1/930: write d3/db/d2a/d127/d7e/da1/fe7 [1095494,70529] 0 2023-12-17T11:58:00.694 INFO:tasks.workunit.client.1.smithi119.stdout:9/997: getdents d12/d1d/d28/d46/dea/dcf 0 2023-12-17T11:58:00.697 INFO:tasks.workunit.client.0.smithi002.stdout:7/939: sync 2023-12-17T11:58:00.697 INFO:tasks.workunit.client.0.smithi002.stdout:1/984: sync 2023-12-17T11:58:00.697 INFO:tasks.workunit.client.0.smithi002.stdout:2/936: sync 2023-12-17T11:58:00.697 INFO:tasks.workunit.client.0.smithi002.stdout:0/913: sync 2023-12-17T11:58:00.697 INFO:tasks.workunit.client.0.smithi002.stdout:7/940: readlink d6/d17/dc/d67/lf8 0 2023-12-17T11:58:00.698 INFO:tasks.workunit.client.0.smithi002.stdout:0/914: readlink d0/d6/d26/d14/d19/d37/dcf/le4 0 2023-12-17T11:58:00.698 INFO:tasks.workunit.client.0.smithi002.stdout:7/941: dread - d6/d99/da1/f104 zero size 2023-12-17T11:58:00.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/985: write d3/d2f/d4d/d95/f96 [5044834,41100] 0 2023-12-17T11:58:00.698 INFO:tasks.workunit.client.0.smithi002.stdout:1/986: stat d3/d2f/d74/c7d 0 2023-12-17T11:58:00.700 INFO:tasks.workunit.client.1.smithi119.stdout:1/931: symlink d3/db/d2a/de5/l154 0 2023-12-17T11:58:00.700 INFO:tasks.workunit.client.1.smithi119.stdout:1/932: chown d3/db/d106/c148 15360 1 2023-12-17T11:58:00.700 INFO:tasks.workunit.client.1.smithi119.stdout:9/998: creat d12/d1d/d79/db1/d13e/dae/f147 x:0 0 0 2023-12-17T11:58:00.700 INFO:tasks.workunit.client.1.smithi119.stdout:9/999: write d12/d1d/d28/d46/dbb/fd5 [5076304,14950] 0 2023-12-17T11:58:00.701 INFO:tasks.workunit.client.0.smithi002.stdout:0/915: unlink d0/d6/d26/d14/d19/d37/d62/l6a 0 2023-12-17T11:58:00.702 INFO:tasks.workunit.client.0.smithi002.stdout:0/916: creat d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/f129 x:0 0 0 2023-12-17T11:58:00.702 INFO:tasks.workunit.client.1.smithi119.stdout:0/937: dwrite d2/fc8 [0,4194304] 0 2023-12-17T11:58:00.704 INFO:tasks.workunit.client.1.smithi119.stdout:8/851: dwrite d7/d18/d45/f109 [0,4194304] 0 2023-12-17T11:58:00.704 INFO:tasks.workunit.client.0.smithi002.stdout:2/937: dread d3/d4/d7/d14/d2e/fca [0,4194304] 0 2023-12-17T11:58:00.706 INFO:tasks.workunit.client.0.smithi002.stdout:4/897: dread d0/d10/f94 [0,4194304] 0 2023-12-17T11:58:00.706 INFO:tasks.workunit.client.0.smithi002.stdout:4/898: write d0/f8a [1796313,16609] 0 2023-12-17T11:58:00.706 INFO:tasks.workunit.client.0.smithi002.stdout:4/899: dread - d0/d6c/ff5 zero size 2023-12-17T11:58:00.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/978: dread f8 [4194304,4194304] 0 2023-12-17T11:58:00.709 INFO:tasks.workunit.client.0.smithi002.stdout:5/979: fdatasync dc/f83 0 2023-12-17T11:58:00.715 INFO:tasks.workunit.client.0.smithi002.stdout:0/917: truncate d0/d6/fe 3671353 0 2023-12-17T11:58:00.715 INFO:tasks.workunit.client.0.smithi002.stdout:7/942: write d6/d17/dc/d13/d37/d4f/f80 [558297,35006] 0 2023-12-17T11:58:00.715 INFO:tasks.workunit.client.0.smithi002.stdout:7/943: fsync d6/d17/dc/f89 0 2023-12-17T11:58:00.715 INFO:tasks.workunit.client.1.smithi119.stdout:0/938: creat d2/d16/f122 x:0 0 0 2023-12-17T11:58:00.719 INFO:tasks.workunit.client.0.smithi002.stdout:5/980: dread dc/d94/ded/d75/f88 [0,4194304] 0 2023-12-17T11:58:00.720 INFO:tasks.workunit.client.1.smithi119.stdout:8/852: dread d7/da/fd8 [0,4194304] 0 2023-12-17T11:58:00.720 INFO:tasks.workunit.client.1.smithi119.stdout:7/954: sync 2023-12-17T11:58:00.722 INFO:tasks.workunit.client.0.smithi002.stdout:5/981: write dc/d94/ded/fe4 [2259479,103283] 0 2023-12-17T11:58:00.723 INFO:tasks.workunit.client.0.smithi002.stdout:1/987: rmdir d3/d6/d16/d28 39 2023-12-17T11:58:00.726 INFO:tasks.workunit.client.0.smithi002.stdout:4/900: symlink d0/d3e/da5/l11e 0 2023-12-17T11:58:00.726 INFO:tasks.workunit.client.1.smithi119.stdout:3/964: sync 2023-12-17T11:58:00.726 INFO:tasks.workunit.client.1.smithi119.stdout:7/955: getdents d2/d40/dc3/d127 0 2023-12-17T11:58:00.728 INFO:tasks.workunit.client.1.smithi119.stdout:4/941: dwrite dd/f1b [0,4194304] 0 2023-12-17T11:58:00.729 INFO:tasks.workunit.client.0.smithi002.stdout:0/918: mknod d0/d6/d26/d14/d19/db1/c12a 0 2023-12-17T11:58:00.731 INFO:tasks.workunit.client.0.smithi002.stdout:5/982: symlink dc/d94/ded/d2d/dcf/d10d/l14a 0 2023-12-17T11:58:00.733 INFO:tasks.workunit.client.1.smithi119.stdout:7/956: creat d2/f12e x:0 0 0 2023-12-17T11:58:00.733 INFO:tasks.workunit.client.1.smithi119.stdout:6/838: sync 2023-12-17T11:58:00.734 INFO:tasks.workunit.client.1.smithi119.stdout:6/839: truncate d2/fb6 1011035 0 2023-12-17T11:58:00.735 INFO:tasks.workunit.client.0.smithi002.stdout:4/901: creat d0/f11f x:0 0 0 2023-12-17T11:58:00.737 INFO:tasks.workunit.client.1.smithi119.stdout:4/942: mkdir dd/d15/d16/d20/d120 0 2023-12-17T11:58:00.738 INFO:tasks.workunit.client.0.smithi002.stdout:0/919: creat d0/d15/f12b x:0 0 0 2023-12-17T11:58:00.740 INFO:tasks.workunit.client.0.smithi002.stdout:7/944: write d6/f3b [458116,110084] 0 2023-12-17T11:58:00.740 INFO:tasks.workunit.client.1.smithi119.stdout:7/957: creat d2/d40/dc3/de9/f12f x:0 0 0 2023-12-17T11:58:00.740 INFO:tasks.workunit.client.1.smithi119.stdout:8/853: write d7/d12/d23/f38 [256999,118586] 0 2023-12-17T11:58:00.742 INFO:tasks.workunit.client.1.smithi119.stdout:4/943: link dd/d15/c83 dd/d11/d2d/d9c/c121 0 2023-12-17T11:58:00.742 INFO:tasks.workunit.client.1.smithi119.stdout:4/944: read - dd/d11/d2d/d9c/d55/d81/d88/d91/ffb zero size 2023-12-17T11:58:00.742 INFO:tasks.workunit.client.1.smithi119.stdout:4/945: chown dd/d15/d16/d3d/dab/dd9 561637313 1 2023-12-17T11:58:00.742 INFO:tasks.workunit.client.1.smithi119.stdout:4/946: creat dd/d15/d16/d3d/f122 x:0 0 0 2023-12-17T11:58:00.743 INFO:tasks.workunit.client.1.smithi119.stdout:1/933: dwrite d3/db/d17/d24/d20/d6c/db7/de4/ffe [0,4194304] 0 2023-12-17T11:58:00.748 INFO:tasks.workunit.client.0.smithi002.stdout:7/945: creat d6/d17/dc/d67/d8b/dbd/dce/ddf/dfa/f11b x:0 0 0 2023-12-17T11:58:00.748 INFO:tasks.workunit.client.0.smithi002.stdout:1/988: dread d3/d2f/d4d/d95/f96 [0,4194304] 0 2023-12-17T11:58:00.750 INFO:tasks.workunit.client.1.smithi119.stdout:7/958: rename d2/d4/d11/d3c/fe5 to d2/d4/d11/d2c/d68/d6a/f130 0 2023-12-17T11:58:00.750 INFO:tasks.workunit.client.1.smithi119.stdout:7/959: fsync d2/f10 0 2023-12-17T11:58:00.750 INFO:tasks.workunit.client.1.smithi119.stdout:8/854: mkdir d7/da/d1a/d84/df7/d118 0 2023-12-17T11:58:00.760 INFO:tasks.workunit.client.0.smithi002.stdout:7/946: creat d6/d17/dc/d13/d21/f11c x:0 0 0 2023-12-17T11:58:00.763 INFO:tasks.workunit.client.1.smithi119.stdout:6/840: write d2/d2b/d43/de6/d17/fa4 [2821218,21427] 0 2023-12-17T11:58:00.770 INFO:tasks.workunit.client.0.smithi002.stdout:2/938: dwrite d3/d4/d43/fdf [0,4194304] 0 2023-12-17T11:58:00.771 INFO:tasks.workunit.client.0.smithi002.stdout:2/939: write d3/d4/d7/d14/d2e/d37/f7d [1068059,19436] 0 2023-12-17T11:58:00.771 INFO:tasks.workunit.client.0.smithi002.stdout:1/989: rename d3/d6/d9/d30/c128 to d3/d6/d9/d37/d39/d43/d4a/d7b/daa/c139 0 2023-12-17T11:58:00.776 INFO:tasks.workunit.client.0.smithi002.stdout:7/947: mkdir d6/d17/dc/d6c/d93/d115/d11d 0 2023-12-17T11:58:00.779 INFO:tasks.workunit.client.0.smithi002.stdout:2/940: truncate d3/d4/d7/d14/d34/f6c 281913 0 2023-12-17T11:58:00.780 INFO:tasks.workunit.client.0.smithi002.stdout:1/990: mknod d3/d6/d9/d30/d87/c13a 0 2023-12-17T11:58:00.782 INFO:tasks.workunit.client.0.smithi002.stdout:7/948: mknod d6/d17/dc/d13/dd8/db0/dfd/c11e 0 2023-12-17T11:58:00.788 INFO:tasks.workunit.client.0.smithi002.stdout:2/941: creat d3/d4/d7/d14/d1b/f143 x:0 0 0 2023-12-17T11:58:00.794 INFO:tasks.workunit.client.0.smithi002.stdout:7/949: dread d6/d17/dc/d67/d8b/d24/f7d [0,4194304] 0 2023-12-17T11:58:00.807 INFO:tasks.workunit.client.0.smithi002.stdout:0/920: dread d0/d6/d26/d14/d90/d64/f127 [0,4194304] 0 2023-12-17T11:58:00.808 INFO:tasks.workunit.client.0.smithi002.stdout:1/991: mkdir d3/d6/d16/dcf/d13b 0 2023-12-17T11:58:00.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/942: creat d3/d4/d8b/f144 x:0 0 0 2023-12-17T11:58:00.808 INFO:tasks.workunit.client.0.smithi002.stdout:7/950: creat d6/d17/dc/d13/dd8/f11f x:0 0 0 2023-12-17T11:58:00.808 INFO:tasks.workunit.client.0.smithi002.stdout:2/943: readlink d3/d4/d8b/ld6 0 2023-12-17T11:58:00.808 INFO:tasks.workunit.client.1.smithi119.stdout:1/934: dwrite d3/db/d17/d24/d20/d40/d76/d96/d99/d9a/f10b [0,4194304] 0 2023-12-17T11:58:00.809 INFO:tasks.workunit.client.0.smithi002.stdout:7/951: mknod d6/d99/c120 0 2023-12-17T11:58:00.812 INFO:tasks.workunit.client.0.smithi002.stdout:5/983: dwrite dc/d94/ded/dad/f102 [0,4194304] 0 2023-12-17T11:58:00.815 INFO:tasks.workunit.client.1.smithi119.stdout:1/935: creat d3/db/d17/d24/d20/f155 x:0 0 0 2023-12-17T11:58:00.815 INFO:tasks.workunit.client.1.smithi119.stdout:1/936: truncate d3/f61 959163 0 2023-12-17T11:58:00.816 INFO:tasks.workunit.client.0.smithi002.stdout:7/952: truncate d6/d17/dc/d13/d21/d2e/fae 3758821 0 2023-12-17T11:58:00.825 INFO:tasks.workunit.client.0.smithi002.stdout:1/992: dread d3/d6/d16/d28/fd2 [0,4194304] 0 2023-12-17T11:58:00.829 INFO:tasks.workunit.client.1.smithi119.stdout:7/960: dwrite d2/d4/d11/d2c/d68/d77/f79 [0,4194304] 0 2023-12-17T11:58:00.829 INFO:tasks.workunit.client.1.smithi119.stdout:7/961: readlink d2/d4/d11/d2c/d68/d6a/l80 0 2023-12-17T11:58:00.834 INFO:tasks.workunit.client.1.smithi119.stdout:4/947: dwrite f2 [0,4194304] 0 2023-12-17T11:58:00.835 INFO:tasks.workunit.client.1.smithi119.stdout:8/855: dwrite d7/da/d1a/d84/d111/fe1 [0,4194304] 0 2023-12-17T11:58:00.835 INFO:tasks.workunit.client.1.smithi119.stdout:8/856: dread - d7/d12/d69/d98/ff0 zero size 2023-12-17T11:58:00.836 INFO:tasks.workunit.client.1.smithi119.stdout:4/948: symlink dd/d15/d16/d3d/dab/db1/l123 0 2023-12-17T11:58:00.846 INFO:tasks.workunit.client.1.smithi119.stdout:6/841: dwrite d2/d61/fb9 [8388608,4194304] 0 2023-12-17T11:58:00.846 INFO:tasks.workunit.client.1.smithi119.stdout:1/937: dread d3/d44/dfd/d64/db2/fe3 [0,4194304] 0 2023-12-17T11:58:00.846 INFO:tasks.workunit.client.1.smithi119.stdout:6/842: chown d2/d2b/d43/d5e/d92/da8/fd6 856525 1 2023-12-17T11:58:00.846 INFO:tasks.workunit.client.1.smithi119.stdout:6/843: write d2/da3/fb5 [576662,6442] 0 2023-12-17T11:58:00.846 INFO:tasks.workunit.client.1.smithi119.stdout:4/949: unlink dd/d11/d26/d86/ff5 0 2023-12-17T11:58:00.847 INFO:tasks.workunit.client.1.smithi119.stdout:8/857: dread d7/d12/ff2 [0,4194304] 0 2023-12-17T11:58:00.848 INFO:tasks.workunit.client.0.smithi002.stdout:5/984: dread dc/d94/ded/d5a/d96/f36 [0,4194304] 0 2023-12-17T11:58:00.848 INFO:tasks.workunit.client.0.smithi002.stdout:5/985: creat dc/d8e/dd6/f14b x:0 0 0 2023-12-17T11:58:00.853 INFO:tasks.workunit.client.0.smithi002.stdout:0/921: dwrite d0/d6/d26/d14/d19/d37/dcf/f5b [0,4194304] 0 2023-12-17T11:58:00.853 INFO:tasks.workunit.client.0.smithi002.stdout:0/922: write d0/d6/d26/f3b [3447924,16953] 0 2023-12-17T11:58:00.853 INFO:tasks.workunit.client.1.smithi119.stdout:1/938: mknod d3/db/d17/d24/d20/d40/d76/d96/d99/d9d/d14f/c156 0 2023-12-17T11:58:00.861 INFO:tasks.workunit.client.0.smithi002.stdout:4/902: dwrite d0/d3e/d41/fcb [0,4194304] 0 2023-12-17T11:58:00.863 INFO:tasks.workunit.client.1.smithi119.stdout:6/844: write d2/d2b/d43/de6/d17/f34 [2408225,39794] 0 2023-12-17T11:58:00.868 INFO:tasks.workunit.client.1.smithi119.stdout:8/858: read d7/d12/d23/d9c/dad/fb7 [2038549,67697] 0 2023-12-17T11:58:00.874 INFO:tasks.workunit.client.1.smithi119.stdout:6/845: mkdir d2/d61/d10b 0 2023-12-17T11:58:00.874 INFO:tasks.workunit.client.1.smithi119.stdout:6/846: dread - d2/d7e/f9e zero size 2023-12-17T11:58:00.875 INFO:tasks.workunit.client.1.smithi119.stdout:6/847: stat d2/d2b/d43/dcb/df8/c106 0 2023-12-17T11:58:00.875 INFO:tasks.workunit.client.1.smithi119.stdout:1/939: dread d3/db/d26/f7b [0,4194304] 0 2023-12-17T11:58:00.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/903: rename d0/d10/d21/d33/dbc/ffe to d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/f120 0 2023-12-17T11:58:00.878 INFO:tasks.workunit.client.0.smithi002.stdout:4/904: chown d0/d10/d14/d27/d69/fd2 106520 1 2023-12-17T11:58:00.879 INFO:tasks.workunit.client.1.smithi119.stdout:1/940: link d3/db/d2a/d127/d7e/ff6 d3/db/d26/d8f/dd1/f157 0 2023-12-17T11:58:00.880 INFO:tasks.workunit.client.0.smithi002.stdout:4/905: mkdir d0/d10/d21/d119/d121 0 2023-12-17T11:58:00.880 INFO:tasks.workunit.client.0.smithi002.stdout:4/906: readlink d0/d10/d21/d33/dbc/l11c 0 2023-12-17T11:58:00.882 INFO:tasks.workunit.client.1.smithi119.stdout:1/941: mkdir d3/db/d17/d24/d20/d40/d76/de9/d158 0 2023-12-17T11:58:00.882 INFO:tasks.workunit.client.1.smithi119.stdout:1/942: truncate d3/db/d26/d5e/fd9 183480 0 2023-12-17T11:58:00.883 INFO:tasks.workunit.client.1.smithi119.stdout:1/943: write d3/db/d17/d24/d20/f155 [70773,70586] 0 2023-12-17T11:58:00.883 INFO:tasks.workunit.client.1.smithi119.stdout:1/944: readlink d3/d44/dfd/d64/db2/l137 0 2023-12-17T11:58:00.883 INFO:tasks.workunit.client.1.smithi119.stdout:1/945: stat d3/db/d26/f83 0 2023-12-17T11:58:00.885 INFO:tasks.workunit.client.1.smithi119.stdout:1/946: creat d3/db/d17/d24/d20/d40/d76/d84/d119/d104/f159 x:0 0 0 2023-12-17T11:58:00.956 INFO:tasks.workunit.client.1.smithi119.stdout:6/848: dwrite d2/d2b/d43/d76/fb0 [0,4194304] 0 2023-12-17T11:58:00.956 INFO:tasks.workunit.client.1.smithi119.stdout:6/849: read - d2/d2b/d43/f8b zero size 2023-12-17T11:58:00.956 INFO:tasks.workunit.client.0.smithi002.stdout:5/986: dwrite dc/d1a/d47/f49 [4194304,4194304] 0 2023-12-17T11:58:00.958 INFO:tasks.workunit.client.1.smithi119.stdout:6/850: creat d2/d2b/d43/dcb/df8/f10c x:0 0 0 2023-12-17T11:58:00.959 INFO:tasks.workunit.client.0.smithi002.stdout:2/944: dwrite d3/d50/df6/f102 [0,4194304] 0 2023-12-17T11:58:00.960 INFO:tasks.workunit.client.0.smithi002.stdout:5/987: chown dc/d94/ded/d5a/d96/f35 834771 1 2023-12-17T11:58:00.963 INFO:tasks.workunit.client.1.smithi119.stdout:7/962: dwrite d2/d4/d11/d2c/feb [4194304,4194304] 0 2023-12-17T11:58:00.963 INFO:tasks.workunit.client.1.smithi119.stdout:4/950: dwrite dd/d11/d26/f111 [4194304,4194304] 0 2023-12-17T11:58:00.964 INFO:tasks.workunit.client.0.smithi002.stdout:2/945: unlink d3/d4/d7/d14/c3b 0 2023-12-17T11:58:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/988: truncate dc/d1a/d7c/ff8 2900781 0 2023-12-17T11:58:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/989: fsync dc/d17/d2f/f7a 0 2023-12-17T11:58:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/990: chown dc/l1d 0 1 2023-12-17T11:58:00.966 INFO:tasks.workunit.client.0.smithi002.stdout:5/991: write dc/d1a/f46 [4038713,110356] 0 2023-12-17T11:58:00.967 INFO:tasks.workunit.client.1.smithi119.stdout:6/851: mkdir d2/d9b/d10d 0 2023-12-17T11:58:00.970 INFO:tasks.workunit.client.0.smithi002.stdout:7/953: truncate d6/d17/dc/d13/d37/d4f/f80 363857 0 2023-12-17T11:58:00.970 INFO:tasks.workunit.client.0.smithi002.stdout:7/954: chown d6/d17/dc/d6c/d93 0 1 2023-12-17T11:58:00.970 INFO:tasks.workunit.client.1.smithi119.stdout:7/963: mkdir d2/d40/dc3/de9/d131 0 2023-12-17T11:58:00.971 INFO:tasks.workunit.client.1.smithi119.stdout:4/951: creat dd/d11/d2d/d9c/d55/f124 x:0 0 0 2023-12-17T11:58:00.973 INFO:tasks.workunit.client.0.smithi002.stdout:5/992: read dc/d94/ded/fe4 [801764,120781] 0 2023-12-17T11:58:00.973 INFO:tasks.workunit.client.0.smithi002.stdout:2/946: dread d3/d4/dbc/f123 [0,4194304] 0 2023-12-17T11:58:00.973 INFO:tasks.workunit.client.1.smithi119.stdout:8/859: dwrite d7/da/d11/d26/d49/fed [0,4194304] 0 2023-12-17T11:58:00.974 INFO:tasks.workunit.client.1.smithi119.stdout:8/860: creat d7/da/d1a/d8a/ddb/dbf/f119 x:0 0 0 2023-12-17T11:58:00.975 INFO:tasks.workunit.client.0.smithi002.stdout:0/923: dwrite d0/d6/d26/d14/d19/d61/de3/f46 [0,4194304] 0 2023-12-17T11:58:00.977 INFO:tasks.workunit.client.1.smithi119.stdout:6/852: mkdir d2/d2b/d43/dee/d10e 0 2023-12-17T11:58:00.977 INFO:tasks.workunit.client.1.smithi119.stdout:4/952: creat dd/d11/d2d/d9c/d55/d81/d88/f125 x:0 0 0 2023-12-17T11:58:00.978 INFO:tasks.workunit.client.0.smithi002.stdout:5/993: unlink dc/d94/l13d 0 2023-12-17T11:58:00.981 INFO:tasks.workunit.client.1.smithi119.stdout:7/964: unlink d2/d4/d11/d2c/d68/d99/f37 0 2023-12-17T11:58:00.981 INFO:tasks.workunit.client.1.smithi119.stdout:7/965: chown d2/d4/d70/c48 99 1 2023-12-17T11:58:00.981 INFO:tasks.workunit.client.1.smithi119.stdout:7/966: fdatasync d2/d4/d11/d3c/f9e 0 2023-12-17T11:58:00.982 INFO:tasks.workunit.client.0.smithi002.stdout:2/947: symlink d3/l145 0 2023-12-17T11:58:00.982 INFO:tasks.workunit.client.0.smithi002.stdout:2/948: write d3/d4/fe [395363,114190] 0 2023-12-17T11:58:00.982 INFO:tasks.workunit.client.0.smithi002.stdout:2/949: chown d3/d4/d7/d14/d34/f46 207713 1 2023-12-17T11:58:00.983 INFO:tasks.workunit.client.1.smithi119.stdout:4/953: dread dd/d11/d2d/d9c/d55/f80 [0,4194304] 0 2023-12-17T11:58:00.988 INFO:tasks.workunit.client.1.smithi119.stdout:8/861: dread d7/d12/d23/f38 [0,4194304] 0 2023-12-17T11:58:00.988 INFO:tasks.workunit.client.1.smithi119.stdout:8/862: write d7/d12/d23/f7d [5068660,24029] 0 2023-12-17T11:58:00.988 INFO:tasks.workunit.client.1.smithi119.stdout:8/863: fsync d7/d18/d45/f6d 0 2023-12-17T11:58:00.989 INFO:tasks.workunit.client.0.smithi002.stdout:4/907: getdents d0/d10/d21/d33/dbc 0 2023-12-17T11:58:00.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/994: dread dc/d1a/f48 [0,4194304] 0 2023-12-17T11:58:00.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/995: fdatasync dc/d1a/d47/f49 0 2023-12-17T11:58:00.989 INFO:tasks.workunit.client.0.smithi002.stdout:5/996: write dc/d94/ded/d5a/d68/f13e [232060,46420] 0 2023-12-17T11:58:00.994 INFO:tasks.workunit.client.0.smithi002.stdout:0/924: rename d0/d6/d26/d14/d19/d37/d86 to d0/d6/d26/d8f/d12c 0 2023-12-17T11:58:00.994 INFO:tasks.workunit.client.0.smithi002.stdout:0/925: dread - d0/d6/d26/d14/d19/d2b/ff4 zero size 2023-12-17T11:58:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:2/950: link d3/d4/d17/d19/d4d/d72/d77/da7/fe1 d3/d4/d7/d14/d1b/f146 0 2023-12-17T11:58:00.997 INFO:tasks.workunit.client.0.smithi002.stdout:2/951: readlink d3/d4/d7/led 0 2023-12-17T11:58:00.998 INFO:tasks.workunit.client.0.smithi002.stdout:4/908: mknod d0/d10/d14/d4e/d10f/c122 0 2023-12-17T11:58:01.001 INFO:tasks.workunit.client.1.smithi119.stdout:7/967: link d2/d4/l5 d2/d40/dc3/dca/dd9/d12c/l132 0 2023-12-17T11:58:01.002 INFO:tasks.workunit.client.0.smithi002.stdout:0/926: creat d0/d6/d26/d14/d19/d2b/df1/f12d x:0 0 0 2023-12-17T11:58:01.002 INFO:tasks.workunit.client.0.smithi002.stdout:0/927: dread - d0/d6/d26/d14/d90/d64/dab/dfc/f110 zero size 2023-12-17T11:58:01.002 INFO:tasks.workunit.client.0.smithi002.stdout:0/928: truncate d0/d6/d26/d14/d19/d2b/f9c 1649164 0 2023-12-17T11:58:01.002 INFO:tasks.workunit.client.0.smithi002.stdout:0/929: write d0/d6/d26/fc5 [187799,96691] 0 2023-12-17T11:58:01.003 INFO:tasks.workunit.client.1.smithi119.stdout:4/954: mkdir dd/d15/d16/d3d/d126 0 2023-12-17T11:58:01.003 INFO:tasks.workunit.client.1.smithi119.stdout:4/955: readlink dd/d15/d16/d20/l11d 0 2023-12-17T11:58:01.006 INFO:tasks.workunit.client.0.smithi002.stdout:4/909: mkdir d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/d123 0 2023-12-17T11:58:01.009 INFO:tasks.workunit.client.1.smithi119.stdout:8/864: truncate d7/d12/d23/f61 1669265 0 2023-12-17T11:58:01.009 INFO:tasks.workunit.client.1.smithi119.stdout:8/865: chown d7/d18/d15/fc1 14910610 1 2023-12-17T11:58:01.009 INFO:tasks.workunit.client.0.smithi002.stdout:5/997: rename dc/d94/ded/d5a/d96/d6c/da0/lca to dc/d1a/d53/da9/l14c 0 2023-12-17T11:58:01.011 INFO:tasks.workunit.client.0.smithi002.stdout:0/930: mkdir d0/d6/d26/d8f/d12e 0 2023-12-17T11:58:01.012 INFO:tasks.workunit.client.1.smithi119.stdout:7/968: mknod d2/d4/d70/dac/c133 0 2023-12-17T11:58:01.013 INFO:tasks.workunit.client.0.smithi002.stdout:2/952: getdents d3/d4/d17/d19 0 2023-12-17T11:58:01.014 INFO:tasks.workunit.client.0.smithi002.stdout:2/953: chown d3/d4/d7/d14/d1b/d5b/de3/f116 20611 1 2023-12-17T11:58:01.015 INFO:tasks.workunit.client.1.smithi119.stdout:4/956: mknod dd/d15/d16/d3d/dab/dd9/c127 0 2023-12-17T11:58:01.016 INFO:tasks.workunit.client.0.smithi002.stdout:4/910: mknod d0/d10/d14/d27/c124 0 2023-12-17T11:58:01.018 INFO:tasks.workunit.client.0.smithi002.stdout:6/989: sync 2023-12-17T11:58:01.018 INFO:tasks.workunit.client.0.smithi002.stdout:5/998: rename dc/d1a/l147 to dc/d94/ded/d5a/d68/d97/l14d 0 2023-12-17T11:58:01.018 INFO:tasks.workunit.client.0.smithi002.stdout:7/955: write d6/d17/dc/d13/d21/d2e/fc6 [79644,78318] 0 2023-12-17T11:58:01.020 INFO:tasks.workunit.client.1.smithi119.stdout:8/866: mknod d7/d18/d45/d9e/c11a 0 2023-12-17T11:58:01.021 INFO:tasks.workunit.client.0.smithi002.stdout:0/931: mknod d0/d6/d26/d14/d90/d64/dab/c12f 0 2023-12-17T11:58:01.021 INFO:tasks.workunit.client.0.smithi002.stdout:2/954: stat d3/d4/d7/d14/d1b/c1e 0 2023-12-17T11:58:01.022 INFO:tasks.workunit.client.1.smithi119.stdout:7/969: creat d2/d40/dc3/dca/dd9/d12c/f134 x:0 0 0 2023-12-17T11:58:01.024 INFO:tasks.workunit.client.0.smithi002.stdout:4/911: creat d0/d10/d14/d27/d57/f125 x:0 0 0 2023-12-17T11:58:01.024 INFO:tasks.workunit.client.0.smithi002.stdout:4/912: dread - d0/d10/d14/d27/d69/d108/d65/d78/d85/f93 zero size 2023-12-17T11:58:01.025 INFO:tasks.workunit.client.1.smithi119.stdout:4/957: creat dd/d15/d16/d3d/dab/f128 x:0 0 0 2023-12-17T11:58:01.026 INFO:tasks.workunit.client.0.smithi002.stdout:6/990: mkdir d0/d1/dc/d17/d67/d6c/d11a/d143 0 2023-12-17T11:58:01.027 INFO:tasks.workunit.client.0.smithi002.stdout:6/991: write d0/d1/d28/dab/fac [1688347,1456] 0 2023-12-17T11:58:01.028 INFO:tasks.workunit.client.1.smithi119.stdout:8/867: symlink d7/d12/d23/d9c/dea/l11b 0 2023-12-17T11:58:01.029 INFO:tasks.workunit.client.1.smithi119.stdout:3/965: sync 2023-12-17T11:58:01.029 INFO:tasks.workunit.client.1.smithi119.stdout:0/939: sync 2023-12-17T11:58:01.029 INFO:tasks.workunit.client.1.smithi119.stdout:0/940: write d2/d66/d2e/d44/d7b/d5/d3f/f121 [8917387,90611] 0 2023-12-17T11:58:01.033 INFO:tasks.workunit.client.0.smithi002.stdout:7/956: mknod d6/d17/dc/d13/d21/d116/c121 0 2023-12-17T11:58:01.034 INFO:tasks.workunit.client.0.smithi002.stdout:7/957: truncate d6/d99/ff9 931102 0 2023-12-17T11:58:01.034 INFO:tasks.workunit.client.0.smithi002.stdout:5/999: write dc/d94/ded/d2d/d5b/fa2 [301036,56433] 0 2023-12-17T11:58:01.034 INFO:tasks.workunit.client.0.smithi002.stdout:0/932: creat d0/d6/d26/d14/d19/d37/d62/f130 x:0 0 0 2023-12-17T11:58:01.034 INFO:tasks.workunit.client.0.smithi002.stdout:1/993: sync 2023-12-17T11:58:01.034 INFO:tasks.workunit.client.0.smithi002.stdout:0/933: creat d0/d6/d26/d14/d19/d2f/f131 x:0 0 0 2023-12-17T11:58:01.034 INFO:tasks.workunit.client.1.smithi119.stdout:4/958: mkdir dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/d129 0 2023-12-17T11:58:01.035 INFO:tasks.workunit.client.1.smithi119.stdout:4/959: stat dd/d15/d4f/c102 0 2023-12-17T11:58:01.035 INFO:tasks.workunit.client.1.smithi119.stdout:4/960: dread - dd/d11/d2d/d9c/d55/d81/d88/d105/f118 zero size 2023-12-17T11:58:01.036 INFO:tasks.workunit.client.0.smithi002.stdout:2/955: link d3/d4/d7/d14/d42/l51 d3/d56/d138/l147 0 2023-12-17T11:58:01.039 INFO:tasks.workunit.client.1.smithi119.stdout:8/868: creat d7/da/d1a/d84/d104/f11c x:0 0 0 2023-12-17T11:58:01.040 INFO:tasks.workunit.client.1.smithi119.stdout:8/869: dread - d7/d18/d45/d9f/d7b/fb6 zero size 2023-12-17T11:58:01.042 INFO:tasks.workunit.client.0.smithi002.stdout:6/992: rename d0/d1/dc/d17/f12a to d0/d1/d6d/d83/da2/f144 0 2023-12-17T11:58:01.042 INFO:tasks.workunit.client.0.smithi002.stdout:6/993: read d0/d1/dc/d17/d67/f84 [92371,58698] 0 2023-12-17T11:58:01.045 INFO:tasks.workunit.client.1.smithi119.stdout:7/970: dread d2/d4/d11/d2c/f58 [0,4194304] 0 2023-12-17T11:58:01.046 INFO:tasks.workunit.client.1.smithi119.stdout:6/853: write d2/d41/f56 [450680,23234] 0 2023-12-17T11:58:01.046 INFO:tasks.workunit.client.1.smithi119.stdout:6/854: fsync d2/d2b/d43/dcb/f105 0 2023-12-17T11:58:01.047 INFO:tasks.workunit.client.0.smithi002.stdout:7/958: rmdir d6/d17/dc/d67/d8b/d24 39 2023-12-17T11:58:01.049 INFO:tasks.workunit.client.1.smithi119.stdout:0/941: creat d2/dcc/f123 x:0 0 0 2023-12-17T11:58:01.050 INFO:tasks.workunit.client.1.smithi119.stdout:0/942: truncate d2/d16/fb0 845107 0 2023-12-17T11:58:01.052 INFO:tasks.workunit.client.1.smithi119.stdout:4/961: symlink dd/d11/d26/d86/l12a 0 2023-12-17T11:58:01.052 INFO:tasks.workunit.client.1.smithi119.stdout:4/962: chown dd/d11/d2d/d9c/d55/d81/d88/fa7 23874513 1 2023-12-17T11:58:01.053 INFO:tasks.workunit.client.0.smithi002.stdout:0/934: rmdir d0/d6/d26/d14/d19/d37/d62/db8 39 2023-12-17T11:58:01.055 INFO:tasks.workunit.client.1.smithi119.stdout:8/870: mkdir d7/d18/d45/d9f/d75/d11d 0 2023-12-17T11:58:01.056 INFO:tasks.workunit.client.0.smithi002.stdout:1/994: getdents d3/d2f 0 2023-12-17T11:58:01.059 INFO:tasks.workunit.client.1.smithi119.stdout:7/971: link d2/d4/d11/d2c/d68/d99/f106 d2/d4/d11/d2c/d68/d77/f135 0 2023-12-17T11:58:01.061 INFO:tasks.workunit.client.0.smithi002.stdout:4/913: dwrite d0/d10/df8/ff9 [0,4194304] 0 2023-12-17T11:58:01.061 INFO:tasks.workunit.client.0.smithi002.stdout:4/914: chown d0/d10/d21/d33/c3f 239208519 1 2023-12-17T11:58:01.063 INFO:tasks.workunit.client.0.smithi002.stdout:2/956: getdents d3/d4/d17/d19/d4d/d72/d77/da7 0 2023-12-17T11:58:01.066 INFO:tasks.workunit.client.1.smithi119.stdout:8/871: mknod d7/d12/d23/d9c/c11e 0 2023-12-17T11:58:01.067 INFO:tasks.workunit.client.1.smithi119.stdout:1/947: sync 2023-12-17T11:58:01.069 INFO:tasks.workunit.client.0.smithi002.stdout:6/994: truncate d0/d1/d6d/d83/d113/da5/f90 3375280 0 2023-12-17T11:58:01.074 INFO:tasks.workunit.client.1.smithi119.stdout:7/972: mkdir d2/d4/d11/d2c/d68/d98/d136 0 2023-12-17T11:58:01.074 INFO:tasks.workunit.client.1.smithi119.stdout:4/963: write dd/d15/d16/d3d/f7c [776310,37030] 0 2023-12-17T11:58:01.076 INFO:tasks.workunit.client.1.smithi119.stdout:3/966: dwrite d9/d59/f115 [0,4194304] 0 2023-12-17T11:58:01.081 INFO:tasks.workunit.client.0.smithi002.stdout:0/935: link d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/f129 d0/d6/f132 0 2023-12-17T11:58:01.081 INFO:tasks.workunit.client.0.smithi002.stdout:1/995: link d3/d6/d16/l22 d3/d6/d16/dcf/d13b/l13c 0 2023-12-17T11:58:01.081 INFO:tasks.workunit.client.0.smithi002.stdout:1/996: chown d3/d2f/d74/dbe/l11b 8179 1 2023-12-17T11:58:01.081 INFO:tasks.workunit.client.0.smithi002.stdout:1/997: chown d3/d6/d16/c2a 66132573 1 2023-12-17T11:58:01.083 INFO:tasks.workunit.client.1.smithi119.stdout:8/872: rename d7/d18/d15/d10f/l110 to d7/d18/d15/d81/dc9/l11f 0 2023-12-17T11:58:01.087 INFO:tasks.workunit.client.1.smithi119.stdout:1/948: creat d3/db/d26/d8f/dd1/d13a/f15a x:0 0 0 2023-12-17T11:58:01.092 INFO:tasks.workunit.client.0.smithi002.stdout:7/959: dwrite d6/d99/da1/f104 [0,4194304] 0 2023-12-17T11:58:01.093 INFO:tasks.workunit.client.0.smithi002.stdout:4/915: mknod d0/d10/d14/d27/d69/d108/d65/c126 0 2023-12-17T11:58:01.097 INFO:tasks.workunit.client.0.smithi002.stdout:2/957: unlink d3/d56/cda 0 2023-12-17T11:58:01.098 INFO:tasks.workunit.client.1.smithi119.stdout:3/967: dread d9/d44/d8c/fad [0,4194304] 0 2023-12-17T11:58:01.100 INFO:tasks.workunit.client.1.smithi119.stdout:1/949: dread d3/db/d26/d8f/f9e [0,4194304] 0 2023-12-17T11:58:01.100 INFO:tasks.workunit.client.1.smithi119.stdout:1/950: readlink d3/db/d2a/de5/l154 0 2023-12-17T11:58:01.100 INFO:tasks.workunit.client.0.smithi002.stdout:6/995: symlink d0/d1/dc/l145 0 2023-12-17T11:58:01.103 INFO:tasks.workunit.client.1.smithi119.stdout:7/973: dread d2/d4/d11/f43 [0,4194304] 0 2023-12-17T11:58:01.104 INFO:tasks.workunit.client.1.smithi119.stdout:0/943: dwrite d2/d16/d35/de9/f104 [0,4194304] 0 2023-12-17T11:58:01.105 INFO:tasks.workunit.client.1.smithi119.stdout:0/944: chown d2/d66/d2e/d44/d7b/d5/f4f 1397604 1 2023-12-17T11:58:01.105 INFO:tasks.workunit.client.1.smithi119.stdout:0/945: write d2/d66/f53 [308665,116240] 0 2023-12-17T11:58:01.105 INFO:tasks.workunit.client.0.smithi002.stdout:0/936: creat d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/d11f/f133 x:0 0 0 2023-12-17T11:58:01.105 INFO:tasks.workunit.client.0.smithi002.stdout:0/937: chown d0/d6/d26/d14/fec 7799 1 2023-12-17T11:58:01.107 INFO:tasks.workunit.client.0.smithi002.stdout:1/998: creat d3/d6/d9/d37/d39/d43/d4a/deb/f13d x:0 0 0 2023-12-17T11:58:01.111 INFO:tasks.workunit.client.1.smithi119.stdout:3/968: dread d9/d11/d1e/d55/d65/ddf/f11f [0,4194304] 0 2023-12-17T11:58:01.113 INFO:tasks.workunit.client.1.smithi119.stdout:3/969: write d9/d44/fc1 [582904,90414] 0 2023-12-17T11:58:01.115 INFO:tasks.workunit.client.0.smithi002.stdout:7/960: rename d6/d17/dc/d67/d86/lcc to d6/d17/dc/d13/dd8/dd0/dd2/ded/l122 0 2023-12-17T11:58:01.115 INFO:tasks.workunit.client.0.smithi002.stdout:7/961: read d6/d17/dc/d8e/f96 [113135,116396] 0 2023-12-17T11:58:01.117 INFO:tasks.workunit.client.0.smithi002.stdout:4/916: mkdir d0/d5a/d127 0 2023-12-17T11:58:01.121 INFO:tasks.workunit.client.0.smithi002.stdout:6/996: symlink d0/d1/d21/l146 0 2023-12-17T11:58:01.121 INFO:tasks.workunit.client.0.smithi002.stdout:2/958: symlink d3/d4/d7/d14/d2e/d37/d3f/d10e/l148 0 2023-12-17T11:58:01.122 INFO:tasks.workunit.client.0.smithi002.stdout:6/997: creat d0/d1/dc/d58/f147 x:0 0 0 2023-12-17T11:58:01.125 INFO:tasks.workunit.client.0.smithi002.stdout:1/999: truncate d3/d6/d9/f13 3986355 0 2023-12-17T11:58:01.126 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:00 smithi002 ceph-mon[107131]: pgmap v33: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 174 MiB/s rd, 213 MiB/s wr, 315 op/s 2023-12-17T11:58:01.126 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:00 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:01.130 INFO:tasks.workunit.client.0.smithi002.stdout:7/962: creat d6/d17/dc/d13/d21/d2e/d4a/daf/db1/f123 x:0 0 0 2023-12-17T11:58:01.133 INFO:tasks.workunit.client.1.smithi119.stdout:1/951: dwrite d3/db/d17/d24/d20/d40/f41 [0,4194304] 0 2023-12-17T11:58:01.133 INFO:tasks.workunit.client.1.smithi119.stdout:1/952: write d3/db/d17/d24/d20/dba/f153 [157026,96977] 0 2023-12-17T11:58:01.134 INFO:tasks.workunit.client.0.smithi002.stdout:4/917: read d0/d10/d14/d4e/f53 [805018,111665] 0 2023-12-17T11:58:01.137 INFO:tasks.workunit.client.0.smithi002.stdout:6/998: link d0/d1/d6d/d83/da2/c13f d0/d1/d6d/d83/d113/da5/dbc/c148 0 2023-12-17T11:58:01.137 INFO:tasks.workunit.client.0.smithi002.stdout:6/999: chown d0/f48 12 1 2023-12-17T11:58:01.138 INFO:tasks.workunit.client.1.smithi119.stdout:6/855: rmdir d2 39 2023-12-17T11:58:01.138 INFO:tasks.workunit.client.1.smithi119.stdout:6/856: write d2/fdd [120970,128730] 0 2023-12-17T11:58:01.138 INFO:tasks.workunit.client.1.smithi119.stdout:6/857: read - d2/d2b/d43/d76/dbd/ff3 zero size 2023-12-17T11:58:01.139 INFO:tasks.workunit.client.0.smithi002.stdout:0/938: symlink d0/d6/d26/d14/d19/d61/de3/l134 0 2023-12-17T11:58:01.139 INFO:tasks.workunit.client.0.smithi002.stdout:0/939: read d0/d6/d26/d14/d19/d61/f7c [647891,43576] 0 2023-12-17T11:58:01.142 INFO:tasks.workunit.client.0.smithi002.stdout:4/918: rename d0/d10/d14/d27/d69/d108/l11b to d0/d3e/da5/l128 0 2023-12-17T11:58:01.143 INFO:tasks.workunit.client.0.smithi002.stdout:4/919: write d0/d10/d21/d119/f11d [617454,93578] 0 2023-12-17T11:58:01.143 INFO:tasks.workunit.client.0.smithi002.stdout:4/920: chown d0/d10/d14/d27/c124 90 1 2023-12-17T11:58:01.143 INFO:tasks.workunit.client.0.smithi002.stdout:4/921: chown d0/d10/d14/d27/d69/d108/d65/c6e 6 1 2023-12-17T11:58:01.143 INFO:tasks.workunit.client.1.smithi119.stdout:4/964: rmdir dd/d11/d2d/d9c/d55/d81/db8/dbd 39 2023-12-17T11:58:01.144 INFO:tasks.workunit.client.0.smithi002.stdout:7/963: write d6/d17/dc/d13/d21/d2e/fb5 [2667828,42424] 0 2023-12-17T11:58:01.146 INFO:tasks.workunit.client.0.smithi002.stdout:4/922: mkdir d0/d3e/d41/d129 0 2023-12-17T11:58:01.147 INFO:tasks.workunit.client.0.smithi002.stdout:0/940: rmdir d0/d15 39 2023-12-17T11:58:01.148 INFO:tasks.workunit.client.0.smithi002.stdout:2/959: write d3/d4/d7/d14/d1b/f26 [766900,75793] 0 2023-12-17T11:58:01.148 INFO:tasks.workunit.client.0.smithi002.stdout:2/960: creat d3/d4/d7/d14/d1b/f149 x:0 0 0 2023-12-17T11:58:01.148 INFO:tasks.workunit.client.0.smithi002.stdout:2/961: creat d3/d4/d7/d14/d34/f14a x:0 0 0 2023-12-17T11:58:01.149 INFO:tasks.workunit.client.1.smithi119.stdout:8/873: rename d7/da/d11/l4d to d7/da/d1a/d8a/ddb/l120 0 2023-12-17T11:58:01.149 INFO:tasks.workunit.client.1.smithi119.stdout:8/874: dread - d7/da/d11/d26/d49/fdd zero size 2023-12-17T11:58:01.150 INFO:tasks.workunit.client.1.smithi119.stdout:0/946: creat d2/d16/d11a/f124 x:0 0 0 2023-12-17T11:58:01.151 INFO:tasks.workunit.client.0.smithi002.stdout:7/964: rmdir d6/d17/dc/d8e 39 2023-12-17T11:58:01.156 INFO:tasks.workunit.client.1.smithi119.stdout:1/953: symlink d3/db/d17/d24/d20/d6c/db7/l15b 0 2023-12-17T11:58:01.156 INFO:tasks.workunit.client.1.smithi119.stdout:1/954: fsync d3/db/d2a/d127/d7e/da1/fe7 0 2023-12-17T11:58:01.159 INFO:tasks.workunit.client.1.smithi119.stdout:6/858: mknod d2/d2b/d43/d5e/d92/c10f 0 2023-12-17T11:58:01.159 INFO:tasks.workunit.client.0.smithi002.stdout:7/965: mkdir d6/d17/dc/d13/d21/d2e/d4a/d124 0 2023-12-17T11:58:01.161 INFO:tasks.workunit.client.1.smithi119.stdout:4/965: unlink dd/d15/d16/d5a/dbc/ff6 0 2023-12-17T11:58:01.162 INFO:tasks.workunit.client.1.smithi119.stdout:8/875: rmdir d7/d18/d45/d9f/d75 39 2023-12-17T11:58:01.163 INFO:tasks.workunit.client.0.smithi002.stdout:0/941: read d0/d15/f23 [1953778,88411] 0 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:0/942: chown d0/d15 9857 1 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:0/943: fdatasync d0/d6/d26/d14/d19/d61/f73 0 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/966: mkdir d6/d17/dc/d13/d37/d125 0 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/967: chown d6/d17/dc/d13/f14 8 1 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/968: chown d6/d17/dc/d13/d37/ce9 16077 1 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:7/969: stat d6/d17/dc/d67 0 2023-12-17T11:58:01.164 INFO:tasks.workunit.client.0.smithi002.stdout:4/923: write d0/d10/d14/d27/d57/f6d [1197712,15986] 0 2023-12-17T11:58:01.167 INFO:tasks.workunit.client.0.smithi002.stdout:0/944: symlink d0/d6/d26/d14/d19/d37/d62/d77/dee/l135 0 2023-12-17T11:58:01.167 INFO:tasks.workunit.client.1.smithi119.stdout:4/966: dread dd/d11/d2d/fb4 [0,4194304] 0 2023-12-17T11:58:01.167 INFO:tasks.workunit.client.1.smithi119.stdout:4/967: dread - dd/d15/d16/d3d/f10e zero size 2023-12-17T11:58:01.168 INFO:tasks.workunit.client.1.smithi119.stdout:1/955: rename d3/db/d26/d8f/dd1/d13a/f15a to d3/db/d26/d8f/dd1/d13a/f15c 0 2023-12-17T11:58:01.168 INFO:tasks.workunit.client.0.smithi002.stdout:2/962: dread d3/d4/d7/d14/d2e/d37/d3f/fad [0,4194304] 0 2023-12-17T11:58:01.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/970: rename d6/d17/dc/d13/c6a to d6/d17/dc/d67/c126 0 2023-12-17T11:58:01.169 INFO:tasks.workunit.client.0.smithi002.stdout:7/971: write d6/d17/dc/d6c/f6f [1761574,51883] 0 2023-12-17T11:58:01.169 INFO:tasks.workunit.client.1.smithi119.stdout:6/859: mkdir d2/d61/d110 0 2023-12-17T11:58:01.171 INFO:tasks.workunit.client.0.smithi002.stdout:4/924: mkdir d0/d10/d14/d27/d69/d108/d99/d12a 0 2023-12-17T11:58:01.171 INFO:tasks.workunit.client.1.smithi119.stdout:3/970: dread d9/da/f54 [0,4194304] 0 2023-12-17T11:58:01.171 INFO:tasks.workunit.client.1.smithi119.stdout:3/971: creat d9/da/df/d41/d33/db4/f165 x:0 0 0 2023-12-17T11:58:01.173 INFO:tasks.workunit.client.1.smithi119.stdout:4/968: mkdir dd/d11/d2d/d9c/d55/d11f/d12b 0 2023-12-17T11:58:01.173 INFO:tasks.workunit.client.1.smithi119.stdout:4/969: readlink dd/d15/ldc 0 2023-12-17T11:58:01.174 INFO:tasks.workunit.client.0.smithi002.stdout:2/963: read d3/d4/d7/d14/d34/f6c [265796,37711] 0 2023-12-17T11:58:01.174 INFO:tasks.workunit.client.0.smithi002.stdout:0/945: rename d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/d11f/f133 to d0/d6/d26/d14/d19/d37/d91/f136 0 2023-12-17T11:58:01.175 INFO:tasks.workunit.client.1.smithi119.stdout:1/956: truncate d3/db/d26/d5e/fd9 162814 0 2023-12-17T11:58:01.176 INFO:tasks.workunit.client.0.smithi002.stdout:7/972: symlink d6/d17/l127 0 2023-12-17T11:58:01.176 INFO:tasks.workunit.client.0.smithi002.stdout:7/973: write d6/d17/dc/d67/d8b/d24/f7d [1517290,2786] 0 2023-12-17T11:58:01.179 INFO:tasks.workunit.client.1.smithi119.stdout:3/972: stat d9/l4b 0 2023-12-17T11:58:01.183 INFO:tasks.workunit.client.0.smithi002.stdout:4/925: read d0/d10/d21/f49 [1877124,98559] 0 2023-12-17T11:58:01.183 INFO:tasks.workunit.client.1.smithi119.stdout:8/876: rename d7/d18/d45/f76 to d7/d18/d45/d9f/d7b/df9/dfd/f121 0 2023-12-17T11:58:01.183 INFO:tasks.workunit.client.1.smithi119.stdout:8/877: write d7/d18/d15/d81/dc9/fd9 [769690,15594] 0 2023-12-17T11:58:01.184 INFO:tasks.workunit.client.1.smithi119.stdout:6/860: read d2/f11 [5905847,94291] 0 2023-12-17T11:58:01.184 INFO:tasks.workunit.client.0.smithi002.stdout:2/964: dread d3/d4/d7/d14/f48 [0,4194304] 0 2023-12-17T11:58:01.185 INFO:tasks.workunit.client.1.smithi119.stdout:6/861: write d2/d61/d8a/fca [720964,42473] 0 2023-12-17T11:58:01.189 INFO:tasks.workunit.client.1.smithi119.stdout:4/970: read dd/d11/f14 [4093611,119209] 0 2023-12-17T11:58:01.189 INFO:tasks.workunit.client.0.smithi002.stdout:7/974: creat d6/d17/dc/d6c/d93/d115/f128 x:0 0 0 2023-12-17T11:58:01.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/946: rmdir d0/d6/d26/d14/d19/d61/de3 39 2023-12-17T11:58:01.189 INFO:tasks.workunit.client.0.smithi002.stdout:7/975: creat d6/d99/da1/f129 x:0 0 0 2023-12-17T11:58:01.189 INFO:tasks.workunit.client.0.smithi002.stdout:0/947: dread - d0/d6/d26/d14/d19/d37/d62/db8/ddd/df7/d106/f113 zero size 2023-12-17T11:58:01.190 INFO:tasks.workunit.client.1.smithi119.stdout:3/973: dread d9/d11/d1e/d55/d65/ddf/f112 [0,4194304] 0 2023-12-17T11:58:01.190 INFO:tasks.workunit.client.1.smithi119.stdout:3/974: write d9/d11/f3f [2204916,82167] 0 2023-12-17T11:58:01.191 INFO:tasks.workunit.client.1.smithi119.stdout:3/975: stat d9/d59/l73 0 2023-12-17T11:58:01.192 INFO:tasks.workunit.client.0.smithi002.stdout:4/926: mkdir d0/d10/d14/d27/d69/d108/d99/d12a/d12b 0 2023-12-17T11:58:01.193 INFO:tasks.workunit.client.1.smithi119.stdout:1/957: rename d3/db/d17/d24/d20/d40/d76/d96/d99/fa6 to d3/d44/dfd/d64/db2/d14e/f15d 0 2023-12-17T11:58:01.194 INFO:tasks.workunit.client.1.smithi119.stdout:3/976: rmdir d9/d11/d1e/d55/d77/d135 39 2023-12-17T11:58:01.197 INFO:tasks.workunit.client.0.smithi002.stdout:7/976: link d6/d17/dc/d13/l117 d6/d17/dc/d13/d37/d125/l12a 0 2023-12-17T11:58:01.197 INFO:tasks.workunit.client.0.smithi002.stdout:7/977: chown d6/d17/dc/d13/f14 0 1 2023-12-17T11:58:01.197 INFO:tasks.workunit.client.0.smithi002.stdout:7/978: truncate d6/d17/dc/d13/d21/d2e/fc6 776574 0 2023-12-17T11:58:01.198 INFO:tasks.workunit.client.0.smithi002.stdout:7/979: write d6/d17/dc/d67/d8b/f10e [714695,79437] 0 2023-12-17T11:58:01.199 INFO:tasks.workunit.client.1.smithi119.stdout:3/977: truncate d9/da/fd4 1008289 0 2023-12-17T11:58:01.201 INFO:tasks.workunit.client.0.smithi002.stdout:2/965: write d3/d4/f16 [1537139,124546] 0 2023-12-17T11:58:01.201 INFO:tasks.workunit.client.0.smithi002.stdout:2/966: truncate d3/d4/d17/d19/d4d/fa2 1805319 0 2023-12-17T11:58:01.201 INFO:tasks.workunit.client.0.smithi002.stdout:0/948: mkdir d0/d137 0 2023-12-17T11:58:01.204 INFO:tasks.workunit.client.1.smithi119.stdout:6/862: dread d2/d2b/d43/de6/d17/f77 [0,4194304] 0 2023-12-17T11:58:01.209 INFO:tasks.workunit.client.0.smithi002.stdout:7/980: rename d6/d17/dc/d13/d21/c36 to d6/d17/dc/d13/d3e/c12b 0 2023-12-17T11:58:01.210 INFO:tasks.workunit.client.0.smithi002.stdout:2/967: symlink d3/d4/d7/d14/d2e/d37/d11e/l14b 0 2023-12-17T11:58:01.210 INFO:tasks.workunit.client.0.smithi002.stdout:2/968: readlink d3/d4/d8b/ld6 0 2023-12-17T11:58:01.210 INFO:tasks.workunit.client.0.smithi002.stdout:2/969: fsync d3/d4/d7/d14/d9b/f130 0 2023-12-17T11:58:01.210 INFO:tasks.workunit.client.1.smithi119.stdout:8/878: dread d7/fb [0,4194304] 0 2023-12-17T11:58:01.210 INFO:tasks.workunit.client.1.smithi119.stdout:3/978: mkdir d9/da/df/d67/d166 0 2023-12-17T11:58:01.211 INFO:tasks.workunit.client.1.smithi119.stdout:3/979: fsync d9/d11/d1e/d55/d65/ddf/f11f 0 2023-12-17T11:58:01.211 INFO:tasks.workunit.client.1.smithi119.stdout:3/980: creat d9/d11/d1e/d9f/f167 x:0 0 0 2023-12-17T11:58:01.213 INFO:tasks.workunit.client.0.smithi002.stdout:2/970: creat d3/d4/d17/d11a/f14c x:0 0 0 2023-12-17T11:58:01.215 INFO:tasks.workunit.client.1.smithi119.stdout:3/981: getdents d9/d44 0 2023-12-17T11:58:01.216 INFO:tasks.workunit.client.0.smithi002.stdout:2/971: link d3/d4/d7/d14/d42/dae/fc7 d3/d4/d17/d19/d4d/d72/d77/f14d 0 2023-12-17T11:58:01.218 INFO:tasks.workunit.client.1.smithi119.stdout:3/982: getdents d9/da/dcc 0 2023-12-17T11:58:01.218 INFO:tasks.workunit.client.1.smithi119.stdout:3/983: chown d9/da/lee 1487427 1 2023-12-17T11:58:01.218 INFO:tasks.workunit.client.0.smithi002.stdout:0/949: dread d0/d6/d26/d14/d90/d64/f127 [0,4194304] 0 2023-12-17T11:58:01.219 INFO:tasks.workunit.client.1.smithi119.stdout:4/971: dwrite dd/d15/d16/ff4 [0,4194304] 0 2023-12-17T11:58:01.219 INFO:tasks.workunit.client.1.smithi119.stdout:4/972: stat dd/d15/d16/d3d/dab/l10f 0 2023-12-17T11:58:01.219 INFO:tasks.workunit.client.1.smithi119.stdout:6/863: dread d2/d61/f94 [0,4194304] 0 2023-12-17T11:58:01.220 INFO:tasks.workunit.client.1.smithi119.stdout:4/973: read dd/d15/d16/d20/d82/fa5 [135873,113335] 0 2023-12-17T11:58:01.220 INFO:tasks.workunit.client.1.smithi119.stdout:4/974: read - dd/d11/d2d/d9c/d55/d81/db8/d78/dcc/f110 zero size 2023-12-17T11:58:01.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/972: symlink d3/d4/d17/d19/d4d/d72/d83/l14e 0 2023-12-17T11:58:01.222 INFO:tasks.workunit.client.0.smithi002.stdout:2/973: creat d3/d56/f14f x:0 0 0 2023-12-17T11:58:01.223 INFO:tasks.workunit.client.0.smithi002.stdout:2/974: truncate d3/d4/d7/d14/d2e/d37/d3f/d10e/f112 354858 0 2023-12-17T11:58:01.226 INFO:tasks.workunit.client.1.smithi119.stdout:8/879: read d7/da/d1a/fdc [64599,120038] 0 2023-12-17T11:58:01.227 INFO:tasks.workunit.client.1.smithi119.stdout:3/984: mknod d9/d35/dbd/dfb/d14c/c168 0 2023-12-17T11:58:01.229 INFO:tasks.workunit.client.0.smithi002.stdout:7/981: fsync d6/d99/da1/f129 0 2023-12-17T11:58:01.232 INFO:tasks.workunit.client.1.smithi119.stdout:6/864: creat d2/d7e/dbc/ddb/f111 x:0 0 0 2023-12-17T11:58:01.238 INFO:tasks.workunit.client.1.smithi119.stdout:4/975: link dd/d4b/fa4 dd/d15/d16/d20/f12c 0 2023-12-17T11:58:01.239 INFO:tasks.workunit.client.0.smithi002.stdout:2/975: write d3/d50/df6/f102 [3366198,12415] 0 2023-12-17T11:58:01.239 INFO:tasks.workunit.client.0.smithi002.stdout:2/976: chown d3/d4/d7/d14/d42/d8a/dd8/c111 17248 1 2023-12-17T11:58:01.239 INFO:tasks.workunit.client.0.smithi002.stdout:2/977: chown d3/d4/d17/d19/d4d/c8e 3224 1 2023-12-17T11:58:01.239 INFO:tasks.workunit.client.0.smithi002.stdout:2/978: write d3/d4/fe [3531172,56703] 0 2023-12-17T11:58:01.240 INFO:tasks.workunit.client.1.smithi119.stdout:8/880: unlink d7/da/d1a/d8a/ddb/dbf/fe8 0 2023-12-17T11:58:01.241 INFO:tasks.workunit.client.0.smithi002.stdout:0/950: dread d0/d15/d59/f6e [0,4194304] 0 2023-12-17T11:58:01.243 INFO:tasks.workunit.client.1.smithi119.stdout:6/865: creat d2/d2b/d43/d5e/d92/f112 x:0 0 0 2023-12-17T11:58:01.245 INFO:tasks.workunit.client.1.smithi119.stdout:4/976: getdents dd/d11/d2d/d9c/d55/d81/db8 0 2023-12-17T11:58:01.246 INFO:tasks.workunit.client.1.smithi119.stdout:4/977: read - dd/d15/d16/d5a/fc7 zero size 2023-12-17T11:58:01.248 INFO:tasks.workunit.client.1.smithi119.stdout:8/881: rename d7/d18/d45/d9f/d7b/lb0 to d7/d18/d45/d9f/d7b/d108/l122 0 2023-12-17T11:58:01.248 INFO:tasks.workunit.client.1.smithi119.stdout:8/882: truncate d7/d18/d45/d9f/f5a 769753 0 2023-12-17T11:58:01.249 INFO:tasks.workunit.client.1.smithi119.stdout:8/883: write d7/da/d11/d26/d49/f79 [430530,66659] 0 2023-12-17T11:58:01.249 INFO:tasks.workunit.client.1.smithi119.stdout:8/884: getdents d7/d102 0 2023-12-17T11:58:01.250 INFO:tasks.workunit.client.1.smithi119.stdout:6/866: symlink d2/d2b/d43/d76/d8d/dc2/d104/l113 0 2023-12-17T11:58:01.251 INFO:tasks.workunit.client.0.smithi002.stdout:2/979: write d3/d4/d17/d19/f89 [2780310,112178] 0 2023-12-17T11:58:01.253 INFO:tasks.workunit.client.1.smithi119.stdout:4/978: mknod dd/d11/d2d/d9c/d55/d81/db8/dbd/dd4/c12d 0 2023-12-17T11:58:01.253 INFO:tasks.workunit.client.1.smithi119.stdout:4/979: read dd/d15/d16/d5a/f70 [2889141,26496] 0 2023-12-17T11:58:01.253 INFO:tasks.workunit.client.1.smithi119.stdout:4/980: chown dd/c63 7 1 2023-12-17T11:58:01.256 INFO:tasks.workunit.client.1.smithi119.stdout:8/885: mknod d7/da/d11/d26/d49/c123 0 2023-12-17T11:58:01.258 INFO:tasks.workunit.client.1.smithi119.stdout:8/886: read d7/d18/d45/d9f/f5a [494263,23106] 0 2023-12-17T11:58:01.260 INFO:tasks.workunit.client.0.smithi002.stdout:7/982: unlink d6/f72 0 2023-12-17T11:58:01.262 INFO:tasks.workunit.client.1.smithi119.stdout:4/981: creat dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/f12e x:0 0 0 2023-12-17T11:58:01.262 INFO:tasks.workunit.client.1.smithi119.stdout:4/982: read f4 [53961,21621] 0 2023-12-17T11:58:01.265 INFO:tasks.workunit.client.0.smithi002.stdout:0/951: mkdir d0/d6/d26/d14/d90/d138 0 2023-12-17T11:58:01.266 INFO:tasks.workunit.client.0.smithi002.stdout:0/952: chown d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/f115 125 1 2023-12-17T11:58:01.266 INFO:tasks.workunit.client.0.smithi002.stdout:2/980: mkdir d3/d4/d17/d19/d4d/d150 0 2023-12-17T11:58:01.266 INFO:tasks.workunit.client.0.smithi002.stdout:2/981: stat d3/d4/d7/d14/d2e/l4a 0 2023-12-17T11:58:01.267 INFO:tasks.workunit.client.1.smithi119.stdout:4/983: rename dd/d15/f5c to dd/d15/d16/d3d/d126/f12f 0 2023-12-17T11:58:01.269 INFO:tasks.workunit.client.0.smithi002.stdout:7/983: symlink d6/d17/dc/d13/d37/l12c 0 2023-12-17T11:58:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:2/982: symlink d3/d4/d17/d19/d4d/d72/d83/d94/l151 0 2023-12-17T11:58:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:2/983: creat d3/d4/f152 x:0 0 0 2023-12-17T11:58:01.271 INFO:tasks.workunit.client.0.smithi002.stdout:2/984: fdatasync d3/d4/d7/d14/d2e/f6d 0 2023-12-17T11:58:01.274 INFO:tasks.workunit.client.0.smithi002.stdout:7/984: rename d6/d81/cee to d6/d17/c12d 0 2023-12-17T11:58:01.280 INFO:tasks.workunit.client.0.smithi002.stdout:2/985: mkdir d3/d4/d8b/da6/d153 0 2023-12-17T11:58:01.282 INFO:tasks.workunit.client.0.smithi002.stdout:7/985: getdents d6/d17/db3 0 2023-12-17T11:58:01.286 INFO:tasks.workunit.client.1.smithi119.stdout:8/887: dread d7/da/d1a/fdc [0,4194304] 0 2023-12-17T11:58:01.286 INFO:tasks.workunit.client.1.smithi119.stdout:8/888: fsync d7/da/d1a/d8a/ddb/dbf/f112 0 2023-12-17T11:58:01.288 INFO:tasks.workunit.client.0.smithi002.stdout:2/986: dread d3/d4/d7/d14/f48 [0,4194304] 0 2023-12-17T11:58:01.288 INFO:tasks.workunit.client.0.smithi002.stdout:2/987: readlink d3/d4/d7/d14/d2e/d37/dc2/l119 0 2023-12-17T11:58:01.288 INFO:tasks.workunit.client.0.smithi002.stdout:2/988: creat d3/d4/d17/d19/d8d/f154 x:0 0 0 2023-12-17T11:58:01.289 INFO:tasks.workunit.client.1.smithi119.stdout:3/985: dwrite d9/da/df/de1/f119 [0,4194304] 0 2023-12-17T11:58:01.291 INFO:tasks.workunit.client.0.smithi002.stdout:7/986: rename d6/d17/dc/d13/dd8/c7c to d6/d17/dc/d13/dd8/dd0/c12e 0 2023-12-17T11:58:01.291 INFO:tasks.workunit.client.0.smithi002.stdout:7/987: fsync d6/d17/dc/d13/d3e/fd4 0 2023-12-17T11:58:01.292 INFO:tasks.workunit.client.1.smithi119.stdout:8/889: creat d7/d18/d45/f124 x:0 0 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/989: mkdir d3/d155 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/990: creat d3/d4/d7/d14/d2e/d37/d11e/d12d/f156 x:0 0 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/991: chown d3/d4/d7/d14/d9b/cfd 22553 1 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/992: chown d3/d4/d17/d19/d4d/d72/d77/ff0 9122028 1 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/993: write d3/d4/d17/d19/d4d/d72/f114 [220438,94823] 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:2/994: write d3/d4/d8b/f144 [500377,52648] 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/988: mkdir d6/d17/dc/d67/d8b/d24/d12f 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/989: truncate d6/d17/dc/d13/d21/f8f 972331 0 2023-12-17T11:58:01.300 INFO:tasks.workunit.client.0.smithi002.stdout:7/990: stat d6/d17/dc/d67/d8b/d24/d12f 0 2023-12-17T11:58:01.301 INFO:tasks.workunit.client.1.smithi119.stdout:3/986: truncate d9/da/df/f32 251711 0 2023-12-17T11:58:01.301 INFO:tasks.workunit.client.1.smithi119.stdout:8/890: truncate d7/da/d1a/d8a/ddb/faf 144862 0 2023-12-17T11:58:01.305 INFO:tasks.workunit.client.1.smithi119.stdout:6/867: dwrite d2/da3/fce [0,4194304] 0 2023-12-17T11:58:01.311 INFO:tasks.workunit.client.0.smithi002.stdout:7/991: mknod d6/d17/dc/d13/d21/d2e/d4a/daf/c130 0 2023-12-17T11:58:01.313 INFO:tasks.workunit.client.0.smithi002.stdout:2/995: dread d3/d50/fc0 [0,4194304] 0 2023-12-17T11:58:01.316 INFO:tasks.workunit.client.1.smithi119.stdout:6/868: mknod d2/d61/d8a/dcf/c114 0 2023-12-17T11:58:01.316 INFO:tasks.workunit.client.1.smithi119.stdout:6/869: write d2/d61/d8a/dcf/feb [698982,124054] 0 2023-12-17T11:58:01.317 INFO:tasks.workunit.client.1.smithi119.stdout:6/870: symlink d2/d61/d10b/l115 0 2023-12-17T11:58:01.327 INFO:tasks.workunit.client.0.smithi002.stdout:7/992: write d6/d17/dc/d67/d8b/f70 [2447692,13388] 0 2023-12-17T11:58:01.329 INFO:tasks.workunit.client.0.smithi002.stdout:0/953: dwrite d0/d6/d26/d14/f10e [4194304,4194304] 0 2023-12-17T11:58:01.329 INFO:tasks.workunit.client.0.smithi002.stdout:0/954: chown d0/d15/la6 53149755 1 2023-12-17T11:58:01.330 INFO:tasks.workunit.client.0.smithi002.stdout:0/955: read - d0/d6/d26/d14/d19/d2b/df1/f12d zero size 2023-12-17T11:58:01.335 INFO:tasks.workunit.client.1.smithi119.stdout:4/984: dwrite dd/d4b/fa4 [0,4194304] 0 2023-12-17T11:58:01.341 INFO:tasks.workunit.client.1.smithi119.stdout:4/985: fsync dd/d11/d2d/d9c/d55/d81/db8/d78/dca/ff1 0 2023-12-17T11:58:01.341 INFO:tasks.workunit.client.1.smithi119.stdout:4/986: write dd/d15/d4f/f8d [71887,6102] 0 2023-12-17T11:58:01.342 INFO:tasks.workunit.client.1.smithi119.stdout:4/987: dread - dd/d15/d16/d3d/f122 zero size 2023-12-17T11:58:01.344 INFO:tasks.workunit.client.0.smithi002.stdout:0/956: link d0/d6/d26/d14/d19/d61/de3/c3c d0/d6/d26/d14/d19/d37/d62/c139 0 2023-12-17T11:58:01.345 INFO:tasks.workunit.client.1.smithi119.stdout:8/891: dwrite d7/da/fc6 [0,4194304] 0 2023-12-17T11:58:01.348 INFO:tasks.workunit.client.1.smithi119.stdout:8/892: write d7/d12/d69/d98/fb1 [736212,100944] 0 2023-12-17T11:58:01.367 INFO:tasks.workunit.client.0.smithi002.stdout:2/996: dwrite d3/d4/d7/d14/d2e/f6d [0,4194304] 0 2023-12-17T11:58:01.375 INFO:tasks.workunit.client.1.smithi119.stdout:3/987: dwrite d9/d11/d1e/f6f [0,4194304] 0 2023-12-17T11:58:01.375 INFO:tasks.workunit.client.1.smithi119.stdout:3/988: chown d9/d35/dbd/dfb/f14a 200 1 2023-12-17T11:58:01.375 INFO:tasks.workunit.client.1.smithi119.stdout:3/989: write d9/da/dcc/db8/f136 [250749,100317] 0 2023-12-17T11:58:01.375 INFO:tasks.workunit.client.1.smithi119.stdout:6/871: dwrite d2/d2b/d43/d76/fb0 [0,4194304] 0 2023-12-17T11:58:01.377 INFO:tasks.workunit.client.1.smithi119.stdout:7/974: sync 2023-12-17T11:58:01.385 INFO:tasks.workunit.client.0.smithi002.stdout:7/993: rmdir d6/d17/dc 39 2023-12-17T11:58:01.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/927: sync 2023-12-17T11:58:01.389 INFO:tasks.workunit.client.0.smithi002.stdout:4/928: chown d0/d10/d21/d33/ca1 1299456 1 2023-12-17T11:58:01.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/957: unlink d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/c11e 0 2023-12-17T11:58:01.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/958: chown d0/d6/d26/d14/d19/d37/d62/d77/dee/d10c/d11f/c122 347656 1 2023-12-17T11:58:01.390 INFO:tasks.workunit.client.0.smithi002.stdout:0/959: write d0/d6/d26/d14/d19/d37/fa8 [5045605,5489] 0 2023-12-17T11:58:01.391 INFO:tasks.workunit.client.1.smithi119.stdout:8/893: dwrite d7/da/d11/d60/fa8 [0,4194304] 0 2023-12-17T11:58:01.392 INFO:tasks.workunit.client.1.smithi119.stdout:4/988: dwrite dd/d11/d2d/d9c/d55/d81/db8/d78/dca/dd6/f12e [0,4194304] 0 2023-12-17T11:58:01.392 INFO:tasks.workunit.client.1.smithi119.stdout:4/989: chown dd/d11/d2d/d9c 1162185 1 2023-12-17T11:58:01.392 INFO:tasks.workunit.client.1.smithi119.stdout:4/990: write dd/d15/f53 [166023,3819] 0 2023-12-17T11:58:01.393 INFO:tasks.workunit.client.1.smithi119.stdout:3/990: unlink d9/d11/d87/l13e 0 2023-12-17T11:58:01.399 INFO:tasks.workunit.client.0.smithi002.stdout:2/997: creat d3/d4/d17/d19/d4d/d150/f157 x:0 0 0 2023-12-17T11:58:01.400 INFO:tasks.workunit.client.1.smithi119.stdout:6/872: mkdir d2/d2b/d100/d116 0 2023-12-17T11:58:01.401 INFO:tasks.workunit.client.1.smithi119.stdout:0/947: sync 2023-12-17T11:58:01.401 INFO:tasks.workunit.client.1.smithi119.stdout:0/948: stat d2/d66/d1f/d24/d50/dbd/f10e 0 2023-12-17T11:58:01.402 INFO:tasks.workunit.client.1.smithi119.stdout:1/958: sync 2023-12-17T11:58:01.403 INFO:tasks.workunit.client.0.smithi002.stdout:7/994: creat d6/d17/dc/d6c/d93/d115/d11d/f131 x:0 0 0 2023-12-17T11:58:01.405 INFO:tasks.workunit.client.0.smithi002.stdout:4/929: rename d0/d10/d21/d33/l4f to d0/d10/d21/d119/l12c 0 2023-12-17T11:58:01.406 INFO:tasks.workunit.client.1.smithi119.stdout:8/894: dread d7/d18/d45/d9f/d7b/df9/dfd/f121 [0,4194304] 0 2023-12-17T11:58:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:00 smithi119 ceph-mon[117414]: pgmap v33: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 174 MiB/s rd, 213 MiB/s wr, 315 op/s 2023-12-17T11:58:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:00 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:01.408 INFO:tasks.workunit.client.0.smithi002.stdout:0/960: stat d0/c75 0 2023-12-17T11:58:01.408 INFO:tasks.workunit.client.0.smithi002.stdout:7/995: creat d6/d17/dc/d8e/f132 x:0 0 0 2023-12-17T11:58:01.410 INFO:tasks.workunit.client.0.smithi002.stdout:4/930: mkdir d0/d3e/d47/d12d 0 2023-12-17T11:58:01.414 INFO:tasks.workunit.client.1.smithi119.stdout:3/991: unlink d9/d35/l42 0 2023-12-17T11:58:01.414 INFO:tasks.workunit.client.1.smithi119.stdout:3/992: readlink d9/d59/da6/l117 0 2023-12-17T11:58:01.414 INFO:tasks.workunit.client.0.smithi002.stdout:0/961: creat d0/d15/d59/f13a x:0 0 0 2023-12-17T11:58:01.415 INFO:tasks.workunit.client.0.smithi002.stdout:7/996: mknod d6/d17/dc/d13/d21/d116/c133 0 2023-12-17T11:58:01.415 INFO:tasks.workunit.client.0.smithi002.stdout:7/997: creat d6/d17/dc/d8e/f134 x:0 0 0 2023-12-17T11:58:01.417 INFO:tasks.workunit.client.0.smithi002.stdout:4/931: creat d0/d10/dc5/f12e x:0 0 0 2023-12-17T11:58:01.418 INFO:tasks.workunit.client.1.smithi119.stdout:0/949: unlink d2/d66/d2e/la8 0 2023-12-17T11:58:01.421 INFO:tasks.workunit.client.0.smithi002.stdout:0/962: mkdir d0/d6/d26/d8f/d12c/dca/d13b 0 2023-12-17T11:58:01.423 INFO:tasks.workunit.client.1.smithi119.stdout:1/959: unlink d3/db/d2a/d127/d7e/da1/fe7 0 2023-12-17T11:58:01.431 INFO:tasks.workunit.client.0.smithi002.stdout:7/998: link d6/d17/dc/d67/d8b/d24/f7d d6/d17/dc/d13/d21/d2e/d4a/d124/f135 0 2023-12-17T11:58:01.431 INFO:tasks.workunit.client.1.smithi119.stdout:8/895: creat d7/d18/d15/d81/f125 x:0 0 0 2023-12-17T11:58:01.434 INFO:tasks.workunit.client.0.smithi002.stdout:7/999: getdents d6/d17/dc/d6c/d93/d115 0 2023-12-17T11:58:01.435 INFO:tasks.workunit.client.1.smithi119.stdout:6/873: rename d2/d61/fb9 to d2/da3/f117 0 2023-12-17T11:58:01.435 INFO:tasks.workunit.client.1.smithi119.stdout:7/975: dwrite d2/d4/d11/d2c/d55/d67/ff8 [0,4194304] 0 2023-12-17T11:58:01.436 INFO:tasks.workunit.client.0.smithi002.stdout:4/932: truncate d0/d10/d21/f48 2374467 0 2023-12-17T11:58:01.439 INFO:tasks.workunit.client.1.smithi119.stdout:7/976: symlink d2/d40/dc3/l137 0 2023-12-17T11:58:01.439 INFO:tasks.workunit.client.1.smithi119.stdout:7/977: write d2/d4/d11/d3c/d75/fbf [229890,116284] 0 2023-12-17T11:58:01.444 INFO:tasks.workunit.client.1.smithi119.stdout:1/960: dread d3/db/d17/d24/f2e [0,4194304] 0 2023-12-17T11:58:01.444 INFO:tasks.workunit.client.1.smithi119.stdout:1/961: write d3/f4 [7015946,63303] 0 2023-12-17T11:58:01.445 INFO:tasks.workunit.client.1.smithi119.stdout:1/962: chown d3/db/d17/d24/d20/dbd/dcb/fdc 6508 1 2023-12-17T11:58:01.445 INFO:tasks.workunit.client.1.smithi119.stdout:1/963: readlink d3/db/d26/d8f/le8 0 2023-12-17T11:58:01.447 INFO:tasks.workunit.client.1.smithi119.stdout:4/991: dwrite dd/d15/d16/d3d/f77 [0,4194304] 0 2023-12-17T11:58:01.448 INFO:tasks.workunit.client.1.smithi119.stdout:4/992: read - dd/d4b/ff8 zero size 2023-12-17T11:58:01.455 INFO:tasks.workunit.client.1.smithi119.stdout:8/896: dread d7/f27 [0,4194304] 0 2023-12-17T11:58:01.455 INFO:tasks.workunit.client.1.smithi119.stdout:8/897: dread - d7/d18/d15/d81/f125 zero size 2023-12-17T11:58:01.455 INFO:tasks.workunit.client.1.smithi119.stdout:4/993: creat dd/d11/d2d/d9c/d55/d81/d88/d105/d106/f130 x:0 0 0 2023-12-17T11:58:01.455 INFO:tasks.workunit.client.1.smithi119.stdout:4/994: getdents dd/d11/d26 0 2023-12-17T11:58:01.455 INFO:tasks.workunit.client.1.smithi119.stdout:4/995: stat dd/d15/d16/c35 0 2023-12-17T11:58:01.455 INFO:tasks.workunit.client.1.smithi119.stdout:4/996: chown dd/d11/d2d/d9c/d55/d81/d88/fa7 500 1 2023-12-17T11:58:01.465 INFO:tasks.workunit.client.1.smithi119.stdout:7/978: read d2/d4/d11/d2c/d68/d99/d6c/fbd [2596426,92196] 0 2023-12-17T11:58:01.466 INFO:tasks.workunit.client.1.smithi119.stdout:7/979: dread - d2/d4/d11/d2c/d55/d103/f118 zero size 2023-12-17T11:58:01.466 INFO:tasks.workunit.client.1.smithi119.stdout:7/980: chown d2/d4/d1f/l94 36 1 2023-12-17T11:58:01.466 INFO:tasks.workunit.client.1.smithi119.stdout:7/981: dread - d2/d4/d11/d2c/d55/d103/f118 zero size 2023-12-17T11:58:01.466 INFO:tasks.workunit.client.1.smithi119.stdout:7/982: write d2/d4/d11/d3c/ffb [870228,87685] 0 2023-12-17T11:58:01.467 INFO:tasks.workunit.client.1.smithi119.stdout:1/964: dread d3/db/d17/d24/d20/d40/f78 [0,4194304] 0 2023-12-17T11:58:01.467 INFO:tasks.workunit.client.1.smithi119.stdout:1/965: readlink d3/db/d17/d24/d20/l133 0 2023-12-17T11:58:01.467 INFO:tasks.workunit.client.1.smithi119.stdout:7/983: link d2/d4/d11/d2c/d55/l11d d2/d4/d11/d2c/d68/d77/l138 0 2023-12-17T11:58:01.469 INFO:tasks.workunit.client.1.smithi119.stdout:7/984: creat d2/d5b/f139 x:0 0 0 2023-12-17T11:58:01.469 INFO:tasks.workunit.client.1.smithi119.stdout:7/985: creat d2/d40/dc3/dc8/f13a x:0 0 0 2023-12-17T11:58:01.474 INFO:tasks.workunit.client.1.smithi119.stdout:8/898: dread d7/da/d1a/fdc [0,4194304] 0 2023-12-17T11:58:01.474 INFO:tasks.workunit.client.1.smithi119.stdout:8/899: dread - d7/d12/d23/db4/f9a zero size 2023-12-17T11:58:01.478 INFO:tasks.workunit.client.1.smithi119.stdout:8/900: read d7/da/d11/d26/f58 [3801849,44830] 0 2023-12-17T11:58:01.481 INFO:tasks.workunit.client.0.smithi002.stdout:2/998: dwrite d3/d4/d17/d19/d8d/f154 [0,4194304] 0 2023-12-17T11:58:01.482 INFO:tasks.workunit.client.1.smithi119.stdout:8/901: rename d7/da/d1a/f66 to d7/da/f126 0 2023-12-17T11:58:01.484 INFO:tasks.workunit.client.1.smithi119.stdout:8/902: mknod d7/d18/d15/d81/c127 0 2023-12-17T11:58:01.485 INFO:tasks.workunit.client.0.smithi002.stdout:0/963: dwrite d0/d15/d59/f6e [0,4194304] 0 2023-12-17T11:58:01.487 INFO:tasks.workunit.client.1.smithi119.stdout:8/903: write d7/da/d11/f87 [493740,38937] 0 2023-12-17T11:58:01.487 INFO:tasks.workunit.client.1.smithi119.stdout:8/904: dread - d7/d18/d45/d9f/d75/f90 zero size 2023-12-17T11:58:01.487 INFO:tasks.workunit.client.1.smithi119.stdout:4/997: dread dd/d11/d2d/d9c/d55/d81/db8/d78/f89 [4194304,4194304] 0 2023-12-17T11:58:01.487 INFO:tasks.workunit.client.0.smithi002.stdout:0/964: unlink d0/d6/d26/d14/d19/d61/f103 0 2023-12-17T11:58:01.489 INFO:tasks.workunit.client.0.smithi002.stdout:4/933: dwrite d0/d10/d21/f42 [0,4194304] 0 2023-12-17T11:58:01.489 INFO:tasks.workunit.client.0.smithi002.stdout:0/965: mkdir d0/d6/d26/d14/d90/d64/d13c 0 2023-12-17T11:58:01.492 INFO:tasks.workunit.client.0.smithi002.stdout:4/934: creat d0/d10/d14/d27/d69/d108/d65/d78/d85/f12f x:0 0 0 2023-12-17T11:58:01.497 INFO:tasks.workunit.client.1.smithi119.stdout:6/874: dwrite d2/da3/fb5 [0,4194304] 0 2023-12-17T11:58:01.497 INFO:tasks.workunit.client.1.smithi119.stdout:6/875: truncate d2/d2b/d43/f8b 410808 0 2023-12-17T11:58:01.501 INFO:tasks.workunit.client.0.smithi002.stdout:0/966: read d0/d6/fe [1963540,5561] 0 2023-12-17T11:58:01.502 INFO:tasks.workunit.client.1.smithi119.stdout:3/993: dwrite d9/d11/d1e/d55/d77/d135/f15b [0,4194304] 0 2023-12-17T11:58:01.502 INFO:tasks.workunit.client.1.smithi119.stdout:3/994: write d9/d59/da6/fec [640389,98669] 0 2023-12-17T11:58:01.506 INFO:tasks.workunit.client.0.smithi002.stdout:2/999: dread d3/d4/d7/d14/d2e/d37/d3f/f91 [0,4194304] 0 2023-12-17T11:58:01.513 INFO:tasks.workunit.client.1.smithi119.stdout:3/995: mknod d9/d59/dda/c169 0 2023-12-17T11:58:01.513 INFO:tasks.workunit.client.1.smithi119.stdout:3/996: chown d9/da/df/d41/d33/db4/fc9 866487 1 2023-12-17T11:58:01.519 INFO:tasks.workunit.client.1.smithi119.stdout:3/997: dread d9/da/df/d41/d33/db4/fe0 [0,4194304] 0 2023-12-17T11:58:01.520 INFO:tasks.workunit.client.1.smithi119.stdout:3/998: symlink d9/d11/d1e/d9f/l16a 0 2023-12-17T11:58:01.523 INFO:tasks.workunit.client.1.smithi119.stdout:1/966: dwrite d3/db/d17/d24/f3c [0,4194304] 0 2023-12-17T11:58:01.525 INFO:tasks.workunit.client.1.smithi119.stdout:7/986: dwrite d2/d4/d11/d2c/d68/d98/f105 [0,4194304] 0 2023-12-17T11:58:01.526 INFO:tasks.workunit.client.1.smithi119.stdout:3/999: rename d9/d11/d1e/d55/df3/d129 to d9/d1c/d16b 0 2023-12-17T11:58:01.527 INFO:tasks.workunit.client.0.smithi002.stdout:4/935: read d0/d10/d21/d33/f45 [3969014,39619] 0 2023-12-17T11:58:01.528 INFO:tasks.workunit.client.1.smithi119.stdout:1/967: rmdir d3/db/d2a/d127/d7e/da1 39 2023-12-17T11:58:01.528 INFO:tasks.workunit.client.1.smithi119.stdout:1/968: creat d3/f15e x:0 0 0 2023-12-17T11:58:01.530 INFO:tasks.workunit.client.0.smithi002.stdout:4/936: mknod d0/d3e/dc8/c130 0 2023-12-17T11:58:01.533 INFO:tasks.workunit.client.1.smithi119.stdout:1/969: rmdir d3/db/d17/d24/d20/d40/d76/d84/d119/d104 39 2023-12-17T11:58:01.535 INFO:tasks.workunit.client.1.smithi119.stdout:6/876: dread d2/d2b/f3d [0,4194304] 0 2023-12-17T11:58:01.536 INFO:tasks.workunit.client.0.smithi002.stdout:0/967: dread d0/d15/f6c [0,4194304] 0 2023-12-17T11:58:01.536 INFO:tasks.workunit.client.0.smithi002.stdout:0/968: stat d0/d6/d26/d14 0 2023-12-17T11:58:01.537 INFO:tasks.workunit.client.1.smithi119.stdout:6/877: creat d2/d2b/d43/d76/d8d/dc2/d104/f118 x:0 0 0 2023-12-17T11:58:01.538 INFO:tasks.workunit.client.1.smithi119.stdout:6/878: creat d2/d9b/d10d/f119 x:0 0 0 2023-12-17T11:58:01.544 INFO:tasks.workunit.client.1.smithi119.stdout:8/905: dwrite d7/da/d11/d60/fa8 [0,4194304] 0 2023-12-17T11:58:01.546 INFO:tasks.workunit.client.1.smithi119.stdout:4/998: dwrite dd/d15/d16/d3d/f4c [4194304,4194304] 0 2023-12-17T11:58:01.547 INFO:tasks.workunit.client.0.smithi002.stdout:4/937: write d0/f6f [1442066,92890] 0 2023-12-17T11:58:01.547 INFO:tasks.workunit.client.0.smithi002.stdout:4/938: chown d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/d123 193948296 1 2023-12-17T11:58:01.547 INFO:tasks.workunit.client.1.smithi119.stdout:8/906: write d7/da/fd8 [53172,84288] 0 2023-12-17T11:58:01.547 INFO:tasks.workunit.client.1.smithi119.stdout:8/907: truncate d7/d12/fe6 208140 0 2023-12-17T11:58:01.552 INFO:tasks.workunit.client.0.smithi002.stdout:4/939: mknod d0/d10/d14/d27/d57/dd4/c131 0 2023-12-17T11:58:01.553 INFO:tasks.workunit.client.0.smithi002.stdout:4/940: write d0/d3e/f101 [132547,60276] 0 2023-12-17T11:58:01.553 INFO:tasks.workunit.client.0.smithi002.stdout:4/941: fsync d0/d10/d14/d4e/f53 0 2023-12-17T11:58:01.553 INFO:tasks.workunit.client.0.smithi002.stdout:4/942: truncate d0/fc0 1228654 0 2023-12-17T11:58:01.556 INFO:tasks.workunit.client.1.smithi119.stdout:1/970: dread d3/db/d17/d24/d20/d40/f41 [0,4194304] 0 2023-12-17T11:58:01.557 INFO:tasks.workunit.client.1.smithi119.stdout:4/999: mkdir dd/d11/d26/d131 0 2023-12-17T11:58:01.558 INFO:tasks.workunit.client.1.smithi119.stdout:8/908: mknod d7/da/d1a/d84/d104/c128 0 2023-12-17T11:58:01.558 INFO:tasks.workunit.client.1.smithi119.stdout:8/909: dread - d7/d12/d23/db4/f9a zero size 2023-12-17T11:58:01.559 INFO:tasks.workunit.client.1.smithi119.stdout:1/971: stat d3/db/d17/d24/d20/d40/d76/d84/ffb 0 2023-12-17T11:58:01.560 INFO:tasks.workunit.client.0.smithi002.stdout:0/969: dread d0/d6/d26/d14/d19/d61/f7c [0,4194304] 0 2023-12-17T11:58:01.560 INFO:tasks.workunit.client.0.smithi002.stdout:0/970: readlink d0/d6/d26/d14/l128 0 2023-12-17T11:58:01.561 INFO:tasks.workunit.client.1.smithi119.stdout:8/910: mkdir d7/da/d1a/d84/d111/d129 0 2023-12-17T11:58:01.561 INFO:tasks.workunit.client.1.smithi119.stdout:8/911: creat d7/d18/d45/d9f/d7b/f12a x:0 0 0 2023-12-17T11:58:01.563 INFO:tasks.workunit.client.1.smithi119.stdout:1/972: symlink d3/db/d17/d24/d20/d40/d76/l15f 0 2023-12-17T11:58:01.573 INFO:tasks.workunit.client.1.smithi119.stdout:1/973: read d3/db/d17/d24/d20/dba/f131 [88353,50450] 0 2023-12-17T11:58:01.574 INFO:tasks.workunit.client.1.smithi119.stdout:1/974: fsync d3/db/d2a/d127/d7e/f94 0 2023-12-17T11:58:01.574 INFO:tasks.workunit.client.0.smithi002.stdout:4/943: write d0/d10/d21/fa2 [847060,56132] 0 2023-12-17T11:58:01.576 INFO:tasks.workunit.client.0.smithi002.stdout:4/944: creat d0/d3e/d41/f132 x:0 0 0 2023-12-17T11:58:01.577 INFO:tasks.workunit.client.1.smithi119.stdout:8/912: dread d7/d12/fba [0,4194304] 0 2023-12-17T11:58:01.577 INFO:tasks.workunit.client.1.smithi119.stdout:8/913: readlink d7/da/d11/l2e 0 2023-12-17T11:58:01.577 INFO:tasks.workunit.client.1.smithi119.stdout:1/975: read d3/db/d17/d24/d20/d40/fdd [333008,55784] 0 2023-12-17T11:58:01.578 INFO:tasks.workunit.client.1.smithi119.stdout:8/914: mknod d7/d12/d69/d98/c12b 0 2023-12-17T11:58:01.580 INFO:tasks.workunit.client.1.smithi119.stdout:8/915: rename d7/da/d1a/d8a/ddb/dbf/fd6 to d7/d12/d23/d9c/dea/f12c 0 2023-12-17T11:58:01.582 INFO:tasks.workunit.client.1.smithi119.stdout:6/879: dwrite d2/d2b/d43/de6/d17/d79/f8c [0,4194304] 0 2023-12-17T11:58:01.588 INFO:tasks.workunit.client.1.smithi119.stdout:6/880: getdents d2/dba 0 2023-12-17T11:58:01.590 INFO:tasks.workunit.client.1.smithi119.stdout:6/881: rmdir d2/d7e/d93/dec 39 2023-12-17T11:58:01.591 INFO:tasks.workunit.client.1.smithi119.stdout:6/882: unlink d2/d61/l8f 0 2023-12-17T11:58:01.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/945: truncate d0/d10/d21/fa2 3483320 0 2023-12-17T11:58:01.594 INFO:tasks.workunit.client.0.smithi002.stdout:4/946: dread - d0/d10/d14/d4e/fe6 zero size 2023-12-17T11:58:01.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/971: dwrite d0/d6/d26/d14/d19/d61/de3/f126 [0,4194304] 0 2023-12-17T11:58:01.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/972: write d0/d15/d59/f13a [707303,31326] 0 2023-12-17T11:58:01.596 INFO:tasks.workunit.client.0.smithi002.stdout:0/973: stat d0/d6/d26/d14/d19/d2f/ffa 0 2023-12-17T11:58:01.597 INFO:tasks.workunit.client.1.smithi119.stdout:6/883: rename d2/d7e/dbc/ddb to d2/da3/d11a 0 2023-12-17T11:58:01.597 INFO:tasks.workunit.client.1.smithi119.stdout:6/884: stat d2/d2b/d43/dcb/df8 0 2023-12-17T11:58:01.598 INFO:tasks.workunit.client.0.smithi002.stdout:0/974: creat d0/d6/d26/d14/d19/d2f/f13d x:0 0 0 2023-12-17T11:58:01.624 INFO:tasks.workunit.client.1.smithi119.stdout:1/976: dwrite d3/db/d17/d24/d20/f7f [0,4194304] 0 2023-12-17T11:58:01.645 INFO:tasks.workunit.client.1.smithi119.stdout:6/885: dwrite d2/d7e/dbc/fe4 [0,4194304] 0 2023-12-17T11:58:01.647 INFO:tasks.workunit.client.1.smithi119.stdout:6/886: mknod d2/d2b/d43/dcb/c11b 0 2023-12-17T11:58:01.653 INFO:tasks.workunit.client.0.smithi002.stdout:0/975: dwrite d0/d6/d26/d14/f9f [0,4194304] 0 2023-12-17T11:58:01.654 INFO:tasks.workunit.client.1.smithi119.stdout:6/887: dread d2/d2b/d43/de6/d17/d79/f7d [0,4194304] 0 2023-12-17T11:58:01.654 INFO:tasks.workunit.client.1.smithi119.stdout:6/888: dread - d2/d2b/d43/d5e/db3/f108 zero size 2023-12-17T11:58:01.655 INFO:tasks.workunit.client.1.smithi119.stdout:6/889: creat d2/d7e/dbc/f11c x:0 0 0 2023-12-17T11:58:01.656 INFO:tasks.workunit.client.1.smithi119.stdout:6/890: symlink d2/d41/l11d 0 2023-12-17T11:58:01.658 INFO:tasks.workunit.client.1.smithi119.stdout:6/891: symlink d2/d7e/l11e 0 2023-12-17T11:58:01.660 INFO:tasks.workunit.client.1.smithi119.stdout:6/892: link d2/d2b/c51 d2/d41/c11f 0 2023-12-17T11:58:01.662 INFO:tasks.workunit.client.1.smithi119.stdout:6/893: mknod d2/d2b/d43/d76/d8d/dc2/c120 0 2023-12-17T11:58:01.662 INFO:tasks.workunit.client.1.smithi119.stdout:6/894: truncate d2/d2b/d43/de6/d17/d79/fe3 859403 0 2023-12-17T11:58:01.665 INFO:tasks.workunit.client.1.smithi119.stdout:6/895: write d2/f26 [3385440,66484] 0 2023-12-17T11:58:01.667 INFO:tasks.workunit.client.1.smithi119.stdout:1/977: dwrite d3/db/d17/d24/d20/d40/d76/d84/d119/f122 [0,4194304] 0 2023-12-17T11:58:01.669 INFO:tasks.workunit.client.1.smithi119.stdout:1/978: link d3/db/d26/d19/f135 d3/db/d2a/d127/f160 0 2023-12-17T11:58:01.670 INFO:tasks.workunit.client.1.smithi119.stdout:1/979: mkdir d3/d44/dfd/d64/db2/d161 0 2023-12-17T11:58:01.671 INFO:tasks.workunit.client.1.smithi119.stdout:1/980: mkdir d3/db/d17/d24/d20/d40/d76/d96/d99/d162 0 2023-12-17T11:58:01.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/976: write d0/d6/d26/d14/d19/d37/fda [7169228,18691] 0 2023-12-17T11:58:01.673 INFO:tasks.workunit.client.0.smithi002.stdout:0/977: stat d0/d15/cbe 0 2023-12-17T11:58:01.711 INFO:tasks.workunit.client.1.smithi119.stdout:6/896: dwrite d2/d2b/d43/de6/f4b [0,4194304] 0 2023-12-17T11:58:01.712 INFO:tasks.workunit.client.1.smithi119.stdout:6/897: write d2/d2b/d43/de6/f55 [2098438,51066] 0 2023-12-17T11:58:01.712 INFO:tasks.workunit.client.1.smithi119.stdout:6/898: chown d2/d2b/d43/dcb/df8/c106 41 1 2023-12-17T11:58:01.713 INFO:tasks.workunit.client.1.smithi119.stdout:6/899: creat d2/d2b/d43/dcb/f121 x:0 0 0 2023-12-17T11:58:01.713 INFO:tasks.workunit.client.1.smithi119.stdout:6/900: dread - d2/d2b/d43/d76/dbd/ff3 zero size 2023-12-17T11:58:01.718 INFO:tasks.workunit.client.1.smithi119.stdout:0/950: sync 2023-12-17T11:58:01.719 INFO:tasks.workunit.client.1.smithi119.stdout:0/951: creat d2/d66/d2e/d44/d7b/d5/d3f/d101/f125 x:0 0 0 2023-12-17T11:58:01.720 INFO:tasks.workunit.client.1.smithi119.stdout:0/952: fdatasync d2/d66/d2e/d44/df0/fa7 0 2023-12-17T11:58:01.722 INFO:tasks.workunit.client.0.smithi002.stdout:0/978: dwrite d0/d15/d59/f6e [0,4194304] 0 2023-12-17T11:58:01.724 INFO:tasks.workunit.client.0.smithi002.stdout:0/979: link d0/d15/d59/fd7 d0/d6/d26/d14/d19/d37/dcf/f13e 0 2023-12-17T11:58:01.725 INFO:tasks.workunit.client.0.smithi002.stdout:0/980: symlink d0/d6/d26/d14/d19/d37/d62/db8/ddd/l13f 0 2023-12-17T11:58:01.725 INFO:tasks.workunit.client.0.smithi002.stdout:0/981: readlink d0/d6/d26/d14/d19/d37/d62/lf3 0 2023-12-17T11:58:01.725 INFO:tasks.workunit.client.0.smithi002.stdout:0/982: truncate d0/d6/d26/d14/d19/d2f/fcc 2432585 0 2023-12-17T11:58:01.729 INFO:tasks.workunit.client.0.smithi002.stdout:4/947: sync 2023-12-17T11:58:01.729 INFO:tasks.workunit.client.0.smithi002.stdout:4/948: chown d0/d10/d21/d33/d96/lea 444 1 2023-12-17T11:58:01.729 INFO:tasks.workunit.client.0.smithi002.stdout:4/949: chown d0/d6c/dda/de1/fe5 941578 1 2023-12-17T11:58:01.730 INFO:tasks.workunit.client.0.smithi002.stdout:4/950: chown d0/d10/d21/d33/d96/le2 82657971 1 2023-12-17T11:58:01.732 INFO:tasks.workunit.client.1.smithi119.stdout:0/953: write d2/d66/d2e/d44/fbe [133676,34942] 0 2023-12-17T11:58:01.734 INFO:tasks.workunit.client.1.smithi119.stdout:0/954: mknod d2/d66/dbb/dcd/c126 0 2023-12-17T11:58:01.737 INFO:tasks.workunit.client.1.smithi119.stdout:1/981: dwrite d3/db/d17/d24/d20/dba/f131 [0,4194304] 0 2023-12-17T11:58:01.738 INFO:tasks.workunit.client.1.smithi119.stdout:1/982: truncate d3/f61 1033578 0 2023-12-17T11:58:01.738 INFO:tasks.workunit.client.1.smithi119.stdout:1/983: write d3/db/d2a/d127/d7e/f13c [336123,112084] 0 2023-12-17T11:58:01.756 INFO:tasks.workunit.client.1.smithi119.stdout:7/987: sync 2023-12-17T11:58:01.761 INFO:tasks.workunit.client.0.smithi002.stdout:0/983: dwrite d0/d6/d26/d14/d19/d37/f39 [4194304,4194304] 0 2023-12-17T11:58:01.763 INFO:tasks.workunit.client.1.smithi119.stdout:1/984: dread d3/db/d17/d24/d20/d40/f41 [0,4194304] 0 2023-12-17T11:58:01.765 INFO:tasks.workunit.client.1.smithi119.stdout:1/985: read - d3/db/d17/d24/d20/d40/d76/d96/fc4 zero size 2023-12-17T11:58:01.766 INFO:tasks.workunit.client.1.smithi119.stdout:6/901: dwrite d2/d2b/d43/d76/dbd/fc1 [0,4194304] 0 2023-12-17T11:58:01.775 INFO:tasks.workunit.client.1.smithi119.stdout:0/955: dwrite d2/d66/d2e/d44/d7b/dbc/df4/ff9 [0,4194304] 0 2023-12-17T11:58:01.785 INFO:tasks.workunit.client.1.smithi119.stdout:6/902: dread d2/d2b/d43/de6/d17/d79/f96 [0,4194304] 0 2023-12-17T11:58:01.785 INFO:tasks.workunit.client.1.smithi119.stdout:6/903: readlink d2/d2b/d43/d76/d8d/lc0 0 2023-12-17T11:58:01.788 INFO:tasks.workunit.client.1.smithi119.stdout:6/904: unlink d2/d2b/d43/de6/d17/d79/fe3 0 2023-12-17T11:58:01.790 INFO:tasks.workunit.client.1.smithi119.stdout:8/916: sync 2023-12-17T11:58:01.799 INFO:tasks.workunit.client.1.smithi119.stdout:7/988: read d2/d4/d70/fd2 [152444,101915] 0 2023-12-17T11:58:01.799 INFO:tasks.workunit.client.1.smithi119.stdout:7/989: dread - d2/d40/dc3/dc8/f125 zero size 2023-12-17T11:58:01.801 INFO:tasks.workunit.client.1.smithi119.stdout:7/990: creat d2/d4/d11/d2c/d55/f13b x:0 0 0 2023-12-17T11:58:01.811 INFO:tasks.workunit.client.1.smithi119.stdout:0/956: dread d2/d16/fab [0,4194304] 0 2023-12-17T11:58:01.811 INFO:tasks.workunit.client.1.smithi119.stdout:1/986: dwrite d3/db/d17/d24/f3c [0,4194304] 0 2023-12-17T11:58:01.811 INFO:tasks.workunit.client.1.smithi119.stdout:6/905: dread d2/d41/f68 [0,4194304] 0 2023-12-17T11:58:01.811 INFO:tasks.workunit.client.0.smithi002.stdout:4/951: dwrite d0/d5a/f76 [0,4194304] 0 2023-12-17T11:58:01.812 INFO:tasks.workunit.client.1.smithi119.stdout:0/957: rmdir d2/d66/d2e/d44/d7b/d5/dc 39 2023-12-17T11:58:01.815 INFO:tasks.workunit.client.1.smithi119.stdout:1/987: mkdir d3/db/d17/d24/d20/d40/d76/d84/d119/d163 0 2023-12-17T11:58:01.815 INFO:tasks.workunit.client.1.smithi119.stdout:1/988: fdatasync d3/db/f1f 0 2023-12-17T11:58:01.815 INFO:tasks.workunit.client.1.smithi119.stdout:1/989: chown d3/db/d17/d24/d20/d40/d76/d84/cd0 42742291 1 2023-12-17T11:58:01.815 INFO:tasks.workunit.client.0.smithi002.stdout:4/952: mkdir d0/d10/d21/d119/d121/d133 0 2023-12-17T11:58:01.816 INFO:tasks.workunit.client.0.smithi002.stdout:4/953: chown d0/d10/d14/d27/d57/de7 0 1 2023-12-17T11:58:01.816 INFO:tasks.workunit.client.1.smithi119.stdout:6/906: mkdir d2/d61/d122 0 2023-12-17T11:58:01.816 INFO:tasks.workunit.client.1.smithi119.stdout:6/907: chown d2/d9b/dac/cb7 2478 1 2023-12-17T11:58:01.817 INFO:tasks.workunit.client.0.smithi002.stdout:4/954: creat d0/d3e/dc8/dcd/f134 x:0 0 0 2023-12-17T11:58:01.819 INFO:tasks.workunit.client.1.smithi119.stdout:6/908: getdents d2/d7e/dbc 0 2023-12-17T11:58:01.834 INFO:tasks.workunit.client.1.smithi119.stdout:0/958: dread d2/d16/f6f [0,4194304] 0 2023-12-17T11:58:01.835 INFO:tasks.workunit.client.1.smithi119.stdout:0/959: write d2/dcc/fce [969405,27342] 0 2023-12-17T11:58:01.836 INFO:tasks.workunit.client.1.smithi119.stdout:0/960: rmdir d2/d66/d1f/d24/d50/d5d 39 2023-12-17T11:58:01.837 INFO:tasks.workunit.client.0.smithi002.stdout:0/984: sync 2023-12-17T11:58:01.837 INFO:tasks.workunit.client.1.smithi119.stdout:0/961: symlink d2/d66/d1f/d24/d50/l127 0 2023-12-17T11:58:01.839 INFO:tasks.workunit.client.1.smithi119.stdout:0/962: symlink d2/d66/d1f/l128 0 2023-12-17T11:58:01.839 INFO:tasks.workunit.client.0.smithi002.stdout:4/955: write d0/d3e/d41/fcb [3006418,9341] 0 2023-12-17T11:58:01.840 INFO:tasks.workunit.client.0.smithi002.stdout:4/956: chown d0/d10/d21/l5b 238952598 1 2023-12-17T11:58:01.841 INFO:tasks.workunit.client.1.smithi119.stdout:8/917: dwrite d7/da/d1a/fdc [4194304,4194304] 0 2023-12-17T11:58:01.841 INFO:tasks.workunit.client.1.smithi119.stdout:8/918: read - d7/d18/d15/d81/f125 zero size 2023-12-17T11:58:01.841 INFO:tasks.workunit.client.1.smithi119.stdout:8/919: fdatasync d7/d18/d45/d9f/d7b/df9/f10d 0 2023-12-17T11:58:01.842 INFO:tasks.workunit.client.0.smithi002.stdout:4/957: creat d0/d10/d21/f135 x:0 0 0 2023-12-17T11:58:01.843 INFO:tasks.workunit.client.1.smithi119.stdout:8/920: creat d7/d18/d45/f12d x:0 0 0 2023-12-17T11:58:01.843 INFO:tasks.workunit.client.1.smithi119.stdout:6/909: dread d2/da3/ff4 [0,4194304] 0 2023-12-17T11:58:01.849 INFO:tasks.workunit.client.1.smithi119.stdout:8/921: link d7/da/d1a/d84/ca1 d7/d18/d15/c12e 0 2023-12-17T11:58:01.850 INFO:tasks.workunit.client.1.smithi119.stdout:8/922: fsync d7/da/d1a/d8a/ddb/dbf/f112 0 2023-12-17T11:58:01.850 INFO:tasks.workunit.client.1.smithi119.stdout:8/923: read - d7/da/d11/d26/d49/fdd zero size 2023-12-17T11:58:01.851 INFO:tasks.workunit.client.1.smithi119.stdout:8/924: truncate d7/d18/d45/d9f/f6a 3022279 0 2023-12-17T11:58:01.851 INFO:tasks.workunit.client.1.smithi119.stdout:8/925: stat d7/d12/d23/db4/cd5 0 2023-12-17T11:58:01.853 INFO:tasks.workunit.client.1.smithi119.stdout:6/910: rename d2/da3/f117 to d2/d2b/d43/dcb/f123 0 2023-12-17T11:58:01.853 INFO:tasks.workunit.client.1.smithi119.stdout:0/963: fsync d2/d66/d2e/d44/fbe 0 2023-12-17T11:58:01.854 INFO:tasks.workunit.client.1.smithi119.stdout:8/926: symlink d7/d18/d45/d9f/l12f 0 2023-12-17T11:58:01.856 INFO:tasks.workunit.client.1.smithi119.stdout:0/964: link d2/d66/d2e/c116 d2/d66/d1f/d24/d50/d5d/c129 0 2023-12-17T11:58:01.857 INFO:tasks.workunit.client.1.smithi119.stdout:1/990: dwrite d3/f15e [0,4194304] 0 2023-12-17T11:58:01.857 INFO:tasks.workunit.client.1.smithi119.stdout:7/991: dwrite d2/d4/d11/d3c/d75/fbc [0,4194304] 0 2023-12-17T11:58:01.861 INFO:tasks.workunit.client.1.smithi119.stdout:0/965: symlink d2/d66/dbb/dcd/dd3/l12a 0 2023-12-17T11:58:01.863 INFO:tasks.workunit.client.1.smithi119.stdout:1/991: rename d3/db/d17/d24/d20/d40/f5b to d3/d44/dfd/d64/db2/d14e/f164 0 2023-12-17T11:58:01.867 INFO:tasks.workunit.client.1.smithi119.stdout:7/992: symlink d2/d4/d11/d2c/d68/d99/d6c/def/l13c 0 2023-12-17T11:58:01.867 INFO:tasks.workunit.client.1.smithi119.stdout:8/927: getdents d7/d18/d45/d9f/d7b 0 2023-12-17T11:58:01.868 INFO:tasks.workunit.client.1.smithi119.stdout:8/928: fsync d7/d12/d23/f38 0 2023-12-17T11:58:01.870 INFO:tasks.workunit.client.1.smithi119.stdout:6/911: write d2/d2b/d43/de6/f55 [6178102,108429] 0 2023-12-17T11:58:01.887 INFO:tasks.workunit.client.1.smithi119.stdout:7/993: dread d2/f10 [0,4194304] 0 2023-12-17T11:58:01.904 INFO:tasks.workunit.client.0.smithi002.stdout:0/985: dwrite d0/d6/d26/d14/d90/d64/fe1 [0,4194304] 0 2023-12-17T11:58:01.905 INFO:tasks.workunit.client.0.smithi002.stdout:4/958: dread d0/d10/d14/d27/d69/d108/d65/f67 [0,4194304] 0 2023-12-17T11:58:01.905 INFO:tasks.workunit.client.0.smithi002.stdout:4/959: truncate d0/d3e/f101 1231457 0 2023-12-17T11:58:01.906 INFO:tasks.workunit.client.0.smithi002.stdout:4/960: chown d0/d10/d14/d27/d57/d7d/fb7 0 1 2023-12-17T11:58:01.906 INFO:tasks.workunit.client.1.smithi119.stdout:1/992: dwrite d3/db/d17/f8e [0,4194304] 0 2023-12-17T11:58:01.911 INFO:tasks.workunit.client.1.smithi119.stdout:0/966: dwrite d2/d16/f7c [0,4194304] 0 2023-12-17T11:58:01.952 INFO:tasks.workunit.client.1.smithi119.stdout:7/994: mkdir d2/d4/d11/d2c/d68/d99/d6c/def/d13d 0 2023-12-17T11:58:01.952 INFO:tasks.workunit.client.1.smithi119.stdout:7/995: dread - d2/d4/d11/d2c/d55/d103/f118 zero size 2023-12-17T11:58:01.952 INFO:tasks.workunit.client.1.smithi119.stdout:7/996: chown d2/d4/d11/d2c/d68/d6a/f10c 835 1 2023-12-17T11:58:01.952 INFO:tasks.workunit.client.1.smithi119.stdout:7/997: write d2/d4/f29 [626038,119322] 0 2023-12-17T11:58:01.954 INFO:tasks.workunit.client.1.smithi119.stdout:8/929: write d7/da/d1a/d84/d104/d105/f107 [1025845,11042] 0 2023-12-17T11:58:01.954 INFO:tasks.workunit.client.1.smithi119.stdout:8/930: readlink d7/da/d1a/d84/d111/lcc 0 2023-12-17T11:58:01.993 INFO:tasks.workunit.client.1.smithi119.stdout:1/993: mkdir d3/d44/dfd/d64/d165 0 2023-12-17T11:58:02.009 INFO:tasks.workunit.client.1.smithi119.stdout:0/967: rmdir d2/d66/d1f/d24/d50/d5d/d80 39 2023-12-17T11:58:02.032 INFO:tasks.workunit.client.0.smithi002.stdout:0/986: creat d0/d6/d26/d14/d19/d37/d91/f140 x:0 0 0 2023-12-17T11:58:02.032 INFO:tasks.workunit.client.0.smithi002.stdout:0/987: truncate d0/d6/d26/d14/d19/d37/d62/db8/ddd/f10a 4627560 0 2023-12-17T11:58:02.049 INFO:tasks.workunit.client.0.smithi002.stdout:4/961: creat d0/d10/d21/d119/d121/f136 x:0 0 0 2023-12-17T11:58:02.073 INFO:tasks.workunit.client.1.smithi119.stdout:7/998: getdents d2/d4/d70/dac 0 2023-12-17T11:58:02.076 INFO:tasks.workunit.client.1.smithi119.stdout:8/931: getdents d7/d18/d15/d10f 0 2023-12-17T11:58:02.084 INFO:tasks.workunit.client.1.smithi119.stdout:0/968: symlink d2/d66/d2e/d44/d7b/dbc/df4/l12b 0 2023-12-17T11:58:02.094 INFO:tasks.workunit.client.1.smithi119.stdout:8/932: mknod d7/da/d1a/d84/d111/c130 0 2023-12-17T11:58:02.097 INFO:tasks.workunit.client.1.smithi119.stdout:1/994: getdents d3/db/d17/d24/d20/dbd/dcb 0 2023-12-17T11:58:02.104 INFO:tasks.workunit.client.1.smithi119.stdout:1/995: creat d3/db/d17/d24/d20/d6c/f166 x:0 0 0 2023-12-17T11:58:02.137 INFO:tasks.workunit.client.0.smithi002.stdout:4/962: link d0/f8a d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/f137 0 2023-12-17T11:58:02.140 INFO:tasks.workunit.client.0.smithi002.stdout:4/963: mknod d0/d3e/dc8/dcd/dd5/c138 0 2023-12-17T11:58:02.140 INFO:tasks.workunit.client.0.smithi002.stdout:4/964: write d0/d10/d14/d27/d57/f125 [60860,125773] 0 2023-12-17T11:58:02.140 INFO:tasks.workunit.client.0.smithi002.stdout:4/965: fsync d0/d3e/d41/fcb 0 2023-12-17T11:58:02.143 INFO:tasks.workunit.client.1.smithi119.stdout:8/933: dwrite d7/d12/d23/fd1 [0,4194304] 0 2023-12-17T11:58:02.144 INFO:tasks.workunit.client.1.smithi119.stdout:1/996: dwrite d3/f15e [0,4194304] 0 2023-12-17T11:58:02.144 INFO:tasks.workunit.client.1.smithi119.stdout:1/997: chown d3/db/d26/d8f/fa8 163 1 2023-12-17T11:58:02.145 INFO:tasks.workunit.client.1.smithi119.stdout:1/998: creat d3/db/d26/d8f/dd1/d13a/f167 x:0 0 0 2023-12-17T11:58:02.160 INFO:tasks.workunit.client.1.smithi119.stdout:1/999: dread d3/db/d17/d24/f3c [0,4194304] 0 2023-12-17T11:58:02.161 INFO:tasks.workunit.client.1.smithi119.stdout:7/999: rename d2/d40/dc3/dc8/d116 to d2/d4/d13e 0 2023-12-17T11:58:02.165 INFO:tasks.workunit.client.1.smithi119.stdout:6/912: mkdir d2/d2b/d43/de6/d17/d124 0 2023-12-17T11:58:02.167 INFO:tasks.workunit.client.1.smithi119.stdout:6/913: rename d2/d2b/d43/de6/d17/f5f to d2/d2b/d100/f125 0 2023-12-17T11:58:02.170 INFO:tasks.workunit.client.1.smithi119.stdout:6/914: unlink d2/d2b/d43/de6/d17/fe7 0 2023-12-17T11:58:02.170 INFO:tasks.workunit.client.1.smithi119.stdout:6/915: readlink d2/d2b/d43/de6/d17/d79/l7b 0 2023-12-17T11:58:02.170 INFO:tasks.workunit.client.1.smithi119.stdout:6/916: chown d2/d2b/d43/d76/d8d 4587 1 2023-12-17T11:58:02.172 INFO:tasks.workunit.client.1.smithi119.stdout:6/917: unlink d2/d2b/d43/de6/d17/c2c 0 2023-12-17T11:58:02.172 INFO:tasks.workunit.client.1.smithi119.stdout:6/918: truncate d2/d2b/d43/de6/d17/d79/f7d 1542048 0 2023-12-17T11:58:02.173 INFO:tasks.workunit.client.1.smithi119.stdout:6/919: truncate d2/d2b/d43/de6/d17/d79/f96 5477795 0 2023-12-17T11:58:02.176 INFO:tasks.workunit.client.1.smithi119.stdout:6/920: truncate d2/d2b/d43/de6/d17/f4e 4321020 0 2023-12-17T11:58:02.177 INFO:tasks.workunit.client.1.smithi119.stdout:6/921: write d2/d2b/d43/de6/d17/f34 [3953886,111235] 0 2023-12-17T11:58:02.188 INFO:tasks.workunit.client.1.smithi119.stdout:8/934: dwrite d7/d18/d45/d9f/d7b/df9/f10d [0,4194304] 0 2023-12-17T11:58:02.198 INFO:tasks.workunit.client.0.smithi002.stdout:4/966: dwrite d0/d10/d14/d27/d69/d108/d65/d78/f10e [4194304,4194304] 0 2023-12-17T11:58:02.198 INFO:tasks.workunit.client.1.smithi119.stdout:0/969: rmdir d2/d66/dbb 39 2023-12-17T11:58:02.198 INFO:tasks.workunit.client.1.smithi119.stdout:0/970: chown d2/d66/d2e/d44/d7b/d5/dc/faa 1843763 1 2023-12-17T11:58:02.198 INFO:tasks.workunit.client.1.smithi119.stdout:0/971: readlink d2/d66/d1f/l42 0 2023-12-17T11:58:02.205 INFO:tasks.workunit.client.0.smithi002.stdout:4/967: creat d0/d3e/da5/daf/f139 x:0 0 0 2023-12-17T11:58:02.213 INFO:tasks.workunit.client.0.smithi002.stdout:4/968: dread d0/f8 [0,4194304] 0 2023-12-17T11:58:02.214 INFO:tasks.workunit.client.0.smithi002.stdout:4/969: mkdir d0/d3e/d47/d12d/d13a 0 2023-12-17T11:58:02.216 INFO:tasks.workunit.client.0.smithi002.stdout:4/970: mkdir d0/d3e/d41/d13b 0 2023-12-17T11:58:02.220 INFO:tasks.workunit.client.0.smithi002.stdout:4/971: link d0/d5a/c62 d0/d10/d21/c13c 0 2023-12-17T11:58:02.220 INFO:tasks.workunit.client.0.smithi002.stdout:4/972: write d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/f137 [2835141,122665] 0 2023-12-17T11:58:02.225 INFO:tasks.workunit.client.1.smithi119.stdout:6/922: dwrite d2/d2b/d43/dcb/f123 [8388608,4194304] 0 2023-12-17T11:58:02.225 INFO:tasks.workunit.client.1.smithi119.stdout:6/923: fdatasync d2/f19 0 2023-12-17T11:58:02.226 INFO:tasks.workunit.client.1.smithi119.stdout:6/924: mknod d2/c126 0 2023-12-17T11:58:02.229 INFO:tasks.workunit.client.1.smithi119.stdout:8/935: read d7/d18/f5f [3062568,66673] 0 2023-12-17T11:58:02.230 INFO:tasks.workunit.client.1.smithi119.stdout:8/936: write d7/d12/d23/f7d [5656020,41612] 0 2023-12-17T11:58:02.232 INFO:tasks.workunit.client.0.smithi002.stdout:0/988: sync 2023-12-17T11:58:02.232 INFO:tasks.workunit.client.1.smithi119.stdout:8/937: unlink d7/d18/c3b 0 2023-12-17T11:58:02.233 INFO:tasks.workunit.client.0.smithi002.stdout:0/989: rename d0/d6/d26/d14/d19/d37/fda to d0/d6/d26/d8f/d12c/f141 0 2023-12-17T11:58:02.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/990: unlink d0/d6/d26/d14/d19/d61/de3/f8b 0 2023-12-17T11:58:02.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/991: write d0/d6/d26/d14/f10b [1582655,112182] 0 2023-12-17T11:58:02.236 INFO:tasks.workunit.client.0.smithi002.stdout:0/992: fdatasync d0/d6/d26/d14/f114 0 2023-12-17T11:58:02.242 INFO:tasks.workunit.client.0.smithi002.stdout:4/973: fsync d0/d3e/da5/daf/f139 0 2023-12-17T11:58:02.245 INFO:tasks.workunit.client.0.smithi002.stdout:4/974: mkdir d0/d10/d14/d27/d69/d108/d13d 0 2023-12-17T11:58:02.248 INFO:tasks.workunit.client.0.smithi002.stdout:4/975: truncate d0/d3e/da5/f11a 834195 0 2023-12-17T11:58:02.248 INFO:tasks.workunit.client.0.smithi002.stdout:4/976: read d0/d10/d14/d4e/f9c [903544,124466] 0 2023-12-17T11:58:02.281 INFO:tasks.workunit.client.1.smithi119.stdout:6/925: dwrite d2/d2b/d43/f4a [0,4194304] 0 2023-12-17T11:58:02.281 INFO:tasks.workunit.client.1.smithi119.stdout:8/938: dwrite d7/da/d11/d26/f58 [0,4194304] 0 2023-12-17T11:58:02.283 INFO:tasks.workunit.client.1.smithi119.stdout:6/926: symlink d2/d2b/d43/d5e/d92/l127 0 2023-12-17T11:58:02.285 INFO:tasks.workunit.client.1.smithi119.stdout:8/939: rename d7/da/d11/d26/d49/l5c to d7/da/d1a/d8a/ddb/dbf/dfc/l131 0 2023-12-17T11:58:02.285 INFO:tasks.workunit.client.1.smithi119.stdout:8/940: write d7/da/d11/d26/d49/f79 [1165253,59667] 0 2023-12-17T11:58:02.286 INFO:tasks.workunit.client.1.smithi119.stdout:6/927: mkdir d2/d61/d110/d128 0 2023-12-17T11:58:02.286 INFO:tasks.workunit.client.1.smithi119.stdout:6/928: chown d2/d2b/d43/de6/c3e 0 1 2023-12-17T11:58:02.287 INFO:tasks.workunit.client.0.smithi002.stdout:4/977: dread d0/d10/d14/d4e/fbe [0,4194304] 0 2023-12-17T11:58:02.288 INFO:tasks.workunit.client.1.smithi119.stdout:6/929: link d2/d61/c72 d2/d41/c129 0 2023-12-17T11:58:02.288 INFO:tasks.workunit.client.1.smithi119.stdout:6/930: dread - d2/d2b/d43/dcb/ff7 zero size 2023-12-17T11:58:02.289 INFO:tasks.workunit.client.1.smithi119.stdout:6/931: getdents d2/d9b 0 2023-12-17T11:58:02.289 INFO:tasks.workunit.client.1.smithi119.stdout:6/932: chown d2/d2b/l6b 18327 1 2023-12-17T11:58:02.289 INFO:tasks.workunit.client.1.smithi119.stdout:6/933: chown d2/c126 105954715 1 2023-12-17T11:58:02.290 INFO:tasks.workunit.client.1.smithi119.stdout:6/934: symlink d2/d41/l12a 0 2023-12-17T11:58:02.291 INFO:tasks.workunit.client.1.smithi119.stdout:6/935: mknod d2/c12b 0 2023-12-17T11:58:02.292 INFO:tasks.workunit.client.1.smithi119.stdout:6/936: mkdir d2/d2b/d43/d5e/d12c 0 2023-12-17T11:58:02.292 INFO:tasks.workunit.client.1.smithi119.stdout:6/937: chown d2/d7e/d93/ce1 893740215 1 2023-12-17T11:58:02.293 INFO:tasks.workunit.client.1.smithi119.stdout:6/938: truncate d2/da3/d11a/fa7 547196 0 2023-12-17T11:58:02.293 INFO:tasks.workunit.client.1.smithi119.stdout:6/939: chown d2/d2b/f84 58104 1 2023-12-17T11:58:02.293 INFO:tasks.workunit.client.1.smithi119.stdout:6/940: fdatasync d2/d2b/f63 0 2023-12-17T11:58:02.294 INFO:tasks.workunit.client.1.smithi119.stdout:6/941: mknod d2/d2b/d43/dee/d10e/c12d 0 2023-12-17T11:58:02.295 INFO:tasks.workunit.client.0.smithi002.stdout:0/993: dwrite d0/d6/fb [0,4194304] 0 2023-12-17T11:58:02.295 INFO:tasks.workunit.client.1.smithi119.stdout:6/942: symlink d2/d2b/d43/de6/l12e 0 2023-12-17T11:58:02.303 INFO:tasks.workunit.client.0.smithi002.stdout:0/994: dread d0/d6/d26/d14/d90/f105 [0,4194304] 0 2023-12-17T11:58:02.303 INFO:tasks.workunit.client.0.smithi002.stdout:0/995: creat d0/d6/d26/d14/d19/d37/dcf/f142 x:0 0 0 2023-12-17T11:58:02.314 INFO:tasks.workunit.client.0.smithi002.stdout:4/978: dread d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/f137 [0,4194304] 0 2023-12-17T11:58:02.325 INFO:tasks.workunit.client.1.smithi119.stdout:8/941: dwrite d7/d18/d45/d9f/d7b/fdf [0,4194304] 0 2023-12-17T11:58:02.327 INFO:tasks.workunit.client.1.smithi119.stdout:8/942: creat d7/d102/f132 x:0 0 0 2023-12-17T11:58:02.327 INFO:tasks.workunit.client.1.smithi119.stdout:8/943: stat d7/d12/l2d 0 2023-12-17T11:58:02.330 INFO:tasks.workunit.client.1.smithi119.stdout:6/943: dwrite d2/d41/f68 [4194304,4194304] 0 2023-12-17T11:58:02.334 INFO:tasks.workunit.client.1.smithi119.stdout:6/944: rename d2/d2b/f3d to d2/d2b/d43/d76/d8d/f12f 0 2023-12-17T11:58:02.334 INFO:tasks.workunit.client.1.smithi119.stdout:6/945: write d2/d2b/d43/dcb/f121 [153129,26594] 0 2023-12-17T11:58:02.334 INFO:tasks.workunit.client.1.smithi119.stdout:6/946: readlink d2/d2b/d43/d5e/d92/l127 0 2023-12-17T11:58:02.340 INFO:tasks.workunit.client.1.smithi119.stdout:6/947: creat d2/d2b/d43/d5e/d12c/f130 x:0 0 0 2023-12-17T11:58:02.341 INFO:tasks.workunit.client.1.smithi119.stdout:6/948: getdents d2/d61/d110 0 2023-12-17T11:58:02.343 INFO:tasks.workunit.client.1.smithi119.stdout:6/949: mkdir d2/d2b/d43/d131 0 2023-12-17T11:58:02.343 INFO:tasks.workunit.client.1.smithi119.stdout:6/950: stat d2/d2b/d43/dee/d10e 0 2023-12-17T11:58:02.343 INFO:tasks.workunit.client.1.smithi119.stdout:6/951: readlink d2/da3/d11a/l101 0 2023-12-17T11:58:02.344 INFO:tasks.workunit.client.1.smithi119.stdout:6/952: unlink d2/d2b/d43/dcb/c11b 0 2023-12-17T11:58:02.347 INFO:tasks.workunit.client.0.smithi002.stdout:4/979: write d0/d10/d14/d27/d69/d108/d65/d78/f10e [225002,3404] 0 2023-12-17T11:58:02.350 INFO:tasks.workunit.client.0.smithi002.stdout:4/980: unlink d0/d3e/d41/lc4 0 2023-12-17T11:58:02.362 INFO:tasks.workunit.client.0.smithi002.stdout:0/996: dwrite d0/d6/d26/d14/d19/d37/dcf/f71 [0,4194304] 0 2023-12-17T11:58:02.364 INFO:tasks.workunit.client.0.smithi002.stdout:0/997: rmdir d0/d6/d26/d14/d6d 39 2023-12-17T11:58:02.365 INFO:tasks.workunit.client.0.smithi002.stdout:0/998: mkdir d0/d6/d26/d14/d90/d64/d143 0 2023-12-17T11:58:02.368 INFO:tasks.workunit.client.0.smithi002.stdout:0/999: link d0/d6/d26/d14/d19/d37/dcf/f142 d0/d6/d26/d14/d19/d61/dbf/f144 0 2023-12-17T11:58:02.370 INFO:tasks.workunit.client.0.smithi002.stdout:4/981: dread d0/d10/f25 [0,4194304] 0 2023-12-17T11:58:02.372 INFO:tasks.workunit.client.0.smithi002.stdout:4/982: rename d0/c23 to d0/dfa/c13e 0 2023-12-17T11:58:02.373 INFO:tasks.workunit.client.0.smithi002.stdout:4/983: link d0/d3e/d41/fef d0/d3e/d47/d12d/d13a/f13f 0 2023-12-17T11:58:02.374 INFO:tasks.workunit.client.0.smithi002.stdout:4/984: symlink d0/d10/d21/d119/d121/d133/l140 0 2023-12-17T11:58:02.376 INFO:tasks.workunit.client.0.smithi002.stdout:4/985: rmdir d0/d10/d14/d27/d69/d108/d65/d78 39 2023-12-17T11:58:02.376 INFO:tasks.workunit.client.0.smithi002.stdout:4/986: readlink d0/d10/d14/d27/d69/d108/d65/l7e 0 2023-12-17T11:58:02.376 INFO:tasks.workunit.client.0.smithi002.stdout:4/987: fsync d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/f137 0 2023-12-17T11:58:02.377 INFO:tasks.workunit.client.1.smithi119.stdout:8/944: dwrite d7/da/d1a/d84/d104/f11c [0,4194304] 0 2023-12-17T11:58:02.380 INFO:tasks.workunit.client.1.smithi119.stdout:6/953: dwrite d2/d2b/d43/d76/d8d/dc2/fe2 [0,4194304] 0 2023-12-17T11:58:02.382 INFO:tasks.workunit.client.1.smithi119.stdout:8/945: rename d7/d18/d45/d9f/d7b/cd3 to d7/d18/d15/d81/c133 0 2023-12-17T11:58:02.387 INFO:tasks.workunit.client.1.smithi119.stdout:8/946: mkdir d7/da/d1a/d84/d111/d129/d134 0 2023-12-17T11:58:02.392 INFO:tasks.workunit.client.0.smithi002.stdout:4/988: write d0/d10/d21/d33/f37 [1722680,67128] 0 2023-12-17T11:58:02.392 INFO:tasks.workunit.client.0.smithi002.stdout:4/989: fdatasync d0/d10/d14/d27/d69/d108/d65/d78/d85/da3/d10d/fde 0 2023-12-17T11:58:02.392 INFO:tasks.workunit.client.0.smithi002.stdout:4/990: dread - d0/d10/d14/d27/d69/d108/f112 zero size 2023-12-17T11:58:02.394 INFO:tasks.workunit.client.0.smithi002.stdout:4/991: link d0/d10/f30 d0/d10/d14/d27/d57/d7d/f141 0 2023-12-17T11:58:02.395 INFO:tasks.workunit.client.0.smithi002.stdout:4/992: mkdir d0/d3e/d41/d142 0 2023-12-17T11:58:02.396 INFO:tasks.workunit.client.0.smithi002.stdout:4/993: write d0/d10/d14/d27/d69/d108/d65/d78/f91 [3356219,77261] 0 2023-12-17T11:58:02.402 INFO:tasks.workunit.client.0.smithi002.stdout:4/994: rmdir d0/d3e/d41 39 2023-12-17T11:58:02.402 INFO:tasks.workunit.client.0.smithi002.stdout:4/995: creat d0/d10/d21/d119/d121/f143 x:0 0 0 2023-12-17T11:58:02.404 INFO:tasks.workunit.client.0.smithi002.stdout:4/996: rename d0/d10/d14/d27/d69/d108/l118 to d0/d6c/dda/de1/l144 0 2023-12-17T11:58:02.405 INFO:tasks.workunit.client.0.smithi002.stdout:4/997: creat d0/dfa/f145 x:0 0 0 2023-12-17T11:58:02.419 INFO:tasks.workunit.client.1.smithi119.stdout:8/947: dwrite d7/d18/d45/f124 [0,4194304] 0 2023-12-17T11:58:02.420 INFO:tasks.workunit.client.0.smithi002.stdout:4/998: write d0/d10/d14/d27/d69/d108/d99/fb8 [3213588,112189] 0 2023-12-17T11:58:02.422 INFO:tasks.workunit.client.0.smithi002.stdout:4/999: symlink d0/d6c/dda/de1/l146 0 2023-12-17T11:58:02.427 INFO:tasks.workunit.client.1.smithi119.stdout:8/948: unlink d7/l9 0 2023-12-17T11:58:02.427 INFO:tasks.workunit.client.1.smithi119.stdout:8/949: chown d7/da/d11 34 1 2023-12-17T11:58:02.428 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:02 smithi002 ceph-mon[107131]: Upgrade: Updating mgr.smithi002.cqnuqs 2023-12-17T11:58:02.428 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:02 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:02.428 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:02 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:58:02.428 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:02 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:58:02.428 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:02 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:58:02.428 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:02 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:02.429 INFO:tasks.workunit.client.1.smithi119.stdout:8/950: symlink d7/d18/d45/l135 0 2023-12-17T11:58:02.429 INFO:tasks.workunit.client.1.smithi119.stdout:8/951: dread - d7/d18/d15/d81/f125 zero size 2023-12-17T11:58:02.429 INFO:tasks.workunit.client.1.smithi119.stdout:8/952: chown d7/d18/d45/d9f/l42 1 1 2023-12-17T11:58:02.430 INFO:tasks.workunit.client.1.smithi119.stdout:8/953: creat d7/da/d1a/d84/d111/d129/d134/f136 x:0 0 0 2023-12-17T11:58:02.431 INFO:tasks.workunit.client.1.smithi119.stdout:8/954: creat d7/da/d11/d100/f137 x:0 0 0 2023-12-17T11:58:02.431 INFO:tasks.workunit.client.0.smithi002.stderr:+ rm -rf -- ./tmp.zCoIgMnCl9 2023-12-17T11:58:02.463 INFO:tasks.workunit.client.1.smithi119.stdout:8/955: dwrite d7/da/d11/f13 [0,4194304] 0 2023-12-17T11:58:02.464 INFO:tasks.workunit.client.1.smithi119.stdout:8/956: read - d7/da/d1a/d8a/ddb/f101 zero size 2023-12-17T11:58:02.499 INFO:tasks.workunit.client.1.smithi119.stdout:8/957: dwrite d7/d18/d45/d9f/d7b/fb6 [0,4194304] 0 2023-12-17T11:58:02.502 INFO:tasks.workunit.client.1.smithi119.stdout:8/958: mkdir d7/da/d1a/d8a/ddb/dbf/dfc/d138 0 2023-12-17T11:58:02.502 INFO:tasks.workunit.client.1.smithi119.stdout:8/959: write d7/d18/f5f [3323445,109457] 0 2023-12-17T11:58:02.504 INFO:tasks.workunit.client.1.smithi119.stdout:8/960: creat d7/d18/f139 x:0 0 0 2023-12-17T11:58:02.506 INFO:tasks.workunit.client.1.smithi119.stdout:8/961: rename d7/da/d11/d60/fa8 to d7/da/d1a/d84/d104/d105/f13a 0 2023-12-17T11:58:02.506 INFO:tasks.workunit.client.1.smithi119.stdout:8/962: chown d7/da/d1a/d84/d104/d105/f13a 3860 1 2023-12-17T11:58:02.554 INFO:tasks.workunit.client.1.smithi119.stdout:8/963: dwrite d7/d12/fe6 [0,4194304] 0 2023-12-17T11:58:02.565 INFO:tasks.workunit.client.1.smithi119.stdout:6/954: sync 2023-12-17T11:58:02.565 INFO:tasks.workunit.client.1.smithi119.stdout:0/972: sync 2023-12-17T11:58:02.578 INFO:tasks.workunit.client.1.smithi119.stdout:0/973: dread d2/d66/d2e/d44/fb9 [0,4194304] 0 2023-12-17T11:58:02.582 INFO:tasks.workunit.client.1.smithi119.stdout:0/974: creat d2/d66/d1f/f12c x:0 0 0 2023-12-17T11:58:02.586 INFO:tasks.workunit.client.1.smithi119.stdout:6/955: write d2/d7e/dbc/fe4 [2956872,60958] 0 2023-12-17T11:58:02.587 INFO:tasks.workunit.client.1.smithi119.stdout:6/956: symlink d2/d2b/d43/d76/d8d/dc2/l132 0 2023-12-17T11:58:02.595 INFO:tasks.workunit.client.1.smithi119.stdout:8/964: dwrite d7/d12/d23/f38 [0,4194304] 0 2023-12-17T11:58:02.600 INFO:tasks.workunit.client.1.smithi119.stdout:8/965: getdents d7/d12/d69/d98 0 2023-12-17T11:58:02.602 INFO:tasks.workunit.client.1.smithi119.stdout:6/957: write d2/d2b/f52 [1749262,36670] 0 2023-12-17T11:58:02.602 INFO:tasks.workunit.client.1.smithi119.stdout:6/958: readlink d2/d2b/d43/d76/d8d/lc0 0 2023-12-17T11:58:02.605 INFO:tasks.workunit.client.1.smithi119.stdout:8/966: unlink d7/d12/d23/d9c/dea/f12c 0 2023-12-17T11:58:02.621 INFO:tasks.workunit.client.1.smithi119.stdout:6/959: dread d2/d61/d8a/f9a [0,4194304] 0 2023-12-17T11:58:02.621 INFO:tasks.workunit.client.1.smithi119.stdout:6/960: dread - d2/d2b/ff9 zero size 2023-12-17T11:58:02.621 INFO:tasks.workunit.client.1.smithi119.stdout:6/961: readlink d2/d2b/l6b 0 2023-12-17T11:58:02.624 INFO:tasks.workunit.client.1.smithi119.stdout:8/967: dread d7/d12/f33 [0,4194304] 0 2023-12-17T11:58:02.624 INFO:tasks.workunit.client.1.smithi119.stdout:8/968: write d7/d12/d23/db4/f91 [3779925,72702] 0 2023-12-17T11:58:02.626 INFO:tasks.workunit.client.1.smithi119.stdout:6/962: mknod d2/da3/c133 0 2023-12-17T11:58:02.628 INFO:tasks.workunit.client.1.smithi119.stdout:8/969: getdents d7/da/d1a/d8a/ddb 0 2023-12-17T11:58:02.631 INFO:tasks.workunit.client.1.smithi119.stdout:6/963: unlink d2/d9b/d10d/f119 0 2023-12-17T11:58:02.633 INFO:tasks.workunit.client.1.smithi119.stdout:0/975: dwrite d2/d16/fbf [0,4194304] 0 2023-12-17T11:58:02.644 INFO:tasks.workunit.client.1.smithi119.stdout:0/976: symlink d2/d66/d2e/d44/d7b/d5/dc/l12d 0 2023-12-17T11:58:02.650 INFO:tasks.workunit.client.1.smithi119.stdout:0/977: symlink d2/d66/dbb/l12e 0 2023-12-17T11:58:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:02 smithi119 ceph-mon[117414]: Upgrade: Updating mgr.smithi002.cqnuqs 2023-12-17T11:58:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:02 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:02 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:58:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:02 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:58:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:02 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:58:02.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:02 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:02.665 INFO:tasks.workunit.client.1.smithi119.stdout:0/978: dread d2/f6b [0,4194304] 0 2023-12-17T11:58:02.665 INFO:tasks.workunit.client.1.smithi119.stdout:0/979: fdatasync d2/d16/d35/f85 0 2023-12-17T11:58:02.668 INFO:tasks.workunit.client.1.smithi119.stdout:0/980: mknod d2/df7/c12f 0 2023-12-17T11:58:02.701 INFO:tasks.workunit.client.1.smithi119.stdout:8/970: dwrite d7/d18/d45/fcb [0,4194304] 0 2023-12-17T11:58:02.701 INFO:tasks.workunit.client.1.smithi119.stdout:8/971: readlink d7/d12/d69/l9d 0 2023-12-17T11:58:02.709 INFO:tasks.workunit.client.1.smithi119.stdout:6/964: dwrite d2/d2b/d43/de6/d17/f4e [0,4194304] 0 2023-12-17T11:58:02.718 INFO:tasks.workunit.client.1.smithi119.stdout:8/972: dread d7/da/d11/d26/d49/f5e [0,4194304] 0 2023-12-17T11:58:02.724 INFO:tasks.workunit.client.1.smithi119.stdout:6/965: write d2/d7e/d93/fb2 [329762,69817] 0 2023-12-17T11:58:02.724 INFO:tasks.workunit.client.1.smithi119.stdout:6/966: chown d2/d2b/d43/d76/d8d/dc2/l132 85 1 2023-12-17T11:58:02.727 INFO:tasks.workunit.client.1.smithi119.stdout:6/967: unlink d2/d2b/d43/dee/d10e/c12d 0 2023-12-17T11:58:02.727 INFO:tasks.workunit.client.1.smithi119.stdout:6/968: truncate d2/d2b/d43/d5e/db3/fd1 925813 0 2023-12-17T11:58:02.727 INFO:tasks.workunit.client.1.smithi119.stdout:6/969: write d2/d2b/d43/de6/d17/f7c [9026896,55221] 0 2023-12-17T11:58:02.728 INFO:tasks.workunit.client.1.smithi119.stdout:6/970: chown d2/d7e/f9d 122962 1 2023-12-17T11:58:02.728 INFO:tasks.workunit.client.1.smithi119.stdout:6/971: stat d2/d2b/d43/d5e/d92/da8/cfb 0 2023-12-17T11:58:02.730 INFO:tasks.workunit.client.1.smithi119.stdout:6/972: creat d2/d61/d8a/f134 x:0 0 0 2023-12-17T11:58:02.736 INFO:tasks.workunit.client.1.smithi119.stdout:8/973: dread d7/da/d1a/d8a/ddb/dbf/dfc/f113 [0,4194304] 0 2023-12-17T11:58:02.737 INFO:tasks.workunit.client.1.smithi119.stdout:8/974: link d7/fab d7/d18/d15/d10f/f13b 0 2023-12-17T11:58:02.750 INFO:tasks.workunit.client.1.smithi119.stdout:8/975: read d7/d18/d15/d81/d8e/fcd [2605204,59010] 0 2023-12-17T11:58:02.750 INFO:tasks.workunit.client.1.smithi119.stdout:8/976: read - d7/d18/d45/d9f/d75/f90 zero size 2023-12-17T11:58:02.751 INFO:tasks.workunit.client.1.smithi119.stdout:8/977: rmdir d7/d12/d23 39 2023-12-17T11:58:02.766 INFO:tasks.workunit.client.1.smithi119.stdout:8/978: read d7/da/d1a/d84/d104/f11c [358347,87353] 0 2023-12-17T11:58:02.766 INFO:tasks.workunit.client.1.smithi119.stdout:8/979: rename d7/d12/d69 to d7/d12/d69/d98/d13c 22 2023-12-17T11:58:02.798 INFO:tasks.workunit.client.1.smithi119.stdout:8/980: dwrite d7/d18/d15/fc1 [0,4194304] 0 2023-12-17T11:58:02.804 INFO:tasks.workunit.client.1.smithi119.stdout:8/981: creat d7/da/d11/f13d x:0 0 0 2023-12-17T11:58:02.808 INFO:tasks.workunit.client.1.smithi119.stdout:8/982: symlink d7/d12/d69/d98/l13e 0 2023-12-17T11:58:02.811 INFO:tasks.workunit.client.1.smithi119.stdout:8/983: symlink d7/da/d1a/d84/df7/l13f 0 2023-12-17T11:58:02.813 INFO:tasks.workunit.client.1.smithi119.stdout:8/984: symlink d7/da/d1a/d84/d111/l140 0 2023-12-17T11:58:02.815 INFO:tasks.workunit.client.1.smithi119.stdout:8/985: unlink d7/da/l68 0 2023-12-17T11:58:02.816 INFO:tasks.workunit.client.1.smithi119.stdout:8/986: mknod d7/d12/c141 0 2023-12-17T11:58:02.856 INFO:tasks.workunit.client.1.smithi119.stdout:8/987: dwrite d7/d18/f4e [0,4194304] 0 2023-12-17T11:58:02.856 INFO:tasks.workunit.client.1.smithi119.stdout:8/988: chown d7/f16 3 1 2023-12-17T11:58:02.858 INFO:tasks.workunit.client.1.smithi119.stdout:0/981: sync 2023-12-17T11:58:02.858 INFO:tasks.workunit.client.1.smithi119.stdout:6/973: sync 2023-12-17T11:58:02.858 INFO:tasks.workunit.client.1.smithi119.stdout:6/974: truncate d2/d9b/ff1 96215 0 2023-12-17T11:58:02.858 INFO:tasks.workunit.client.1.smithi119.stdout:8/989: mknod d7/da/d1a/d84/d104/c142 0 2023-12-17T11:58:02.860 INFO:tasks.workunit.client.1.smithi119.stdout:0/982: rename d2/d16/cec to d2/d66/d2e/d44/d7b/d5/c130 0 2023-12-17T11:58:02.860 INFO:tasks.workunit.client.1.smithi119.stdout:6/975: creat d2/d61/d110/d128/f135 x:0 0 0 2023-12-17T11:58:02.865 INFO:tasks.workunit.client.1.smithi119.stdout:6/976: mknod d2/d2b/d43/c136 0 2023-12-17T11:58:02.865 INFO:tasks.workunit.client.1.smithi119.stdout:6/977: write d2/d7e/dbc/fe9 [657037,115294] 0 2023-12-17T11:58:02.865 INFO:tasks.workunit.client.1.smithi119.stdout:6/978: chown d2/d61/d8a/dcf/feb 123602 1 2023-12-17T11:58:02.867 INFO:tasks.workunit.client.1.smithi119.stdout:8/990: getdents d7/d18/d45/d9f/d7b/df9/dfd 0 2023-12-17T11:58:02.867 INFO:tasks.workunit.client.1.smithi119.stdout:8/991: readlink d7/d18/d45/d9f/d7b/ld4 0 2023-12-17T11:58:02.867 INFO:tasks.workunit.client.1.smithi119.stdout:8/992: fsync d7/da/d11/d26/d49/f8d 0 2023-12-17T11:58:02.867 INFO:tasks.workunit.client.1.smithi119.stdout:8/993: chown d7/d18/d15/d64/c80 7 1 2023-12-17T11:58:02.867 INFO:tasks.workunit.client.1.smithi119.stdout:8/994: fdatasync d7/da/fd8 0 2023-12-17T11:58:02.901 INFO:tasks.workunit.client.1.smithi119.stdout:0/983: dwrite d2/d16/f6f [0,4194304] 0 2023-12-17T11:58:02.905 INFO:tasks.workunit.client.1.smithi119.stdout:0/984: rename d2/d66/d2e/d44/d7b/l114 to d2/d66/d1f/l131 0 2023-12-17T11:58:02.905 INFO:tasks.workunit.client.1.smithi119.stdout:0/985: dread - d2/d66/f71 zero size 2023-12-17T11:58:02.905 INFO:tasks.workunit.client.1.smithi119.stdout:0/986: truncate d2/dcc/f123 197513 0 2023-12-17T11:58:02.907 INFO:tasks.workunit.client.1.smithi119.stdout:0/987: mkdir d2/d16/d132 0 2023-12-17T11:58:02.909 INFO:tasks.workunit.client.1.smithi119.stdout:0/988: unlink d2/dac/dcf/ce2 0 2023-12-17T11:58:02.910 INFO:tasks.workunit.client.1.smithi119.stdout:8/995: dwrite d7/da/d11/d26/f58 [0,4194304] 0 2023-12-17T11:58:02.915 INFO:tasks.workunit.client.1.smithi119.stdout:8/996: mknod d7/d18/d45/d9f/d7b/df9/dfd/c143 0 2023-12-17T11:58:02.922 INFO:tasks.workunit.client.1.smithi119.stdout:0/989: dread d2/d16/d35/d39/f76 [0,4194304] 0 2023-12-17T11:58:02.931 INFO:tasks.workunit.client.1.smithi119.stdout:8/997: dread d7/d18/d15/fc1 [0,4194304] 0 2023-12-17T11:58:02.951 INFO:tasks.workunit.client.1.smithi119.stdout:8/998: dread d7/da/d1a/d84/d111/fe1 [0,4194304] 0 2023-12-17T11:58:02.964 INFO:tasks.workunit.client.1.smithi119.stdout:0/990: dwrite d2/d16/d11a/f124 [0,4194304] 0 2023-12-17T11:58:02.998 INFO:tasks.workunit.client.1.smithi119.stdout:8/999: dwrite d7/d18/d45/f53 [0,4194304] 0 2023-12-17T11:58:03.006 INFO:tasks.workunit.client.1.smithi119.stdout:0/991: dwrite d2/d66/d2e/f6d [0,4194304] 0 2023-12-17T11:58:03.011 INFO:tasks.workunit.client.1.smithi119.stdout:6/979: sync 2023-12-17T11:58:03.011 INFO:tasks.workunit.client.1.smithi119.stdout:6/980: readlink d2/l6e 0 2023-12-17T11:58:03.015 INFO:tasks.workunit.client.1.smithi119.stdout:6/981: rename d2/d41/c129 to d2/d41/c137 0 2023-12-17T11:58:03.015 INFO:tasks.workunit.client.1.smithi119.stdout:6/982: fdatasync d2/d7e/dbc/f107 0 2023-12-17T11:58:03.017 INFO:tasks.workunit.client.1.smithi119.stdout:6/983: getdents d2/d7e/d93/dec 0 2023-12-17T11:58:03.017 INFO:tasks.workunit.client.1.smithi119.stdout:6/984: stat d2/d41/lad 0 2023-12-17T11:58:03.017 INFO:tasks.workunit.client.1.smithi119.stdout:6/985: write d2/d2b/d43/de6/d17/f37 [2559134,58451] 0 2023-12-17T11:58:03.032 INFO:tasks.workunit.client.1.smithi119.stdout:6/986: dread d2/f59 [0,4194304] 0 2023-12-17T11:58:03.044 INFO:tasks.workunit.client.1.smithi119.stdout:0/992: dwrite d2/f4 [0,4194304] 0 2023-12-17T11:58:03.044 INFO:tasks.workunit.client.1.smithi119.stdout:0/993: dread - d2/d16/d35/f120 zero size 2023-12-17T11:58:03.049 INFO:tasks.workunit.client.1.smithi119.stdout:0/994: mknod d2/d66/d1f/d24/d50/c133 0 2023-12-17T11:58:03.049 INFO:tasks.workunit.client.1.smithi119.stdout:0/995: stat d2/d66/d2e/d44/d7b/d5/d3f/d101 0 2023-12-17T11:58:03.054 INFO:tasks.workunit.client.1.smithi119.stdout:0/996: creat d2/d66/d2e/d44/d7b/dbc/f134 x:0 0 0 2023-12-17T11:58:03.090 INFO:tasks.workunit.client.1.smithi119.stdout:6/987: dwrite d2/f86 [4194304,4194304] 0 2023-12-17T11:58:03.090 INFO:tasks.workunit.client.1.smithi119.stdout:6/988: fdatasync d2/f11 0 2023-12-17T11:58:03.090 INFO:tasks.workunit.client.1.smithi119.stdout:6/989: readlink d2/d61/laf 0 2023-12-17T11:58:03.092 INFO:tasks.workunit.client.1.smithi119.stdout:6/990: creat d2/d2b/d43/d5e/db3/f138 x:0 0 0 2023-12-17T11:58:03.092 INFO:tasks.workunit.client.1.smithi119.stdout:6/991: stat d2/d2b/d43/l46 0 2023-12-17T11:58:03.093 INFO:tasks.workunit.client.1.smithi119.stdout:6/992: getdents d2/d9b/d10d 0 2023-12-17T11:58:03.093 INFO:tasks.workunit.client.1.smithi119.stdout:6/993: truncate d2/d61/d8a/f134 817431 0 2023-12-17T11:58:03.094 INFO:tasks.workunit.client.1.smithi119.stdout:6/994: chown d2/d61/d8a/dcf/feb 27856 1 2023-12-17T11:58:03.113 INFO:tasks.workunit.client.1.smithi119.stdout:0/997: dwrite d2/d66/d2e/d44/df0/dc3/f11e [0,4194304] 0 2023-12-17T11:58:03.116 INFO:tasks.workunit.client.1.smithi119.stdout:6/995: dread d2/d2b/d43/de6/d17/f50 [0,4194304] 0 2023-12-17T11:58:03.116 INFO:tasks.workunit.client.1.smithi119.stdout:6/996: fdatasync d2/d2b/d43/dcb/f121 0 2023-12-17T11:58:03.116 INFO:tasks.workunit.client.1.smithi119.stdout:6/997: chown d2/d61/d8a/f134 1269745 1 2023-12-17T11:58:03.118 INFO:tasks.workunit.client.1.smithi119.stdout:6/998: write d2/d2b/d43/f8b [53033,121894] 0 2023-12-17T11:58:03.118 INFO:tasks.workunit.client.1.smithi119.stdout:6/999: stat d2/d2b/d43/de6/f6d 0 2023-12-17T11:58:03.127 INFO:tasks.workunit.client.1.smithi119.stdout:0/998: dread d2/d66/d1f/f57 [0,4194304] 0 2023-12-17T11:58:03.127 INFO:tasks.workunit.client.1.smithi119.stdout:0/999: truncate d2/f6b 4493145 0 2023-12-17T11:58:03.138 INFO:tasks.workunit.client.1.smithi119.stderr:+ rm -rf -- ./tmp.wYjjqJzn2L 2023-12-17T11:58:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:03 smithi002 ceph-mon[107131]: Deploying daemon mgr.smithi002.cqnuqs on smithi002 2023-12-17T11:58:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:03 smithi002 ceph-mon[107131]: pgmap v34: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 254 MiB/s rd, 318 MiB/s wr, 465 op/s 2023-12-17T11:58:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:03 smithi119 ceph-mon[117414]: Deploying daemon mgr.smithi002.cqnuqs on smithi002 2023-12-17T11:58:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:03 smithi119 ceph-mon[117414]: pgmap v34: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 254 MiB/s rd, 318 MiB/s wr, 465 op/s 2023-12-17T11:58:04.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:04 smithi002 ceph-mon[107131]: pgmap v35: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 205 MiB/s wr, 312 op/s 2023-12-17T11:58:04.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:04 smithi119 ceph-mon[117414]: pgmap v35: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 205 MiB/s wr, 312 op/s 2023-12-17T11:58:06.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:05 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:06.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:05 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:06.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:05 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:06.247 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:05 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:06.247 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:05 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:06.247 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:05 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:07.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:07 smithi119 ceph-mon[117414]: pgmap v36: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 205 MiB/s wr, 312 op/s 2023-12-17T11:58:07.436 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:07 smithi002 ceph-mon[107131]: pgmap v36: 65 pgs: 65 active+clean; 4.1 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 166 MiB/s rd, 205 MiB/s wr, 312 op/s 2023-12-17T11:58:08.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:08 smithi002 ceph-mon[107131]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:58:08.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:08 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T11:58:09.322 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:09 smithi002 ceph-mon[107131]: pgmap v37: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 190 MiB/s rd, 231 MiB/s wr, 417 op/s 2023-12-17T11:58:09.322 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:09 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:09.322 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:09 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:09 smithi119 ceph-mon[117414]: pgmap v37: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 190 MiB/s rd, 231 MiB/s wr, 417 op/s 2023-12-17T11:58:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:09 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:09.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:09 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:11.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:11 smithi002 ceph-mon[107131]: pgmap v38: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 103 MiB/s rd, 132 MiB/s wr, 254 op/s 2023-12-17T11:58:11.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:11 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:11.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:11 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:11.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:11 smithi119 ceph-mon[117414]: pgmap v38: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 103 MiB/s rd, 132 MiB/s wr, 254 op/s 2023-12-17T11:58:11.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:11 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:11.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:11 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:12.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:12 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:12.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:12 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:12.791 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:12 smithi002 ceph-mon[107131]: pgmap v39: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 133 MiB/s wr, 299 op/s 2023-12-17T11:58:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:12 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:12 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:12 smithi119 ceph-mon[117414]: pgmap v39: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 133 MiB/s wr, 299 op/s 2023-12-17T11:58:15.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:14 smithi002 ceph-mon[107131]: pgmap v40: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 24 MiB/s rd, 28 MiB/s wr, 149 op/s 2023-12-17T11:58:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:14 smithi119 ceph-mon[117414]: pgmap v40: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 24 MiB/s rd, 28 MiB/s wr, 149 op/s 2023-12-17T11:58:16.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:15 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:16.402 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:15 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:17.322 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: pgmap v41: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 24 MiB/s rd, 28 MiB/s wr, 149 op/s 2023-12-17T11:58:17.322 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr fail", "who": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr fail", "who": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: osdmap e50: 6 total, 6 up, 6 in 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd='[{"prefix": "mgr fail", "who": "smithi119.nzblpy"}]': finished 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: mgrmap e26: smithi002.cqnuqs(active, starting, since 0.00806366s) 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: osdmap e51: 6 total, 6 up, 6 in 2023-12-17T11:58:17.323 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: mgrmap e27: smithi002.cqnuqs(active, starting, since 0.00789328s) 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/crt"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/crt"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:58:17.324 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:58:17.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:58:17.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:58:17.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:58:17.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:58:17.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/key"}]: dispatch 2023-12-17T11:58:17.325 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: pgmap v41: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 24 MiB/s rd, 28 MiB/s wr, 149 op/s 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 172.21.15.119:0/13085119' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr fail", "who": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:17.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "mgr fail", "who": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: osdmap e50: 6 total, 6 up, 6 in 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.24421 ' entity='mgr.smithi119.nzblpy' cmd='[{"prefix": "mgr fail", "who": "smithi119.nzblpy"}]': finished 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: mgrmap e26: smithi002.cqnuqs(active, starting, since 0.00806366s) 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: Activating manager daemon smithi002.cqnuqs 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: osdmap e51: 6 total, 6 up, 6 in 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: mgrmap e27: smithi002.cqnuqs(active, starting, since 0.00789328s) 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/crt"}]: dispatch 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/crt"}]: dispatch 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T11:58:17.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi002.cqnuqs/key"}]: dispatch 2023-12-17T11:58:17.411 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:58:18.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:18 smithi119 ceph-mon[117414]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:58:18.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:18 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:18.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:18 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:18.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:18 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:18.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:18 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:58:18.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:18 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:58:18.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:18 smithi002 ceph-mon[107131]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T11:58:18.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:18 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:18.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:18 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:18.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:18 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:18.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:18 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:58:18.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:18 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T11:58:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:19 smithi119 ceph-mon[117414]: mgrmap e28: smithi002.cqnuqs(active, since 1.06444s) 2023-12-17T11:58:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:19 smithi119 ceph-mon[117414]: [17/Dec/2023:11:58:18] ENGINE Bus STARTING 2023-12-17T11:58:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:19 smithi119 ceph-mon[117414]: [17/Dec/2023:11:58:18] ENGINE Serving on http://172.21.15.2:8765 2023-12-17T11:58:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:19 smithi119 ceph-mon[117414]: [17/Dec/2023:11:58:18] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T11:58:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:19 smithi119 ceph-mon[117414]: [17/Dec/2023:11:58:18] ENGINE Bus STARTED 2023-12-17T11:58:19.433 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-17T11:58:19.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-17T11:58:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:19 smithi002 ceph-mon[107131]: mgrmap e28: smithi002.cqnuqs(active, since 1.06444s) 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:19 smithi002 ceph-mon[107131]: [17/Dec/2023:11:58:18] ENGINE Bus STARTING 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:19 smithi002 ceph-mon[107131]: [17/Dec/2023:11:58:18] ENGINE Serving on http://172.21.15.2:8765 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:19 smithi002 ceph-mon[107131]: [17/Dec/2023:11:58:18] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:19 smithi002 ceph-mon[107131]: [17/Dec/2023:11:58:18] ENGINE Bus STARTED 2023-12-17T11:58:20.351 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:20 smithi002 ceph-mon[107131]: pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2023-12-17T11:58:20.351 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:20 smithi002 ceph-mon[107131]: mgrmap e29: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:58:20.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:20 smithi119 ceph-mon[117414]: pgmap v4: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2023-12-17T11:58:20.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:20 smithi119 ceph-mon[117414]: mgrmap e29: smithi002.cqnuqs(active, since 2s) 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.709+0000 7f741ab9c700 1 -- 172.21.15.2:0/2793036699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fcbf0 msgr2=0x7f74140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.709+0000 7f741ab9c700 1 --2- 172.21.15.2:0/2793036699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fcbf0 0x7f74140fd000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7408004940 tx=0x7f7408009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.709+0000 7f741ab9c700 1 -- 172.21.15.2:0/2793036699 shutdown_connections 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.709+0000 7f741ab9c700 1 --2- 172.21.15.2:0/2793036699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74140fde00 0x7f74140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.709+0000 7f741ab9c700 1 --2- 172.21.15.2:0/2793036699 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fcbf0 0x7f74140fd000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.709+0000 7f741ab9c700 1 -- 172.21.15.2:0/2793036699 >> 172.21.15.2:0/2793036699 conn(0x7f74140f82d0 msgr2=0x7f74140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.710+0000 7f741ab9c700 1 -- 172.21.15.2:0/2793036699 shutdown_connections 2023-12-17T11:58:20.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.710+0000 7f741ab9c700 1 -- 172.21.15.2:0/2793036699 wait complete. 2023-12-17T11:58:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.711+0000 7f741ab9c700 1 Processor -- start 2023-12-17T11:58:20.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.711+0000 7f741ab9c700 1 -- start start 2023-12-17T11:58:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f741ab9c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74140fcbf0 0x7f741410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f741ab9c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 0x7f741410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f741ab9c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741410e010 con 0x7f74140fde00 2023-12-17T11:58:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f741ab9c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741410e8b0 con 0x7f74140fcbf0 2023-12-17T11:58:20.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f7413fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 0x7f741410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f7413fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 0x7f741410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45586/0 (socket says 172.21.15.2:45586) 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f7413fff700 1 -- 172.21.15.2:0/680355269 learned_addr learned my addr 172.21.15.2:0/680355269 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.712+0000 7f7418938700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74140fcbf0 0x7f741410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f7413fff700 1 -- 172.21.15.2:0/680355269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74140fcbf0 msgr2=0x7f741410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f7413fff700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74140fcbf0 0x7f741410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f7413fff700 1 -- 172.21.15.2:0/680355269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408005040 con 0x7f74140fde00 2023-12-17T11:58:20.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f7413fff700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 0x7f741410da10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f740000eb40 tx=0x7f740000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7400007cc0 con 0x7f74140fde00 2023-12-17T11:58:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741410eb30 con 0x7f74140fde00 2023-12-17T11:58:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f740000f040 con 0x7f74140fde00 2023-12-17T11:58:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f740000c990 con 0x7f74140fde00 2023-12-17T11:58:20.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.713+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741410f070 con 0x7f74140fde00 2023-12-17T11:58:20.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.715+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741404bb80 con 0x7f74140fde00 2023-12-17T11:58:20.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.715+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 29) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f740000cc00 con 0x7f74140fde00 2023-12-17T11:58:20.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.716+0000 7f74117fa700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f74040386d0 0x7f740403ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.716+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f740004be50 con 0x7f74140fde00 2023-12-17T11:58:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.717+0000 7f7418938700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f74040386d0 0x7f740403ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.717+0000 7f7418938700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f74040386d0 0x7f740403ab80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f740800b0d0 tx=0x7f7408009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:20.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:20.722+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7400012b30 con 0x7f74140fde00 2023-12-17T11:58:21.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.061+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f741410f540 con 0x7f74040386d0 2023-12-17T11:58:21.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.063+0000 7f74117fa700 1 -- 172.21.15.2:0/680355269 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f741410f540 con 0x7f74040386d0 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f74040386d0 msgr2=0x7f740403ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f74040386d0 0x7f740403ab80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f740800b0d0 tx=0x7f7408009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 msgr2=0x7f741410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 0x7f741410da10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f740000eb40 tx=0x7f740000b040 comp rx=0 tx=0).stop 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 shutdown_connections 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74140fcbf0 0x7f741410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f74040386d0 0x7f740403ab80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 --2- 172.21.15.2:0/680355269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74140fde00 0x7f741410da10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.066+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 >> 172.21.15.2:0/680355269 conn(0x7f74140f82d0 msgr2=0x7f7414101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.067+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 shutdown_connections 2023-12-17T11:58:21.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.067+0000 7f741ab9c700 1 -- 172.21.15.2:0/680355269 wait complete. 2023-12-17T11:58:21.091 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:58:21.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.282+0000 7fbf70b26700 1 -- 172.21.15.2:0/1812798358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fde00 msgr2=0x7fbf6c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.282+0000 7fbf70b26700 1 --2- 172.21.15.2:0/1812798358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c0fe250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbf60004940 tx=0x7fbf60009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:21.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.283+0000 7fbf70b26700 1 -- 172.21.15.2:0/1812798358 shutdown_connections 2023-12-17T11:58:21.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.283+0000 7fbf70b26700 1 --2- 172.21.15.2:0/1812798358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c0fe250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.283+0000 7fbf70b26700 1 --2- 172.21.15.2:0/1812798358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.283+0000 7fbf70b26700 1 -- 172.21.15.2:0/1812798358 >> 172.21.15.2:0/1812798358 conn(0x7fbf6c0f82d0 msgr2=0x7fbf6c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:21.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.283+0000 7fbf70b26700 1 -- 172.21.15.2:0/1812798358 shutdown_connections 2023-12-17T11:58:21.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.283+0000 7fbf70b26700 1 -- 172.21.15.2:0/1812798358 wait complete. 2023-12-17T11:58:21.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.284+0000 7fbf70b26700 1 Processor -- start 2023-12-17T11:58:21.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.285+0000 7fbf70b26700 1 -- start start 2023-12-17T11:58:21.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.285+0000 7fbf70b26700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:21.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.285+0000 7fbf70b26700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:21.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.285+0000 7fbf70b26700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c111380 con 0x7fbf6c0fde00 2023-12-17T11:58:21.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.285+0000 7fbf70b26700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0704d0 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.285+0000 7fbf6a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:21.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf6a59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:54920/0 (socket says 172.21.15.2:54920) 2023-12-17T11:58:21.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf6a59c700 1 -- 172.21.15.2:0/3946184305 learned_addr learned my addr 172.21.15.2:0/3946184305 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf69d9b700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf6a59c700 1 -- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fde00 msgr2=0x7fbf6c06ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf6a59c700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c06ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf6a59c700 1 -- 172.21.15.2:0/3946184305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60005040 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.286+0000 7fbf69d9b700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.287+0000 7fbf6a59c700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c071b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00bb00 tx=0x7fbf5c009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:21.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.287+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf5c00cae0 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.287+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c0707b0 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.287+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf5c00cc40 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.287+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf5c007720 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.287+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c070cf0 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.289+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 30) v1 ==== 45725+0+0 (secure 0 0 0) 0x7fbf5c007880 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.289+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c04bb80 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.290+0000 7fbf5affd700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbf540387b0 0x7fbf5403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:21.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.290+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fbf5c04d560 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.291+0000 7fbf69d9b700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbf540387b0 0x7fbf5403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:21.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.291+0000 7fbf69d9b700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbf540387b0 0x7fbf5403ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbf60004f90 tx=0x7fbf60009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:21.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.297+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbf5c001b90 con 0x7fbf6c0fcbf0 2023-12-17T11:58:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.642+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf6c102750 con 0x7fbf540387b0 2023-12-17T11:58:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.645+0000 7fbf5affd700 1 -- 172.21.15.2:0/3946184305 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fbf6c102750 con 0x7fbf540387b0 2023-12-17T11:58:21.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbf540387b0 msgr2=0x7fbf5403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbf540387b0 0x7fbf5403ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbf60004f90 tx=0x7fbf60009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 msgr2=0x7fbf6c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c071b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c00bb00 tx=0x7fbf5c009810 comp rx=0 tx=0).stop 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 shutdown_connections 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf6c0fcbf0 0x7fbf6c071b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbf540387b0 0x7fbf5403ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 --2- 172.21.15.2:0/3946184305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf6c0fde00 0x7fbf6c06ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.649+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 >> 172.21.15.2:0/3946184305 conn(0x7fbf6c0f82d0 msgr2=0x7fbf6c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:21.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.651+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 shutdown_connections 2023-12-17T11:58:21.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.651+0000 7fbf70b26700 1 -- 172.21.15.2:0/3946184305 wait complete. 2023-12-17T11:58:21.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2827206592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 msgr2=0x7f5c14103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2827206592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c14103660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5c08004940 tx=0x7f5c08009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2827206592 shutdown_connections 2023-12-17T11:58:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2827206592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 0x7f5c14104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2827206592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c14103660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2827206592 >> 172.21.15.2:0/2827206592 conn(0x7f5c14072340 msgr2=0x7f5c14074770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:21.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.898+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2827206592 shutdown_connections 2023-12-17T11:58:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.899+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2827206592 wait complete. 2023-12-17T11:58:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.899+0000 7f5c1b0e5700 1 Processor -- start 2023-12-17T11:58:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.900+0000 7f5c1b0e5700 1 -- start start 2023-12-17T11:58:21.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.900+0000 7f5c1b0e5700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c1407da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.901+0000 7f5c1b0e5700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 0x7f5c1407dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.901+0000 7f5c1b0e5700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1407e5c0 con 0x7f5c14104410 2023-12-17T11:58:21.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.901+0000 7f5c1b0e5700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1411d6b0 con 0x7f5c14103250 2023-12-17T11:58:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.901+0000 7f5c18e81700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c1407da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.901+0000 7f5c18e81700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c1407da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:54948/0 (socket says 172.21.15.2:54948) 2023-12-17T11:58:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.901+0000 7f5c18e81700 1 -- 172.21.15.2:0/2015566775 learned_addr learned my addr 172.21.15.2:0/2015566775 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.902+0000 7f5c13fff700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 0x7f5c1407dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.902+0000 7f5c13fff700 1 -- 172.21.15.2:0/2015566775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 msgr2=0x7f5c1407da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:21.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.902+0000 7f5c13fff700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c1407da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:21.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.902+0000 7f5c13fff700 1 -- 172.21.15.2:0/2015566775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08005040 con 0x7f5c14104410 2023-12-17T11:58:21.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.902+0000 7f5c18e81700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c1407da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:58:21.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.903+0000 7f5c13fff700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 0x7f5c1407dfc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009fd0 tx=0x7f5c0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:21.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.904+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c00004e90 con 0x7f5c14104410 2023-12-17T11:58:21.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.904+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1411d930 con 0x7f5c14104410 2023-12-17T11:58:21.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.904+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1411de70 con 0x7f5c14104410 2023-12-17T11:58:21.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.905+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c0000f040 con 0x7f5c14104410 2023-12-17T11:58:21.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.905+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c0000c7f0 con 0x7f5c14104410 2023-12-17T11:58:21.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.906+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 30) v1 ==== 45725+0+0 (secure 0 0 0) 0x7f5c0000c950 con 0x7f5c14104410 2023-12-17T11:58:21.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.906+0000 7f5c117fa700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f5c04038760 0x7f5c0403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.906+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f5c0004be60 con 0x7f5c14104410 2023-12-17T11:58:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.907+0000 7f5c18e81700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f5c04038760 0x7f5c0403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:21.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.908+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf80052e0 con 0x7f5c14104410 2023-12-17T11:58:21.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.908+0000 7f5c18e81700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f5c04038760 0x7f5c0403ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c080045a0 tx=0x7f5c08009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:21.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:21.914+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5c0001a260 con 0x7f5c14104410 2023-12-17T11:58:22.207 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-17T11:58:22.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-17T11:58:22.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:22 smithi002 ceph-mon[107131]: pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2023-12-17T11:58:22.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:22 smithi002 ceph-mon[107131]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:22 smithi002 ceph-mon[107131]: mgrmap e30: smithi002.cqnuqs(active, since 4s) 2023-12-17T11:58:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:22 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:22 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:22 smithi002 ceph-mon[107131]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.239+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bf8000bf0 con 0x7f5c04038760 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.262+0000 7f5c117fa700 1 -- 172.21.15.2:0/2015566775 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f5bf8000bf0 con 0x7f5c04038760 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (42s) 12s ago 8m 15.0M - 0.25.0 c8568f914cd2 2f4dbb3520de 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (8m) 12s ago 8m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (7m) 0s ago 7m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (36s) 12s ago 7m 74.5M - 9.4.7 954c08fa6188 af7992352f21 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (3m) 12s ago 3m 3121M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (3m) 12s ago 3m 13.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:58:22.265 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (3m) 0s ago 3m 3105M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (3m) 0s ago 3m 13.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (17s) 12s ago 9m 55.5M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283 running (92s) 0s ago 7m 124M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 22ff493c069a 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (9m) 12s ago 9m 86.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (6m) 0s ago 6m 64.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (50s) 12s ago 8m 7822k - 1.5.0 0da6a335fe13 9040adae03fc 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (24s) 0s ago 7m 8128k - 1.5.0 0da6a335fe13 9ededc0905f6 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 12s ago 6m 478M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (5m) 12s ago 5m 563M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (5m) 12s ago 5m 382M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (5m) 0s ago 5m 666M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (4m) 0s ago 4m 516M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (4m) 0s ago 4m 598M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:58:22.266 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (29s) 12s ago 7m 38.1M - 2.43.0 a07b618ecd1d c879ae7f28c6 2023-12-17T11:58:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f5c04038760 msgr2=0x7f5c0403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f5c04038760 0x7f5c0403ac10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5c080045a0 tx=0x7f5c08009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 msgr2=0x7f5c1407dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 0x7f5c1407dfc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009fd0 tx=0x7f5c0000b040 comp rx=0 tx=0).stop 2023-12-17T11:58:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 shutdown_connections 2023-12-17T11:58:22.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c14103250 0x7f5c1407da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:22.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f5c04038760 0x7f5c0403ac10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:22.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 --2- 172.21.15.2:0/2015566775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c14104410 0x7f5c1407dfc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:22.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 >> 172.21.15.2:0/2015566775 conn(0x7f5c14072340 msgr2=0x7f5c14107640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:22.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 shutdown_connections 2023-12-17T11:58:22.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.267+0000 7f5c1b0e5700 1 -- 172.21.15.2:0/2015566775 wait complete. 2023-12-17T11:58:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:22 smithi119 ceph-mon[117414]: pgmap v5: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2023-12-17T11:58:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:22 smithi119 ceph-mon[117414]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:22 smithi119 ceph-mon[117414]: mgrmap e30: smithi002.cqnuqs(active, since 4s) 2023-12-17T11:58:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:22 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:22 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:22 smithi119 ceph-mon[117414]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.473+0000 7ff28a1eb700 1 -- 172.21.15.2:0/2688823127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 msgr2=0x7ff284070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.473+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/2688823127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 0x7ff284070980 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff278004940 tx=0x7ff278009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.474+0000 7ff28a1eb700 1 -- 172.21.15.2:0/2688823127 shutdown_connections 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.474+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/2688823127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 0x7ff284070980 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.474+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/2688823127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.474+0000 7ff28a1eb700 1 -- 172.21.15.2:0/2688823127 >> 172.21.15.2:0/2688823127 conn(0x7ff2840f82d0 msgr2=0x7ff2840fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.474+0000 7ff28a1eb700 1 -- 172.21.15.2:0/2688823127 shutdown_connections 2023-12-17T11:58:22.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.474+0000 7ff28a1eb700 1 -- 172.21.15.2:0/2688823127 wait complete. 2023-12-17T11:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.475+0000 7ff28a1eb700 1 Processor -- start 2023-12-17T11:58:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.475+0000 7ff28a1eb700 1 -- start start 2023-12-17T11:58:22.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff28a1eb700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 0x7ff28410f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:22.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff28a1eb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28410fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:22.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff28a1eb700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2841102c0 con 0x7ff284070510 2023-12-17T11:58:22.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff28a1eb700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284110b60 con 0x7ff284071b60 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff282ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28410fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff282ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28410fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:54960/0 (socket says 172.21.15.2:54960) 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff282ffd700 1 -- 172.21.15.2:0/4294113320 learned_addr learned my addr 172.21.15.2:0/4294113320 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.476+0000 7ff2837fe700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 0x7ff28410f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.477+0000 7ff282ffd700 1 -- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 msgr2=0x7ff28410f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.477+0000 7ff282ffd700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 0x7ff28410f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:22.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.477+0000 7ff282ffd700 1 -- 172.21.15.2:0/4294113320 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278005040 con 0x7ff284071b60 2023-12-17T11:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.478+0000 7ff282ffd700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28410fcc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff278009fd0 tx=0x7ff278009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.478+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff278021070 con 0x7ff284071b60 2023-12-17T11:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.478+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff27801c400 con 0x7ff284071b60 2023-12-17T11:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.478+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff284110de0 con 0x7ff284071b60 2023-12-17T11:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.478+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27800e070 con 0x7ff284071b60 2023-12-17T11:58:22.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.478+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284111320 con 0x7ff284071b60 2023-12-17T11:58:22.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.479+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 30) v1 ==== 45725+0+0 (secure 0 0 0) 0x7ff27800b760 con 0x7ff284071b60 2023-12-17T11:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.480+0000 7ff26bfff700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff26c038770 0x7ff26c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.480+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff27804d470 con 0x7ff284071b60 2023-12-17T11:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.481+0000 7ff2837fe700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff26c038770 0x7ff26c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:22.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.481+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2841096f0 con 0x7ff284071b60 2023-12-17T11:58:22.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.482+0000 7ff2837fe700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff26c038770 0x7ff26c03ac20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff274009b80 tx=0x7ff27400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:22.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:22.489+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff27800bb00 con 0x7ff284071b60 2023-12-17T11:58:23.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.082+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff28404bb80 con 0x7ff284071b60 2023-12-17T11:58:23.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.082+0000 7ff26bfff700 1 -- 172.21.15.2:0/4294113320 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7ff278011b20 con 0x7ff284071b60 2023-12-17T11:58:23.086 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:58:23.086 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:58:23.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:23.088 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:58:23.088 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-17T11:58:23.088 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T11:58:23.088 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:58:23.088 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:58:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff26c038770 msgr2=0x7ff26c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:23.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff26c038770 0x7ff26c03ac20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff274009b80 tx=0x7ff27400b040 comp rx=0 tx=0).stop 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 msgr2=0x7ff28410fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28410fcc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff278009fd0 tx=0x7ff278009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 shutdown_connections 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff26c038770 0x7ff26c03ac20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff284070510 0x7ff28410f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 --2- 172.21.15.2:0/4294113320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff284071b60 0x7ff28410fcc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 >> 172.21.15.2:0/4294113320 conn(0x7ff2840f82d0 msgr2=0x7ff2840fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 shutdown_connections 2023-12-17T11:58:23.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.087+0000 7ff28a1eb700 1 -- 172.21.15.2:0/4294113320 wait complete. 2023-12-17T11:58:23.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 -- 172.21.15.2:0/3552264294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 msgr2=0x7f0868070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 --2- 172.21.15.2:0/3552264294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868070030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f085c004940 tx=0x7f085c009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 -- 172.21.15.2:0/3552264294 shutdown_connections 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 --2- 172.21.15.2:0/3552264294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f08680709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 --2- 172.21.15.2:0/3552264294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868070030 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 -- 172.21.15.2:0/3552264294 >> 172.21.15.2:0/3552264294 conn(0x7f08680f82d0 msgr2=0x7f08680fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 -- 172.21.15.2:0/3552264294 shutdown_connections 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.300+0000 7f086f11f700 1 -- 172.21.15.2:0/3552264294 wait complete. 2023-12-17T11:58:23.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.301+0000 7f086f11f700 1 Processor -- start 2023-12-17T11:58:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.301+0000 7f086f11f700 1 -- start start 2023-12-17T11:58:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.302+0000 7f086f11f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f0868113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.302+0000 7f086f11f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.302+0000 7f086f11f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08681145e0 con 0x7f0868071bc0 2023-12-17T11:58:23.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.302+0000 7f086f11f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0868114e80 con 0x7f0868070570 2023-12-17T11:58:23.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.302+0000 7f086cebb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f0868113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:23.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f086cebb700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f0868113aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:54964/0 (socket says 172.21.15.2:54964) 2023-12-17T11:58:23.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f086cebb700 1 -- 172.21.15.2:0/2411551716 learned_addr learned my addr 172.21.15.2:0/2411551716 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:23.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f0867fff700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:23.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f086cebb700 1 -- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 msgr2=0x7f0868113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:23.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f086cebb700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f086cebb700 1 -- 172.21.15.2:0/2411551716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c005040 con 0x7f0868070570 2023-12-17T11:58:23.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.303+0000 7f0867fff700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:58:23.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.304+0000 7f086cebb700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f0868113aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f085c009fd0 tx=0x7f085c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:23.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.304+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085c021070 con 0x7f0868070570 2023-12-17T11:58:23.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.304+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f085c013c60 con 0x7f0868070570 2023-12-17T11:58:23.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.304+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085c00e070 con 0x7f0868070570 2023-12-17T11:58:23.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.305+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0868115100 con 0x7f0868070570 2023-12-17T11:58:23.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.305+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0868115590 con 0x7f0868070570 2023-12-17T11:58:23.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.307+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 30) v1 ==== 45725+0+0 (secure 0 0 0) 0x7f085c026410 con 0x7f0868070570 2023-12-17T11:58:23.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.307+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086804bb80 con 0x7f0868070570 2023-12-17T11:58:23.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.307+0000 7f08657fa700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f0858038760 0x7f085803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:23.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.307+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f085c04d710 con 0x7f0868070570 2023-12-17T11:58:23.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.308+0000 7f0867fff700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f0858038760 0x7f085803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:23.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.308+0000 7f0867fff700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f0858038760 0x7f085803ac10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0854009fd0 tx=0x7f085400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:23.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.312+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f085c0248b0 con 0x7f0868070570 2023-12-17T11:58:23.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:23 smithi119 ceph-mon[117414]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:23.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:23 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:23.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:23 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:23.381 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:23 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/4294113320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:23.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:23 smithi002 ceph-mon[107131]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:23.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:23 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:23.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:23 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:23.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:23 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4294113320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:23.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.667+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08680ffd50 con 0x7f0858038760 2023-12-17T11:58:23.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.668+0000 7f08657fa700 1 -- 172.21.15.2:0/2411551716 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f08680ffd50 con 0x7f0858038760 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2023-12-17T11:58:23.672 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2023-12-17T11:58:23.673 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:58:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:58:23.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f0858038760 msgr2=0x7f085803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:23.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f0858038760 0x7f085803ac10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0854009fd0 tx=0x7f085400b040 comp rx=0 tx=0).stop 2023-12-17T11:58:23.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 msgr2=0x7f0868113aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:23.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f0868113aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f085c009fd0 tx=0x7f085c009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:23.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 shutdown_connections 2023-12-17T11:58:23.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0868070570 0x7f0868113aa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f0858038760 0x7f085803ac10 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0854009fd0 tx=0x7f085400b040 comp rx=0 tx=0).stop 2023-12-17T11:58:23.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 --2- 172.21.15.2:0/2411551716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0868071bc0 0x7f0868113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:23.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.673+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 >> 172.21.15.2:0/2411551716 conn(0x7f08680f82d0 msgr2=0x7f08680fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:23.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.674+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 shutdown_connections 2023-12-17T11:58:23.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:23.674+0000 7f086f11f700 1 -- 172.21.15.2:0/2411551716 wait complete. 2023-12-17T11:58:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:24 smithi002 ceph-mon[107131]: pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2023-12-17T11:58:24.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:24 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:24.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:24 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:24.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:24 smithi002 ceph-mon[107131]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:24 smithi119 ceph-mon[117414]: pgmap v6: 65 pgs: 65 active+clean; 1.3 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail 2023-12-17T11:58:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:24 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:24 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:24 smithi119 ceph-mon[117414]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:26.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:26.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:26.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:26 smithi119 ceph-mon[117414]: pgmap v7: 65 pgs: 65 active+clean; 429 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 50 KiB/s rd, 985 KiB/s wr, 166 op/s 2023-12-17T11:58:26.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:26.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:26.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:26 smithi002 ceph-mon[107131]: pgmap v7: 65 pgs: 65 active+clean; 429 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 50 KiB/s rd, 985 KiB/s wr, 166 op/s 2023-12-17T11:58:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:28 smithi119 ceph-mon[117414]: pgmap v8: 65 pgs: 65 active+clean; 429 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 764 KiB/s wr, 129 op/s 2023-12-17T11:58:28.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:28 smithi119 ceph-mon[117414]: Standby manager daemon smithi119.nzblpy started 2023-12-17T11:58:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:58:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:58:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:58:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:28 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:58:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:28 smithi002 ceph-mon[107131]: pgmap v8: 65 pgs: 65 active+clean; 429 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 39 KiB/s rd, 764 KiB/s wr, 129 op/s 2023-12-17T11:58:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:28 smithi002 ceph-mon[107131]: Standby manager daemon smithi119.nzblpy started 2023-12-17T11:58:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:58:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:58:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:58:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:28 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3453453298' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:58:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:29 smithi119 ceph-mon[117414]: mgrmap e31: smithi002.cqnuqs(active, since 11s), standbys: smithi119.nzblpy 2023-12-17T11:58:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:29 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:29.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:29 smithi002 ceph-mon[107131]: mgrmap e31: smithi002.cqnuqs(active, since 11s), standbys: smithi119.nzblpy 2023-12-17T11:58:29.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:29 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:30.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:30 smithi119 ceph-mon[117414]: pgmap v9: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.4 MiB/s wr, 252 op/s 2023-12-17T11:58:30.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:30 smithi002 ceph-mon[107131]: pgmap v9: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.4 MiB/s wr, 252 op/s 2023-12-17T11:58:32.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:32 smithi002 ceph-mon[107131]: pgmap v10: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 229 op/s 2023-12-17T11:58:32.858 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:32 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:32.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:32 smithi119 ceph-mon[117414]: pgmap v10: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 229 op/s 2023-12-17T11:58:32.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:32 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:34.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: pgmap v11: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 229 op/s 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:58:34.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:33 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T11:58:34.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: pgmap v11: 65 pgs: 65 active+clean; 323 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.2 MiB/s wr, 229 op/s 2023-12-17T11:58:34.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:58:34.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:33 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:58:35.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:35 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:58:35.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:35 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:58:35.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:35 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:58:35.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:35 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:35.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:35 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:35.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:35 smithi002 ceph-mon[107131]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:58:35.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:35 smithi002 ceph-mon[107131]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:58:35.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:35 smithi002 ceph-mon[107131]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:58:35.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:35 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:35.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:35 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:36.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:36 smithi119 ceph-mon[117414]: pgmap v12: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.2 MiB/s wr, 310 op/s 2023-12-17T11:58:36.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:36 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:58:36.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:36 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:36.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:36 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:36.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:36 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:36 smithi002 ceph-mon[107131]: pgmap v12: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.2 MiB/s wr, 310 op/s 2023-12-17T11:58:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:36 smithi002 ceph-mon[107131]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:58:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:36 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:36 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:36 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:37.890 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:37 smithi002 ceph-mon[107131]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2023-12-17T11:58:37.890 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:37 smithi002 ceph-mon[107131]: Reconfiguring daemon prometheus.smithi002 on smithi002 2023-12-17T11:58:37.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:37 smithi119 ceph-mon[117414]: Reconfiguring prometheus.smithi002 (dependencies changed)... 2023-12-17T11:58:37.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:37 smithi119 ceph-mon[117414]: Reconfiguring daemon prometheus.smithi002 on smithi002 2023-12-17T11:58:38.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:38 smithi002 ceph-mon[107131]: pgmap v13: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 214 op/s 2023-12-17T11:58:38.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:38 smithi119 ceph-mon[117414]: pgmap v13: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 214 op/s 2023-12-17T11:58:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:40 smithi002 ceph-mon[107131]: pgmap v14: 65 pgs: 65 active+clean; 338 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2023-12-17T11:58:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:40 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:40 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:40 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:58:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:40 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:40.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:40 smithi119 ceph-mon[117414]: pgmap v14: 65 pgs: 65 active+clean; 338 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 2.3 MiB/s wr, 369 op/s 2023-12-17T11:58:40.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:40 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:40.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:40 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:40.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:40 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:58:40.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:40 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:41.848 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:41 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:58:41.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:41 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:58:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:42 smithi119 ceph-mon[117414]: pgmap v15: 65 pgs: 65 active+clean; 338 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 235 op/s 2023-12-17T11:58:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:42 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:58:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:42 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:58:42.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:42 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:42 smithi002 ceph-mon[107131]: pgmap v15: 65 pgs: 65 active+clean; 338 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 235 op/s 2023-12-17T11:58:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:42 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:42 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:42 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:43.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:43 smithi119 ceph-mon[117414]: Upgrade: Updating mgr.smithi119.nzblpy 2023-12-17T11:58:43.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:43 smithi119 ceph-mon[117414]: Deploying daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:58:43.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:43 smithi002 ceph-mon[107131]: Upgrade: Updating mgr.smithi119.nzblpy 2023-12-17T11:58:43.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:43 smithi002 ceph-mon[107131]: Deploying daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T11:58:44.747 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:44 smithi119 ceph-mon[117414]: pgmap v16: 65 pgs: 65 active+clean; 338 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 235 op/s 2023-12-17T11:58:44.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:44 smithi002 ceph-mon[107131]: pgmap v16: 65 pgs: 65 active+clean; 338 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.6 MiB/s wr, 235 op/s 2023-12-17T11:58:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:46 smithi119 ceph-mon[117414]: pgmap v17: 65 pgs: 65 active+clean; 347 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.6 MiB/s wr, 373 op/s 2023-12-17T11:58:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:46 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:46 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:46 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:46.838 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:46 smithi002 ceph-mon[107131]: pgmap v17: 65 pgs: 65 active+clean; 347 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.6 MiB/s wr, 373 op/s 2023-12-17T11:58:46.838 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:46 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:46.838 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:46 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:46.838 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:46 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:47.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:47.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:58:48.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:48 smithi119 ceph-mon[117414]: pgmap v18: 65 pgs: 65 active+clean; 347 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 292 op/s 2023-12-17T11:58:48.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:48 smithi002 ceph-mon[107131]: pgmap v18: 65 pgs: 65 active+clean; 347 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 292 op/s 2023-12-17T11:58:50.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:49 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:50.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:49 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:50.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:49 smithi002 ceph-mon[107131]: pgmap v19: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 462 op/s 2023-12-17T11:58:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:49 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:49 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:49 smithi119 ceph-mon[117414]: pgmap v19: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.4 MiB/s wr, 462 op/s 2023-12-17T11:58:51.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:51 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:51 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:51 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:51 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:51 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:51 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:51 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:51 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:52.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:52 smithi119 ceph-mon[117414]: pgmap v20: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-12-17T11:58:53.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:52 smithi002 ceph-mon[107131]: pgmap v20: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-12-17T11:58:53.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 -- 172.21.15.2:0/4243621810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 msgr2=0x7f88300709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 --2- 172.21.15.2:0/4243621810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88300709c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8820004940 tx=0x7f8820009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 -- 172.21.15.2:0/4243621810 shutdown_connections 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 --2- 172.21.15.2:0/4243621810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88300709c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 --2- 172.21.15.2:0/4243621810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8830071bc0 0x7f8830070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 -- 172.21.15.2:0/4243621810 >> 172.21.15.2:0/4243621810 conn(0x7f88300f8240 msgr2=0x7f88300fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 -- 172.21.15.2:0/4243621810 shutdown_connections 2023-12-17T11:58:53.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.882+0000 7f8838156700 1 -- 172.21.15.2:0/4243621810 wait complete. 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.883+0000 7f8838156700 1 Processor -- start 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.883+0000 7f8838156700 1 -- start start 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.883+0000 7f8838156700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88301139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.883+0000 7f8838156700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8830071bc0 0x7f8830113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8838156700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88301144f0 con 0x7f8830070570 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8838156700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8830114d90 con 0x7f8830071bc0 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8835ef2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88301139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8835ef2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88301139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52462/0 (socket says 172.21.15.2:52462) 2023-12-17T11:58:53.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8835ef2700 1 -- 172.21.15.2:0/4143000449 learned_addr learned my addr 172.21.15.2:0/4143000449 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:53.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f88356f1700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8830071bc0 0x7f8830113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:53.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8835ef2700 1 -- 172.21.15.2:0/4143000449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8830071bc0 msgr2=0x7f8830113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:53.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8835ef2700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8830071bc0 0x7f8830113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:53.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.884+0000 7f8835ef2700 1 -- 172.21.15.2:0/4143000449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820005040 con 0x7f8830070570 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.885+0000 7f8835ef2700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88301139b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f882c00eb70 tx=0x7f882c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.885+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882c007cc0 con 0x7f8830070570 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.885+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f882c00f040 con 0x7f8830070570 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.885+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8830115010 con 0x7f8830070570 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.885+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f882c00c9f0 con 0x7f8830070570 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.885+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8830115550 con 0x7f8830070570 2023-12-17T11:58:53.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.887+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883004bb80 con 0x7f8830070570 2023-12-17T11:58:53.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.888+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 90897+0+0 (secure 0 0 0) 0x7f882c00cb50 con 0x7f8830070570 2023-12-17T11:58:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.888+0000 7f88267fc700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f881c06cc00 0x7f881c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.889+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f882c08bbf0 con 0x7f8830070570 2023-12-17T11:58:53.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.889+0000 7f88356f1700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f881c06cc00 0x7f881c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:53.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.890+0000 7f88356f1700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f881c06cc00 0x7f881c06f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8820013600 tx=0x7f8820009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:53.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:53.898+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f882c0597a0 con 0x7f8830070570 2023-12-17T11:58:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.232+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8830115bf0 con 0x7f881c06cc00 2023-12-17T11:58:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.234+0000 7f88267fc700 1 -- 172.21.15.2:0/4143000449 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f8830115bf0 con 0x7f881c06cc00 2023-12-17T11:58:54.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.237+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f881c06cc00 msgr2=0x7f881c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:54.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.237+0000 7f8838156700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f881c06cc00 0x7f881c06f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8820013600 tx=0x7f8820009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.237+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 msgr2=0x7f88301139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.237+0000 7f8838156700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88301139b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f882c00eb70 tx=0x7f882c00b040 comp rx=0 tx=0).stop 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 shutdown_connections 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f881c06cc00 0x7f881c06f0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8830070570 0x7f88301139b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 --2- 172.21.15.2:0/4143000449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8830071bc0 0x7f8830113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 >> 172.21.15.2:0/4143000449 conn(0x7f88300f8240 msgr2=0x7f88300fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 shutdown_connections 2023-12-17T11:58:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.238+0000 7f8838156700 1 -- 172.21.15.2:0/4143000449 wait complete. 2023-12-17T11:58:54.254 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:58:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.435+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2721945885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 msgr2=0x7fdbc4073c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:54.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.435+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2721945885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc4073c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8004940 tx=0x7fdbb8009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:54.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.436+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2721945885 shutdown_connections 2023-12-17T11:58:54.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.436+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2721945885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc4073c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.436+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2721945885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 0x7fdbc4072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.436+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2721945885 >> 172.21.15.2:0/2721945885 conn(0x7fdbc40fa5d0 msgr2=0x7fdbc40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.437+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2721945885 shutdown_connections 2023-12-17T11:58:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.437+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2721945885 wait complete. 2023-12-17T11:58:54.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.438+0000 7fdbc8b3c700 1 Processor -- start 2023-12-17T11:58:54.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.438+0000 7fdbc8b3c700 1 -- start start 2023-12-17T11:58:54.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc8b3c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 0x7fdbc40fecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:54.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc8b3c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc40ff200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:54.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc8b3c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc40ff8e0 con 0x7fdbc40737a0 2023-12-17T11:58:54.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc8b3c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc41000f0 con 0x7fdbc4072540 2023-12-17T11:58:54.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc40ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:54.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc1d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc40ff200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52470/0 (socket says 172.21.15.2:52470) 2023-12-17T11:58:54.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.439+0000 7fdbc1d9b700 1 -- 172.21.15.2:0/2359633629 learned_addr learned my addr 172.21.15.2:0/2359633629 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:54.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.440+0000 7fdbc259c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 0x7fdbc40fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:54.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.440+0000 7fdbc1d9b700 1 -- 172.21.15.2:0/2359633629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 msgr2=0x7fdbc40fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:54.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.440+0000 7fdbc1d9b700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 0x7fdbc40fecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.440+0000 7fdbc1d9b700 1 -- 172.21.15.2:0/2359633629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8005040 con 0x7fdbc40737a0 2023-12-17T11:58:54.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.440+0000 7fdbc259c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 0x7fdbc40fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:58:54.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.441+0000 7fdbc1d9b700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc40ff200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800b3b0 tx=0x7fdbb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:54.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.441+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb800e040 con 0x7fdbc40737a0 2023-12-17T11:58:54.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.441+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbb800bc50 con 0x7fdbc40737a0 2023-12-17T11:58:54.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.441+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb801c630 con 0x7fdbc40737a0 2023-12-17T11:58:54.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.441+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc4100370 con 0x7fdbc40737a0 2023-12-17T11:58:54.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.442+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc41008b0 con 0x7fdbc40737a0 2023-12-17T11:58:54.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.443+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba40052e0 con 0x7fdbc40737a0 2023-12-17T11:58:54.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.445+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 90897+0+0 (secure 0 0 0) 0x7fdbb8013420 con 0x7fdbc40737a0 2023-12-17T11:58:54.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.447+0000 7fdbb2ffd700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fdbac06ccc0 0x7fdbac06f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:54.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.447+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fdbb808d3c0 con 0x7fdbc40737a0 2023-12-17T11:58:54.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.450+0000 7fdbc259c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fdbac06ccc0 0x7fdbac06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:54.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.451+0000 7fdbc259c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fdbac06ccc0 0x7fdbac06f170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40fea50 tx=0x7fdbb40091a0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:54.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.459+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fdbb8057560 con 0x7fdbc40737a0 2023-12-17T11:58:54.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.847+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdba4000bf0 con 0x7fdbac06ccc0 2023-12-17T11:58:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.849+0000 7fdbb2ffd700 1 -- 172.21.15.2:0/2359633629 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fdba4000bf0 con 0x7fdbac06ccc0 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.853+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fdbac06ccc0 msgr2=0x7fdbac06f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.853+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fdbac06ccc0 0x7fdbac06f170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40fea50 tx=0x7fdbb40091a0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.853+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 msgr2=0x7fdbc40ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.853+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc40ff200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800b3b0 tx=0x7fdbb8009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.854+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 shutdown_connections 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.854+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbc4072540 0x7fdbc40fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.854+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fdbac06ccc0 0x7fdbac06f170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.854+0000 7fdbc8b3c700 1 --2- 172.21.15.2:0/2359633629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbc40737a0 0x7fdbc40ff200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:54.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.854+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 >> 172.21.15.2:0/2359633629 conn(0x7fdbc40fa5d0 msgr2=0x7fdbc4109110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.855+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 shutdown_connections 2023-12-17T11:58:54.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:54.855+0000 7fdbc8b3c700 1 -- 172.21.15.2:0/2359633629 wait complete. 2023-12-17T11:58:55.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.060+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4090688776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006e210 msgr2=0x7fa7f006e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:55.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.060+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4090688776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006e210 0x7fa7f006e620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4004940 tx=0x7fa7e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:55.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.060+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4090688776 shutdown_connections 2023-12-17T11:58:55.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.060+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4090688776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f006eb60 0x7fa7f0108c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.060+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4090688776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006e210 0x7fa7f006e620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.060+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4090688776 >> 172.21.15.2:0/4090688776 conn(0x7fa7f0069b20 msgr2=0x7fa7f006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:55.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.061+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4090688776 shutdown_connections 2023-12-17T11:58:55.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.061+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4090688776 wait complete. 2023-12-17T11:58:55.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.063+0000 7fa7f4f02700 1 Processor -- start 2023-12-17T11:58:55.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.064+0000 7fa7f4f02700 1 -- start start 2023-12-17T11:58:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.064+0000 7fa7f4f02700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f006e210 0x7fa7f011c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.064+0000 7fa7f4f02700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 0x7fa7f011c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.064+0000 7fa7f4f02700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f011ce20 con 0x7fa7f006eb60 2023-12-17T11:58:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.064+0000 7fa7f4f02700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f011d6c0 con 0x7fa7f006e210 2023-12-17T11:58:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.065+0000 7fa7edd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 0x7fa7f011c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:55.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.065+0000 7fa7edd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 0x7fa7f011c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52484/0 (socket says 172.21.15.2:52484) 2023-12-17T11:58:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.065+0000 7fa7edd9b700 1 -- 172.21.15.2:0/4100149886 learned_addr learned my addr 172.21.15.2:0/4100149886 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.066+0000 7fa7ee59c700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f006e210 0x7fa7f011c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.066+0000 7fa7edd9b700 1 -- 172.21.15.2:0/4100149886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f006e210 msgr2=0x7fa7f011c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.066+0000 7fa7edd9b700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f006e210 0x7fa7f011c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.066+0000 7fa7edd9b700 1 -- 172.21.15.2:0/4100149886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4005040 con 0x7fa7f006eb60 2023-12-17T11:58:55.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.066+0000 7fa7edd9b700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 0x7fa7f011c820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eb70 tx=0x7fa7e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.067+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e0007cc0 con 0x7fa7f006eb60 2023-12-17T11:58:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.067+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa7e000f040 con 0x7fa7f006eb60 2023-12-17T11:58:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.067+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e000c9d0 con 0x7fa7f006eb60 2023-12-17T11:58:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.067+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f011d8e0 con 0x7fa7f006eb60 2023-12-17T11:58:55.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.068+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f011de20 con 0x7fa7f006eb60 2023-12-17T11:58:55.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.070+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f0116400 con 0x7fa7f006eb60 2023-12-17T11:58:55.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.071+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 31) v1 ==== 90897+0+0 (secure 0 0 0) 0x7fa7e000cb30 con 0x7fa7f006eb60 2023-12-17T11:58:55.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.074+0000 7fa7deffd700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa7d806ccd0 0x7fa7d806f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:55.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.074+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa7e008bb00 con 0x7fa7f006eb60 2023-12-17T11:58:55.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.074+0000 7fa7ee59c700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa7d806ccd0 0x7fa7d806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:55.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.076+0000 7fa7ee59c700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa7d806ccd0 0x7fa7d806f180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400b0d0 tx=0x7fa7e4009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:55.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.078+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa7e0059760 con 0x7fa7f006eb60 2023-12-17T11:58:55.109 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:54 smithi119 ceph-mon[117414]: pgmap v21: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-12-17T11:58:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:54 smithi002 ceph-mon[107131]: pgmap v21: 65 pgs: 65 active+clean; 346 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.7 MiB/s wr, 307 op/s 2023-12-17T11:58:55.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.438+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7f002b1f0 con 0x7fa7d806ccd0 2023-12-17T11:58:55.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.457+0000 7fa7deffd700 1 -- 172.21.15.2:0/4100149886 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa7f002b1f0 con 0x7fa7d806ccd0 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (75s) 4s ago 8m 15.4M - 0.25.0 c8568f914cd2 2f4dbb3520de 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (8m) 4s ago 8m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (7m) 6s ago 7m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (69s) 4s ago 8m 81.5M - 9.4.7 954c08fa6188 af7992352f21 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (3m) 4s ago 3m 5509M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (3m) 4s ago 3m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (3m) 6s ago 3m 3217M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (3m) 6s ago 3m 13.8M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:58:55.461 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (50s) 4s ago 9m 502M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (10s) 6s ago 7m 59.3M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (10m) 4s ago 10m 92.9M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (7m) 6s ago 7m 65.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (83s) 4s ago 8m 8052k - 1.5.0 0da6a335fe13 9040adae03fc 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (58s) 6s ago 7m 8330k - 1.5.0 0da6a335fe13 9ededc0905f6 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (6m) 4s ago 6m 602M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (6m) 4s ago 6m 705M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (6m) 4s ago 6m 478M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (5m) 6s ago 5m 772M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (5m) 6s ago 5m 594M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (5m) 6s ago 5m 671M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:58:55.462 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (15s) 4s ago 8m 34.9M - 2.43.0 a07b618ecd1d d892b91c7eb8 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.460+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa7d806ccd0 msgr2=0x7fa7d806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.460+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa7d806ccd0 0x7fa7d806f180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400b0d0 tx=0x7fa7e4009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.460+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 msgr2=0x7fa7f011c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.460+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 0x7fa7f011c820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eb70 tx=0x7fa7e000b040 comp rx=0 tx=0).stop 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.461+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 shutdown_connections 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.461+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7f006e210 0x7fa7f011c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.461+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa7d806ccd0 0x7fa7d806f180 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.461+0000 7fa7f4f02700 1 --2- 172.21.15.2:0/4100149886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7f006eb60 0x7fa7f011c820 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.461+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 >> 172.21.15.2:0/4100149886 conn(0x7fa7f0069b20 msgr2=0x7fa7f01074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:55.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.462+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 shutdown_connections 2023-12-17T11:58:55.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.462+0000 7fa7f4f02700 1 -- 172.21.15.2:0/4100149886 wait complete. 2023-12-17T11:58:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 -- 172.21.15.2:0/988505040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 msgr2=0x7f66e80fce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 --2- 172.21.15.2:0/988505040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e80fce60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f66d8004940 tx=0x7f66d8009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 -- 172.21.15.2:0/988505040 shutdown_connections 2023-12-17T11:58:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 --2- 172.21.15.2:0/988505040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e80fdc60 0x7f66e80fe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 --2- 172.21.15.2:0/988505040 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e80fce60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 -- 172.21.15.2:0/988505040 >> 172.21.15.2:0/988505040 conn(0x7f66e80f80f0 msgr2=0x7f66e80fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 -- 172.21.15.2:0/988505040 shutdown_connections 2023-12-17T11:58:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.640+0000 7f66ed329700 1 -- 172.21.15.2:0/988505040 wait complete. 2023-12-17T11:58:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.641+0000 7f66ed329700 1 Processor -- start 2023-12-17T11:58:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.641+0000 7f66ed329700 1 -- start start 2023-12-17T11:58:55.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66ed329700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e810f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:55.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66ed329700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e80fdc60 0x7f66e810fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:55.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66ed329700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8110000 con 0x7f66e80fdc60 2023-12-17T11:58:55.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66ed329700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e81108a0 con 0x7f66e80fca50 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e810f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66e77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e80fdc60 0x7f66e810fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66e7fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e810f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:35600/0 (socket says 172.21.15.2:35600) 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.642+0000 7f66e7fff700 1 -- 172.21.15.2:0/3617567177 learned_addr learned my addr 172.21.15.2:0/3617567177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e7fff700 1 -- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e80fdc60 msgr2=0x7f66e810fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e7fff700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e80fdc60 0x7f66e810fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e7fff700 1 -- 172.21.15.2:0/3617567177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d8005040 con 0x7f66e80fca50 2023-12-17T11:58:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e7fff700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e810f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66d8008f80 tx=0x7f66d8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d8021070 con 0x7f66e80fca50 2023-12-17T11:58:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66d801c400 con 0x7f66e80fca50 2023-12-17T11:58:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e8110b20 con 0x7f66e80fca50 2023-12-17T11:58:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.643+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66d800e070 con 0x7f66e80fca50 2023-12-17T11:58:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.644+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e8111000 con 0x7f66e80fca50 2023-12-17T11:58:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.645+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e804bb80 con 0x7f66e80fca50 2023-12-17T11:58:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.646+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 90897+0+0 (secure 0 0 0) 0x7f66d801c950 con 0x7f66e80fca50 2023-12-17T11:58:55.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.647+0000 7f66e4ff9700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f66d006cc00 0x7f66d006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:55.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.647+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f66d808cef0 con 0x7f66e80fca50 2023-12-17T11:58:55.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.648+0000 7f66e77fe700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f66d006cc00 0x7f66d006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:55.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.648+0000 7f66e77fe700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f66d006cc00 0x7f66d006f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009b80 tx=0x7f66dc00b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:55.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:55.654+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f66d805aaa0 con 0x7f66e80fca50 2023-12-17T11:58:55.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:55 smithi119 ceph-mon[117414]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:56.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.072+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f66e8111220 con 0x7f66e80fca50 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:58:56.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:58:56.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.073+0000 7f66e4ff9700 1 -- 172.21.15.2:0/3617567177 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f66d805a630 con 0x7f66e80fca50 2023-12-17T11:58:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.077+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f66d006cc00 msgr2=0x7f66d006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.077+0000 7f66ed329700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f66d006cc00 0x7f66d006f0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009b80 tx=0x7f66dc00b040 comp rx=0 tx=0).stop 2023-12-17T11:58:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.077+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 msgr2=0x7f66e810f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:56.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.077+0000 7f66ed329700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e810f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f66d8008f80 tx=0x7f66d8009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 shutdown_connections 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66e80fca50 0x7f66e810f4c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f66d006cc00 0x7f66d006f0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 --2- 172.21.15.2:0/3617567177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66e80fdc60 0x7f66e810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 >> 172.21.15.2:0/3617567177 conn(0x7f66e80f80f0 msgr2=0x7f66e8100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 shutdown_connections 2023-12-17T11:58:56.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.078+0000 7f66ed329700 1 -- 172.21.15.2:0/3617567177 wait complete. 2023-12-17T11:58:56.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:55 smithi002 ceph-mon[107131]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.298+0000 7f9900648700 1 -- 172.21.15.2:0/2247228882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8104410 msgr2=0x7f98f8104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.298+0000 7f9900648700 1 --2- 172.21.15.2:0/2247228882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8104410 0x7f98f8104860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f98e8004880 tx=0x7f98e8009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.298+0000 7f9900648700 1 -- 172.21.15.2:0/2247228882 shutdown_connections 2023-12-17T11:58:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.298+0000 7f9900648700 1 --2- 172.21.15.2:0/2247228882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8104410 0x7f98f8104860 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.298+0000 7f9900648700 1 --2- 172.21.15.2:0/2247228882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8103250 0x7f98f8103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.298+0000 7f9900648700 1 -- 172.21.15.2:0/2247228882 >> 172.21.15.2:0/2247228882 conn(0x7f98f8072340 msgr2=0x7f98f8074770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.299+0000 7f9900648700 1 -- 172.21.15.2:0/2247228882 shutdown_connections 2023-12-17T11:58:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.299+0000 7f9900648700 1 -- 172.21.15.2:0/2247228882 wait complete. 2023-12-17T11:58:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.301+0000 7f9900648700 1 Processor -- start 2023-12-17T11:58:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.301+0000 7f9900648700 1 -- start start 2023-12-17T11:58:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.303+0000 7f9900648700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8103250 0x7f98f8113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.303+0000 7f9900648700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 0x7f98f8113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.303+0000 7f9900648700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f81145e0 con 0x7f98f8103250 2023-12-17T11:58:56.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.303+0000 7f9900648700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8114e80 con 0x7f98f8104410 2023-12-17T11:58:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.304+0000 7f98fdbe3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 0x7f98f8113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.304+0000 7f98fdbe3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 0x7f98f8113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:35624/0 (socket says 172.21.15.2:35624) 2023-12-17T11:58:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.304+0000 7f98fdbe3700 1 -- 172.21.15.2:0/1781021085 learned_addr learned my addr 172.21.15.2:0/1781021085 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:58:56.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.304+0000 7f98fe3e4700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8103250 0x7f98f8113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.305+0000 7f98fdbe3700 1 -- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8103250 msgr2=0x7f98f8113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.305+0000 7f98fdbe3700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8103250 0x7f98f8113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.305+0000 7f98fdbe3700 1 -- 172.21.15.2:0/1781021085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8005040 con 0x7f98f8104410 2023-12-17T11:58:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.305+0000 7f98fdbe3700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 0x7f98f8113fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98e80134a0 tx=0x7f98e8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.306+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e800e030 con 0x7f98f8104410 2023-12-17T11:58:56.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.306+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f8115100 con 0x7f98f8104410 2023-12-17T11:58:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.307+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98e801c400 con 0x7f98f8104410 2023-12-17T11:58:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.308+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98e80125e0 con 0x7f98f8104410 2023-12-17T11:58:56.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.308+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f8115640 con 0x7f98f8104410 2023-12-17T11:58:56.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.310+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f804bb80 con 0x7f98f8104410 2023-12-17T11:58:56.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.311+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 31) v1 ==== 90897+0+0 (secure 0 0 0) 0x7f98e801c570 con 0x7f98f8104410 2023-12-17T11:58:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.312+0000 7f98eeffd700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e406cca0 0x7f98e406f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:56.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.313+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f98e808da40 con 0x7f98f8104410 2023-12-17T11:58:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.314+0000 7f98fe3e4700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e406cca0 0x7f98e406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.315+0000 7f98fe3e4700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e406cca0 0x7f98e406f150 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009b80 tx=0x7f98f400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:56.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.319+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f98e805b6b0 con 0x7f98f8104410 2023-12-17T11:58:56.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.670+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98f8115a50 con 0x7f98e406cca0 2023-12-17T11:58:56.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.671+0000 7f98eeffd700 1 -- 172.21.15.2:0/1781021085 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f98f8115a50 con 0x7f98e406cca0 2023-12-17T11:58:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:58:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:58:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:58:56.673 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mgr daemons", 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:58:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e406cca0 msgr2=0x7f98e406f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e406cca0 0x7f98e406f150 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009b80 tx=0x7f98f400b040 comp rx=0 tx=0).stop 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 msgr2=0x7f98f8113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 0x7f98f8113fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98e80134a0 tx=0x7f98e8009e30 comp rx=0 tx=0).stop 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 shutdown_connections 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e406cca0 0x7f98e406f150 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f8103250 0x7f98f8113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 --2- 172.21.15.2:0/1781021085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f8104410 0x7f98f8113fe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.673+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 >> 172.21.15.2:0/1781021085 conn(0x7f98f8072340 msgr2=0x7f98f8107640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:56.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.674+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 shutdown_connections 2023-12-17T11:58:56.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:58:56.674+0000 7f9900648700 1 -- 172.21.15.2:0/1781021085 wait complete. 2023-12-17T11:58:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:56 smithi119 ceph-mon[117414]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:56 smithi119 ceph-mon[117414]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 3.0 MiB/s wr, 512 op/s 2023-12-17T11:58:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:56 smithi119 ceph-mon[117414]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:56.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:56 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3617567177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:56 smithi002 ceph-mon[107131]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:57.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:56 smithi002 ceph-mon[107131]: pgmap v22: 65 pgs: 65 active+clean; 337 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 3.0 MiB/s wr, 512 op/s 2023-12-17T11:58:57.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:56 smithi002 ceph-mon[107131]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:57.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:56 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3617567177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:57.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.cqnuqs"}]: dispatch 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.cqnuqs"}]': finished 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.nzblpy"}]': finished 2023-12-17T11:58:57.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: Standby manager daemon smithi119.nzblpy restarted 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: Standby manager daemon smithi119.nzblpy started 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:58:57.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:58:57.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:57.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:57.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:57 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='client.24549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:58.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:58.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:58.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.cqnuqs"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi002.cqnuqs"}]': finished 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.nzblpy"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi119.nzblpy"}]': finished 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: Standby manager daemon smithi119.nzblpy restarted 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: Standby manager daemon smithi119.nzblpy started 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.? 172.21.15.119:0/3834068799' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:58:58.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:57 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:58:58.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.9 MiB/s wr, 374 op/s 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all mgr 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all rgw 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all rbd-mirror 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all ceph-exporter 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all iscsi 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all nfs 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all nvmeof 2023-12-17T11:58:58.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:58:58 smithi002 ceph-mon[107131]: mgrmap e32: smithi002.cqnuqs(active, since 41s), standbys: smithi119.nzblpy 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: pgmap v23: 65 pgs: 65 active+clean; 337 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.9 MiB/s wr, 374 op/s 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all mgr 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all rgw 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all rbd-mirror 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all ceph-exporter 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all iscsi 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all nfs 2023-12-17T11:58:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all nvmeof 2023-12-17T11:58:59.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:58:58 smithi119 ceph-mon[117414]: mgrmap e32: smithi002.cqnuqs(active, since 41s), standbys: smithi119.nzblpy 2023-12-17T11:59:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:00 smithi119 ceph-mon[117414]: pgmap v24: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 634 op/s 2023-12-17T11:59:01.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:00 smithi002 ceph-mon[107131]: pgmap v24: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 634 op/s 2023-12-17T11:59:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:02 smithi119 ceph-mon[117414]: pgmap v25: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 464 op/s 2023-12-17T11:59:03.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:02 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:03.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:02 smithi002 ceph-mon[107131]: pgmap v25: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 464 op/s 2023-12-17T11:59:03.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:02 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:05.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:04 smithi119 ceph-mon[117414]: pgmap v26: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 464 op/s 2023-12-17T11:59:05.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:04 smithi002 ceph-mon[107131]: pgmap v26: 65 pgs: 65 active+clean; 339 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 464 op/s 2023-12-17T11:59:07.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:06 smithi119 ceph-mon[117414]: pgmap v27: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 3.5 MiB/s wr, 681 op/s 2023-12-17T11:59:07.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:06 smithi002 ceph-mon[107131]: pgmap v27: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 3.5 MiB/s wr, 681 op/s 2023-12-17T11:59:09.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:08 smithi119 ceph-mon[117414]: pgmap v28: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 476 op/s 2023-12-17T11:59:09.218 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:08 smithi002 ceph-mon[107131]: pgmap v28: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 476 op/s 2023-12-17T11:59:09.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:09 smithi002 ceph-mon[107131]: Upgrade: Updating node-exporter.smithi002 (1/2) 2023-12-17T11:59:09.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:09 smithi002 ceph-mon[107131]: Deploying daemon node-exporter.smithi002 on smithi002 2023-12-17T11:59:10.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:09 smithi119 ceph-mon[117414]: Upgrade: Updating node-exporter.smithi002 (1/2) 2023-12-17T11:59:10.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:09 smithi119 ceph-mon[117414]: Deploying daemon node-exporter.smithi002 on smithi002 2023-12-17T11:59:10.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:10 smithi002 ceph-mon[107131]: pgmap v29: 65 pgs: 65 active+clean; 345 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 2.9 MiB/s wr, 622 op/s 2023-12-17T11:59:10.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:10 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:10 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:11.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:10 smithi119 ceph-mon[117414]: pgmap v29: 65 pgs: 65 active+clean; 345 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 2.9 MiB/s wr, 622 op/s 2023-12-17T11:59:11.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:10 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:11.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:10 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:12 smithi119 ceph-mon[117414]: pgmap v30: 65 pgs: 65 active+clean; 345 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 362 op/s 2023-12-17T11:59:13.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:12 smithi002 ceph-mon[107131]: pgmap v30: 65 pgs: 65 active+clean; 345 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 362 op/s 2023-12-17T11:59:14.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:13 smithi119 ceph-mon[117414]: Upgrade: Updating node-exporter.smithi119 (2/2) 2023-12-17T11:59:14.135 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:13 smithi119 ceph-mon[117414]: Deploying daemon node-exporter.smithi119 on smithi119 2023-12-17T11:59:14.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:13 smithi002 ceph-mon[107131]: Upgrade: Updating node-exporter.smithi119 (2/2) 2023-12-17T11:59:14.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:13 smithi002 ceph-mon[107131]: Deploying daemon node-exporter.smithi119 on smithi119 2023-12-17T11:59:15.131 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:14 smithi119 ceph-mon[117414]: pgmap v31: 65 pgs: 65 active+clean; 345 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 362 op/s 2023-12-17T11:59:15.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:14 smithi002 ceph-mon[107131]: pgmap v31: 65 pgs: 65 active+clean; 345 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 362 op/s 2023-12-17T11:59:16.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:16 smithi119 ceph-mon[117414]: pgmap v32: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 511 op/s 2023-12-17T11:59:16.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:16 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:16.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:16 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:16.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:16 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:16.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:16 smithi002 ceph-mon[107131]: pgmap v32: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 511 op/s 2023-12-17T11:59:16.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:16 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:16.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:16 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:16.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:16 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:18.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:18 smithi119 ceph-mon[117414]: pgmap v33: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 294 op/s 2023-12-17T11:59:18.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:18 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:18.661 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:18 smithi002 ceph-mon[107131]: pgmap v33: 65 pgs: 65 active+clean; 343 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 294 op/s 2023-12-17T11:59:18.661 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:18 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:20.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:19 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:20.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:19 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:20.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:19 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:20.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:19 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:20 smithi119 ceph-mon[117414]: pgmap v34: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.0 MiB/s wr, 418 op/s 2023-12-17T11:59:21.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:20 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:20 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:20 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:20 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:20 smithi002 ceph-mon[107131]: pgmap v34: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.0 MiB/s wr, 418 op/s 2023-12-17T11:59:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:20 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:20 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:20 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:21.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:20 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:22.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:22 smithi002 ceph-mon[107131]: pgmap v35: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 272 op/s 2023-12-17T11:59:22.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:22 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:22.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:22 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:22 smithi119 ceph-mon[117414]: pgmap v35: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 272 op/s 2023-12-17T11:59:22.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:22 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:22.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:22 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:24.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:24 smithi119 ceph-mon[117414]: pgmap v36: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 272 op/s 2023-12-17T11:59:24.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:24 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:24.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:24 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:24.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:24 smithi002 ceph-mon[107131]: pgmap v36: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 272 op/s 2023-12-17T11:59:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:24 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:24 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:25.439 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-17T11:59:25.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-17T11:59:26.412 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-17T11:59:26.412 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-17T11:59:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: pgmap v37: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 427 op/s 2023-12-17T11:59:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:26 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: pgmap v37: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 427 op/s 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.727 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:26 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:26.743 DEBUG:teuthology.parallel:result is None 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 -- 172.21.15.2:0/3785770531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff420072540 msgr2=0x7ff420072950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 --2- 172.21.15.2:0/3785770531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff420072540 0x7ff420072950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff414004940 tx=0x7ff414009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 -- 172.21.15.2:0/3785770531 shutdown_connections 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 --2- 172.21.15.2:0/3785770531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4200737a0 0x7ff420073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 --2- 172.21.15.2:0/3785770531 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff420072540 0x7ff420072950 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 -- 172.21.15.2:0/3785770531 >> 172.21.15.2:0/3785770531 conn(0x7ff4200fa5d0 msgr2=0x7ff4200fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:26.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 -- 172.21.15.2:0/3785770531 shutdown_connections 2023-12-17T11:59:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.825+0000 7ff426b50700 1 -- 172.21.15.2:0/3785770531 wait complete. 2023-12-17T11:59:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.826+0000 7ff426b50700 1 Processor -- start 2023-12-17T11:59:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.826+0000 7ff426b50700 1 -- start start 2023-12-17T11:59:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.826+0000 7ff426b50700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420072540 0x7ff420113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.826+0000 7ff426b50700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 0x7ff4201140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:26.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.826+0000 7ff426b50700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4201146c0 con 0x7ff4200737a0 2023-12-17T11:59:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.826+0000 7ff426b50700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420114f60 con 0x7ff420072540 2023-12-17T11:59:26.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 0x7ff4201140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff4248ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420072540 0x7ff420113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 0x7ff4201140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33128/0 (socket says 172.21.15.2:33128) 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 -- 172.21.15.2:0/594131005 learned_addr learned my addr 172.21.15.2:0/594131005 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 -- 172.21.15.2:0/594131005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420072540 msgr2=0x7ff420113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420072540 0x7ff420113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 -- 172.21.15.2:0/594131005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414005040 con 0x7ff4200737a0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff4248ec700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420072540 0x7ff420113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41ffff700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 0x7ff4201140c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff40c002a50 tx=0x7ff40c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.827+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40c007cc0 con 0x7ff4200737a0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.828+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff40c00f040 con 0x7ff4200737a0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.828+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40c00d9c0 con 0x7ff4200737a0 2023-12-17T11:59:26.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.828+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff420115240 con 0x7ff4200737a0 2023-12-17T11:59:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.828+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420115780 con 0x7ff4200737a0 2023-12-17T11:59:26.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.829+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42004bb80 con 0x7ff4200737a0 2023-12-17T11:59:26.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.830+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 90897+0+0 (secure 0 0 0) 0x7ff40c00db20 con 0x7ff4200737a0 2023-12-17T11:59:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.831+0000 7ff41d7fa700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff41006cc00 0x7ff41006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.831+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff40c08be20 con 0x7ff4200737a0 2023-12-17T11:59:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.831+0000 7ff4248ec700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff41006cc00 0x7ff41006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:26.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.832+0000 7ff4248ec700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff41006cc00 0x7ff41006f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff414004f90 tx=0x7ff414009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:26.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:26.836+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ff40c059950 con 0x7ff4200737a0 2023-12-17T11:59:27.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.077+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff42010a850 con 0x7ff41006cc00 2023-12-17T11:59:27.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.078+0000 7ff41d7fa700 1 -- 172.21.15.2:0/594131005 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7ff42010a850 con 0x7ff41006cc00 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff41006cc00 msgr2=0x7ff41006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff41006cc00 0x7ff41006f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff414004f90 tx=0x7ff414009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 msgr2=0x7ff4201140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 0x7ff4201140c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff40c002a50 tx=0x7ff40c0046b0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 shutdown_connections 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420072540 0x7ff420113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7ff41006cc00 0x7ff41006f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 --2- 172.21.15.2:0/594131005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4200737a0 0x7ff4201140c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 >> 172.21.15.2:0/594131005 conn(0x7ff4200fa5d0 msgr2=0x7ff420109110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:27.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 shutdown_connections 2023-12-17T11:59:27.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.081+0000 7ff426b50700 1 -- 172.21.15.2:0/594131005 wait complete. 2023-12-17T11:59:27.097 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 -- 172.21.15.2:0/2267801550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fcbf0 msgr2=0x7fac940fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 --2- 172.21.15.2:0/2267801550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fcbf0 0x7fac940fd000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fac84004940 tx=0x7fac84009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 -- 172.21.15.2:0/2267801550 shutdown_connections 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 --2- 172.21.15.2:0/2267801550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac940fde00 0x7fac940fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 --2- 172.21.15.2:0/2267801550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fcbf0 0x7fac940fd000 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 -- 172.21.15.2:0/2267801550 >> 172.21.15.2:0/2267801550 conn(0x7fac940f82d0 msgr2=0x7fac940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.225+0000 7fac98838700 1 -- 172.21.15.2:0/2267801550 shutdown_connections 2023-12-17T11:59:27.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.226+0000 7fac98838700 1 -- 172.21.15.2:0/2267801550 wait complete. 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.226+0000 7fac98838700 1 Processor -- start 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac98838700 1 -- start start 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac98838700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac940fcbf0 0x7fac94071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac98838700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 0x7fac9406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac98838700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94111240 con 0x7fac940fde00 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac98838700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac941113b0 con 0x7fac940fcbf0 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac91d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 0x7fac9406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac91d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 0x7fac9406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33140/0 (socket says 172.21.15.2:33140) 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac91d9b700 1 -- 172.21.15.2:0/609179364 learned_addr learned my addr 172.21.15.2:0/609179364 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.227+0000 7fac9259c700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac940fcbf0 0x7fac94071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac91d9b700 1 -- 172.21.15.2:0/609179364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac940fcbf0 msgr2=0x7fac94071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac91d9b700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac940fcbf0 0x7fac94071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac91d9b700 1 -- 172.21.15.2:0/609179364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84005040 con 0x7fac940fde00 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac91d9b700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 0x7fac9406ff90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac88002a50 tx=0x7fac880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac88007cc0 con 0x7fac940fde00 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fac8800f040 con 0x7fac940fde00 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac940705f0 con 0x7fac940fde00 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac8800d9c0 con 0x7fac940fde00 2023-12-17T11:59:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.228+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac94070b30 con 0x7fac940fde00 2023-12-17T11:59:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.229+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9404bb80 con 0x7fac940fde00 2023-12-17T11:59:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.230+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 90897+0+0 (secure 0 0 0) 0x7fac8800db20 con 0x7fac940fde00 2023-12-17T11:59:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.231+0000 7fac82ffd700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fac7c06cc00 0x7fac7c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.231+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fac8808bd30 con 0x7fac940fde00 2023-12-17T11:59:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.231+0000 7fac9259c700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fac7c06cc00 0x7fac7c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.232+0000 7fac9259c700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fac7c06cc00 0x7fac7c06f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac8400b7d0 tx=0x7fac84009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.235+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fac880598e0 con 0x7fac940fde00 2023-12-17T11:59:27.319 DEBUG:teuthology.parallel:result is None 2023-12-17T11:59:27.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-17T11:59:27.399 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-17T11:59:27.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-17T11:59:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.475+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac94102750 con 0x7fac7c06cc00 2023-12-17T11:59:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.476+0000 7fac82ffd700 1 -- 172.21.15.2:0/609179364 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fac94102750 con 0x7fac7c06cc00 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fac7c06cc00 msgr2=0x7fac7c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fac7c06cc00 0x7fac7c06f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fac8400b7d0 tx=0x7fac84009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 msgr2=0x7fac9406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 0x7fac9406ff90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac88002a50 tx=0x7fac880046b0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 shutdown_connections 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac940fcbf0 0x7fac94071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fac7c06cc00 0x7fac7c06f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 --2- 172.21.15.2:0/609179364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac940fde00 0x7fac9406ff90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.479+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 >> 172.21.15.2:0/609179364 conn(0x7fac940f82d0 msgr2=0x7fac94101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.480+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 shutdown_connections 2023-12-17T11:59:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.480+0000 7fac98838700 1 -- 172.21.15.2:0/609179364 wait complete. 2023-12-17T11:59:27.484 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-17T11:59:27.485 DEBUG:teuthology.parallel:result is None 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 -- 172.21.15.2:0/1244239308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 msgr2=0x7f98f40ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 --2- 172.21.15.2:0/1244239308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f40ff210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f98f0004940 tx=0x7f98f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 -- 172.21.15.2:0/1244239308 shutdown_connections 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 --2- 172.21.15.2:0/1244239308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 0x7f98f41003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 --2- 172.21.15.2:0/1244239308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f40ff210 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 -- 172.21.15.2:0/1244239308 >> 172.21.15.2:0/1244239308 conn(0x7f98f40fa5d0 msgr2=0x7f98f40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 -- 172.21.15.2:0/1244239308 shutdown_connections 2023-12-17T11:59:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.622+0000 7f98fb932700 1 -- 172.21.15.2:0/1244239308 wait complete. 2023-12-17T11:59:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.623+0000 7f98fb932700 1 Processor -- start 2023-12-17T11:59:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.623+0000 7f98fb932700 1 -- start start 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.623+0000 7f98fb932700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f410f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.623+0000 7f98fb932700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 0x7f98f410fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.623+0000 7f98fb932700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4110250 con 0x7f98f40fee00 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.623+0000 7f98fb932700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4110af0 con 0x7f98f40fff70 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f410f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f410f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33168/0 (socket says 172.21.15.2:33168) 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 -- 172.21.15.2:0/1450481866 learned_addr learned my addr 172.21.15.2:0/1450481866 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f8ecd700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 0x7f98f410fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 -- 172.21.15.2:0/1450481866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 msgr2=0x7f98f410fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 0x7f98f410fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 -- 172.21.15.2:0/1450481866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0005040 con 0x7f98f40fee00 2023-12-17T11:59:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f8ecd700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 0x7f98f410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:59:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.624+0000 7f98f96ce700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f410f710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f98f00040d0 tx=0x7f98f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.625+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f0021070 con 0x7f98f40fee00 2023-12-17T11:59:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.625+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98f001c400 con 0x7f98f40fee00 2023-12-17T11:59:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.625+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98f000e070 con 0x7f98f40fee00 2023-12-17T11:59:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.625+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f4110d70 con 0x7f98f40fee00 2023-12-17T11:59:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.625+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f4111250 con 0x7f98f40fee00 2023-12-17T11:59:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.626+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f404bb80 con 0x7f98f40fee00 2023-12-17T11:59:27.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.627+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 90897+0+0 (secure 0 0 0) 0x7f98f001c9c0 con 0x7f98f40fee00 2023-12-17T11:59:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.628+0000 7f98e9ffb700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e006cc00 0x7f98e006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.628+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f98f008d120 con 0x7f98f40fee00 2023-12-17T11:59:27.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.628+0000 7f98f8ecd700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e006cc00 0x7f98e006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:27.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.630+0000 7f98f8ecd700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e006cc00 0x7f98e006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98e4004600 tx=0x7f98e400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:27.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.633+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f98f005ae10 con 0x7f98f40fee00 2023-12-17T11:59:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.869+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f98f4111990 con 0x7f98e006cc00 2023-12-17T11:59:27.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.880+0000 7f98e9ffb700 1 -- 172.21.15.2:0/1450481866 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f98f4111990 con 0x7f98e006cc00 2023-12-17T11:59:27.882 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T11:59:27.882 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (107s) 8s ago 9m 15.5M - 0.25.0 c8568f914cd2 2f4dbb3520de 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (9m) 8s ago 9m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (8m) 9s ago 8m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (102s) 8s ago 8m 79.5M - 9.4.7 954c08fa6188 af7992352f21 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (4m) 8s ago 4m 6351M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (4m) 8s ago 4m 14.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (4m) 9s ago 4m 4726M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (4m) 9s ago 4m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (83s) 8s ago 10m 505M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (42s) 9s ago 8m 449M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (10m) 8s ago 10m 98.4M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (8m) 9s ago 8m 68.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (17s) 8s ago 9m 7545k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T11:59:27.883 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (13s) 9s ago 8m 3602k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 8s ago 7m 725M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (7m) 8s ago 7m 830M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (6m) 8s ago 6m 601M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (6m) 9s ago 6m 916M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (5m) 9s ago 5m 704M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (5m) 9s ago 5m 803M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (47s) 8s ago 8m 40.6M - 2.43.0 a07b618ecd1d d892b91c7eb8 2023-12-17T11:59:27.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.882+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e006cc00 msgr2=0x7f98e006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.882+0000 7f98fb932700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e006cc00 0x7f98e006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98e4004600 tx=0x7f98e400b040 comp rx=0 tx=0).stop 2023-12-17T11:59:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.882+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 msgr2=0x7f98f410f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.882+0000 7f98fb932700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f410f710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f98f00040d0 tx=0x7f98f0009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 shutdown_connections 2023-12-17T11:59:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f98e006cc00 0x7f98e006f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98f40fee00 0x7f98f410f710 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 --2- 172.21.15.2:0/1450481866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98f40fff70 0x7f98f410fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 >> 172.21.15.2:0/1450481866 conn(0x7f98f40fa5d0 msgr2=0x7f98f4103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 shutdown_connections 2023-12-17T11:59:27.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:27.883+0000 7f98fb932700 1 -- 172.21.15.2:0/1450481866 wait complete. 2023-12-17T11:59:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 -- 172.21.15.2:0/3847602170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 msgr2=0x7f8a6c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 --2- 172.21.15.2:0/3847602170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c0fd000 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8a68004940 tx=0x7f8a68009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 -- 172.21.15.2:0/3847602170 shutdown_connections 2023-12-17T11:59:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 --2- 172.21.15.2:0/3847602170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6c0fde00 0x7f8a6c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 --2- 172.21.15.2:0/3847602170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c0fd000 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 -- 172.21.15.2:0/3847602170 >> 172.21.15.2:0/3847602170 conn(0x7f8a6c0f82d0 msgr2=0x7f8a6c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 -- 172.21.15.2:0/3847602170 shutdown_connections 2023-12-17T11:59:28.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.040+0000 7f8a7421d700 1 -- 172.21.15.2:0/3847602170 wait complete. 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a7421d700 1 Processor -- start 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a7421d700 1 -- start start 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a7421d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a7421d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6c0fde00 0x7f8a6c10da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a7421d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c10e010 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a7421d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6c10e8b0 con 0x7f8a6c0fde00 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.041+0000 7f8a71fb9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a71fb9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33194/0 (socket says 172.21.15.2:33194) 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a71fb9700 1 -- 172.21.15.2:0/1094850696 learned_addr learned my addr 172.21.15.2:0/1094850696 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a717b8700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6c0fde00 0x7f8a6c10da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a71fb9700 1 -- 172.21.15.2:0/1094850696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6c0fde00 msgr2=0x7f8a6c10da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a71fb9700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6c0fde00 0x7f8a6c10da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a71fb9700 1 -- 172.21.15.2:0/1094850696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68005040 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a71fb9700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c10d4d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a68008f80 tx=0x7f8a68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a68021070 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a6801c400 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6c10eb30 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.042+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a6800e070 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.043+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6c10f010 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.044+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6c04bb80 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.045+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 90897+0+0 (secure 0 0 0) 0x7f8a6801c9c0 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.046+0000 7f8a627fc700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f8a5806cc00 0x7f8a5806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.046+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f8a6808d3b0 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.046+0000 7f8a717b8700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f8a5806cc00 0x7f8a5806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.046+0000 7f8a717b8700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f8a5806cc00 0x7f8a5806f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c004600 tx=0x7f8a5c00b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:28.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.050+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8a6805af60 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.405+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a6c10f310 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.407+0000 7f8a627fc700 1 -- 172.21.15.2:0/1094850696 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f8a6805aaf0 con 0x7f8a6c0fcbf0 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T11:59:28.409 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T11:59:28.410 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.409+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f8a5806cc00 msgr2=0x7f8a5806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.409+0000 7f8a7421d700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f8a5806cc00 0x7f8a5806f0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c004600 tx=0x7f8a5c00b040 comp rx=0 tx=0).stop 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.409+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 msgr2=0x7f8a6c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.409+0000 7f8a7421d700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c10d4d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a68008f80 tx=0x7f8a68009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 shutdown_connections 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f8a5806cc00 0x7f8a5806f0b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a6c0fcbf0 0x7f8a6c10d4d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 --2- 172.21.15.2:0/1094850696 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a6c0fde00 0x7f8a6c10da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 >> 172.21.15.2:0/1094850696 conn(0x7f8a6c0f82d0 msgr2=0x7f8a6c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 shutdown_connections 2023-12-17T11:59:28.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.410+0000 7f8a7421d700 1 -- 172.21.15.2:0/1094850696 wait complete. 2023-12-17T11:59:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.550+0000 7f2bc4943700 1 -- 172.21.15.2:0/3309517177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 msgr2=0x7f2bc00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.550+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3309517177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc00fd000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0004940 tx=0x7f2bb0009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.551+0000 7f2bc4943700 1 -- 172.21.15.2:0/3309517177 shutdown_connections 2023-12-17T11:59:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.551+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3309517177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00fde00 0x7f2bc00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.551+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3309517177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc00fd000 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.551+0000 7f2bc4943700 1 -- 172.21.15.2:0/3309517177 >> 172.21.15.2:0/3309517177 conn(0x7f2bc00f82d0 msgr2=0x7f2bc00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.551+0000 7f2bc4943700 1 -- 172.21.15.2:0/3309517177 shutdown_connections 2023-12-17T11:59:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.551+0000 7f2bc4943700 1 -- 172.21.15.2:0/3309517177 wait complete. 2023-12-17T11:59:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bc4943700 1 Processor -- start 2023-12-17T11:59:28.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bc4943700 1 -- start start 2023-12-17T11:59:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bc4943700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bc4943700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00fde00 0x7f2bc006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bc4943700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0070590 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bc4943700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0070700 con 0x7f2bc00fde00 2023-12-17T11:59:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bbe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bbe59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33218/0 (socket says 172.21.15.2:33218) 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.552+0000 7f2bbe59c700 1 -- 172.21.15.2:0/3752505755 learned_addr learned my addr 172.21.15.2:0/3752505755 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.553+0000 7f2bbdd9b700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00fde00 0x7f2bc006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.553+0000 7f2bbe59c700 1 -- 172.21.15.2:0/3752505755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00fde00 msgr2=0x7f2bc006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.553+0000 7f2bbe59c700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00fde00 0x7f2bc006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.553+0000 7f2bbe59c700 1 -- 172.21.15.2:0/3752505755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb0005040 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.553+0000 7f2bbe59c700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc0071b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009360 tx=0x7f2bb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.554+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb000e040 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.554+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2bb0004290 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.554+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bb001c3f0 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.554+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc0070980 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.554+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc0115590 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.555+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc004bb80 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.556+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 32) v1 ==== 90897+0+0 (secure 0 0 0) 0x7f2bb0013770 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.557+0000 7f2baeffd700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2ba806cc00 0x7f2ba806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.557+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2bb008d380 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.558+0000 7f2bbdd9b700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2ba806cc00 0x7f2ba806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.558+0000 7f2bbdd9b700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2ba806cc00 0x7f2ba806f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4004f40 tx=0x7f2bb400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:28.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.562+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2bb005af30 con 0x7f2bc00fcbf0 2023-12-17T11:59:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:28 smithi119 ceph-mon[117414]: pgmap v38: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 278 op/s 2023-12-17T11:59:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:28 smithi119 ceph-mon[117414]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:28 smithi119 ceph-mon[117414]: Upgrade: Updating prometheus.smithi002 2023-12-17T11:59:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:28 smithi119 ceph-mon[117414]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:28 smithi119 ceph-mon[117414]: Deploying daemon prometheus.smithi002 on smithi002 2023-12-17T11:59:28.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:28 smithi002 ceph-mon[107131]: pgmap v38: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 278 op/s 2023-12-17T11:59:28.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:28 smithi002 ceph-mon[107131]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:28.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:28 smithi002 ceph-mon[107131]: Upgrade: Updating prometheus.smithi002 2023-12-17T11:59:28.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:28 smithi002 ceph-mon[107131]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:28.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:28 smithi002 ceph-mon[107131]: Deploying daemon prometheus.smithi002 on smithi002 2023-12-17T11:59:28.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.796+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bc0102750 con 0x7f2ba806cc00 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.798+0000 7f2baeffd700 1 -- 172.21.15.2:0/3752505755 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f2bc0102750 con 0x7f2ba806cc00 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T11:59:28.800 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2023-12-17T11:59:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T11:59:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2023-12-17T11:59:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading prometheus daemons", 2023-12-17T11:59:28.801 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T11:59:28.801 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T11:59:28.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2ba806cc00 msgr2=0x7f2ba806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2ba806cc00 0x7f2ba806f0b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4004f40 tx=0x7f2bb400b040 comp rx=0 tx=0).stop 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 msgr2=0x7f2bc0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc0071b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009360 tx=0x7f2bb0009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 shutdown_connections 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2ba806cc00 0x7f2ba806f0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc00fcbf0 0x7f2bc0071b10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 --2- 172.21.15.2:0/3752505755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc00fde00 0x7f2bc006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 >> 172.21.15.2:0/3752505755 conn(0x7f2bc00f82d0 msgr2=0x7f2bc0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.800+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 shutdown_connections 2023-12-17T11:59:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:28.801+0000 7f2bc4943700 1 -- 172.21.15.2:0/3752505755 wait complete. 2023-12-17T11:59:29.669 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:29 smithi002 ceph-mon[107131]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:29.669 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:29 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1094850696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:29.669 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:29 smithi002 ceph-mon[107131]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:29.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:29 smithi119 ceph-mon[117414]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:29.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:29 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1094850696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:29.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:29 smithi119 ceph-mon[117414]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:30.792 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:30 smithi002 ceph-mon[107131]: pgmap v39: 65 pgs: 65 active+clean; 336 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 394 op/s 2023-12-17T11:59:30.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:30 smithi119 ceph-mon[117414]: pgmap v39: 65 pgs: 65 active+clean; 336 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 394 op/s 2023-12-17T11:59:32.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:32 smithi119 ceph-mon[117414]: pgmap v40: 65 pgs: 65 active+clean; 336 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 270 op/s 2023-12-17T11:59:32.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:32 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:32.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:32 smithi002 ceph-mon[107131]: pgmap v40: 65 pgs: 65 active+clean; 336 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 270 op/s 2023-12-17T11:59:32.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:32 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:34.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:34 smithi002 ceph-mon[107131]: pgmap v41: 65 pgs: 65 active+clean; 336 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 270 op/s 2023-12-17T11:59:34.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:34 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:34.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:34 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:34.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:34 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:34 smithi119 ceph-mon[117414]: pgmap v41: 65 pgs: 65 active+clean; 336 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 270 op/s 2023-12-17T11:59:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:34 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:34 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:34 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:36.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:36 smithi119 ceph-mon[117414]: pgmap v42: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 283 op/s 2023-12-17T11:59:36.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:36 smithi002 ceph-mon[107131]: pgmap v42: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.3 MiB/s wr, 283 op/s 2023-12-17T11:59:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:38 smithi119 ceph-mon[117414]: pgmap v43: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 499 KiB/s wr, 128 op/s 2023-12-17T11:59:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:38 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:38.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:38 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:38.661 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:38 smithi002 ceph-mon[107131]: pgmap v43: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 499 KiB/s wr, 128 op/s 2023-12-17T11:59:38.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:38 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:38.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:38 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:39 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:39.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:39 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:40.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:39 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:40.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:39 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:40.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:40 smithi002 ceph-mon[107131]: pgmap v44: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 500 KiB/s wr, 129 op/s 2023-12-17T11:59:41.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:40 smithi119 ceph-mon[117414]: pgmap v44: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 500 KiB/s wr, 129 op/s 2023-12-17T11:59:42.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:42 smithi002 ceph-mon[107131]: pgmap v45: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 9.8 KiB/s wr, 14 op/s 2023-12-17T11:59:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:42 smithi119 ceph-mon[117414]: pgmap v45: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 9.8 KiB/s wr, 14 op/s 2023-12-17T11:59:44.670 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: pgmap v46: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 9.8 KiB/s wr, 14 op/s 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.671 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.672 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:44 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: pgmap v46: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 9.8 KiB/s wr, 14 op/s 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:44.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:44 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T11:59:46.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:46 smithi002 ceph-mon[107131]: pgmap v47: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 9.8 KiB/s wr, 14 op/s 2023-12-17T11:59:46.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:46 smithi002 ceph-mon[107131]: Upgrade: Updating alertmanager.smithi002 2023-12-17T11:59:46.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:46 smithi002 ceph-mon[107131]: Deploying daemon alertmanager.smithi002 on smithi002 2023-12-17T11:59:46.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:46 smithi119 ceph-mon[117414]: pgmap v47: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 255 B/s rd, 9.8 KiB/s wr, 14 op/s 2023-12-17T11:59:46.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:46 smithi119 ceph-mon[117414]: Upgrade: Updating alertmanager.smithi002 2023-12-17T11:59:46.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:46 smithi119 ceph-mon[117414]: Deploying daemon alertmanager.smithi002 on smithi002 2023-12-17T11:59:47.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:47.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T11:59:48.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:48 smithi119 ceph-mon[117414]: pgmap v48: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 767 B/s wr, 1 op/s 2023-12-17T11:59:48.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:48 smithi002 ceph-mon[107131]: pgmap v48: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 767 B/s wr, 1 op/s 2023-12-17T11:59:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: pgmap v49: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-17T11:59:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: mgrmap e33: smithi002.cqnuqs(active, since 92s), standbys: smithi119.nzblpy 2023-12-17T11:59:50.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:50 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: pgmap v49: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 1 op/s 2023-12-17T11:59:50.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: mgrmap e33: smithi002.cqnuqs(active, since 92s), standbys: smithi119.nzblpy 2023-12-17T11:59:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:50.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:50 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:52.583 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:52 smithi002 ceph-mon[107131]: pgmap v50: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:52.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:52 smithi119 ceph-mon[117414]: pgmap v50: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:54.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:54 smithi119 ceph-mon[117414]: pgmap v51: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:54.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:54 smithi002 ceph-mon[107131]: pgmap v51: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:55 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:55 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:55.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:55 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:55.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:55 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:56.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:56 smithi002 ceph-mon[107131]: pgmap v52: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:56.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:56.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:57.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:56 smithi119 ceph-mon[117414]: pgmap v52: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:57.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:57.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T11:59:58.937 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:58 smithi002 ceph-mon[107131]: pgmap v53: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 -- 172.21.15.2:0/1669652487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 msgr2=0x7f315c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 --2- 172.21.15.2:0/1669652487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c0ffb10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3150004940 tx=0x7f3150009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 -- 172.21.15.2:0/1669652487 shutdown_connections 2023-12-17T11:59:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 --2- 172.21.15.2:0/1669652487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c100050 0x7f315c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 --2- 172.21.15.2:0/1669652487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c0ffb10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:58.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 -- 172.21.15.2:0/1669652487 >> 172.21.15.2:0/1669652487 conn(0x7f315c0f7190 msgr2=0x7f315c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 -- 172.21.15.2:0/1669652487 shutdown_connections 2023-12-17T11:59:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.948+0000 7f316310e700 1 -- 172.21.15.2:0/1669652487 wait complete. 2023-12-17T11:59:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.949+0000 7f316310e700 1 Processor -- start 2023-12-17T11:59:58.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.949+0000 7f316310e700 1 -- start start 2023-12-17T11:59:58.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f316310e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c10d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f316310e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c100050 0x7f315c10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f316310e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c10dfd0 con 0x7f315c0fd730 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f316310e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c10e870 con 0x7f315c100050 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f3160eaa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c10d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f3160eaa700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c10d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34294/0 (socket says 172.21.15.2:34294) 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.950+0000 7f3160eaa700 1 -- 172.21.15.2:0/2371114589 learned_addr learned my addr 172.21.15.2:0/2371114589 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:58.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.951+0000 7f315bfff700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c100050 0x7f315c10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.951+0000 7f3160eaa700 1 -- 172.21.15.2:0/2371114589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c100050 msgr2=0x7f315c10d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.951+0000 7f3160eaa700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c100050 0x7f315c10d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.951+0000 7f3160eaa700 1 -- 172.21.15.2:0/2371114589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150005040 con 0x7f315c0fd730 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.951+0000 7f3160eaa700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c10d490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3150008f90 tx=0x7f3150009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.951+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3150021070 con 0x7f315c0fd730 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.952+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c10eaf0 con 0x7f315c0fd730 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.952+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f315001c400 con 0x7f315c0fd730 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.952+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c10f030 con 0x7f315c0fd730 2023-12-17T11:59:58.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.952+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315000e030 con 0x7f315c0fd730 2023-12-17T11:59:58.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.953+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c04bb80 con 0x7f315c0fd730 2023-12-17T11:59:58.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.954+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f315001ca00 con 0x7f315c0fd730 2023-12-17T11:59:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.955+0000 7f31597fa700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f314c06caf0 0x7f314c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.955+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f315008d050 con 0x7f315c0fd730 2023-12-17T11:59:58.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.955+0000 7f315bfff700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f314c06caf0 0x7f314c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:58.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.956+0000 7f315bfff700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f314c06caf0 0x7f314c06efa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3148009b80 tx=0x7f314800b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:58.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:58.963+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f315005ae20 con 0x7f315c0fd730 2023-12-17T11:59:59.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:58 smithi119 ceph-mon[117414]: pgmap v53: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T11:59:59.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.209+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f315c100cb0 con 0x7f314c06caf0 2023-12-17T11:59:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.210+0000 7f31597fa700 1 -- 172.21.15.2:0/2371114589 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f315c100cb0 con 0x7f314c06caf0 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.212+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f314c06caf0 msgr2=0x7f314c06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.212+0000 7f316310e700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f314c06caf0 0x7f314c06efa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3148009b80 tx=0x7f314800b040 comp rx=0 tx=0).stop 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.212+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 msgr2=0x7f315c10d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.212+0000 7f316310e700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c10d490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3150008f90 tx=0x7f3150009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 shutdown_connections 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f314c06caf0 0x7f314c06efa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f315c0fd730 0x7f315c10d490 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 --2- 172.21.15.2:0/2371114589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f315c100050 0x7f315c10d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 >> 172.21.15.2:0/2371114589 conn(0x7f315c0f7190 msgr2=0x7f315c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 shutdown_connections 2023-12-17T11:59:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.213+0000 7f316310e700 1 -- 172.21.15.2:0/2371114589 wait complete. 2023-12-17T11:59:59.230 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T11:59:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 -- 172.21.15.2:0/17249367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 msgr2=0x7f10a40ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 --2- 172.21.15.2:0/17249367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a40ff210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f10a0004940 tx=0x7f10a0009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 -- 172.21.15.2:0/17249367 shutdown_connections 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 --2- 172.21.15.2:0/17249367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10a40fff70 0x7f10a41003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 --2- 172.21.15.2:0/17249367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a40ff210 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 -- 172.21.15.2:0/17249367 >> 172.21.15.2:0/17249367 conn(0x7f10a40fa5d0 msgr2=0x7f10a40fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 -- 172.21.15.2:0/17249367 shutdown_connections 2023-12-17T11:59:59.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.372+0000 7f10abe0a700 1 -- 172.21.15.2:0/17249367 wait complete. 2023-12-17T11:59:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.373+0000 7f10abe0a700 1 Processor -- start 2023-12-17T11:59:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.373+0000 7f10abe0a700 1 -- start start 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10abe0a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a410f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10abe0a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10a40fff70 0x7f10a410fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10abe0a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41102b0 con 0x7f10a40fee00 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10abe0a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4110b50 con 0x7f10a40fff70 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a9ba6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a410f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a9ba6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a410f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51060/0 (socket says 172.21.15.2:51060) 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a9ba6700 1 -- 172.21.15.2:0/2096080279 learned_addr learned my addr 172.21.15.2:0/2096080279 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a93a5700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10a40fff70 0x7f10a410fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a9ba6700 1 -- 172.21.15.2:0/2096080279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10a40fff70 msgr2=0x7f10a410fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a9ba6700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10a40fff70 0x7f10a410fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.374+0000 7f10a9ba6700 1 -- 172.21.15.2:0/2096080279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0005040 con 0x7f10a40fee00 2023-12-17T11:59:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.375+0000 7f10a9ba6700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a410f770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f10a000b3b0 tx=0x7f10a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.375+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10a000e040 con 0x7f10a40fee00 2023-12-17T11:59:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.375+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10a000bc50 con 0x7f10a40fee00 2023-12-17T11:59:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.375+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a4110dd0 con 0x7f10a40fee00 2023-12-17T11:59:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.375+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10a001c630 con 0x7f10a40fee00 2023-12-17T11:59:59.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.375+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a4111310 con 0x7f10a40fee00 2023-12-17T11:59:59.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.376+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a404bb80 con 0x7f10a40fee00 2023-12-17T11:59:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.378+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f10a0013420 con 0x7f10a40fee00 2023-12-17T11:59:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.378+0000 7f109a7fc700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f109006caf0 0x7f109006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.379+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f10a008d270 con 0x7f10a40fee00 2023-12-17T11:59:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.379+0000 7f10a93a5700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f109006caf0 0x7f109006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.380+0000 7f10a93a5700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f109006caf0 0x7f109006efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1094004f40 tx=0x7f109400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.383+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f10a005b040 con 0x7f10a40fee00 2023-12-17T11:59:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.623+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10a4104950 con 0x7f109006caf0 2023-12-17T11:59:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.624+0000 7f109a7fc700 1 -- 172.21.15.2:0/2096080279 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f10a4104950 con 0x7f109006caf0 2023-12-17T11:59:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f109006caf0 msgr2=0x7f109006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f109006caf0 0x7f109006efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1094004f40 tx=0x7f109400b040 comp rx=0 tx=0).stop 2023-12-17T11:59:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 msgr2=0x7f10a410f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a410f770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f10a000b3b0 tx=0x7f10a0009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 shutdown_connections 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f109006caf0 0x7f109006efa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10a40fee00 0x7f10a410f770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 --2- 172.21.15.2:0/2096080279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10a40fff70 0x7f10a410fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 >> 172.21.15.2:0/2096080279 conn(0x7f10a40fa5d0 msgr2=0x7f10a4103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 shutdown_connections 2023-12-17T11:59:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.627+0000 7f10abe0a700 1 -- 172.21.15.2:0/2096080279 wait complete. 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 -- 172.21.15.2:0/761239825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 msgr2=0x7fb91010ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 --2- 172.21.15.2:0/761239825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 0x7fb91010ae70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb904004940 tx=0x7fb904009e30 comp rx=0 tx=0).stop 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 -- 172.21.15.2:0/761239825 shutdown_connections 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 --2- 172.21.15.2:0/761239825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 0x7fb91010ae70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 --2- 172.21.15.2:0/761239825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb91006e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 -- 172.21.15.2:0/761239825 >> 172.21.15.2:0/761239825 conn(0x7fb910069b20 msgr2=0x7fb91006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 -- 172.21.15.2:0/761239825 shutdown_connections 2023-12-17T11:59:59.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.780+0000 7fb914869700 1 -- 172.21.15.2:0/761239825 wait complete. 2023-12-17T11:59:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.781+0000 7fb914869700 1 Processor -- start 2023-12-17T11:59:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.782+0000 7fb914869700 1 -- start start 2023-12-17T11:59:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.782+0000 7fb914869700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb910115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.782+0000 7fb914869700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 0x7fb9101162a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:59.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.782+0000 7fb914869700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb910117060 con 0x7fb91006eb60 2023-12-17T11:59:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.782+0000 7fb914869700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9101171d0 con 0x7fb91006e210 2023-12-17T11:59:59.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 0x7fb9101162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb910115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90e59c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb910115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:35420/0 (socket says 172.21.15.2:35420) 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90e59c700 1 -- 172.21.15.2:0/1413776961 learned_addr learned my addr 172.21.15.2:0/1413776961 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90e59c700 1 -- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 msgr2=0x7fb9101162a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90e59c700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 0x7fb9101162a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.783+0000 7fb90e59c700 1 -- 172.21.15.2:0/1413776961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904005040 con 0x7fb91006e210 2023-12-17T11:59:59.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.784+0000 7fb90e59c700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb910115d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb90000eb70 tx=0x7fb90000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.784+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb900007cc0 con 0x7fb91006e210 2023-12-17T11:59:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.784+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb90000f040 con 0x7fb91006e210 2023-12-17T11:59:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.784+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9101173f0 con 0x7fb91006e210 2023-12-17T11:59:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.784+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90000c9d0 con 0x7fb91006e210 2023-12-17T11:59:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.784+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb910117930 con 0x7fb91006e210 2023-12-17T11:59:59.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.785+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91010fe00 con 0x7fb91006e210 2023-12-17T11:59:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.786+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fb90000cb30 con 0x7fb91006e210 2023-12-17T11:59:59.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.787+0000 7fb8feffd700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb8f806caf0 0x7fb8f806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:59.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.787+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb90008b870 con 0x7fb91006e210 2023-12-17T11:59:59.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.787+0000 7fb90dd9b700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb8f806caf0 0x7fb8f806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.788+0000 7fb90dd9b700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb8f806caf0 0x7fb8f806efa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb90400b0d0 tx=0x7fb904009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T11:59:59.792+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb900055c60 con 0x7fb91006e210 2023-12-17T12:00:00.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.030+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb910117ba0 con 0x7fb8f806caf0 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.041+0000 7fb8feffd700 1 -- 172.21.15.2:0/1413776961 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb910117ba0 con 0x7fb8f806caf0 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (11s) 5s ago 9m 15.3M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (9m) 5s ago 9m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (8m) 41s ago 8m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 5s ago 9m 80.4M - 9.4.7 954c08fa6188 af7992352f21 2023-12-17T12:00:00.043 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (4m) 5s ago 4m 6648M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (5m) 5s ago 5m 14.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (4m) 41s ago 4m 4726M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (4m) 41s ago 4m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (115s) 5s ago 11m 509M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (74s) 41s ago 8m 449M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (11m) 5s ago 11m 100M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (8m) 41s ago 8m 68.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (49s) 5s ago 9m 7562k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (45s) 41s ago 8m 3602k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (7m) 5s ago 7m 760M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (7m) 5s ago 7m 866M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (7m) 5s ago 7m 633M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (6m) 41s ago 6m 916M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:00:00.044 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (6m) 41s ago 6m 704M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:00:00.045 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (6m) 41s ago 6m 803M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:00:00.045 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (27s) 5s ago 9m 42.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb8f806caf0 msgr2=0x7fb8f806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb8f806caf0 0x7fb8f806efa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb90400b0d0 tx=0x7fb904009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 msgr2=0x7fb910115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb910115d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb90000eb70 tx=0x7fb90000b040 comp rx=0 tx=0).stop 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 shutdown_connections 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb91006e210 0x7fb910115d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.043+0000 7fb914869700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb8f806caf0 0x7fb8f806efa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.044+0000 7fb914869700 1 --2- 172.21.15.2:0/1413776961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb91006eb60 0x7fb9101162a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.044+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 >> 172.21.15.2:0/1413776961 conn(0x7fb910069b20 msgr2=0x7fb9101096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.044+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 shutdown_connections 2023-12-17T12:00:00.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.044+0000 7fb914869700 1 -- 172.21.15.2:0/1413776961 wait complete. 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.185+0000 7f374ce12700 1 -- 172.21.15.2:0/1416234674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748071bc0 msgr2=0x7f3748070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.185+0000 7f374ce12700 1 --2- 172.21.15.2:0/1416234674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748071bc0 0x7f3748070030 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3738004940 tx=0x7f3738009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.185+0000 7f374ce12700 1 -- 172.21.15.2:0/1416234674 shutdown_connections 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.185+0000 7f374ce12700 1 --2- 172.21.15.2:0/1416234674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748070570 0x7f37480709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.185+0000 7f374ce12700 1 --2- 172.21.15.2:0/1416234674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748071bc0 0x7f3748070030 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.185+0000 7f374ce12700 1 -- 172.21.15.2:0/1416234674 >> 172.21.15.2:0/1416234674 conn(0x7f37480f82d0 msgr2=0x7f37480fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.186+0000 7f374ce12700 1 -- 172.21.15.2:0/1416234674 shutdown_connections 2023-12-17T12:00:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.186+0000 7f374ce12700 1 -- 172.21.15.2:0/1416234674 wait complete. 2023-12-17T12:00:00.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.187+0000 7f374ce12700 1 Processor -- start 2023-12-17T12:00:00.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.187+0000 7f374ce12700 1 -- start start 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.187+0000 7f374ce12700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 0x7f374810f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.187+0000 7f374ce12700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748071bc0 0x7f374810fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.187+0000 7f374ce12700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748110420 con 0x7f3748070570 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.187+0000 7f374ce12700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748110cc0 con 0x7f3748071bc0 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f374659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 0x7f374810f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f374659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 0x7f374810f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51092/0 (socket says 172.21.15.2:51092) 2023-12-17T12:00:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f374659c700 1 -- 172.21.15.2:0/3474447982 learned_addr learned my addr 172.21.15.2:0/3474447982 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f3745d9b700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748071bc0 0x7f374810fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f374659c700 1 -- 172.21.15.2:0/3474447982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748071bc0 msgr2=0x7f374810fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f374659c700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748071bc0 0x7f374810fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f374659c700 1 -- 172.21.15.2:0/3474447982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738005040 con 0x7f3748070570 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.188+0000 7f3745d9b700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748071bc0 0x7f374810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.189+0000 7f374659c700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 0x7f374810f8e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3738009fd0 tx=0x7f3738009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.189+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3738021070 con 0x7f3748070570 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.189+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f373801c400 con 0x7f3748070570 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.189+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3748110f40 con 0x7f3748070570 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.189+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373800e070 con 0x7f3748070570 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.189+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3748111480 con 0x7f3748070570 2023-12-17T12:00:00.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.190+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37481096f0 con 0x7f3748070570 2023-12-17T12:00:00.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.191+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f373801ca00 con 0x7f3748070570 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: pgmap v54: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:00.194 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.195 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 11:59:59 smithi002 ceph-mon[107131]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.192+0000 7f3736ffd700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f373006caf0 0x7f373006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.192+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f373808cff0 con 0x7f3748070570 2023-12-17T12:00:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.193+0000 7f3745d9b700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f373006caf0 0x7f373006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:00.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.194+0000 7f3745d9b700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f373006caf0 0x7f373006efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f373c004600 tx=0x7f373c00b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:00.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.197+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f373805ade0 con 0x7f3748070570 2023-12-17T12:00:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: pgmap v54: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:00.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 11:59:59 smithi119 ceph-mon[117414]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:00.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.513+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3748109110 con 0x7f3748070570 2023-12-17T12:00:00.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.513+0000 7f3736ffd700 1 -- 172.21.15.2:0/3474447982 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f373805a970 con 0x7f3748070570 2023-12-17T12:00:00.516 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:00:00.516 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:00:00.516 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-17T12:00:00.517 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:00:00.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:00:00.518 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f373006caf0 msgr2=0x7f373006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f373006caf0 0x7f373006efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f373c004600 tx=0x7f373c00b040 comp rx=0 tx=0).stop 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 msgr2=0x7f374810f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 0x7f374810f8e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3738009fd0 tx=0x7f3738009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 shutdown_connections 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f373006caf0 0x7f373006efa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3748070570 0x7f374810f8e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 --2- 172.21.15.2:0/3474447982 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3748071bc0 0x7f374810fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 >> 172.21.15.2:0/3474447982 conn(0x7f37480f82d0 msgr2=0x7f3748103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.516+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 shutdown_connections 2023-12-17T12:00:00.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.517+0000 7f374ce12700 1 -- 172.21.15.2:0/3474447982 wait complete. 2023-12-17T12:00:00.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 -- 172.21.15.2:0/284324204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1734100050 msgr2=0x7f1734102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 --2- 172.21.15.2:0/284324204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1734100050 0x7f1734102430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1724004940 tx=0x7f1724009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 -- 172.21.15.2:0/284324204 shutdown_connections 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 --2- 172.21.15.2:0/284324204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1734100050 0x7f1734102430 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 --2- 172.21.15.2:0/284324204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17340fd730 0x7f17340ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 -- 172.21.15.2:0/284324204 >> 172.21.15.2:0/284324204 conn(0x7f17340f7190 msgr2=0x7f17340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 -- 172.21.15.2:0/284324204 shutdown_connections 2023-12-17T12:00:00.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.663+0000 7f173b6f1700 1 -- 172.21.15.2:0/284324204 wait complete. 2023-12-17T12:00:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.664+0000 7f173b6f1700 1 Processor -- start 2023-12-17T12:00:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173b6f1700 1 -- start start 2023-12-17T12:00:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173b6f1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 0x7f173410d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173b6f1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1734100050 0x7f173410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173b6f1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173410e070 con 0x7f17340fd730 2023-12-17T12:00:00.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173b6f1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173410e910 con 0x7f1734100050 2023-12-17T12:00:00.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173948d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 0x7f173410d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:00.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173948d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 0x7f173410d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51104/0 (socket says 172.21.15.2:51104) 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f173948d700 1 -- 172.21.15.2:0/506275099 learned_addr learned my addr 172.21.15.2:0/506275099 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.665+0000 7f1738c8c700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1734100050 0x7f173410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f173948d700 1 -- 172.21.15.2:0/506275099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1734100050 msgr2=0x7f173410da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f173948d700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1734100050 0x7f173410da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f173948d700 1 -- 172.21.15.2:0/506275099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1724005040 con 0x7f17340fd730 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f173948d700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 0x7f173410d530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1730002a50 tx=0x7f17300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1730007cc0 con 0x7f17340fd730 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f173000f040 con 0x7f17340fd730 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173410ebf0 con 0x7f17340fd730 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.666+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173000d9c0 con 0x7f17340fd730 2023-12-17T12:00:00.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.667+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173410f130 con 0x7f17340fd730 2023-12-17T12:00:00.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.668+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17341075c0 con 0x7f17340fd730 2023-12-17T12:00:00.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.669+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f173000db20 con 0x7f17340fd730 2023-12-17T12:00:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.670+0000 7f1729ffb700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f172006caf0 0x7f172006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.670+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f173008baa0 con 0x7f17340fd730 2023-12-17T12:00:00.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.670+0000 7f1738c8c700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f172006caf0 0x7f172006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:00.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.671+0000 7f1738c8c700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f172006caf0 0x7f172006efa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17240043d0 tx=0x7f1724009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:00.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.675+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1730059870 con 0x7f17340fd730 2023-12-17T12:00:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.910+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f173410f410 con 0x7f172006caf0 2023-12-17T12:00:00.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.912+0000 7f1729ffb700 1 -- 172.21.15.2:0/506275099 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f173410f410 con 0x7f172006caf0 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/2 daemons upgraded", 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading grafana daemons", 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:00:00.914 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:00:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f172006caf0 msgr2=0x7f172006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f172006caf0 0x7f172006efa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17240043d0 tx=0x7f1724009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 msgr2=0x7f173410d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 0x7f173410d530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1730002a50 tx=0x7f17300046b0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 shutdown_connections 2023-12-17T12:00:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f172006caf0 0x7f172006efa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17340fd730 0x7f173410d530 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 --2- 172.21.15.2:0/506275099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1734100050 0x7f173410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 >> 172.21.15.2:0/506275099 conn(0x7f17340f7190 msgr2=0x7f17340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 shutdown_connections 2023-12-17T12:00:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:00.914+0000 7f173b6f1700 1 -- 172.21.15.2:0/506275099 wait complete. 2023-12-17T12:00:01.279 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:00:01.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:00:01.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:00:01.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: from='client.24581 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:01.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3474447982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:01.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: Upgrade: Updating grafana.smithi002 2023-12-17T12:00:01.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:01 smithi002 ceph-mon[107131]: Deploying daemon grafana.smithi002 on smithi002 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: from='client.24581 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3474447982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: Upgrade: Updating grafana.smithi002 2023-12-17T12:00:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:01 smithi119 ceph-mon[117414]: Deploying daemon grafana.smithi002 on smithi002 2023-12-17T12:00:02.279 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:02 smithi002 ceph-mon[107131]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:02.280 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:02 smithi002 ceph-mon[107131]: pgmap v55: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:02.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:02 smithi119 ceph-mon[117414]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:02.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:02 smithi119 ceph-mon[117414]: pgmap v55: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:03.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:03 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:03.434 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:03 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:04.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:04 smithi002 ceph-mon[107131]: pgmap v56: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:04 smithi119 ceph-mon[117414]: pgmap v56: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:06.122 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:05 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:06.122 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:05 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:06.122 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:05 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:06.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:05 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:06.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:05 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:06.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:05 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:07.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:06 smithi119 ceph-mon[117414]: pgmap v57: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:07.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:06 smithi002 ceph-mon[107131]: pgmap v57: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:08.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:08 smithi002 ceph-mon[107131]: pgmap v58: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:09.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:08 smithi119 ceph-mon[117414]: pgmap v58: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:10.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:10 smithi119 ceph-mon[117414]: pgmap v59: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:10.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:10 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:10.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:10 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:10.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:10 smithi002 ceph-mon[107131]: pgmap v59: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:10.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:10 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:10.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:10 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:11 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:11 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:12.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:11 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:12.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:11 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:12.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:12 smithi002 ceph-mon[107131]: pgmap v60: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:12 smithi119 ceph-mon[117414]: pgmap v60: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:14.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: pgmap v61: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:14.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:14.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:14.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:14.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:14.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:14.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T12:00:14.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:14.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.978 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.979 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.980 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:14.981 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:14.981 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-17T12:00:14.981 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-17T12:00:14.981 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.981 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-17T12:00:14.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-17T12:00:14.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-17T12:00:14.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-17T12:00:14.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-17T12:00:14.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-17T12:00:14.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-17T12:00:14.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-17T12:00:14.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-17T12:00:14.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-17T12:00:14.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-17T12:00:14.983 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-17T12:00:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-17T12:00:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-17T12:00:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-17T12:00:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-17T12:00:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.984 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.985 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.985 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.985 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.985 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:14.985 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-17T12:00:14.986 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-17T12:00:14.986 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:14.986 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:14.986 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:14.986 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:14.986 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:14.987 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:14.987 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:14.987 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:14 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: pgmap v61: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-17T12:00:15.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-17T12:00:15.162 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:15.163 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:14 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:15.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:15 smithi002 ceph-mon[107131]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T12:00:15.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:15 smithi002 ceph-mon[107131]: Upgrade: Finalizing container_image settings 2023-12-17T12:00:15.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:15 smithi002 ceph-mon[107131]: Upgrade: Complete! 2023-12-17T12:00:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:15 smithi119 ceph-mon[117414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-17T12:00:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:15 smithi119 ceph-mon[117414]: Upgrade: Finalizing container_image settings 2023-12-17T12:00:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:15 smithi119 ceph-mon[117414]: Upgrade: Complete! 2023-12-17T12:00:16.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:16 smithi002 ceph-mon[107131]: pgmap v62: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:16 smithi119 ceph-mon[117414]: pgmap v62: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:17.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:17.982 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:17 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:18.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:18.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:17 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:18.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:18 smithi002 ceph-mon[107131]: pgmap v63: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:19.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:18 smithi119 ceph-mon[117414]: pgmap v63: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:21.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:20 smithi119 ceph-mon[117414]: pgmap v64: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:21.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:20 smithi002 ceph-mon[107131]: pgmap v64: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:23.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:22 smithi119 ceph-mon[117414]: pgmap v65: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:23.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:22 smithi002 ceph-mon[107131]: pgmap v65: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:25.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:24 smithi119 ceph-mon[117414]: pgmap v66: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:25.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:24 smithi002 ceph-mon[107131]: pgmap v66: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:27.161 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:26 smithi119 ceph-mon[117414]: pgmap v67: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:27.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:26 smithi002 ceph-mon[107131]: pgmap v67: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:28.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:28 smithi002 ceph-mon[107131]: pgmap v68: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:29.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:28 smithi119 ceph-mon[117414]: pgmap v68: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.071+0000 7fc907c31700 1 -- 172.21.15.2:0/3838816651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900071bc0 msgr2=0x7fc900070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.071+0000 7fc907c31700 1 --2- 172.21.15.2:0/3838816651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900071bc0 0x7fc900070030 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc004940 tx=0x7fc8fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.072+0000 7fc907c31700 1 -- 172.21.15.2:0/3838816651 shutdown_connections 2023-12-17T12:00:31.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.072+0000 7fc907c31700 1 --2- 172.21.15.2:0/3838816651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900070570 0x7fc9000709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.072+0000 7fc907c31700 1 --2- 172.21.15.2:0/3838816651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900071bc0 0x7fc900070030 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.072+0000 7fc907c31700 1 -- 172.21.15.2:0/3838816651 >> 172.21.15.2:0/3838816651 conn(0x7fc9000f82d0 msgr2=0x7fc9000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.072+0000 7fc907c31700 1 -- 172.21.15.2:0/3838816651 shutdown_connections 2023-12-17T12:00:31.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.072+0000 7fc907c31700 1 -- 172.21.15.2:0/3838816651 wait complete. 2023-12-17T12:00:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.073+0000 7fc907c31700 1 Processor -- start 2023-12-17T12:00:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.073+0000 7fc907c31700 1 -- start start 2023-12-17T12:00:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.073+0000 7fc907c31700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 0x7fc900113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.073+0000 7fc907c31700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900071bc0 0x7fc900114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.073+0000 7fc907c31700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900114660 con 0x7fc900070570 2023-12-17T12:00:31.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.073+0000 7fc907c31700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900114f00 con 0x7fc900071bc0 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 0x7fc900113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 0x7fc900113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55226/0 (socket says 172.21.15.2:55226) 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 -- 172.21.15.2:0/3015264907 learned_addr learned my addr 172.21.15.2:0/3015264907 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9051cc700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900071bc0 0x7fc900114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 -- 172.21.15.2:0/3015264907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900071bc0 msgr2=0x7fc900114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900071bc0 0x7fc900114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 -- 172.21.15.2:0/3015264907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc005040 con 0x7fc900070570 2023-12-17T12:00:31.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9051cc700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900071bc0 0x7fc900114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:00:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.074+0000 7fc9059cd700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 0x7fc900113b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009360 tx=0x7fc8fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.075+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8fc00e040 con 0x7fc900070570 2023-12-17T12:00:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.075+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8fc00bcd0 con 0x7fc900070570 2023-12-17T12:00:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.075+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8fc01c630 con 0x7fc900070570 2023-12-17T12:00:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.075+0000 7fc907c31700 1 -- 172.21.15.2:0/3015264907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc900115180 con 0x7fc900070570 2023-12-17T12:00:31.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.075+0000 7fc907c31700 1 -- 172.21.15.2:0/3015264907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc900115670 con 0x7fc900070570 2023-12-17T12:00:31.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.076+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90004bb80 con 0x7fc900070570 2023-12-17T12:00:31.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.077+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fc8fc013960 con 0x7fc900070570 2023-12-17T12:00:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.078+0000 7fc8f67fc700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc8ec06cae0 0x7fc8ec06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.078+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc8fc08d330 con 0x7fc900070570 2023-12-17T12:00:31.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.078+0000 7fc9051cc700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc8ec06cae0 0x7fc8ec06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:31.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.079+0000 7fc9051cc700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc8ec06cae0 0x7fc8ec06ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009fd0 tx=0x7fc8f0009ee0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:31.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.083+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc8fc05b100 con 0x7fc900070570 2023-12-17T12:00:31.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:30 smithi119 ceph-mon[117414]: pgmap v69: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:31.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:30 smithi002 ceph-mon[107131]: pgmap v69: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:31.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.318+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc90010bb70 con 0x7fc8ec06cae0 2023-12-17T12:00:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.319+0000 7fc8f67fc700 1 -- 172.21.15.2:0/3015264907 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc90010bb70 con 0x7fc8ec06cae0 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc8ec06cae0 msgr2=0x7fc8ec06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc8ec06cae0 0x7fc8ec06ef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009fd0 tx=0x7fc8f0009ee0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 msgr2=0x7fc900113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 0x7fc900113b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009360 tx=0x7fc8fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 shutdown_connections 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc8ec06cae0 0x7fc8ec06ef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc900070570 0x7fc900113b20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 --2- 172.21.15.2:0/3015264907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc900071bc0 0x7fc900114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.321+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 >> 172.21.15.2:0/3015264907 conn(0x7fc9000f82d0 msgr2=0x7fc9000fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.322+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 shutdown_connections 2023-12-17T12:00:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:31.322+0000 7fc8ebfff700 1 -- 172.21.15.2:0/3015264907 wait complete. 2023-12-17T12:00:31.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-17T12:00:32.218 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:32.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:32 smithi002 ceph-mon[107131]: pgmap v70: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:32.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:32 smithi002 ceph-mon[107131]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:32.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:32 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:32 smithi119 ceph-mon[117414]: pgmap v70: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:32 smithi119 ceph-mon[117414]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:32 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:33.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 -- 172.21.15.2:0/436547291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c102ba0 msgr2=0x7f720c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:33.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 --2- 172.21.15.2:0/436547291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c102ba0 0x7f720c102f70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f71fc004940 tx=0x7f71fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 -- 172.21.15.2:0/436547291 shutdown_connections 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 --2- 172.21.15.2:0/436547291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f720c103540 0x7f720c0fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 --2- 172.21.15.2:0/436547291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c102ba0 0x7f720c102f70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 -- 172.21.15.2:0/436547291 >> 172.21.15.2:0/436547291 conn(0x7f720c0f8730 msgr2=0x7f720c0fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 -- 172.21.15.2:0/436547291 shutdown_connections 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.346+0000 7f7210eef700 1 -- 172.21.15.2:0/436547291 wait complete. 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.347+0000 7f7210eef700 1 Processor -- start 2023-12-17T12:00:33.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.347+0000 7f7210eef700 1 -- start start 2023-12-17T12:00:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7210eef700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f720c102ba0 0x7f720c1156c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:33.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7210eef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 0x7f720c115c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7210eef700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c116290 con 0x7f720c103540 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7210eef700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c10f580 con 0x7f720c102ba0 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7209d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 0x7f720c115c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7209d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 0x7f720c115c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55240/0 (socket says 172.21.15.2:55240) 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7209d9b700 1 -- 172.21.15.2:0/4157081671 learned_addr learned my addr 172.21.15.2:0/4157081671 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f720a59c700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f720c102ba0 0x7f720c1156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7209d9b700 1 -- 172.21.15.2:0/4157081671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f720c102ba0 msgr2=0x7f720c1156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7209d9b700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f720c102ba0 0x7f720c1156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.348+0000 7f7209d9b700 1 -- 172.21.15.2:0/4157081671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc005040 con 0x7f720c103540 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.349+0000 7f7209d9b700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 0x7f720c115c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f720000eb40 tx=0x7f720000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.349+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7200007cc0 con 0x7f720c103540 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.349+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f720000f040 con 0x7f720c103540 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.349+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f720000c8f0 con 0x7f720c103540 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.349+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c10f7b0 con 0x7f720c103540 2023-12-17T12:00:33.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.349+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c10fcf0 con 0x7f720c103540 2023-12-17T12:00:33.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.350+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c0fc330 con 0x7f720c103540 2023-12-17T12:00:33.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.351+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f72000090d0 con 0x7f720c103540 2023-12-17T12:00:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.353+0000 7f71faffd700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f71f406cae0 0x7f71f406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.353+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f720008b7c0 con 0x7f720c103540 2023-12-17T12:00:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.353+0000 7f720a59c700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f71f406cae0 0x7f71f406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:33.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.354+0000 7f720a59c700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f71f406cae0 0x7f71f406ef90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000c00 tx=0x7f71fc009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:33.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.357+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7200059640 con 0x7f720c103540 2023-12-17T12:00:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.664+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f720c110d40 con 0x7f720c103540 2023-12-17T12:00:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.664+0000 7f71faffd700 1 -- 172.21.15.2:0/4157081671 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f72000591d0 con 0x7f720c103540 2023-12-17T12:00:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f71f406cae0 msgr2=0x7f71f406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f71f406cae0 0x7f71f406ef90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000c00 tx=0x7f71fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 msgr2=0x7f720c115c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 0x7f720c115c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f720000eb40 tx=0x7f720000b040 comp rx=0 tx=0).stop 2023-12-17T12:00:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 shutdown_connections 2023-12-17T12:00:33.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f720c102ba0 0x7f720c1156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f71f406cae0 0x7f71f406ef90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 --2- 172.21.15.2:0/4157081671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f720c103540 0x7f720c115c40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 >> 172.21.15.2:0/4157081671 conn(0x7f720c0f8730 msgr2=0x7f720c0f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 shutdown_connections 2023-12-17T12:00:33.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:33.667+0000 7f7210eef700 1 -- 172.21.15.2:0/4157081671 wait complete. 2023-12-17T12:00:33.683 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:00:33.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:33 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/4157081671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:34.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-17T12:00:34.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:33 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/4157081671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:34 smithi002 ceph-mon[107131]: pgmap v71: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:35.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:34 smithi119 ceph-mon[117414]: pgmap v71: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.702+0000 7f2fb2825700 1 -- 172.21.15.2:0/2949019875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 msgr2=0x7f2fac102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.702+0000 7f2fb2825700 1 --2- 172.21.15.2:0/2949019875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac102fc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c004940 tx=0x7f2f9c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.702+0000 7f2fb2825700 1 -- 172.21.15.2:0/2949019875 shutdown_connections 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.703+0000 7f2fb2825700 1 --2- 172.21.15.2:0/2949019875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fac103590 0x7f2fac0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.703+0000 7f2fb2825700 1 --2- 172.21.15.2:0/2949019875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac102fc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.703+0000 7f2fb2825700 1 -- 172.21.15.2:0/2949019875 >> 172.21.15.2:0/2949019875 conn(0x7f2fac0f87a0 msgr2=0x7f2fac0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.703+0000 7f2fb2825700 1 -- 172.21.15.2:0/2949019875 shutdown_connections 2023-12-17T12:00:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.703+0000 7f2fb2825700 1 -- 172.21.15.2:0/2949019875 wait complete. 2023-12-17T12:00:35.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.703+0000 7f2fb2825700 1 Processor -- start 2023-12-17T12:00:35.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fb2825700 1 -- start start 2023-12-17T12:00:35.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fb2825700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac1157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fb2825700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fac103590 0x7f2fac115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fb2825700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac116380 con 0x7f2fac102bf0 2023-12-17T12:00:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fb2825700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac10f6b0 con 0x7f2fac103590 2023-12-17T12:00:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac1157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fabfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac1157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55260/0 (socket says 172.21.15.2:55260) 2023-12-17T12:00:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.704+0000 7f2fabfff700 1 -- 172.21.15.2:0/3740203015 learned_addr learned my addr 172.21.15.2:0/3740203015 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fabfff700 1 -- 172.21.15.2:0/3740203015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fac103590 msgr2=0x7f2fac115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fabfff700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fac103590 0x7f2fac115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fabfff700 1 -- 172.21.15.2:0/3740203015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c005040 con 0x7f2fac102bf0 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fabfff700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac1157f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009fd0 tx=0x7f2f9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9c00e040 con 0x7f2fac102bf0 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f9c00bc50 con 0x7f2fac102bf0 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac10f930 con 0x7f2fac102bf0 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9c013ea0 con 0x7f2fac102bf0 2023-12-17T12:00:35.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.705+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac10fe70 con 0x7f2fac102bf0 2023-12-17T12:00:35.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.706+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac0fc3a0 con 0x7f2fac102bf0 2023-12-17T12:00:35.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.707+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f2f9c013420 con 0x7f2fac102bf0 2023-12-17T12:00:35.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.709+0000 7f2fa8ff9700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2f9406caf0 0x7f2f9406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.709+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2f9c08d340 con 0x7f2fac102bf0 2023-12-17T12:00:35.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.709+0000 7f2fab7fe700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2f9406caf0 0x7f2f9406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:35.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.710+0000 7f2fab7fe700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2f9406caf0 0x7f2f9406efa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fac111020 tx=0x7f2fa0009ce0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:35.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:35.713+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2f9c05b110 con 0x7f2fac102bf0 2023-12-17T12:00:36.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.013+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2fac04bb80 con 0x7f2fac102bf0 2023-12-17T12:00:36.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.014+0000 7f2fa8ff9700 1 -- 172.21.15.2:0/3740203015 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f2f9c05aca0 con 0x7f2fac102bf0 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2f9406caf0 msgr2=0x7f2f9406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2f9406caf0 0x7f2f9406efa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fac111020 tx=0x7f2fa0009ce0 comp rx=0 tx=0).stop 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 msgr2=0x7f2fac1157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac1157f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009fd0 tx=0x7f2f9c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 shutdown_connections 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f2f9406caf0 0x7f2f9406efa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fac102bf0 0x7f2fac1157f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 --2- 172.21.15.2:0/3740203015 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fac103590 0x7f2fac115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 >> 172.21.15.2:0/3740203015 conn(0x7f2fac0f87a0 msgr2=0x7f2fac0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 shutdown_connections 2023-12-17T12:00:36.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:36.016+0000 7f2fb2825700 1 -- 172.21.15.2:0/3740203015 wait complete. 2023-12-17T12:00:36.033 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)" 2023-12-17T12:00:36.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-17T12:00:36.846 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:37.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:36 smithi002 ceph-mon[107131]: pgmap v72: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:37.042 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:36 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/3740203015' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:37.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:36 smithi119 ceph-mon[117414]: pgmap v72: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:37.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:36 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/3740203015' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.112+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/2909628480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f40708f0 msgr2=0x7fa6f4108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.112+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/2909628480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f40708f0 0x7fa6f4108f10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4004970 tx=0x7fa6e4009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:38.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.113+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/2909628480 shutdown_connections 2023-12-17T12:00:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.113+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/2909628480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f40708f0 0x7fa6f4108f10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.113+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/2909628480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f406ffe0 0x7fa6f40703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.113+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/2909628480 >> 172.21.15.2:0/2909628480 conn(0x7fa6f40f8790 msgr2=0x7fa6f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.113+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/2909628480 shutdown_connections 2023-12-17T12:00:38.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.113+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/2909628480 wait complete. 2023-12-17T12:00:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fc6cf700 1 Processor -- start 2023-12-17T12:00:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fc6cf700 1 -- start start 2023-12-17T12:00:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fc6cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 0x7fa6f4115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:38.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fc6cf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f40708f0 0x7fa6f4115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fc6cf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f41163a0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fc6cf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f410f6d0 con 0x7fa6f40708f0 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.114+0000 7fa6fa46b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 0x7fa6f4115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6fa46b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 0x7fa6f4115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55274/0 (socket says 172.21.15.2:55274) 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6fa46b700 1 -- 172.21.15.2:0/162829740 learned_addr learned my addr 172.21.15.2:0/162829740 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6fa46b700 1 -- 172.21.15.2:0/162829740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f40708f0 msgr2=0x7fa6f4115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6fa46b700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f40708f0 0x7fa6f4115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6fa46b700 1 -- 172.21.15.2:0/162829740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4005040 con 0x7fa6f406ffe0 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6fa46b700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 0x7fa6f4115810 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0002a50 tx=0x7fa6f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:38.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f0007cc0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.115+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6f000f040 con 0x7fa6f406ffe0 2023-12-17T12:00:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.116+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f0009540 con 0x7fa6f406ffe0 2023-12-17T12:00:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.116+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f410f9b0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.116+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f410fef0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.117+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f41065d0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.118+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fa6f00096a0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.119+0000 7fa6eaffd700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa6e006cae0 0x7fa6e006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.119+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa6f008bb70 con 0x7fa6f406ffe0 2023-12-17T12:00:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.119+0000 7fa6f9c6a700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa6e006cae0 0x7fa6e006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.120+0000 7fa6f9c6a700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa6e006cae0 0x7fa6e006ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009fd0 tx=0x7fa6e4009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.123+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa6f0059940 con 0x7fa6f406ffe0 2023-12-17T12:00:38.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.426+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6f404bb80 con 0x7fa6f406ffe0 2023-12-17T12:00:38.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.426+0000 7fa6eaffd700 1 -- 172.21.15.2:0/162829740 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7fa6f00594d0 con 0x7fa6f406ffe0 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa6e006cae0 msgr2=0x7fa6e006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa6e006cae0 0x7fa6e006ef90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009fd0 tx=0x7fa6e4009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 msgr2=0x7fa6f4115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 0x7fa6f4115810 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0002a50 tx=0x7fa6f00046b0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 shutdown_connections 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fa6e006cae0 0x7fa6e006ef90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6f406ffe0 0x7fa6f4115810 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 --2- 172.21.15.2:0/162829740 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6f40708f0 0x7fa6f4115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 >> 172.21.15.2:0/162829740 conn(0x7fa6f40f8790 msgr2=0x7fa6f4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 shutdown_connections 2023-12-17T12:00:38.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:38.429+0000 7fa6fc6cf700 1 -- 172.21.15.2:0/162829740 wait complete. 2023-12-17T12:00:38.446 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:00:38.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-17T12:00:39.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:38 smithi119 ceph-mon[117414]: pgmap v73: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:39.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:38 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/162829740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:39.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:38 smithi002 ceph-mon[107131]: pgmap v73: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:39.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:38 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/162829740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:39.270 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 -- 172.21.15.2:0/1193354678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae78102c00 msgr2=0x7fae78102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 --2- 172.21.15.2:0/1193354678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae78102c00 0x7fae78102fd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae74004940 tx=0x7fae74009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 -- 172.21.15.2:0/1193354678 shutdown_connections 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 --2- 172.21.15.2:0/1193354678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae781035a0 0x7fae780fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 --2- 172.21.15.2:0/1193354678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae78102c00 0x7fae78102fd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 -- 172.21.15.2:0/1193354678 >> 172.21.15.2:0/1193354678 conn(0x7fae780f8790 msgr2=0x7fae780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 -- 172.21.15.2:0/1193354678 shutdown_connections 2023-12-17T12:00:40.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.447+0000 7fae802f2700 1 -- 172.21.15.2:0/1193354678 wait complete. 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.448+0000 7fae802f2700 1 Processor -- start 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.448+0000 7fae802f2700 1 -- start start 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae802f2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae78102c00 0x7fae78113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae802f2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 0x7fae78113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae802f2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae781141e0 con 0x7fae781035a0 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae802f2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7810d4d0 con 0x7fae78102c00 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae7d88d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 0x7fae78113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae7d88d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 0x7fae78113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53162/0 (socket says 172.21.15.2:53162) 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae7d88d700 1 -- 172.21.15.2:0/2973546778 learned_addr learned my addr 172.21.15.2:0/2973546778 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae7e08e700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae78102c00 0x7fae78113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae7d88d700 1 -- 172.21.15.2:0/2973546778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae78102c00 msgr2=0x7fae78113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:40.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.449+0000 7fae7d88d700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae78102c00 0x7fae78113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:40.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae7d88d700 1 -- 172.21.15.2:0/2973546778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74005040 con 0x7fae781035a0 2023-12-17T12:00:40.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae7d88d700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 0x7fae78113b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae68002a50 tx=0x7fae68004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:40.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae68007cc0 con 0x7fae781035a0 2023-12-17T12:00:40.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae6800f040 con 0x7fae781035a0 2023-12-17T12:00:40.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae6800d920 con 0x7fae781035a0 2023-12-17T12:00:40.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7810d760 con 0x7fae781035a0 2023-12-17T12:00:40.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.450+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7810dca0 con 0x7fae781035a0 2023-12-17T12:00:40.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.451+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae780fff10 con 0x7fae781035a0 2023-12-17T12:00:40.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.452+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fae68009680 con 0x7fae781035a0 2023-12-17T12:00:40.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.454+0000 7fae6effd700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fae6406caf0 0x7fae6406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:40.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.454+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fae6808ba40 con 0x7fae781035a0 2023-12-17T12:00:40.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.454+0000 7fae7e08e700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fae6406caf0 0x7fae6406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:40.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.455+0000 7fae7e08e700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fae6406caf0 0x7fae6406efa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae7400b840 tx=0x7fae74009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:40.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.459+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fae680598b0 con 0x7fae781035a0 2023-12-17T12:00:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:40.689+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "target": ["mon-mgr", ""]}) v1 -- 0x7fae7810ebf0 con 0x7fae6406caf0 2023-12-17T12:00:41.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:40 smithi119 ceph-mon[117414]: pgmap v74: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:41.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:40 smithi002 ceph-mon[107131]: pgmap v74: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:41.875 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:41 smithi002 ceph-mon[107131]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:42.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:41 smithi119 ceph-mon[117414]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.560+0000 7fae6effd700 1 -- 172.21.15.2:0/2973546778 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5090 (secure 0 0 0) 0x7fae7810ebf0 con 0x7fae6406caf0 2023-12-17T12:00:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fae6406caf0 msgr2=0x7fae6406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fae6406caf0 0x7fae6406efa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fae7400b840 tx=0x7fae74009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 msgr2=0x7fae78113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 0x7fae78113b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae68002a50 tx=0x7fae68004600 comp rx=0 tx=0).stop 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 shutdown_connections 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae78102c00 0x7fae78113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fae6406caf0 0x7fae6406efa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 --2- 172.21.15.2:0/2973546778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae781035a0 0x7fae78113b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 >> 172.21.15.2:0/2973546778 conn(0x7fae780f8790 msgr2=0x7fae780fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 shutdown_connections 2023-12-17T12:00:42.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:42.562+0000 7fae802f2700 1 -- 172.21.15.2:0/2973546778 wait complete. 2023-12-17T12:00:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:00:42.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch ps' 2023-12-17T12:00:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:42 smithi119 ceph-mon[117414]: pgmap v75: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:43.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:42 smithi002 ceph-mon[107131]: pgmap v75: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:43.351 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 -- 172.21.15.2:0/3786359998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c1035a0 msgr2=0x7f862c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 --2- 172.21.15.2:0/3786359998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c1035a0 0x7f862c0fcc10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8620004940 tx=0x7f8620009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 -- 172.21.15.2:0/3786359998 shutdown_connections 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 --2- 172.21.15.2:0/3786359998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c1035a0 0x7f862c0fcc10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 --2- 172.21.15.2:0/3786359998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c102c00 0x7f862c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 -- 172.21.15.2:0/3786359998 >> 172.21.15.2:0/3786359998 conn(0x7f862c0f8790 msgr2=0x7f862c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 -- 172.21.15.2:0/3786359998 shutdown_connections 2023-12-17T12:00:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.503+0000 7f86328c2700 1 -- 172.21.15.2:0/3786359998 wait complete. 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.504+0000 7f86328c2700 1 Processor -- start 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.504+0000 7f86328c2700 1 -- start start 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.504+0000 7f86328c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 0x7f862c115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.504+0000 7f86328c2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c1035a0 0x7f862c115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.504+0000 7f86328c2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1163e0 con 0x7f862c102c00 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.504+0000 7f86328c2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c10f710 con 0x7f862c1035a0 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 0x7f862c115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 0x7f862c115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53184/0 (socket says 172.21.15.2:53184) 2023-12-17T12:00:44.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 -- 172.21.15.2:0/543390493 learned_addr learned my addr 172.21.15.2:0/543390493 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862b7fe700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c1035a0 0x7f862c115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 -- 172.21.15.2:0/543390493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c1035a0 msgr2=0x7f862c115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c1035a0 0x7f862c115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 -- 172.21.15.2:0/543390493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620005040 con 0x7f862c102c00 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.505+0000 7f862bfff700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 0x7f862c115850 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f861c002a50 tx=0x7f861c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.506+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861c007cc0 con 0x7f862c102c00 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.506+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f861c00f040 con 0x7f862c102c00 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.506+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c10f9f0 con 0x7f862c102c00 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.506+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f861c00d9c0 con 0x7f862c102c00 2023-12-17T12:00:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.506+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c10ff00 con 0x7f862c102c00 2023-12-17T12:00:44.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.507+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c0fc390 con 0x7f862c102c00 2023-12-17T12:00:44.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.508+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f861c00db20 con 0x7f862c102c00 2023-12-17T12:00:44.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.509+0000 7f8628ff9700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f861406caf0 0x7f861406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:44.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.509+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f861c08bb90 con 0x7f862c102c00 2023-12-17T12:00:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.510+0000 7f862b7fe700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f861406caf0 0x7f861406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.510+0000 7f862b7fe700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f861406caf0 0x7f861406efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f862c111180 tx=0x7f8620009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:44.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.514+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f861c0598e0 con 0x7f862c102c00 2023-12-17T12:00:44.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.734+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f862c110ea0 con 0x7f861406caf0 2023-12-17T12:00:44.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.744+0000 7f8628ff9700 1 -- 172.21.15.2:0/543390493 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f862c110ea0 con 0x7f861406caf0 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (55s) 35s ago 10m 15.3M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (10m) 35s ago 10m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (9m) 85s ago 9m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (40s) 35s ago 10m 48.1M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (5m) 35s ago 5m 6648M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (5m) 35s ago 5m 14.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (5m) 85s ago 5m 4726M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (5m) 85s ago 5m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (2m) 35s ago 11m 511M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (119s) 85s ago 9m 449M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (11m) 35s ago 11m 101M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (9m) 85s ago 9m 68.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T12:00:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (94s) 35s ago 10m 7990k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (89s) 85s ago 9m 3602k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (8m) 35s ago 8m 761M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (8m) 35s ago 8m 867M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (7m) 35s ago 7m 633M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (7m) 85s ago 7m 916M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (7m) 85s ago 7m 704M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (6m) 85s ago 6m 803M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:00:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (71s) 35s ago 9m 46.4M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:00:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f861406caf0 msgr2=0x7f861406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f861406caf0 0x7f861406efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f862c111180 tx=0x7f8620009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 msgr2=0x7f862c115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 0x7f862c115850 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f861c002a50 tx=0x7f861c0046b0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 shutdown_connections 2023-12-17T12:00:44.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f861406caf0 0x7f861406efa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862c102c00 0x7f862c115850 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 --2- 172.21.15.2:0/543390493 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f862c1035a0 0x7f862c115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 >> 172.21.15.2:0/543390493 conn(0x7f862c0f8790 msgr2=0x7f862c0fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 shutdown_connections 2023-12-17T12:00:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:44.747+0000 7f86328c2700 1 -- 172.21.15.2:0/543390493 wait complete. 2023-12-17T12:00:45.094 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:44 smithi002 ceph-mon[107131]: pgmap v76: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:45.123 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-17T12:00:45.124 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T12:00:45.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-17T12:00:45.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:44 smithi119 ceph-mon[117414]: pgmap v76: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:45.565 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:46.086 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:45 smithi002 ceph-mon[107131]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:46.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:45 smithi119 ceph-mon[117414]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 -- 172.21.15.2:0/1445218470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f463806ffe0 msgr2=0x7f46380703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 --2- 172.21.15.2:0/1445218470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f463806ffe0 0x7f46380703b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4628004970 tx=0x7f4628009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 -- 172.21.15.2:0/1445218470 shutdown_connections 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 --2- 172.21.15.2:0/1445218470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46380708f0 0x7f4638108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 --2- 172.21.15.2:0/1445218470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f463806ffe0 0x7f46380703b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 -- 172.21.15.2:0/1445218470 >> 172.21.15.2:0/1445218470 conn(0x7f46380f8790 msgr2=0x7f46380faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 -- 172.21.15.2:0/1445218470 shutdown_connections 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.754+0000 7f463d564700 1 -- 172.21.15.2:0/1445218470 wait complete. 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.755+0000 7f463d564700 1 Processor -- start 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.755+0000 7f463d564700 1 -- start start 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f463d564700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f463806ffe0 0x7f46381157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f463d564700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 0x7f4638115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f463d564700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4638116380 con 0x7f46380708f0 2023-12-17T12:00:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f463d564700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463810f6b0 con 0x7f463806ffe0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f46367fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 0x7f4638115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f46367fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 0x7f4638115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53200/0 (socket says 172.21.15.2:53200) 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f46367fc700 1 -- 172.21.15.2:0/1562151343 learned_addr learned my addr 172.21.15.2:0/1562151343 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f4636ffd700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f463806ffe0 0x7f46381157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f46367fc700 1 -- 172.21.15.2:0/1562151343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f463806ffe0 msgr2=0x7f46381157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f46367fc700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f463806ffe0 0x7f46381157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.756+0000 7f46367fc700 1 -- 172.21.15.2:0/1562151343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628005040 con 0x7f46380708f0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.757+0000 7f46367fc700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 0x7f4638115d30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f462c002a50 tx=0x7f462c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.757+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462c007cc0 con 0x7f46380708f0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.757+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f462c00f040 con 0x7f46380708f0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.757+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462c00d9c0 con 0x7f46380708f0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.757+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463810f990 con 0x7f46380708f0 2023-12-17T12:00:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.757+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463810fe80 con 0x7f46380708f0 2023-12-17T12:00:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.758+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46381065d0 con 0x7f46380708f0 2023-12-17T12:00:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.759+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f462c00db20 con 0x7f46380708f0 2023-12-17T12:00:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.760+0000 7f461f7fe700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f462006caf0 0x7f462006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.760+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f462c08bb90 con 0x7f46380708f0 2023-12-17T12:00:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.761+0000 7f4636ffd700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f462006caf0 0x7f462006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.761+0000 7f4636ffd700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f462006caf0 0x7f462006efa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4628004940 tx=0x7f4628009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:46.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.765+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f462c0598e0 con 0x7f46380708f0 2023-12-17T12:00:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.982+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f463810bdb0 con 0x7f46380708f0 2023-12-17T12:00:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.987+0000 7f461f7fe700 1 -- 172.21.15.2:0/1562151343 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f462c059470 con 0x7f46380708f0 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.989+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f462006caf0 msgr2=0x7f462006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.989+0000 7f463d564700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f462006caf0 0x7f462006efa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4628004940 tx=0x7f4628009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.989+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 msgr2=0x7f4638115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.989+0000 7f463d564700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 0x7f4638115d30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f462c002a50 tx=0x7f462c0046b0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 shutdown_connections 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f463806ffe0 0x7f46381157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f462006caf0 0x7f462006efa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 --2- 172.21.15.2:0/1562151343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46380708f0 0x7f4638115d30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 >> 172.21.15.2:0/1562151343 conn(0x7f46380f8790 msgr2=0x7f4638103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 shutdown_connections 2023-12-17T12:00:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:46.990+0000 7f463d564700 1 -- 172.21.15.2:0/1562151343 wait complete. 2023-12-17T12:00:47.109 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:46 smithi002 ceph-mon[107131]: pgmap v77: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:46 smithi119 ceph-mon[117414]: pgmap v77: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:47.341 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-17T12:00:47.341 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T12:00:47.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-17T12:00:47.820 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:48.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1562151343' entity='client.admin' 2023-12-17T12:00:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: pgmap v78: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:47 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1562151343' entity='client.admin' 2023-12-17T12:00:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: pgmap v78: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:00:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:47 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 -- 172.21.15.2:0/1126565897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 msgr2=0x7f3708102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 --2- 172.21.15.2:0/1126565897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f3708102fd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f36fc004940 tx=0x7f36fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 -- 172.21.15.2:0/1126565897 shutdown_connections 2023-12-17T12:00:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 --2- 172.21.15.2:0/1126565897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37081035a0 0x7f37080fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 --2- 172.21.15.2:0/1126565897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f3708102fd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 -- 172.21.15.2:0/1126565897 >> 172.21.15.2:0/1126565897 conn(0x7f37080f8790 msgr2=0x7f37080faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.982+0000 7f370ede3700 1 -- 172.21.15.2:0/1126565897 shutdown_connections 2023-12-17T12:00:48.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.983+0000 7f370ede3700 1 -- 172.21.15.2:0/1126565897 wait complete. 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.983+0000 7f370ede3700 1 Processor -- start 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.983+0000 7f370ede3700 1 -- start start 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370ede3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f370806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370ede3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37081035a0 0x7f3708070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370ede3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3708070a80 con 0x7f3708102c00 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370ede3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3708070bf0 con 0x7f37081035a0 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370cb7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f370806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370cb7f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f370806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53206/0 (socket says 172.21.15.2:53206) 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f370cb7f700 1 -- 172.21.15.2:0/1678211852 learned_addr learned my addr 172.21.15.2:0/1678211852 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.984+0000 7f3707fff700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37081035a0 0x7f3708070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f370cb7f700 1 -- 172.21.15.2:0/1678211852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37081035a0 msgr2=0x7f3708070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:48.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f370cb7f700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37081035a0 0x7f3708070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f370cb7f700 1 -- 172.21.15.2:0/1678211852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc005040 con 0x7f3708102c00 2023-12-17T12:00:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f370cb7f700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f370806ff40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009360 tx=0x7f36fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc00e040 con 0x7f3708102c00 2023-12-17T12:00:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36fc013420 con 0x7f3708102c00 2023-12-17T12:00:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36fc01c610 con 0x7f3708102c00 2023-12-17T12:00:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3708119850 con 0x7f3708102c00 2023-12-17T12:00:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.985+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3708119cb0 con 0x7f3708102c00 2023-12-17T12:00:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.986+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37080fff10 con 0x7f3708102c00 2023-12-17T12:00:48.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.987+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f36fc013590 con 0x7f3708102c00 2023-12-17T12:00:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.988+0000 7f37057fa700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f36f806caf0 0x7f36f806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:48.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.988+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f36fc08d090 con 0x7f3708102c00 2023-12-17T12:00:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.988+0000 7f3707fff700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f36f806caf0 0x7f36f806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:48.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.989+0000 7f3707fff700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f36f806caf0 0x7f36f806efa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3708071940 tx=0x7f36f400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:48.992+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f36fc057480 con 0x7f3708102c00 2023-12-17T12:00:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.205+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f37080fc390 con 0x7f3708102c00 2023-12-17T12:00:49.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.206+0000 7f37057fa700 1 -- 172.21.15.2:0/1678211852 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f36fc05aaa0 con 0x7f3708102c00 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.208+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f36f806caf0 msgr2=0x7f36f806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.208+0000 7f370ede3700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f36f806caf0 0x7f36f806efa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3708071940 tx=0x7f36f400b040 comp rx=0 tx=0).stop 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.208+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 msgr2=0x7f370806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.208+0000 7f370ede3700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f370806ff40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009360 tx=0x7f36fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 shutdown_connections 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f36f806caf0 0x7f36f806efa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3708102c00 0x7f370806ff40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 --2- 172.21.15.2:0/1678211852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37081035a0 0x7f3708070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 >> 172.21.15.2:0/1678211852 conn(0x7f37080f8790 msgr2=0x7f37080fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 shutdown_connections 2023-12-17T12:00:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:49.209+0000 7f370ede3700 1 -- 172.21.15.2:0/1678211852 wait complete. 2023-12-17T12:00:49.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-17T12:00:50.040 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:50.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:50 smithi119 ceph-mon[117414]: pgmap v79: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:50.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:50 smithi002 ceph-mon[107131]: pgmap v79: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.225+0000 7fbb20726700 1 -- 172.21.15.2:0/4016397027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 msgr2=0x7fbb180fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.225+0000 7fbb20726700 1 --2- 172.21.15.2:0/4016397027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb180fffb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbb08004940 tx=0x7fbb08009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.226+0000 7fbb20726700 1 -- 172.21.15.2:0/4016397027 shutdown_connections 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.226+0000 7fbb20726700 1 --2- 172.21.15.2:0/4016397027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb180fffb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.226+0000 7fbb20726700 1 --2- 172.21.15.2:0/4016397027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb18101ad0 0x7fbb180ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.226+0000 7fbb20726700 1 -- 172.21.15.2:0/4016397027 >> 172.21.15.2:0/4016397027 conn(0x7fbb180719b0 msgr2=0x7fbb18071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.226+0000 7fbb20726700 1 -- 172.21.15.2:0/4016397027 shutdown_connections 2023-12-17T12:00:51.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.226+0000 7fbb20726700 1 -- 172.21.15.2:0/4016397027 wait complete. 2023-12-17T12:00:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.227+0000 7fbb20726700 1 Processor -- start 2023-12-17T12:00:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.227+0000 7fbb20726700 1 -- start start 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb20726700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb18119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb20726700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb18101ad0 0x7fbb1811a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb20726700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1811a870 con 0x7fbb180ffb40 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb20726700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18113b80 con 0x7fbb18101ad0 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1e4c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb18119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1e4c2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb18119ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50838/0 (socket says 172.21.15.2:50838) 2023-12-17T12:00:51.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1e4c2700 1 -- 172.21.15.2:0/2779210386 learned_addr learned my addr 172.21.15.2:0/2779210386 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:51.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1dcc1700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb18101ad0 0x7fbb1811a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:51.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1e4c2700 1 -- 172.21.15.2:0/2779210386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb18101ad0 msgr2=0x7fbb1811a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:51.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1e4c2700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb18101ad0 0x7fbb1811a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.228+0000 7fbb1e4c2700 1 -- 172.21.15.2:0/2779210386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08005040 con 0x7fbb180ffb40 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.229+0000 7fbb1e4c2700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb18119ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb14002a50 tx=0x7fbb140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.229+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb14007cc0 con 0x7fbb180ffb40 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.229+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb1400f040 con 0x7fbb180ffb40 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.229+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb18113e60 con 0x7fbb180ffb40 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.229+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb1400da70 con 0x7fbb180ffb40 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.229+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb181143a0 con 0x7fbb180ffb40 2023-12-17T12:00:51.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.230+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1810c0b0 con 0x7fbb180ffb40 2023-12-17T12:00:51.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.231+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fbb1400dc10 con 0x7fbb180ffb40 2023-12-17T12:00:51.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.232+0000 7fbb0effd700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbb0406caf0 0x7fbb0406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:51.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.232+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fbb1408b4c0 con 0x7fbb180ffb40 2023-12-17T12:00:51.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.232+0000 7fbb1dcc1700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbb0406caf0 0x7fbb0406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:51.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.233+0000 7fbb1dcc1700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbb0406caf0 0x7fbb0406efa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009fd0 tx=0x7fbb08009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:51.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.237+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbb14059290 con 0x7fbb180ffb40 2023-12-17T12:00:51.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.453+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fbb1804bb80 con 0x7fbb180ffb40 2023-12-17T12:00:51.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.454+0000 7fbb0effd700 1 -- 172.21.15.2:0/2779210386 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7fbb14058e20 con 0x7fbb180ffb40 2023-12-17T12:00:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbb0406caf0 msgr2=0x7fbb0406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbb0406caf0 0x7fbb0406efa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009fd0 tx=0x7fbb08009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 msgr2=0x7fbb18119ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:51.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb18119ce0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbb14002a50 tx=0x7fbb140046b0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 shutdown_connections 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fbb0406caf0 0x7fbb0406efa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb180ffb40 0x7fbb18119ce0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 --2- 172.21.15.2:0/2779210386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb18101ad0 0x7fbb1811a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 >> 172.21.15.2:0/2779210386 conn(0x7fbb180719b0 msgr2=0x7fbb180fa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 shutdown_connections 2023-12-17T12:00:51.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:51.456+0000 7fbb20726700 1 -- 172.21.15.2:0/2779210386 wait complete. 2023-12-17T12:00:51.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-17T12:00:52.291 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:52.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:52 smithi002 ceph-mon[107131]: pgmap v80: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:52.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:52 smithi119 ceph-mon[117414]: pgmap v80: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:53.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.463+0000 7f11da1ec700 1 -- 172.21.15.2:0/1673089436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d4102c00 msgr2=0x7f11d4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.463+0000 7f11da1ec700 1 --2- 172.21.15.2:0/1673089436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d4102c00 0x7f11d4102fd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f11c4004940 tx=0x7f11c4009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.463+0000 7f11da1ec700 1 -- 172.21.15.2:0/1673089436 shutdown_connections 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.463+0000 7f11da1ec700 1 --2- 172.21.15.2:0/1673089436 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d41035a0 0x7f11d40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.463+0000 7f11da1ec700 1 --2- 172.21.15.2:0/1673089436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d4102c00 0x7f11d4102fd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.463+0000 7f11da1ec700 1 -- 172.21.15.2:0/1673089436 >> 172.21.15.2:0/1673089436 conn(0x7f11d40f8790 msgr2=0x7f11d40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.464+0000 7f11da1ec700 1 -- 172.21.15.2:0/1673089436 shutdown_connections 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.464+0000 7f11da1ec700 1 -- 172.21.15.2:0/1673089436 wait complete. 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.464+0000 7f11da1ec700 1 Processor -- start 2023-12-17T12:00:53.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11da1ec700 1 -- start start 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11da1ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d4102c00 0x7f11d41135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11da1ec700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 0x7f11d4113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11da1ec700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4114160 con 0x7f11d41035a0 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11da1ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d410d500 con 0x7f11d4102c00 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 0x7f11d4113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11d2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 0x7f11d4113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50852/0 (socket says 172.21.15.2:50852) 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11d2ffd700 1 -- 172.21.15.2:0/3279244545 learned_addr learned my addr 172.21.15.2:0/3279244545 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.465+0000 7f11d37fe700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d4102c00 0x7f11d41135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11d2ffd700 1 -- 172.21.15.2:0/3279244545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d4102c00 msgr2=0x7f11d41135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11d2ffd700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d4102c00 0x7f11d41135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11d2ffd700 1 -- 172.21.15.2:0/3279244545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c4005040 con 0x7f11d41035a0 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11d2ffd700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 0x7f11d4113b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11c800eb40 tx=0x7f11c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:53.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c8007cc0 con 0x7f11d41035a0 2023-12-17T12:00:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f11c800f040 con 0x7f11d41035a0 2023-12-17T12:00:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d410d780 con 0x7f11d41035a0 2023-12-17T12:00:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c800c8f0 con 0x7f11d41035a0 2023-12-17T12:00:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.466+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d410dcc0 con 0x7f11d41035a0 2023-12-17T12:00:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.467+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d40fff10 con 0x7f11d41035a0 2023-12-17T12:00:53.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.468+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f11c80090d0 con 0x7f11d41035a0 2023-12-17T12:00:53.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.469+0000 7f11bbfff700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f11bc06caf0 0x7f11bc06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:53.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.469+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f11c808b7c0 con 0x7f11d41035a0 2023-12-17T12:00:53.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.470+0000 7f11d37fe700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f11bc06caf0 0x7f11bc06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:53.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.470+0000 7f11d37fe700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f11bc06caf0 0x7f11bc06efa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009fd0 tx=0x7f11c4009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:53.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.474+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f11c8059640 con 0x7f11d41035a0 2023-12-17T12:00:53.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.688+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f11d4109bb0 con 0x7f11d41035a0 2023-12-17T12:00:53.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.688+0000 7f11bbfff700 1 -- 172.21.15.2:0/3279244545 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f11c80591d0 con 0x7f11d41035a0 2023-12-17T12:00:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f11bc06caf0 msgr2=0x7f11bc06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f11bc06caf0 0x7f11bc06efa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009fd0 tx=0x7f11c4009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 msgr2=0x7f11d4113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 0x7f11d4113b10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11c800eb40 tx=0x7f11c800b040 comp rx=0 tx=0).stop 2023-12-17T12:00:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 shutdown_connections 2023-12-17T12:00:53.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11d4102c00 0x7f11d41135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f11bc06caf0 0x7f11bc06efa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 --2- 172.21.15.2:0/3279244545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d41035a0 0x7f11d4113b10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 >> 172.21.15.2:0/3279244545 conn(0x7f11d40f8790 msgr2=0x7f11d40fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 shutdown_connections 2023-12-17T12:00:53.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:53.691+0000 7f11da1ec700 1 -- 172.21.15.2:0/3279244545 wait complete. 2023-12-17T12:00:54.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-17T12:00:54.562 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:54.873 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:54 smithi002 ceph-mon[107131]: pgmap v81: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:54.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:54 smithi119 ceph-mon[117414]: pgmap v81: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.754+0000 7f64484ac700 1 -- 172.21.15.2:0/3162350495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440070520 msgr2=0x7f6440070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.754+0000 7f64484ac700 1 --2- 172.21.15.2:0/3162350495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440070520 0x7f6440070990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6430004970 tx=0x7f6430009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.754+0000 7f64484ac700 1 -- 172.21.15.2:0/3162350495 shutdown_connections 2023-12-17T12:00:55.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.754+0000 7f64484ac700 1 --2- 172.21.15.2:0/3162350495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440070520 0x7f6440070990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.754+0000 7f64484ac700 1 --2- 172.21.15.2:0/3162350495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6440071c10 0x7f644006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.754+0000 7f64484ac700 1 -- 172.21.15.2:0/3162350495 >> 172.21.15.2:0/3162350495 conn(0x7f64400f8790 msgr2=0x7f64400faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.755+0000 7f64484ac700 1 -- 172.21.15.2:0/3162350495 shutdown_connections 2023-12-17T12:00:55.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.755+0000 7f64484ac700 1 -- 172.21.15.2:0/3162350495 wait complete. 2023-12-17T12:00:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.755+0000 7f64484ac700 1 Processor -- start 2023-12-17T12:00:55.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f64484ac700 1 -- start start 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f64484ac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6440070520 0x7f6440119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f64484ac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 0x7f644011a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f64484ac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644011a790 con 0x7f6440071c10 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f64484ac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440113ac0 con 0x7f6440070520 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f6445a47700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 0x7f644011a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f6445a47700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 0x7f644011a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50860/0 (socket says 172.21.15.2:50860) 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.756+0000 7f6445a47700 1 -- 172.21.15.2:0/2961080506 learned_addr learned my addr 172.21.15.2:0/2961080506 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6446248700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6440070520 0x7f6440119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6445a47700 1 -- 172.21.15.2:0/2961080506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6440070520 msgr2=0x7f6440119c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6445a47700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6440070520 0x7f6440119c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6445a47700 1 -- 172.21.15.2:0/2961080506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430005040 con 0x7f6440071c10 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6445a47700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 0x7f644011a140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6430009380 tx=0x7f6430009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f643000e040 con 0x7f6440071c10 2023-12-17T12:00:55.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f643000bc10 con 0x7f6440071c10 2023-12-17T12:00:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f643001c630 con 0x7f6440071c10 2023-12-17T12:00:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.757+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6440113d40 con 0x7f6440071c10 2023-12-17T12:00:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.758+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6440114280 con 0x7f6440071c10 2023-12-17T12:00:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.759+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64400fe0b0 con 0x7f6440071c10 2023-12-17T12:00:55.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.760+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f643000bd80 con 0x7f6440071c10 2023-12-17T12:00:55.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.760+0000 7f6436ffd700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f642c06cae0 0x7f642c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:55.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.761+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f643008d260 con 0x7f6440071c10 2023-12-17T12:00:55.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.761+0000 7f6446248700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f642c06cae0 0x7f642c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:55.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.761+0000 7f6446248700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f642c06cae0 0x7f642c06ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f643c004990 tx=0x7f643c009ee0 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:55.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.765+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f643005b0b0 con 0x7f6440071c10 2023-12-17T12:00:56.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:55.998+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "target": ["mon-mgr", ""]}) v1 -- 0x7f64401101e0 con 0x7f642c06cae0 2023-12-17T12:00:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.004+0000 7f6436ffd700 1 -- 172.21.15.2:0/2961080506 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f64401101e0 con 0x7f642c06cae0 2023-12-17T12:00:56.006 INFO:teuthology.orchestra.run.smithi002.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T12:00:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f642c06cae0 msgr2=0x7f642c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f642c06cae0 0x7f642c06ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f643c004990 tx=0x7f643c009ee0 comp rx=0 tx=0).stop 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 msgr2=0x7f644011a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 0x7f644011a140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6430009380 tx=0x7f6430009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 shutdown_connections 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6440070520 0x7f6440119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f642c06cae0 0x7f642c06ef90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 --2- 172.21.15.2:0/2961080506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6440071c10 0x7f644011a140 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 >> 172.21.15.2:0/2961080506 conn(0x7f64400f8790 msgr2=0x7f64400fa4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 shutdown_connections 2023-12-17T12:00:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:56.006+0000 7f64484ac700 1 -- 172.21.15.2:0/2961080506 wait complete. 2023-12-17T12:00:56.433 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-17T12:00:56.433 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T12:00:56.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-17T12:00:56.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:56 smithi002 ceph-mon[107131]: pgmap v82: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:56 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:56.897 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:00:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:56 smithi119 ceph-mon[117414]: pgmap v82: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:56.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:56 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:57.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:57 smithi002 ceph-mon[107131]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:57.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:57 smithi002 ceph-mon[107131]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T12:00:57.722 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:57 smithi002 ceph-mon[107131]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T12:00:57.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:57 smithi119 ceph-mon[117414]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:57.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:57 smithi119 ceph-mon[117414]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T12:00:57.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:57 smithi119 ceph-mon[117414]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T12:00:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 -- 172.21.15.2:0/778555642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb790102c00 msgr2=0x7fb790102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 --2- 172.21.15.2:0/778555642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb790102c00 0x7fb790102fd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb78c004940 tx=0x7fb78c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 -- 172.21.15.2:0/778555642 shutdown_connections 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 --2- 172.21.15.2:0/778555642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7901035a0 0x7fb7900fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 --2- 172.21.15.2:0/778555642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb790102c00 0x7fb790102fd0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 -- 172.21.15.2:0/778555642 >> 172.21.15.2:0/778555642 conn(0x7fb7900f8790 msgr2=0x7fb7900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 -- 172.21.15.2:0/778555642 shutdown_connections 2023-12-17T12:00:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.288+0000 7fb79782c700 1 -- 172.21.15.2:0/778555642 wait complete. 2023-12-17T12:00:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.289+0000 7fb79782c700 1 Processor -- start 2023-12-17T12:00:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.289+0000 7fb79782c700 1 -- start start 2023-12-17T12:00:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.289+0000 7fb79782c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb790102c00 0x7fb790113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.289+0000 7fb79782c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 0x7fb790113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.289+0000 7fb79782c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901141e0 con 0x7fb7901035a0 2023-12-17T12:00:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.289+0000 7fb79782c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79010d4d0 con 0x7fb790102c00 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 0x7fb790113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 0x7fb790113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50874/0 (socket says 172.21.15.2:50874) 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 -- 172.21.15.2:0/2451774429 learned_addr learned my addr 172.21.15.2:0/2451774429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb7955c8700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb790102c00 0x7fb790113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 -- 172.21.15.2:0/2451774429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb790102c00 msgr2=0x7fb790113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb790102c00 0x7fb790113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 -- 172.21.15.2:0/2451774429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c005040 con 0x7fb7901035a0 2023-12-17T12:00:58.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.290+0000 7fb794dc7700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 0x7fb790113b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb780002a50 tx=0x7fb780004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.291+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb780007cc0 con 0x7fb7901035a0 2023-12-17T12:00:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.291+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb78000f040 con 0x7fb7901035a0 2023-12-17T12:00:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.291+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79010d760 con 0x7fb7901035a0 2023-12-17T12:00:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.291+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb78000d920 con 0x7fb7901035a0 2023-12-17T12:00:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.291+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79010dca0 con 0x7fb7901035a0 2023-12-17T12:00:58.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.292+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7900fff10 con 0x7fb7901035a0 2023-12-17T12:00:58.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.293+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fb780009680 con 0x7fb7901035a0 2023-12-17T12:00:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.294+0000 7fb785ffb700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb77c06caf0 0x7fb77c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.294+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb78008bae0 con 0x7fb7901035a0 2023-12-17T12:00:58.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.294+0000 7fb7955c8700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb77c06caf0 0x7fb77c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.295+0000 7fb7955c8700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb77c06caf0 0x7fb77c06efa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00b840 tx=0x7fb78c009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:58.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.298+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb7800598b0 con 0x7fb7901035a0 2023-12-17T12:00:58.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.558+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb79010ebf0 con 0x7fb77c06caf0 2023-12-17T12:00:58.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.559+0000 7fb785ffb700 1 -- 172.21.15.2:0/2451774429 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb79010ebf0 con 0x7fb77c06caf0 2023-12-17T12:00:58.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb77c06caf0 msgr2=0x7fb77c06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb77c06caf0 0x7fb77c06efa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00b840 tx=0x7fb78c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:58.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 msgr2=0x7fb790113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 0x7fb790113b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb780002a50 tx=0x7fb780004600 comp rx=0 tx=0).stop 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 shutdown_connections 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb790102c00 0x7fb790113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb77c06caf0 0x7fb77c06efa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 --2- 172.21.15.2:0/2451774429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7901035a0 0x7fb790113b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 >> 172.21.15.2:0/2451774429 conn(0x7fb7900f8790 msgr2=0x7fb7900fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 shutdown_connections 2023-12-17T12:00:58.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.562+0000 7fb79782c700 1 -- 172.21.15.2:0/2451774429 wait complete. 2023-12-17T12:00:58.579 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:00:58.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:58 smithi002 ceph-mon[107131]: pgmap v83: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:58.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:58 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:58.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:58 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:58.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:58 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:58.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:58 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:58.662 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:58 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.707+0000 7f0982a7d700 1 -- 172.21.15.2:0/4263739247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0708f0 msgr2=0x7f097c108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.707+0000 7f0982a7d700 1 --2- 172.21.15.2:0/4263739247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0708f0 0x7f097c108f10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0968004970 tx=0x7f0968009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.707+0000 7f0982a7d700 1 -- 172.21.15.2:0/4263739247 shutdown_connections 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.708+0000 7f0982a7d700 1 --2- 172.21.15.2:0/4263739247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c0708f0 0x7f097c108f10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.708+0000 7f0982a7d700 1 --2- 172.21.15.2:0/4263739247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c06ffe0 0x7f097c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.708+0000 7f0982a7d700 1 -- 172.21.15.2:0/4263739247 >> 172.21.15.2:0/4263739247 conn(0x7f097c0f8790 msgr2=0x7f097c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.708+0000 7f0982a7d700 1 -- 172.21.15.2:0/4263739247 shutdown_connections 2023-12-17T12:00:58.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.708+0000 7f0982a7d700 1 -- 172.21.15.2:0/4263739247 wait complete. 2023-12-17T12:00:58.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0982a7d700 1 Processor -- start 2023-12-17T12:00:58.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0982a7d700 1 -- start start 2023-12-17T12:00:58.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0982a7d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 0x7f097c115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:58.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0982a7d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0708f0 0x7f097c115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:58.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0982a7d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c1163a0 con 0x7f097c06ffe0 2023-12-17T12:00:58.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0982a7d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c10f6d0 con 0x7f097c0708f0 2023-12-17T12:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.709+0000 7f0980819700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 0x7f097c115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f0980819700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 0x7f097c115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50886/0 (socket says 172.21.15.2:50886) 2023-12-17T12:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f0980819700 1 -- 172.21.15.2:0/324191714 learned_addr learned my addr 172.21.15.2:0/324191714 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f097bfff700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0708f0 0x7f097c115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f0980819700 1 -- 172.21.15.2:0/324191714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0708f0 msgr2=0x7f097c115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f0980819700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0708f0 0x7f097c115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f0980819700 1 -- 172.21.15.2:0/324191714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968005040 con 0x7f097c06ffe0 2023-12-17T12:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f0980819700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 0x7f097c115810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f097000eb40 tx=0x7f097000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.710+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0970007cc0 con 0x7f097c06ffe0 2023-12-17T12:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.711+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f097000f040 con 0x7f097c06ffe0 2023-12-17T12:00:58.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.711+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c10f950 con 0x7f097c06ffe0 2023-12-17T12:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.711+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0970009570 con 0x7f097c06ffe0 2023-12-17T12:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.711+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c10fe60 con 0x7f097c06ffe0 2023-12-17T12:00:58.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.712+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c1065d0 con 0x7f097c06ffe0 2023-12-17T12:00:58.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.713+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f09700096d0 con 0x7f097c06ffe0 2023-12-17T12:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.714+0000 7f09797fa700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f096c06cae0 0x7f096c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.714+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f097008baa0 con 0x7f097c06ffe0 2023-12-17T12:00:58.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.714+0000 7f097bfff700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f096c06cae0 0x7f096c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:58.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.715+0000 7f097bfff700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f096c06cae0 0x7f096c06ef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f097c110a00 tx=0x7f0968009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:58.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.721+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0970059940 con 0x7f097c06ffe0 2023-12-17T12:00:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:58 smithi119 ceph-mon[117414]: pgmap v83: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:00:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:58 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:58 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:58 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:00:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:58 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:00:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:58 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-17T12:00:58.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.966+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f097c04bb80 con 0x7f096c06cae0 2023-12-17T12:00:58.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.968+0000 7f09797fa700 1 -- 172.21.15.2:0/324191714 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f097c04bb80 con 0x7f096c06cae0 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f096c06cae0 msgr2=0x7f096c06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f096c06cae0 0x7f096c06ef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f097c110a00 tx=0x7f0968009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 msgr2=0x7f097c115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 0x7f097c115810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f097000eb40 tx=0x7f097000b040 comp rx=0 tx=0).stop 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 shutdown_connections 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f096c06cae0 0x7f096c06ef90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f097c06ffe0 0x7f097c115810 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 --2- 172.21.15.2:0/324191714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f097c0708f0 0x7f097c115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.970+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 >> 172.21.15.2:0/324191714 conn(0x7f097c0f8790 msgr2=0x7f097c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.971+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 shutdown_connections 2023-12-17T12:00:58.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:58.971+0000 7f0982a7d700 1 -- 172.21.15.2:0/324191714 wait complete. 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 -- 172.21.15.2:0/1656804778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 msgr2=0x7f7140109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 --2- 172.21.15.2:0/1656804778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140109190 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7134004940 tx=0x7f7134009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 -- 172.21.15.2:0/1656804778 shutdown_connections 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 --2- 172.21.15.2:0/1656804778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140109190 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 --2- 172.21.15.2:0/1656804778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71400fc5d0 0x7f71400fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 -- 172.21.15.2:0/1656804778 >> 172.21.15.2:0/1656804778 conn(0x7f71400719b0 msgr2=0x7f7140071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 -- 172.21.15.2:0/1656804778 shutdown_connections 2023-12-17T12:00:59.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.121+0000 7f7144875700 1 -- 172.21.15.2:0/1656804778 wait complete. 2023-12-17T12:00:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.122+0000 7f7144875700 1 Processor -- start 2023-12-17T12:00:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.122+0000 7f7144875700 1 -- start start 2023-12-17T12:00:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f7144875700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71400fc5d0 0x7f7140115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f7144875700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140115e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f7144875700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71401164a0 con 0x7f71400fcee0 2023-12-17T12:00:59.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f7144875700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714010f840 con 0x7f71400fc5d0 2023-12-17T12:00:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140115e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140115e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60868/0 (socket says 172.21.15.2:60868) 2023-12-17T12:00:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713dd9b700 1 -- 172.21.15.2:0/1778426855 learned_addr learned my addr 172.21.15.2:0/1778426855 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:59.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713e59c700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71400fc5d0 0x7f7140115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713dd9b700 1 -- 172.21.15.2:0/1778426855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71400fc5d0 msgr2=0x7f7140115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713dd9b700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71400fc5d0 0x7f7140115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.123+0000 7f713dd9b700 1 -- 172.21.15.2:0/1778426855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134005040 con 0x7f71400fcee0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.124+0000 7f713dd9b700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140115e50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f713400b3b0 tx=0x7f7134009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.124+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f713400e040 con 0x7f71400fcee0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.124+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f713401c430 con 0x7f71400fcee0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.124+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714010fac0 con 0x7f71400fcee0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.124+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7134013640 con 0x7f71400fcee0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.124+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7140110000 con 0x7f71400fcee0 2023-12-17T12:00:59.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.125+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71401068c0 con 0x7f71400fcee0 2023-12-17T12:00:59.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.126+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f713401c5a0 con 0x7f71400fcee0 2023-12-17T12:00:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.128+0000 7f712effd700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f712806cae0 0x7f712806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.128+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f713408c8a0 con 0x7f71400fcee0 2023-12-17T12:00:59.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.128+0000 7f713e59c700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f712806cae0 0x7f712806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.129+0000 7f713e59c700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f712806cae0 0x7f712806ef90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7130004f40 tx=0x7f713000b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:59.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.133+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f713405a7a0 con 0x7f71400fcee0 2023-12-17T12:00:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.360+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71401155e0 con 0x7f712806cae0 2023-12-17T12:00:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.371+0000 7f712effd700 1 -- 172.21.15.2:0/1778426855 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f71401155e0 con 0x7f712806cae0 2023-12-17T12:00:59.374 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:00:59.374 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (70s) 49s ago 10m 15.3M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:00:59.374 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (10m) 49s ago 10m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T12:00:59.374 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (9m) 100s ago 9m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (54s) 49s ago 10m 48.1M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (5m) 49s ago 5m 6648M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (6m) 49s ago 6m 14.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (5m) 100s ago 5m 4726M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (5m) 100s ago 5m 14.1M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (2m) 49s ago 12m 511M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (2m) 100s ago 9m 449M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (12m) 49s ago 12m 101M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 bfbcbd865f4d 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (9m) 100s ago 9m 68.2M 2048M 17.2.7-125-g1f2f5510 60cc83a9c8f1 755b61effb85 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (109s) 49s ago 10m 7990k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (104s) 100s ago 9m 3602k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (8m) 49s ago 8m 761M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (8m) 49s ago 8m 867M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (8m) 49s ago 8m 633M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:00:59.375 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (7m) 100s ago 7m 916M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (7m) 100s ago 7m 704M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (7m) 100s ago 7m 803M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (86s) 49s ago 10m 46.4M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.373+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f712806cae0 msgr2=0x7f712806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.373+0000 7f7144875700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f712806cae0 0x7f712806ef90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7130004f40 tx=0x7f713000b040 comp rx=0 tx=0).stop 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.373+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 msgr2=0x7f7140115e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.373+0000 7f7144875700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140115e50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f713400b3b0 tx=0x7f7134009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 shutdown_connections 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71400fc5d0 0x7f7140115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f712806cae0 0x7f712806ef90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 --2- 172.21.15.2:0/1778426855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71400fcee0 0x7f7140115e50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 >> 172.21.15.2:0/1778426855 conn(0x7f71400719b0 msgr2=0x7f71400fa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 shutdown_connections 2023-12-17T12:00:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.374+0000 7f7144875700 1 -- 172.21.15.2:0/1778426855 wait complete. 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.517+0000 7f1257d99700 1 -- 172.21.15.2:0/1684401198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 msgr2=0x7f12500703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.517+0000 7f1257d99700 1 --2- 172.21.15.2:0/1684401198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12500703b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f124c004970 tx=0x7f124c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 -- 172.21.15.2:0/1684401198 shutdown_connections 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 --2- 172.21.15.2:0/1684401198 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12500708f0 0x7f1250108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 --2- 172.21.15.2:0/1684401198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12500703b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 -- 172.21.15.2:0/1684401198 >> 172.21.15.2:0/1684401198 conn(0x7f12500f8790 msgr2=0x7f12500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 -- 172.21.15.2:0/1684401198 shutdown_connections 2023-12-17T12:00:59.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 -- 172.21.15.2:0/1684401198 wait complete. 2023-12-17T12:00:59.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.518+0000 7f1257d99700 1 Processor -- start 2023-12-17T12:00:59.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1257d99700 1 -- start start 2023-12-17T12:00:59.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1257d99700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12501157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1257d99700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12500708f0 0x7f1250115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1257d99700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250116380 con 0x7f125006ffe0 2023-12-17T12:00:59.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1257d99700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125010f6b0 con 0x7f12500708f0 2023-12-17T12:00:59.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1255b35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12501157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1255b35700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12501157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60894/0 (socket says 172.21.15.2:60894) 2023-12-17T12:00:59.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.519+0000 7f1255b35700 1 -- 172.21.15.2:0/1355604857 learned_addr learned my addr 172.21.15.2:0/1355604857 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f1255334700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12500708f0 0x7f1250115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f1255b35700 1 -- 172.21.15.2:0/1355604857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12500708f0 msgr2=0x7f1250115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f1255b35700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12500708f0 0x7f1250115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f1255b35700 1 -- 172.21.15.2:0/1355604857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c005040 con 0x7f125006ffe0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f1255b35700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12501157f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f124c005010 tx=0x7f124c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124c00e040 con 0x7f125006ffe0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f124c013420 con 0x7f125006ffe0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.520+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125010f930 con 0x7f125006ffe0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.521+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f124c01c610 con 0x7f125006ffe0 2023-12-17T12:00:59.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.521+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125010fe70 con 0x7f125006ffe0 2023-12-17T12:00:59.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.522+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12501065d0 con 0x7f125006ffe0 2023-12-17T12:00:59.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.523+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7f124c009530 con 0x7f125006ffe0 2023-12-17T12:00:59.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.524+0000 7f12467fc700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f123c06caf0 0x7f123c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.524+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f124c08d130 con 0x7f125006ffe0 2023-12-17T12:00:59.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.524+0000 7f1255334700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f123c06caf0 0x7f123c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.525+0000 7f1255334700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f123c06caf0 0x7f123c06efa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1250111020 tx=0x7f124000b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:59.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.529+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f124c05af80 con 0x7f125006ffe0 2023-12-17T12:00:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.838+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f125004bb80 con 0x7f125006ffe0 2023-12-17T12:00:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.839+0000 7f12467fc700 1 -- 172.21.15.2:0/1355604857 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+735 (secure 0 0 0) 0x7f124c05ab10 con 0x7f125006ffe0 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:00:59.842 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:00:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:00:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:00:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 12, 2023-12-17T12:00:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:00:59.843 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:00:59.843 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f123c06caf0 msgr2=0x7f123c06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f123c06caf0 0x7f123c06efa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1250111020 tx=0x7f124000b040 comp rx=0 tx=0).stop 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 msgr2=0x7f12501157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12501157f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f124c005010 tx=0x7f124c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 shutdown_connections 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7f123c06caf0 0x7f123c06efa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f125006ffe0 0x7f12501157f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 --2- 172.21.15.2:0/1355604857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12500708f0 0x7f1250115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 >> 172.21.15.2:0/1355604857 conn(0x7f12500f8790 msgr2=0x7f1250103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 shutdown_connections 2023-12-17T12:00:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.842+0000 7f1257d99700 1 -- 172.21.15.2:0/1355604857 wait complete. 2023-12-17T12:00:59.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:59 smithi119 ceph-mon[117414]: Upgrade: Target is version 19.0.0-119-ga62fda73 (unknown) 2023-12-17T12:00:59.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:59 smithi119 ceph-mon[117414]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40, digests ['quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40'] 2023-12-17T12:00:59.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:59 smithi119 ceph-mon[117414]: Upgrade: Setting container_image for all mgr 2023-12-17T12:00:59.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:00:59 smithi119 ceph-mon[117414]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:59.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:59 smithi002 ceph-mon[107131]: Upgrade: Target is version 19.0.0-119-ga62fda73 (unknown) 2023-12-17T12:00:59.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:59 smithi002 ceph-mon[107131]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40, digests ['quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40'] 2023-12-17T12:00:59.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:59 smithi002 ceph-mon[107131]: Upgrade: Setting container_image for all mgr 2023-12-17T12:00:59.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:00:59 smithi002 ceph-mon[107131]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/675663863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd980708f0 msgr2=0x7fcd98108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/675663863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd980708f0 0x7fcd98108f10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c004970 tx=0x7fcd8c009e30 comp rx=0 tx=0).stop 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/675663863 shutdown_connections 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/675663863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd980708f0 0x7fcd98108f10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/675663863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd9806ffe0 0x7fcd980703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/675663863 >> 172.21.15.2:0/675663863 conn(0x7fcd980f8790 msgr2=0x7fcd980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/675663863 shutdown_connections 2023-12-17T12:00:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.983+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/675663863 wait complete. 2023-12-17T12:00:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.984+0000 7fcd9cbe3700 1 Processor -- start 2023-12-17T12:00:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.984+0000 7fcd9cbe3700 1 -- start start 2023-12-17T12:00:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9cbe3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 0x7fcd98115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9cbe3700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd980708f0 0x7fcd98115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9cbe3700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981163a0 con 0x7fcd9806ffe0 2023-12-17T12:00:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9cbe3700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9810f6d0 con 0x7fcd980708f0 2023-12-17T12:00:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 0x7fcd98115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 0x7fcd98115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60908/0 (socket says 172.21.15.2:60908) 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd9659c700 1 -- 172.21.15.2:0/820493396 learned_addr learned my addr 172.21.15.2:0/820493396 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.985+0000 7fcd95d9b700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd980708f0 0x7fcd98115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd9659c700 1 -- 172.21.15.2:0/820493396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd980708f0 msgr2=0x7fcd98115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd9659c700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd980708f0 0x7fcd98115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd9659c700 1 -- 172.21.15.2:0/820493396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c005040 con 0x7fcd9806ffe0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd9659c700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 0x7fcd98115810 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcd88002a50 tx=0x7fcd880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd88007cc0 con 0x7fcd9806ffe0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd8800f040 con 0x7fcd9806ffe0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9810f9b0 con 0x7fcd9806ffe0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd8800d9c0 con 0x7fcd9806ffe0 2023-12-17T12:00:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.986+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9810fec0 con 0x7fcd9806ffe0 2023-12-17T12:00:59.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.987+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd981065d0 con 0x7fcd9806ffe0 2023-12-17T12:00:59.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.989+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fcd8800db20 con 0x7fcd9806ffe0 2023-12-17T12:00:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.990+0000 7fcd86ffd700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fcd8006caf0 0x7fcd8006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.990+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fcd8808bb90 con 0x7fcd9806ffe0 2023-12-17T12:00:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.990+0000 7fcd95d9b700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fcd8006caf0 0x7fcd8006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:59.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.991+0000 7fcd95d9b700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fcd8006caf0 0x7fcd8006efa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c004940 tx=0x7fcd8c009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:00.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:00:59.999+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fcd880598e0 con 0x7fcd9806ffe0 2023-12-17T12:01:00.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.269+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcd980fc390 con 0x7fcd9806ffe0 2023-12-17T12:01:00.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.269+0000 7fcd86ffd700 1 -- 172.21.15.2:0/820493396 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1845 (secure 0 0 0) 0x7fcd88059470 con 0x7fcd9806ffe0 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:e17 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 17 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:01:00.272 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T11:58:06.999510+0000 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:01:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fcd8006caf0 msgr2=0x7fcd8006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fcd8006caf0 0x7fcd8006efa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c004940 tx=0x7fcd8c009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 msgr2=0x7fcd98115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 0x7fcd98115810 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcd88002a50 tx=0x7fcd880046b0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 shutdown_connections 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fcd8006caf0 0x7fcd8006efa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9806ffe0 0x7fcd98115810 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 --2- 172.21.15.2:0/820493396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd980708f0 0x7fcd98115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 >> 172.21.15.2:0/820493396 conn(0x7fcd980f8790 msgr2=0x7fcd98103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 shutdown_connections 2023-12-17T12:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.272+0000 7fcd9cbe3700 1 -- 172.21.15.2:0/820493396 wait complete. 2023-12-17T12:01:00.276 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-12-17T12:01:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.436+0000 7fc9d18cf700 1 -- 172.21.15.2:0/1249236350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc1035a0 msgr2=0x7fc9cc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.436+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/1249236350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc1035a0 0x7fc9cc0fcc10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0004940 tx=0x7fc9c0009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 -- 172.21.15.2:0/1249236350 shutdown_connections 2023-12-17T12:01:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/1249236350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc1035a0 0x7fc9cc0fcc10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/1249236350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9cc102c00 0x7fc9cc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 -- 172.21.15.2:0/1249236350 >> 172.21.15.2:0/1249236350 conn(0x7fc9cc0f8790 msgr2=0x7fc9cc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 -- 172.21.15.2:0/1249236350 shutdown_connections 2023-12-17T12:01:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 -- 172.21.15.2:0/1249236350 wait complete. 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.437+0000 7fc9d18cf700 1 Processor -- start 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9d18cf700 1 -- start start 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9d18cf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 0x7fc9cc113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9d18cf700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9cc1035a0 0x7fc9cc113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9d18cf700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc114210 con 0x7fc9cc102c00 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9d18cf700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc10d500 con 0x7fc9cc1035a0 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9caffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 0x7fc9cc113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9caffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 0x7fc9cc113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60928/0 (socket says 172.21.15.2:60928) 2023-12-17T12:01:00.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.438+0000 7fc9caffd700 1 -- 172.21.15.2:0/345793802 learned_addr learned my addr 172.21.15.2:0/345793802 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:00.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9ca7fc700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9cc1035a0 0x7fc9cc113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:00.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9caffd700 1 -- 172.21.15.2:0/345793802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9cc1035a0 msgr2=0x7fc9cc113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9caffd700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9cc1035a0 0x7fc9cc113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9caffd700 1 -- 172.21.15.2:0/345793802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0005040 con 0x7fc9cc102c00 2023-12-17T12:01:00.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9caffd700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 0x7fc9cc113680 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc002a50 tx=0x7fc9bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:00.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9bc007cc0 con 0x7fc9cc102c00 2023-12-17T12:01:00.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc9bc00f040 con 0x7fc9cc102c00 2023-12-17T12:01:00.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9bc00d9c0 con 0x7fc9cc102c00 2023-12-17T12:01:00.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.439+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc10d7e0 con 0x7fc9cc102c00 2023-12-17T12:01:00.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.440+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc10dd20 con 0x7fc9cc102c00 2023-12-17T12:01:00.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.441+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc113330 con 0x7fc9cc102c00 2023-12-17T12:01:00.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.442+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fc9bc00db20 con 0x7fc9cc102c00 2023-12-17T12:01:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.444+0000 7fc9b37fe700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc9b406caf0 0x7fc9b406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.444+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc9bc08ba00 con 0x7fc9cc102c00 2023-12-17T12:01:00.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.444+0000 7fc9ca7fc700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc9b406caf0 0x7fc9b406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:00.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.445+0000 7fc9ca7fc700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc9b406caf0 0x7fc9b406efa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc10eee0 tx=0x7fc9c0009e30 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:00.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.449+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fc9bc059870 con 0x7fc9cc102c00 2023-12-17T12:01:00.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.695+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 --> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9cc10ec20 con 0x7fc9b406caf0 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.697+0000 7fc9b37fe700 1 -- 172.21.15.2:0/345793802 <== mgr.14676 v2:172.21.15.2:6800/2515016248 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fc9cc10ec20 con 0x7fc9b406caf0 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr" 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:01:00.699 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "2/21 daemons upgraded", 2023-12-17T12:01:00.700 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mon daemons", 2023-12-17T12:01:00.700 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:01:00.700 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc9b406caf0 msgr2=0x7fc9b406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc9b406caf0 0x7fc9b406efa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc10eee0 tx=0x7fc9c0009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 msgr2=0x7fc9cc113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 0x7fc9cc113680 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc002a50 tx=0x7fc9bc0046b0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 shutdown_connections 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fc9b406caf0 0x7fc9b406efa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9cc102c00 0x7fc9cc113680 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 --2- 172.21.15.2:0/345793802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9cc1035a0 0x7fc9cc113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 >> 172.21.15.2:0/345793802 conn(0x7fc9cc0f8790 msgr2=0x7fc9cc0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 shutdown_connections 2023-12-17T12:01:00.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.699+0000 7fc9d18cf700 1 -- 172.21.15.2:0/345793802 wait complete. 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.842+0000 7fb2eff4e700 1 -- 172.21.15.2:0/3656201553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 msgr2=0x7fb2e80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.842+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/3656201553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e80fcc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8004940 tx=0x7fb2d8009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.842+0000 7fb2eff4e700 1 -- 172.21.15.2:0/3656201553 shutdown_connections 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.842+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/3656201553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e80fcc10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.842+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/3656201553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e8102c00 0x7fb2e8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.842+0000 7fb2eff4e700 1 -- 172.21.15.2:0/3656201553 >> 172.21.15.2:0/3656201553 conn(0x7fb2e80f8790 msgr2=0x7fb2e80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:00.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.843+0000 7fb2eff4e700 1 -- 172.21.15.2:0/3656201553 shutdown_connections 2023-12-17T12:01:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.843+0000 7fb2eff4e700 1 -- 172.21.15.2:0/3656201553 wait complete. 2023-12-17T12:01:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.844+0000 7fb2eff4e700 1 Processor -- start 2023-12-17T12:01:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.844+0000 7fb2eff4e700 1 -- start start 2023-12-17T12:01:00.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2eff4e700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e8102c00 0x7fb2e8113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2eff4e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e8113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2eff4e700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8114210 con 0x7fb2e81035a0 2023-12-17T12:01:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2eff4e700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e810d500 con 0x7fb2e8102c00 2023-12-17T12:01:00.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2ed4e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e8113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2ed4e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e8113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60952/0 (socket says 172.21.15.2:60952) 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2ed4e9700 1 -- 172.21.15.2:0/2952490883 learned_addr learned my addr 172.21.15.2:0/2952490883 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2edcea700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e8102c00 0x7fb2e8113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2ed4e9700 1 -- 172.21.15.2:0/2952490883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e8102c00 msgr2=0x7fb2e8113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2ed4e9700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e8102c00 0x7fb2e8113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.845+0000 7fb2ed4e9700 1 -- 172.21.15.2:0/2952490883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8005040 con 0x7fb2e81035a0 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.846+0000 7fb2ed4e9700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e8113bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009360 tx=0x7fb2d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:00.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.846+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d800e040 con 0x7fb2e81035a0 2023-12-17T12:01:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.846+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2d8013420 con 0x7fb2e81035a0 2023-12-17T12:01:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.846+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e810d780 con 0x7fb2e81035a0 2023-12-17T12:01:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.846+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d801c610 con 0x7fb2e81035a0 2023-12-17T12:01:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.846+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e810dcc0 con 0x7fb2e81035a0 2023-12-17T12:01:00.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.847+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e8113310 con 0x7fb2e81035a0 2023-12-17T12:01:00.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.848+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 33) v1 ==== 90795+0+0 (secure 0 0 0) 0x7fb2d8013590 con 0x7fb2e81035a0 2023-12-17T12:01:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.850+0000 7fb2de7fc700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb2d406caf0 0x7fb2d406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.850+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb2d808cfc0 con 0x7fb2e81035a0 2023-12-17T12:01:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.850+0000 7fb2edcea700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb2d406caf0 0x7fb2d406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:00.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.851+0000 7fb2edcea700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb2d406caf0 0x7fb2d406efa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4004f40 tx=0x7fb2e400b040 comp rx=0 tx=0).ready entity=mgr.14676 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:00.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:00.855+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb2d80bfce0 con 0x7fb2e81035a0 2023-12-17T12:01:01.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:01.043 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: pgmap v84: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: Upgrade: Updating mon.smithi002 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: Deploying daemon mon.smithi002 on smithi002 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/1355604857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:01.044 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:00 smithi002 ceph-mon[107131]: from='client.? 172.21.15.2:0/820493396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: pgmap v84: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: Upgrade: Updating mon.smithi002 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:01.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:01.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:01.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: Deploying daemon mon.smithi002 on smithi002 2023-12-17T12:01:01.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/1355604857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:01.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:00 smithi119 ceph-mon[117414]: from='client.? 172.21.15.2:0/820493396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:01:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.175+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb2e81050d0 con 0x7fb2e81035a0 2023-12-17T12:01:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.176+0000 7fb2de7fc700 1 -- 172.21.15.2:0/2952490883 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fb2d805ad90 con 0x7fb2e81035a0 2023-12-17T12:01:01.179 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:01.179 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:01.179 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb2d406caf0 msgr2=0x7fb2d406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb2d406caf0 0x7fb2d406efa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4004f40 tx=0x7fb2e400b040 comp rx=0 tx=0).stop 2023-12-17T12:01:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 msgr2=0x7fb2e8113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e8113bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009360 tx=0x7fb2d8009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 shutdown_connections 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e8102c00 0x7fb2e8113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:6800/2515016248,v1:172.21.15.2:6801/2515016248] conn(0x7fb2d406caf0 0x7fb2d406efa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 --2- 172.21.15.2:0/2952490883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2e81035a0 0x7fb2e8113bc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 >> 172.21.15.2:0/2952490883 conn(0x7fb2e80f8790 msgr2=0x7fb2e80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 shutdown_connections 2023-12-17T12:01:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:01.179+0000 7fb2eff4e700 1 -- 172.21.15.2:0/2952490883 wait complete. 2023-12-17T12:01:01.629 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:01 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:01:01.629 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:01 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[107108]: 2023-12-17T12:01:01.605+0000 7ff91d1d6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:01:01.629 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:01 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[107108]: 2023-12-17T12:01:01.605+0000 7ff91d1d6700 -1 mon.smithi002@0(leader) e2 *** Got Signal Terminated *** 2023-12-17T12:01:01.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:01 smithi002 bash[211529]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002 2023-12-17T12:01:02.459 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service: Succeeded. 2023-12-17T12:01:02.459 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 systemd[1]: Stopped Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:01:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 systemd[1]: Starting Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:01:03.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: set uid:gid to 167:167 (ceph:ceph) 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: pidfile_write: ignore empty --pid-file 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: load: jerasure load: lrc 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: RocksDB version: 7.9.2 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Git sha 0 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: DB SUMMARY 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: DB Session ID: KYSYC1RD3QK6RCRBVPTA 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: CURRENT file: CURRENT 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: IDENTITY file: IDENTITY 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1171 Bytes 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi002/store.db dir, Total Num: 1, files: 000033.sst 2023-12-17T12:01:03.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi002/store.db: 000031.log size: 1900415 ; 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.error_if_exists: 0 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.create_if_missing: 0 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.paranoid_checks: 1 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.env: 0x5645f1300a60 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.fs: PosixFileSystem 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.info_log: 0x5645f3291640 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_file_opening_threads: 16 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.statistics: (nil) 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.use_fsync: 0 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_log_file_size: 0 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-17T12:01:03.228 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.keep_log_file_num: 1000 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.recycle_log_file_num: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.allow_fallocate: 1 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.allow_mmap_reads: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.allow_mmap_writes: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.use_direct_reads: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.create_missing_column_families: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.db_log_dir: 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.wal_dir: 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-17T12:01:03.229 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.advise_random_on_open: 1 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.db_write_buffer_size: 0 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.write_buffer_manager: 0x5645f3247360 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.rate_limiter: (nil) 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.wal_recovery_mode: 2 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.enable_thread_tracking: 0 2023-12-17T12:01:03.230 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.enable_pipelined_write: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.unordered_write: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.row_cache: None 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.wal_filter: None 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.allow_ingest_behind: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.two_write_queues: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.manual_wal_flush: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.wal_compression: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.atomic_flush: 0 2023-12-17T12:01:03.231 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.log_readahead_size: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.best_efforts_recovery: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.allow_data_in_errors: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.db_host_id: __hostname__ 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_background_jobs: 2 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_background_compactions: -1 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_subcompactions: 1 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-17T12:01:03.232 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_total_wal_size: 0 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_open_files: -1 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bytes_per_sync: 0 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_readahead_size: 0 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_background_flushes: -1 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Compression algorithms supported: 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-17T12:01:03.233 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kZSTD supported: 0 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kXpressCompression supported: 0 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kLZ4HCCompression supported: 1 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kZlibCompression supported: 1 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kSnappyCompression supported: 1 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kLZ4Compression supported: 1 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: kBZip2Compression supported: 0 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000015 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.merge_operator: 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_filter: None 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_filter_factory: None 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.sst_partitioner_factory: None 2023-12-17T12:01:03.234 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5645f3291740) 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks: 1 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: pin_top_level_index_and_filter: 1 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_type: 0 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_index_type: 0 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_shortening: 1 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: checksum: 4 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: no_block_cache: 0 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache: 0x5645f32e7090 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_name: BinnedLRUCache 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_options: 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: capacity : 536870912 2023-12-17T12:01:03.235 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_shard_bits : 4 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: strict_capacity_limit : 0 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: high_pri_pool_ratio: 0.000 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_cache_compressed: (nil) 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: persistent_cache: (nil) 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size: 4096 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_size_deviation: 10 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_restart_interval: 16 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: index_block_restart_interval: 1 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_block_size: 4096 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: partition_filters: 0 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: use_delta_encoding: 1 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: filter_policy: bloomfilter 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: whole_key_filtering: 1 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: verify_compression: 0 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: read_amp_bytes_per_bit: 0 2023-12-17T12:01:03.236 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: format_version: 5 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_index_compression: 1 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: block_align: 0 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_auto_readahead_size: 262144 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: prepopulate_block_cache: 0 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: initial_auto_readahead_size: 8192 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.write_buffer_size: 33554432 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_write_buffer_number: 2 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression: NoCompression 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression: Disabled 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.prefix_extractor: nullptr 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.num_levels: 7 2023-12-17T12:01:03.237 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-17T12:01:03.238 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-17T12:01:03.238 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-17T12:01:03.238 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-17T12:01:03.238 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-17T12:01:03.238 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-17T12:01:03.238 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-17T12:01:03.240 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-17T12:01:03.240 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.level: 32767 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.strategy: 0 2023-12-17T12:01:03.241 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.enabled: false 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.target_file_size_base: 67108864 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-17T12:01:03.242 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.arena_block_size: 1048576 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.disable_auto_compactions: 0 2023-12-17T12:01:03.243 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-17T12:01:03.244 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-17T12:01:03.244 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-17T12:01:03.244 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-17T12:01:03.244 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.table_properties_collectors: 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.inplace_update_support: 0 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-17T12:01:03.245 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.bloom_locality: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.max_successive_merges: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.paranoid_file_checks: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.force_consistency_checks: 1 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.report_bg_io_stats: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.ttl: 2592000 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.enable_blob_files: false 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.min_blob_size: 0 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.blob_file_size: 268435456 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-17T12:01:03.246 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.blob_file_starting_level: 0 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi002/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12242, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4ce51f7a-71e7-4e1a-8d64-a635108d085d 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814462948015, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814462957978, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1675575, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12236, "largest_seqno": 13860, "table_properties": {"data_size": 1668689, "index_size": 4143, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1733, "raw_key_size": 16175, "raw_average_key_size": 23, "raw_value_size": 1654353, "raw_average_value_size": 2418, "num_data_blocks": 189, "num_entries": 684, "num_filter_entries": 684, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702814462, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4ce51f7a-71e7-4e1a-8d64-a635108d085d", "db_session_id": "KYSYC1RD3QK6RCRBVPTA", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814462958129, "job": 1, "event": "recovery_finished"} 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-17T12:01:03.247 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi002/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5645f3382000 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: DB pointer 0x5645f336e000 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** DB Stats ** 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T12:01:03.248 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L0 1/0 1.60 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 330.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: L6 1/0 6.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Sum 2/0 7.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 330.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 330.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** Compaction Stats [default] ** 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 330.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-17T12:01:03.249 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Cumulative compaction: 0.00 GB write, 107.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Interval compaction: 0.00 GB write, 107.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache BinnedLRUCache@0x5645f32e7090#7 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: starting mon.smithi002 rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi002 fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???) e2 preinit fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).mds e17 new map 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).mds e17 print_map 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: e17 2023-12-17T12:01:03.250 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: legacy client fscid: 1 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Filesystem 'cephfs' (1) 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: fs_name cephfs 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: epoch 17 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: modified 2023-12-17T11:58:06.999510+0000 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: tableserver 0 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: root 0 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: session_timeout 60 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: session_autoclose 300 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_file_size 1099511627776 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_xattr_size 65536 2023-12-17T12:01:03.251 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: required_client_features {} 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: last_failure 0 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: last_failure_osd_epoch 47 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: max_mds 2 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: in 0,1 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: up {0=24315,1=24311} 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: failed 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: damaged 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: stopped 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: data_pools [3] 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: metadata_pool 2 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: inline_data enabled 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: balancer 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: bal_rank_mask -1 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: standby_count_wanted 1 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:03.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: Standby daemons: 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout: [mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).osd e51 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:02 smithi002 ceph-mon[211741]: mon.smithi002@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 bash[211703]: 82916f6a36633c32983241ff8b14caf9f9acd25de48c39231798b92d2f8cc5bd 2023-12-17T12:01:03.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 systemd[1]: Started Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: mon.smithi002 calling monitor election 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: mon.smithi002 is new leader, mons smithi002,smithi119 in quorum (ranks 0,1) 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: osdmap e51: 6 total, 6 up, 6 in 2023-12-17T12:01:03.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: mgrmap e33: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T12:01:03.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: from='mgr.14676 ' entity='' 2023-12-17T12:01:03.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: mgrmap e34: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T12:01:03.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:03.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:03.660 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:03 smithi119 ceph-mon[117414]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:03.705 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: from='mgr.14676 172.21.15.2:0/3928908890' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: mon.smithi002 calling monitor election 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: mon.smithi002 is new leader, mons smithi002,smithi119 in quorum (ranks 0,1) 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: monmap e2: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: osdmap e51: 6 total, 6 up, 6 in 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: mgrmap e33: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: from='mgr.14676 ' entity='' 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: mgrmap e34: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:03.706 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:03 smithi002 ceph-mon[211741]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:11.829 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:11 smithi119 ceph-mon[117414]: Standby manager daemon smithi119.nzblpy restarted 2023-12-17T12:01:11.829 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:11 smithi119 ceph-mon[117414]: Standby manager daemon smithi119.nzblpy started 2023-12-17T12:01:11.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:11 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T12:01:11.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:11 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T12:01:11.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:11 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T12:01:11.830 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:11 smithi119 ceph-mon[117414]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T12:01:12.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:11 smithi002 ceph-mon[211741]: Standby manager daemon smithi119.nzblpy restarted 2023-12-17T12:01:12.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:11 smithi002 ceph-mon[211741]: Standby manager daemon smithi119.nzblpy started 2023-12-17T12:01:12.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:11 smithi002 ceph-mon[211741]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/crt"}]: dispatch 2023-12-17T12:01:12.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:11 smithi002 ceph-mon[211741]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T12:01:12.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:11 smithi002 ceph-mon[211741]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi119.nzblpy/key"}]: dispatch 2023-12-17T12:01:12.022 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:11 smithi002 ceph-mon[211741]: from='mgr.? 172.21.15.119:0/984108715' entity='mgr.smithi119.nzblpy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T12:01:12.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119[117391]: 2023-12-17T12:01:12.185+0000 7fc92d5f9700 -1 mon.smithi119@1(peon).osd e52 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-17T12:01:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: mgrmap e35: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T12:01:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: Activating manager daemon smithi002.cqnuqs 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: osdmap e52: 6 total, 6 up, 6 in 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: mgrmap e36: smithi002.cqnuqs(active, starting, since 0.00649253s), standbys: smithi119.nzblpy 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T12:01:13.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T12:01:13.160 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:12 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: mgrmap e35: smithi002.cqnuqs(active, since 2m), standbys: smithi119.nzblpy 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: Active manager daemon smithi002.cqnuqs restarted 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: Activating manager daemon smithi002.cqnuqs 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: osdmap e52: 6 total, 6 up, 6 in 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: mgrmap e36: smithi002.cqnuqs(active, starting, since 0.00649253s), standbys: smithi119.nzblpy 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.ercyvj"}]: dispatch 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.mzkvrk"}]: dispatch 2023-12-17T12:01:13.208 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi002.atwfoy"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi119.qgnwfs"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi002.cqnuqs", "id": "smithi002.cqnuqs"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr metadata", "who": "smithi119.nzblpy", "id": "smithi119.nzblpy"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: Manager daemon smithi002.cqnuqs is now available 2023-12-17T12:01:13.209 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:13.210 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:13.210 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:13.210 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/mirror_snapshot_schedule"}]: dispatch 2023-12-17T12:01:13.210 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi002.cqnuqs/trash_purge_schedule"}]: dispatch 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: failed to encode map e52 with expected crc 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: failed to encode map e52 with expected crc 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: [17/Dec/2023:12:01:13] ENGINE Bus STARTING 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: [17/Dec/2023:12:01:13] ENGINE Serving on http://172.21.15.2:8765 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: mgrmap e37: smithi002.cqnuqs(active, since 1.01446s), standbys: smithi119.nzblpy 2023-12-17T12:01:14.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:13 smithi002 ceph-mon[211741]: pgmap v3: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:14.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: failed to encode map e52 with expected crc 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: failed to encode map e52 with expected crc 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: [17/Dec/2023:12:01:13] ENGINE Bus STARTING 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: [17/Dec/2023:12:01:13] ENGINE Serving on http://172.21.15.2:8765 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: mgrmap e37: smithi002.cqnuqs(active, since 1.01446s), standbys: smithi119.nzblpy 2023-12-17T12:01:14.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:13 smithi119 ceph-mon[117414]: pgmap v3: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:15 smithi119 ceph-mon[117414]: [17/Dec/2023:12:01:13] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T12:01:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:15 smithi119 ceph-mon[117414]: [17/Dec/2023:12:01:13] ENGINE Bus STARTED 2023-12-17T12:01:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:15 smithi119 ceph-mon[117414]: pgmap v4: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:15 smithi119 ceph-mon[117414]: mgrmap e38: smithi002.cqnuqs(active, since 2s), standbys: smithi119.nzblpy 2023-12-17T12:01:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:15 smithi002 ceph-mon[211741]: [17/Dec/2023:12:01:13] ENGINE Serving on https://172.21.15.2:7150 2023-12-17T12:01:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:15 smithi002 ceph-mon[211741]: [17/Dec/2023:12:01:13] ENGINE Bus STARTED 2023-12-17T12:01:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:15 smithi002 ceph-mon[211741]: pgmap v4: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:15 smithi002 ceph-mon[211741]: mgrmap e38: smithi002.cqnuqs(active, since 2s), standbys: smithi119.nzblpy 2023-12-17T12:01:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:16 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:16 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:16 smithi119 ceph-mon[117414]: pgmap v5: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:16 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:16 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:16 smithi002 ceph-mon[211741]: pgmap v5: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:18.061 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:17 smithi119 ceph-mon[117414]: mgrmap e39: smithi002.cqnuqs(active, since 4s), standbys: smithi119.nzblpy 2023-12-17T12:01:18.061 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:17 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.061 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:17 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.061 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:17 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.061 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:17 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:17 smithi002 ceph-mon[211741]: mgrmap e39: smithi002.cqnuqs(active, since 4s), standbys: smithi119.nzblpy 2023-12-17T12:01:18.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:17 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:17 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:17 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:18.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:17 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:19.252 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:18 smithi002 ceph-mon[211741]: pgmap v6: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:19.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:19.253 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:18 smithi119 ceph-mon[117414]: pgmap v6: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:18 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:18 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:21.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:21 smithi002 ceph-mon[211741]: pgmap v7: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-17T12:01:21.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:21 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:21.531 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:21 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:21.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:21 smithi119 ceph-mon[117414]: pgmap v7: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-17T12:01:21.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:21 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:21.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:21 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:22.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:22 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi119 2023-12-17T12:01:22.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:22 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:22.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:22 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:22.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:22 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:22.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:22 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:22.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:22 smithi002 ceph-mon[211741]: Detected new or changed devices on smithi119 2023-12-17T12:01:22.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:22 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:22.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:22 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:22.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:22 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:22.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:22 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:23.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:23 smithi119 ceph-mon[117414]: Detected new or changed devices on smithi002 2023-12-17T12:01:23.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:23 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T12:01:23.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:23 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T12:01:23.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:23 smithi119 ceph-mon[117414]: pgmap v8: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-17T12:01:23.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:23 smithi002 ceph-mon[211741]: Detected new or changed devices on smithi002 2023-12-17T12:01:23.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:23 smithi002 ceph-mon[211741]: Updating smithi002:/etc/ceph/ceph.conf 2023-12-17T12:01:23.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:23 smithi002 ceph-mon[211741]: Updating smithi119:/etc/ceph/ceph.conf 2023-12-17T12:01:23.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:23 smithi002 ceph-mon[211741]: pgmap v8: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:24 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T12:01:24.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:24.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:24 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:25.527 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:25 smithi119 ceph-mon[117414]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T12:01:25.527 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:25 smithi119 ceph-mon[117414]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T12:01:25.528 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:25 smithi119 ceph-mon[117414]: pgmap v9: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-17T12:01:25.528 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:25 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:25.528 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:25 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:25.528 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:25 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-17T12:01:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:25 smithi002 ceph-mon[211741]: Updating smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T12:01:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:25 smithi002 ceph-mon[211741]: Updating smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T12:01:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:25 smithi002 ceph-mon[211741]: pgmap v9: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-17T12:01:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-17T12:01:26.786 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: Upgrade: Updating mon.smithi119 2023-12-17T12:01:26.786 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:26.786 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:26.786 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:26.786 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:26.786 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: Deploying daemon mon.smithi119 on smithi119 2023-12-17T12:01:26.787 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:26 smithi119 ceph-mon[117414]: pgmap v10: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-17T12:01:26.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: Upgrade: Updating mon.smithi119 2023-12-17T12:01:26.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:26.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:26.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:26.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:26.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: Deploying daemon mon.smithi119 on smithi119 2023-12-17T12:01:26.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:26 smithi002 ceph-mon[211741]: pgmap v10: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-17T12:01:27.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:27 smithi119 systemd[1]: Stopping Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:01:27.535 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:27 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119[117391]: 2023-12-17T12:01:27.281+0000 7fc932e04700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi119 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:01:27.535 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:27 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119[117391]: 2023-12-17T12:01:27.281+0000 7fc932e04700 -1 mon.smithi119@1(peon) e2 *** Got Signal Terminated *** 2023-12-17T12:01:27.535 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:27 smithi119 bash[177370]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119 2023-12-17T12:01:28.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:27 smithi119 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi119.service: Succeeded. 2023-12-17T12:01:28.143 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:27 smithi119 systemd[1]: Stopped Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:01:28.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 systemd[1]: Starting Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: set uid:gid to 167:167 (ceph:ceph) 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: pidfile_write: ignore empty --pid-file 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 bash[177521]: 76eda43791050d330b836d724ef16ed824f2a34e03c5c6d1dc7693050388a29b 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: load: jerasure load: lrc 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 systemd[1]: Started Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: RocksDB version: 7.9.2 2023-12-17T12:01:28.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Git sha 0 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: DB SUMMARY 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: DB Session ID: 03VK0756QVQ471RHWZXD 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: CURRENT file: CURRENT 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: IDENTITY file: IDENTITY 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1096 Bytes 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi119/store.db dir, Total Num: 1, files: 000027.sst 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi119/store.db: 000025.log size: 5822652 ; 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.error_if_exists: 0 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.create_if_missing: 0 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.paranoid_checks: 1 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.env: 0x56290ef48a60 2023-12-17T12:01:28.910 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.fs: PosixFileSystem 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.info_log: 0x562910dc3640 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_file_opening_threads: 16 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.statistics: (nil) 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.use_fsync: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_log_file_size: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.keep_log_file_num: 1000 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.recycle_log_file_num: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.allow_fallocate: 1 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.allow_mmap_reads: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.allow_mmap_writes: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.use_direct_reads: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-17T12:01:28.911 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.create_missing_column_families: 0 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.db_log_dir: 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.wal_dir: 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.advise_random_on_open: 1 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.db_write_buffer_size: 0 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.write_buffer_manager: 0x562910d79360 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-17T12:01:28.912 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.rate_limiter: (nil) 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.wal_recovery_mode: 2 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.enable_thread_tracking: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.enable_pipelined_write: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.unordered_write: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.row_cache: None 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.wal_filter: None 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.allow_ingest_behind: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.two_write_queues: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.manual_wal_flush: 0 2023-12-17T12:01:28.913 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.wal_compression: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.atomic_flush: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.log_readahead_size: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.best_efforts_recovery: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.allow_data_in_errors: 0 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.db_host_id: __hostname__ 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_background_jobs: 2 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_background_compactions: -1 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_subcompactions: 1 2023-12-17T12:01:28.914 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_total_wal_size: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_open_files: -1 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bytes_per_sync: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_readahead_size: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_background_flushes: -1 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Compression algorithms supported: 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kZSTD supported: 0 2023-12-17T12:01:28.915 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kXpressCompression supported: 0 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kLZ4HCCompression supported: 1 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kZlibCompression supported: 1 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kSnappyCompression supported: 1 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kLZ4Compression supported: 1 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: kBZip2Compression supported: 0 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000009 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.merge_operator: 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_filter: None 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_filter_factory: None 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.sst_partitioner_factory: None 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-17T12:01:28.916 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562910dc3740) 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks: 1 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: pin_top_level_index_and_filter: 1 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_type: 0 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_index_type: 0 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_shortening: 1 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: checksum: 4 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: no_block_cache: 0 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache: 0x562910e19090 2023-12-17T12:01:28.917 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_name: BinnedLRUCache 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_options: 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: capacity : 536870912 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: num_shard_bits : 4 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: strict_capacity_limit : 0 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: high_pri_pool_ratio: 0.000 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_cache_compressed: (nil) 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: persistent_cache: (nil) 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size: 4096 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_size_deviation: 10 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_restart_interval: 16 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: index_block_restart_interval: 1 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: metadata_block_size: 4096 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: partition_filters: 0 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: use_delta_encoding: 1 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: filter_policy: bloomfilter 2023-12-17T12:01:28.918 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: whole_key_filtering: 1 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: verify_compression: 0 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: read_amp_bytes_per_bit: 0 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: format_version: 5 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_index_compression: 1 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: block_align: 0 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_auto_readahead_size: 262144 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: prepopulate_block_cache: 0 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: initial_auto_readahead_size: 8192 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: num_file_reads_for_auto_readahead: 2 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.write_buffer_size: 33554432 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_write_buffer_number: 2 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression: NoCompression 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression: Disabled 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.prefix_extractor: nullptr 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.num_levels: 7 2023-12-17T12:01:28.919 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-17T12:01:28.920 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-17T12:01:28.920 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-17T12:01:28.920 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-17T12:01:28.920 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.level: 32767 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.strategy: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-17T12:01:28.921 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.enabled: false 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.target_file_size_base: 67108864 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-17T12:01:28.922 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.arena_block_size: 1048576 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.disable_auto_compactions: 0 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-17T12:01:28.923 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.table_properties_collectors: 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.inplace_update_support: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.bloom_locality: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.max_successive_merges: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.paranoid_file_checks: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.force_consistency_checks: 1 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.report_bg_io_stats: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.ttl: 2592000 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-17T12:01:28.924 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.enable_blob_files: false 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.min_blob_size: 0 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.blob_file_size: 268435456 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.blob_file_starting_level: 0 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi119/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12421, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-17T12:01:28.925 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5d5537b4-a78c-43e0-b2d7-e9dc98753760 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814488660361, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814488684353, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3533297, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12418, "largest_seqno": 14798, "table_properties": {"data_size": 3524222, "index_size": 5751, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2309, "raw_key_size": 21416, "raw_average_key_size": 23, "raw_value_size": 3505072, "raw_average_value_size": 3847, "num_data_blocks": 261, "num_entries": 911, "num_filter_entries": 911, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702814488, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5d5537b4-a78c-43e0-b2d7-e9dc98753760", "db_session_id": "03VK0756QVQ471RHWZXD", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814488684526, "job": 1, "event": "recovery_finished"} 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi119/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562910eb4000 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: DB pointer 0x562910ea0000 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** DB Stats ** 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T12:01:28.926 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L0 1/0 3.37 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 424.5 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: L6 1/0 6.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Sum 2/0 9.55 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 424.5 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 424.5 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** Compaction Stats [default] ** 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T12:01:28.927 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 424.5 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Flush(GB): cumulative 0.003, interval 0.003 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Cumulative compaction: 0.00 GB write, 115.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Interval compaction: 0.00 GB write, 115.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Block cache BinnedLRUCache@0x562910e19090#7 capacity: 512.00 MB usage: 8.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.53 KB,0.000482798%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2023-12-17T12:01:28.928 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: starting mon.smithi119 rank 1 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi119 fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???) e2 preinit fsid 1a404768-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).mds e17 new map 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).mds e17 print_map 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: e17 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: legacy client fscid: 1 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Filesystem 'cephfs' (1) 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: fs_name cephfs 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: epoch 17 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: modified 2023-12-17T11:58:06.999510+0000 2023-12-17T12:01:28.929 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: tableserver 0 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: root 0 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: session_timeout 60 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: session_autoclose 300 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_file_size 1099511627776 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_xattr_size 65536 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: required_client_features {} 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: last_failure 0 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: last_failure_osd_epoch 47 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: max_mds 2 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: in 0,1 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: up {0=24315,1=24311} 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: failed 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: damaged 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: stopped 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: data_pools [3] 2023-12-17T12:01:28.930 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: metadata_pool 2 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: inline_data enabled 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: balancer 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: bal_rank_mask -1 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: standby_count_wanted 1 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: Standby daemons: 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout: [mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).osd e52 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2023-12-17T12:01:28.931 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: mon.smithi119@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2023-12-17T12:01:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:29.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: mon.smithi119 calling monitor election 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: mon.smithi002 calling monitor election 2023-12-17T12:01:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: mon.smithi002 is new leader, mons smithi002,smithi119 in quorum (ranks 0,1) 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: monmap e3: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: osdmap e52: 6 total, 6 up, 6 in 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: mgrmap e39: smithi002.cqnuqs(active, since 16s), standbys: smithi119.nzblpy 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:30.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:29 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi002"}]: dispatch 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: mon.smithi119 calling monitor election 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: mon.smithi002 calling monitor election 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: mon.smithi002 is new leader, mons smithi002,smithi119 in quorum (ranks 0,1) 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mon metadata", "id": "smithi119"}]: dispatch 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: monmap e3: 2 mons at {smithi002=[v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0],smithi119=[v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: osdmap e52: 6 total, 6 up, 6 in 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: mgrmap e39: smithi002.cqnuqs(active, since 16s), standbys: smithi119.nzblpy 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:30.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:30.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:30.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:30.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:29 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.336+0000 7f2663e06700 1 -- 172.21.15.2:0/2083785834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072170 msgr2=0x7f265c072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.336+0000 7f2663e06700 1 --2- 172.21.15.2:0/2083785834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072170 0x7f265c072540 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2658004940 tx=0x7f2658009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 -- 172.21.15.2:0/2083785834 shutdown_connections 2023-12-17T12:01:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 --2- 172.21.15.2:0/2083785834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072a80 0x7f265c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 --2- 172.21.15.2:0/2083785834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072170 0x7f265c072540 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 -- 172.21.15.2:0/2083785834 >> 172.21.15.2:0/2083785834 conn(0x7f265c0fa990 msgr2=0x7f265c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 -- 172.21.15.2:0/2083785834 shutdown_connections 2023-12-17T12:01:31.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 -- 172.21.15.2:0/2083785834 wait complete. 2023-12-17T12:01:31.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.337+0000 7f2663e06700 1 Processor -- start 2023-12-17T12:01:31.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f2663e06700 1 -- start start 2023-12-17T12:01:31.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f2663e06700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 0x7f265c119c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f2663e06700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 0x7f265c11a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f2663e06700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c11a7b0 con 0x7f265c072a80 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f2663e06700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265c113ae0 con 0x7f265c072170 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f26613a1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 0x7f265c11a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f26613a1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 0x7f265c11a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33668/0 (socket says 172.21.15.2:33668) 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f2661ba2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 0x7f265c119c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.338+0000 7f26613a1700 1 -- 172.21.15.2:0/2471616653 learned_addr learned my addr 172.21.15.2:0/2471616653 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f2661ba2700 1 -- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 msgr2=0x7f265c119c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f2661ba2700 1 -- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 msgr2=0x7f265c119c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f2661ba2700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 0x7f265c119c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f2661ba2700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 0x7f265c119c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26613a1700 1 -- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 msgr2=0x7f265c119c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26613a1700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 0x7f265c119c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26613a1700 1 -- 172.21.15.2:0/2471616653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658005040 con 0x7f265c072a80 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26613a1700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 0x7f265c11a160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f264c0041d0 tx=0x7f264c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:31.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264c007cc0 con 0x7f265c072a80 2023-12-17T12:01:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f264c00f040 con 0x7f265c072a80 2023-12-17T12:01:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265c113dc0 con 0x7f265c072a80 2023-12-17T12:01:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264c00dae0 con 0x7f265c072a80 2023-12-17T12:01:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.339+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c114300 con 0x7f265c072a80 2023-12-17T12:01:31.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.341+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265c10acc0 con 0x7f265c072a80 2023-12-17T12:01:31.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.342+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f264c00dc40 con 0x7f265c072a80 2023-12-17T12:01:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.343+0000 7f26527fc700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f264806cf80 0x7f264806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.343+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f264c08bd80 con 0x7f265c072a80 2023-12-17T12:01:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.343+0000 7f2661ba2700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f264806cf80 0x7f264806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:31.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.344+0000 7f2661ba2700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f264806cf80 0x7f264806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2658009fd0 tx=0x7f2658009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:31.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.348+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f264c059430 con 0x7f265c072a80 2023-12-17T12:01:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:31 smithi119 ceph-mon[177559]: pgmap v12: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-17T12:01:31.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:31 smithi002 ceph-mon[211741]: pgmap v12: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-17T12:01:31.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.585+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f265c1101f0 con 0x7f264806cf80 2023-12-17T12:01:31.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.587+0000 7f26527fc700 1 -- 172.21.15.2:0/2471616653 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f265c1101f0 con 0x7f264806cf80 2023-12-17T12:01:31.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f264806cf80 msgr2=0x7f264806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:31.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f264806cf80 0x7f264806f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2658009fd0 tx=0x7f2658009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 msgr2=0x7f265c11a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 0x7f265c11a160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f264c0041d0 tx=0x7f264c0046b0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 shutdown_connections 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f264806cf80 0x7f264806f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f265c072170 0x7f265c119c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 --2- 172.21.15.2:0/2471616653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f265c072a80 0x7f265c11a160 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 >> 172.21.15.2:0/2471616653 conn(0x7f265c0fa990 msgr2=0x7f265c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 shutdown_connections 2023-12-17T12:01:31.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.589+0000 7f2663e06700 1 -- 172.21.15.2:0/2471616653 wait complete. 2023-12-17T12:01:31.606 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 -- 172.21.15.2:0/1032009104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0070520 msgr2=0x7f8cf0070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/1032009104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0070520 0x7f8cf0070990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0004970 tx=0x7f8ce0009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 -- 172.21.15.2:0/1032009104 shutdown_connections 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/1032009104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0070520 0x7f8cf0070990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/1032009104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0071c10 0x7f8cf006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 -- 172.21.15.2:0/1032009104 >> 172.21.15.2:0/1032009104 conn(0x7f8cf00f8560 msgr2=0x7f8cf00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 -- 172.21.15.2:0/1032009104 shutdown_connections 2023-12-17T12:01:31.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.731+0000 7f8cf66ec700 1 -- 172.21.15.2:0/1032009104 wait complete. 2023-12-17T12:01:31.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.733+0000 7f8cf66ec700 1 Processor -- start 2023-12-17T12:01:31.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.733+0000 7f8cf66ec700 1 -- start start 2023-12-17T12:01:31.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.733+0000 7f8cf66ec700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:31.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.733+0000 7f8cf66ec700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 0x7f8cf0119ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:31.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.733+0000 7f8cf66ec700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf011a540 con 0x7f8cf0071c10 2023-12-17T12:01:31.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.733+0000 7f8cf66ec700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0113870 con 0x7f8cf0070520 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf4ee9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 0x7f8cf0119ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf56ea700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf4ee9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 0x7f8cf0119ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33696/0 (socket says 172.21.15.2:33696) 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf56ea700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:42104/0 (socket says 172.21.15.2:42104) 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf4ee9700 1 -- 172.21.15.2:0/5359314 learned_addr learned my addr 172.21.15.2:0/5359314 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf56ea700 1 -- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 msgr2=0x7f8cf01199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf56ea700 1 -- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 msgr2=0x7f8cf01199b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf56ea700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf56ea700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf4ee9700 1 -- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 msgr2=0x7f8cf01199b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf4ee9700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.734+0000 7f8cf4ee9700 1 -- 172.21.15.2:0/5359314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0005040 con 0x7f8cf0071c10 2023-12-17T12:01:31.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.735+0000 7f8cf4ee9700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 0x7f8cf0119ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0004f50 tx=0x7f8ce0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:31.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.736+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ce000e040 con 0x7f8cf0071c10 2023-12-17T12:01:31.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.736+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf0113af0 con 0x7f8cf0071c10 2023-12-17T12:01:31.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.736+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ce000bc10 con 0x7f8cf0071c10 2023-12-17T12:01:31.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.736+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf0114030 con 0x7f8cf0071c10 2023-12-17T12:01:31.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.736+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ce001c630 con 0x7f8cf0071c10 2023-12-17T12:01:31.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.737+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf00fdea0 con 0x7f8cf0071c10 2023-12-17T12:01:31.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.739+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f8ce0013420 con 0x7f8cf0071c10 2023-12-17T12:01:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.739+0000 7f8ce5ffb700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f8cdc06cf80 0x7f8cdc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.740+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8ce008d9b0 con 0x7f8cf0071c10 2023-12-17T12:01:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.740+0000 7f8cf56ea700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f8cdc06cf80 0x7f8cdc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:31.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.740+0000 7f8cf56ea700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f8cdc06cf80 0x7f8cdc06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009ce0 tx=0x7f8cec009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:31.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.744+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8ce005b0e0 con 0x7f8cf0071c10 2023-12-17T12:01:31.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.976+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cf0119680 con 0x7f8cdc06cf80 2023-12-17T12:01:31.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.977+0000 7f8ce5ffb700 1 -- 172.21.15.2:0/5359314 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f8cf0119680 con 0x7f8cdc06cf80 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.979+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f8cdc06cf80 msgr2=0x7f8cdc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.979+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f8cdc06cf80 0x7f8cdc06f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009ce0 tx=0x7f8cec009f70 comp rx=0 tx=0).stop 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.979+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 msgr2=0x7f8cf0119ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.979+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 0x7f8cf0119ef0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0004f50 tx=0x7f8ce0009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 shutdown_connections 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f8cdc06cf80 0x7f8cdc06f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cf0070520 0x7f8cf01199b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 --2- 172.21.15.2:0/5359314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cf0071c10 0x7f8cf0119ef0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 >> 172.21.15.2:0/5359314 conn(0x7f8cf00f8560 msgr2=0x7f8cf00fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 shutdown_connections 2023-12-17T12:01:31.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:31.980+0000 7f8cf66ec700 1 -- 172.21.15.2:0/5359314 wait complete. 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.119+0000 7f354afe1700 1 -- 172.21.15.2:0/2430992592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 msgr2=0x7f3544108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.119+0000 7f354afe1700 1 --2- 172.21.15.2:0/2430992592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544108f70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3530004970 tx=0x7f3530009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.119+0000 7f354afe1700 1 -- 172.21.15.2:0/2430992592 shutdown_connections 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.119+0000 7f354afe1700 1 --2- 172.21.15.2:0/2430992592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544108f70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.119+0000 7f354afe1700 1 --2- 172.21.15.2:0/2430992592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.119+0000 7f354afe1700 1 -- 172.21.15.2:0/2430992592 >> 172.21.15.2:0/2430992592 conn(0x7f35440f8790 msgr2=0x7f35440faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.120+0000 7f354afe1700 1 -- 172.21.15.2:0/2430992592 shutdown_connections 2023-12-17T12:01:32.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.120+0000 7f354afe1700 1 -- 172.21.15.2:0/2430992592 wait complete. 2023-12-17T12:01:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.120+0000 7f354afe1700 1 Processor -- start 2023-12-17T12:01:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f354afe1700 1 -- start start 2023-12-17T12:01:32.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f354afe1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f354afe1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f354afe1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544116390 con 0x7f3544070890 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f354afe1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354410f6c0 con 0x7f354406ff80 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3543fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3548d7d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3543fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544115d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33718/0 (socket says 172.21.15.2:33718) 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3543fff700 1 -- 172.21.15.2:0/2573258845 learned_addr learned my addr 172.21.15.2:0/2573258845 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3548d7d700 1 -- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 msgr2=0x7f3544115800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3548d7d700 1 -- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 msgr2=0x7f3544115800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.121+0000 7f3548d7d700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544115800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f3548d7d700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544115800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T12:01:32.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f3543fff700 1 -- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 msgr2=0x7f3544115800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f3543fff700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544115800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f3543fff700 1 -- 172.21.15.2:0/2573258845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530005040 con 0x7f3544070890 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f3543fff700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544115d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3530004f50 tx=0x7f3530009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353000e040 con 0x7f3544070890 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f353000bc10 con 0x7f3544070890 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353001c3f0 con 0x7f3544070890 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354410f940 con 0x7f3544070890 2023-12-17T12:01:32.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.122+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354410fe80 con 0x7f3544070890 2023-12-17T12:01:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.123+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3544106630 con 0x7f3544070890 2023-12-17T12:01:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.124+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f3530013420 con 0x7f3544070890 2023-12-17T12:01:32.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.125+0000 7f35417fa700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f353406cf80 0x7f353406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.125+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f353008d990 con 0x7f3544070890 2023-12-17T12:01:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.125+0000 7f3548d7d700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f353406cf80 0x7f353406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.126+0000 7f3548d7d700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f353406cf80 0x7f353406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3538009ce0 tx=0x7f3538009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:32.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.130+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f353005b0c0 con 0x7f3544070890 2023-12-17T12:01:32.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.353+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f354410bde0 con 0x7f353406cf80 2023-12-17T12:01:32.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.364+0000 7f35417fa700 1 -- 172.21.15.2:0/2573258845 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f354410bde0 con 0x7f353406cf80 2023-12-17T12:01:32.366 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:01:32.366 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (103s) 15s ago 11m 15.6M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:01:32.366 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (11m) 15s ago 11m 7822k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f31fed3e74af 2023-12-17T12:01:32.366 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (10m) 0s ago 10m 7818k - 17.2.7-125-g1f2f5510 60cc83a9c8f1 fc1a1bddf631 2023-12-17T12:01:32.366 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (87s) 15s ago 10m 78.0M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (6m) 15s ago 6m 6649M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (6m) 15s ago 6m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (6m) 0s ago 6m 5123M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (6m) 0s ago 6m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (3m) 15s ago 12m 483M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (2m) 0s ago 10m 450M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (29s) 15s ago 12m 30.7M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (3s) 0s ago 10m 27.3M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (2m) 15s ago 11m 8350k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (2m) 0s ago 10m 8196k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (9m) 15s ago 9m 764M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (9m) 15s ago 9m 872M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (8m) 15s ago 8m 638M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (8m) 0s ago 8m 979M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:01:32.367 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (8m) 0s ago 7m 742M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:01:32.368 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (7m) 0s ago 7m 860M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:01:32.368 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (119s) 15s ago 10m 48.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.366+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f353406cf80 msgr2=0x7f353406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.366+0000 7f354afe1700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f353406cf80 0x7f353406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3538009ce0 tx=0x7f3538009f70 comp rx=0 tx=0).stop 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.366+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 msgr2=0x7f3544115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.366+0000 7f354afe1700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544115d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3530004f50 tx=0x7f3530009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 shutdown_connections 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f353406cf80 0x7f353406f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f354406ff80 0x7f3544115800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 --2- 172.21.15.2:0/2573258845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3544070890 0x7f3544115d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 >> 172.21.15.2:0/2573258845 conn(0x7f35440f8790 msgr2=0x7f35441037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 shutdown_connections 2023-12-17T12:01:32.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.367+0000 7f354afe1700 1 -- 172.21.15.2:0/2573258845 wait complete. 2023-12-17T12:01:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 -- 172.21.15.2:0/1576369695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 msgr2=0x7fe4fc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 --2- 172.21.15.2:0/1576369695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc0fcc10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec004940 tx=0x7fe4ec009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:32.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 -- 172.21.15.2:0/1576369695 shutdown_connections 2023-12-17T12:01:32.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 --2- 172.21.15.2:0/1576369695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc0fcc10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 --2- 172.21.15.2:0/1576369695 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 -- 172.21.15.2:0/1576369695 >> 172.21.15.2:0/1576369695 conn(0x7fe4fc0f8790 msgr2=0x7fe4fc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:32.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 -- 172.21.15.2:0/1576369695 shutdown_connections 2023-12-17T12:01:32.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.505+0000 7fe503329700 1 -- 172.21.15.2:0/1576369695 wait complete. 2023-12-17T12:01:32.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.506+0000 7fe503329700 1 Processor -- start 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.506+0000 7fe503329700 1 -- start start 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.506+0000 7fe503329700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.506+0000 7fe503329700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe503329700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc1163b0 con 0x7fe4fc1035a0 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe503329700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc10f6e0 con 0x7fe4fc102c00 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5008c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5008c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33734/0 (socket says 172.21.15.2:33734) 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5008c4700 1 -- 172.21.15.2:0/3769541025 learned_addr learned my addr 172.21.15.2:0/3769541025 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5010c5700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5010c5700 1 -- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 msgr2=0x7fe4fc115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5010c5700 1 -- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 msgr2=0x7fe4fc115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5010c5700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5010c5700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T12:01:32.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5008c4700 1 -- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 msgr2=0x7fe4fc115820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T12:01:32.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5008c4700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.507+0000 7fe5008c4700 1 -- 172.21.15.2:0/3769541025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec005040 con 0x7fe4fc1035a0 2023-12-17T12:01:32.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.508+0000 7fe5008c4700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc115d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009180 tx=0x7fe4ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:32.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.508+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4ec00e040 con 0x7fe4fc1035a0 2023-12-17T12:01:32.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.508+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4ec004290 con 0x7fe4fc1035a0 2023-12-17T12:01:32.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.508+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc10f960 con 0x7fe4fc1035a0 2023-12-17T12:01:32.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.508+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4ec01c3f0 con 0x7fe4fc1035a0 2023-12-17T12:01:32.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.508+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc10fea0 con 0x7fe4fc1035a0 2023-12-17T12:01:32.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.509+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc0fc390 con 0x7fe4fc1035a0 2023-12-17T12:01:32.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.510+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fe4ec00bc50 con 0x7fe4fc1035a0 2023-12-17T12:01:32.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.511+0000 7fe4f1ffb700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4e806cf80 0x7fe4e806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.511+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe4ec08d830 con 0x7fe4fc1035a0 2023-12-17T12:01:32.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.511+0000 7fe5010c5700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4e806cf80 0x7fe4e806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.512+0000 7fe5010c5700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4e806cf80 0x7fe4e806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009ce0 tx=0x7fe4f8009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.516+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe4ec05afe0 con 0x7fe4fc1035a0 2023-12-17T12:01:32.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.824+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4fc109be0 con 0x7fe4fc1035a0 2023-12-17T12:01:32.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.824+0000 7fe4f1ffb700 1 -- 172.21.15.2:0/3769541025 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7fe4ec05ab70 con 0x7fe4fc1035a0 2023-12-17T12:01:32.826 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:01:32.827 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 10, 2023-12-17T12:01:32.828 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 4 2023-12-17T12:01:32.828 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:01:32.828 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:01:32.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4e806cf80 msgr2=0x7fe4e806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4e806cf80 0x7fe4e806f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009ce0 tx=0x7fe4f8009f70 comp rx=0 tx=0).stop 2023-12-17T12:01:32.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 msgr2=0x7fe4fc115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc115d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009180 tx=0x7fe4ec009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:32.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 shutdown_connections 2023-12-17T12:01:32.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4e806cf80 0x7fe4e806f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4fc102c00 0x7fe4fc115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 --2- 172.21.15.2:0/3769541025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4fc1035a0 0x7fe4fc115d60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 >> 172.21.15.2:0/3769541025 conn(0x7fe4fc0f8790 msgr2=0x7fe4fc0fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:32.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 shutdown_connections 2023-12-17T12:01:32.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.827+0000 7fe503329700 1 -- 172.21.15.2:0/3769541025 wait complete. 2023-12-17T12:01:32.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.967+0000 7fe8589bc700 1 -- 172.21.15.2:0/1233963932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 msgr2=0x7fe8540fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:32.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.967+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1233963932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe8540fcc10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe848004940 tx=0x7fe848009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:32.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.968+0000 7fe8589bc700 1 -- 172.21.15.2:0/1233963932 shutdown_connections 2023-12-17T12:01:32.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.968+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1233963932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe8540fcc10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.968+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1233963932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.968+0000 7fe8589bc700 1 -- 172.21.15.2:0/1233963932 >> 172.21.15.2:0/1233963932 conn(0x7fe8540f8790 msgr2=0x7fe8540faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:32.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.968+0000 7fe8589bc700 1 -- 172.21.15.2:0/1233963932 shutdown_connections 2023-12-17T12:01:32.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.968+0000 7fe8589bc700 1 -- 172.21.15.2:0/1233963932 wait complete. 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.969+0000 7fe8589bc700 1 Processor -- start 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.969+0000 7fe8589bc700 1 -- start start 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.969+0000 7fe8589bc700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.969+0000 7fe8589bc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe854113bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.969+0000 7fe8589bc700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe854114220 con 0x7fe8541035a0 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.969+0000 7fe8589bc700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85410d510 con 0x7fe854102c00 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe854113bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe85259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe854113bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33754/0 (socket says 172.21.15.2:33754) 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe85259c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:42152/0 (socket says 172.21.15.2:42152) 2023-12-17T12:01:32.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 -- 172.21.15.2:0/1978464689 learned_addr learned my addr 172.21.15.2:0/1978464689 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe85259c700 1 -- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 msgr2=0x7fe854113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe85259c700 1 -- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 msgr2=0x7fe854113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe85259c700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe85259c700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 -- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 msgr2=0x7fe854113690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 -- 172.21.15.2:0/1978464689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848005040 con 0x7fe8541035a0 2023-12-17T12:01:32.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.970+0000 7fe851d9b700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe854113bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe848009180 tx=0x7fe848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.971+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84800e040 con 0x7fe8541035a0 2023-12-17T12:01:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.971+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85410d790 con 0x7fe8541035a0 2023-12-17T12:01:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.972+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85410dcd0 con 0x7fe8541035a0 2023-12-17T12:01:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.973+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe848004290 con 0x7fe8541035a0 2023-12-17T12:01:32.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.973+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe848013dd0 con 0x7fe8541035a0 2023-12-17T12:01:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.973+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe854113320 con 0x7fe8541035a0 2023-12-17T12:01:32.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.974+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fe848013420 con 0x7fe8541035a0 2023-12-17T12:01:32.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.975+0000 7fe842ffd700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe83c06cf80 0x7fe83c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:32.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.976+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe84808d910 con 0x7fe8541035a0 2023-12-17T12:01:32.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.976+0000 7fe85259c700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe83c06cf80 0x7fe83c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:32.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.976+0000 7fe85259c700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe83c06cf80 0x7fe83c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe844009ce0 tx=0x7fe844009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:32.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:32.982+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe84805b0e0 con 0x7fe8541035a0 2023-12-17T12:01:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:32 smithi119 ceph-mon[177559]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:32 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:32 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:32 smithi119 ceph-mon[177559]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:33.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:32 smithi119 ceph-mon[177559]: pgmap v13: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:33.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:32 smithi002 ceph-mon[211741]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:33.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:32 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:32 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:32 smithi002 ceph-mon[211741]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:33.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:32 smithi002 ceph-mon[211741]: pgmap v13: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:33.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.245+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe8541050d0 con 0x7fe8541035a0 2023-12-17T12:01:33.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.245+0000 7fe842ffd700 1 -- 172.21.15.2:0/1978464689 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1883 (secure 0 0 0) 0x7fe84805ac70 con 0x7fe8541035a0 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:e17 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 17 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T11:58:06.999510+0000 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:01:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:01:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:33.250 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:01:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe83c06cf80 msgr2=0x7fe83c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe83c06cf80 0x7fe83c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe844009ce0 tx=0x7fe844009f70 comp rx=0 tx=0).stop 2023-12-17T12:01:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 msgr2=0x7fe854113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe854113bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe848009180 tx=0x7fe848009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 shutdown_connections 2023-12-17T12:01:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe83c06cf80 0x7fe83c06f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe854102c00 0x7fe854113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 --2- 172.21.15.2:0/1978464689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8541035a0 0x7fe854113bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 >> 172.21.15.2:0/1978464689 conn(0x7fe8540f8790 msgr2=0x7fe8540fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 shutdown_connections 2023-12-17T12:01:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.248+0000 7fe8589bc700 1 -- 172.21.15.2:0/1978464689 wait complete. 2023-12-17T12:01:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-12-17T12:01:33.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.387+0000 7f3745057700 1 -- 172.21.15.2:0/4165124073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37400708f0 msgr2=0x7f3740108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.387+0000 7f3745057700 1 --2- 172.21.15.2:0/4165124073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37400708f0 0x7f3740108f10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3734004970 tx=0x7f3734009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:33.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 -- 172.21.15.2:0/4165124073 shutdown_connections 2023-12-17T12:01:33.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 --2- 172.21.15.2:0/4165124073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f37400708f0 0x7f3740108f10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 --2- 172.21.15.2:0/4165124073 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f374006ffe0 0x7f37400703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 -- 172.21.15.2:0/4165124073 >> 172.21.15.2:0/4165124073 conn(0x7f37400f8790 msgr2=0x7f37400faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:33.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 -- 172.21.15.2:0/4165124073 shutdown_connections 2023-12-17T12:01:33.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 -- 172.21.15.2:0/4165124073 wait complete. 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.388+0000 7f3745057700 1 Processor -- start 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f3745057700 1 -- start start 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f3745057700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 0x7f3740115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f3745057700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 0x7f3740115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f3745057700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37401163e0 con 0x7f374006ffe0 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f3745057700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374010f710 con 0x7f37400708f0 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f373ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 0x7f3740115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f373ed9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 0x7f3740115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33770/0 (socket says 172.21.15.2:33770) 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f373ed9d700 1 -- 172.21.15.2:0/701918877 learned_addr learned my addr 172.21.15.2:0/701918877 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.389+0000 7f373e59c700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 0x7f3740115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373e59c700 1 -- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 msgr2=0x7f3740115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-17T12:01:33.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373e59c700 1 -- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 msgr2=0x7f3740115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373e59c700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 0x7f3740115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373e59c700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 0x7f3740115d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373ed9d700 1 -- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 msgr2=0x7f3740115d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373ed9d700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 0x7f3740115d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373ed9d700 1 -- 172.21.15.2:0/701918877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734005040 con 0x7f374006ffe0 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f373ed9d700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 0x7f3740115850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f37300041d0 tx=0x7f37300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3730007cc0 con 0x7f374006ffe0 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f373000f040 con 0x7f374006ffe0 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374010f9f0 con 0x7f374006ffe0 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.390+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373000dae0 con 0x7f374006ffe0 2023-12-17T12:01:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.391+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374010ff00 con 0x7f374006ffe0 2023-12-17T12:01:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.392+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37401065d0 con 0x7f374006ffe0 2023-12-17T12:01:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.393+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f373000dc40 con 0x7f374006ffe0 2023-12-17T12:01:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.394+0000 7f37277fe700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f372806cf80 0x7f372806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.394+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f373008bd80 con 0x7f374006ffe0 2023-12-17T12:01:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.394+0000 7f373e59c700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f372806cf80 0x7f372806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:33.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.394+0000 7f373e59c700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f372806cf80 0x7f372806f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3734009fd0 tx=0x7f3734009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:33.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.398+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3730059430 con 0x7f374006ffe0 2023-12-17T12:01:33.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.631+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f374004bbf0 con 0x7f372806cf80 2023-12-17T12:01:33.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.632+0000 7f37277fe700 1 -- 172.21.15.2:0/701918877 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f374004bbf0 con 0x7f372806cf80 2023-12-17T12:01:33.634 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:01:33.634 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:01:33.634 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:01:33.634 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "4/21 daemons upgraded", 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading mon daemons", 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:01:33.635 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:01:33.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f372806cf80 msgr2=0x7f372806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f372806cf80 0x7f372806f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3734009fd0 tx=0x7f3734009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 msgr2=0x7f3740115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 0x7f3740115850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f37300041d0 tx=0x7f37300046b0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 shutdown_connections 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f372806cf80 0x7f372806f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f374006ffe0 0x7f3740115850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 --2- 172.21.15.2:0/701918877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37400708f0 0x7f3740115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 >> 172.21.15.2:0/701918877 conn(0x7f37400f8790 msgr2=0x7f3740103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.634+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 shutdown_connections 2023-12-17T12:01:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.635+0000 7f3745057700 1 -- 172.21.15.2:0/701918877 wait complete. 2023-12-17T12:01:33.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 -- 172.21.15.2:0/1621745138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 msgr2=0x7fe4d40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1621745138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d40fcc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0004940 tx=0x7fe4c0009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 -- 172.21.15.2:0/1621745138 shutdown_connections 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1621745138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d40fcc10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1621745138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d4102c00 0x7fe4d4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 -- 172.21.15.2:0/1621745138 >> 172.21.15.2:0/1621745138 conn(0x7fe4d40f8790 msgr2=0x7fe4d40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 -- 172.21.15.2:0/1621745138 shutdown_connections 2023-12-17T12:01:33.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.775+0000 7fe4dad02700 1 -- 172.21.15.2:0/1621745138 wait complete. 2023-12-17T12:01:33.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.776+0000 7fe4dad02700 1 Processor -- start 2023-12-17T12:01:33.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.776+0000 7fe4dad02700 1 -- start start 2023-12-17T12:01:33.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.776+0000 7fe4dad02700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d4102c00 0x7fe4d41157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:33.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.776+0000 7fe4dad02700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d4115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4dad02700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4116350 con 0x7fe4d41035a0 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4dad02700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d410f680 con 0x7fe4d4102c00 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d4115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d3fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d4115d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33780/0 (socket says 172.21.15.2:33780) 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d3fff700 1 -- 172.21.15.2:0/1634478376 learned_addr learned my addr 172.21.15.2:0/1634478376 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d8a9e700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d4102c00 0x7fe4d41157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d3fff700 1 -- 172.21.15.2:0/1634478376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d4102c00 msgr2=0x7fe4d41157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d3fff700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d4102c00 0x7fe4d41157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:33.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.777+0000 7fe4d3fff700 1 -- 172.21.15.2:0/1634478376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0005040 con 0x7fe4d41035a0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.778+0000 7fe4d3fff700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d4115d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009fd0 tx=0x7fe4c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.778+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c0021070 con 0x7fe4d41035a0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.778+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d410f900 con 0x7fe4d41035a0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.778+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4c00093b0 con 0x7fe4d41035a0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.778+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c000e070 con 0x7fe4d41035a0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.778+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d410fde0 con 0x7fe4d41035a0 2023-12-17T12:01:33.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.779+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d40fc390 con 0x7fe4d41035a0 2023-12-17T12:01:33.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.780+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fe4c0013a50 con 0x7fe4d41035a0 2023-12-17T12:01:33.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.781+0000 7fe4d17fa700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4c406cf80 0x7fe4c406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:33.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.781+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe4c008d660 con 0x7fe4d41035a0 2023-12-17T12:01:33.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.781+0000 7fe4d8a9e700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4c406cf80 0x7fe4c406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:33.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.782+0000 7fe4d8a9e700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4c406cf80 0x7fe4c406f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009b80 tx=0x7fe4c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:33.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:33.786+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe4c005ae30 con 0x7fe4d41035a0 2023-12-17T12:01:33.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:33 smithi119 ceph-mon[177559]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:33.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:33 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3769541025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:33.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:33 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:33 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:33 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1978464689' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:01:33.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:33 smithi002 ceph-mon[211741]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:33.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:33 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3769541025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:33.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:33 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:33 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:33.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:33 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1978464689' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:01:34.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.080+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe4d404bb80 con 0x7fe4d41035a0 2023-12-17T12:01:34.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.080+0000 7fe4d17fa700 1 -- 172.21.15.2:0/1634478376 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fe4c005a9c0 con 0x7fe4d41035a0 2023-12-17T12:01:34.083 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:34.083 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:01:34.083 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:01:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4c406cf80 msgr2=0x7fe4c406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4c406cf80 0x7fe4c406f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009b80 tx=0x7fe4c800b040 comp rx=0 tx=0).stop 2023-12-17T12:01:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 msgr2=0x7fe4d4115d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:34.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d4115d00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009fd0 tx=0x7fe4c0009e30 comp rx=0 tx=0).stop 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 shutdown_connections 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe4c406cf80 0x7fe4c406f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d4102c00 0x7fe4d41157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 --2- 172.21.15.2:0/1634478376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4d41035a0 0x7fe4d4115d00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 >> 172.21.15.2:0/1634478376 conn(0x7fe4d40f8790 msgr2=0x7fe4d4070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 shutdown_connections 2023-12-17T12:01:34.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:01:34.083+0000 7fe4dad02700 1 -- 172.21.15.2:0/1634478376 wait complete. 2023-12-17T12:01:35.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:34 smithi119 ceph-mon[177559]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:35.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:34 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1634478376' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:01:35.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:34 smithi119 ceph-mon[177559]: pgmap v14: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:35.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:34 smithi002 ceph-mon[211741]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:35.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:34 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1634478376' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:01:35.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:34 smithi002 ceph-mon[211741]: pgmap v14: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:37.344 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: pgmap v15: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:37.345 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: pgmap v15: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:37.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:37.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:37.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:37.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: Reconfiguring mon.smithi002 (monmap changed)... 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: Reconfiguring daemon mon.smithi002 on smithi002 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T12:01:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:38 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: Reconfiguring mon.smithi002 (monmap changed)... 2023-12-17T12:01:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: Reconfiguring daemon mon.smithi002 on smithi002 2023-12-17T12:01:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:38.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi002.cqnuqs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T12:01:38.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T12:01:38.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:38 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: Reconfiguring mgr.smithi002.cqnuqs (monmap changed)... 2023-12-17T12:01:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: Reconfiguring daemon mgr.smithi002.cqnuqs on smithi002 2023-12-17T12:01:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: pgmap v16: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:01:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: Reconfiguring mgr.smithi002.cqnuqs (monmap changed)... 2023-12-17T12:01:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: Reconfiguring daemon mgr.smithi002.cqnuqs on smithi002 2023-12-17T12:01:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: pgmap v16: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:39.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:01:39.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:40.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:40 smithi002 ceph-mon[211741]: Reconfiguring crash.smithi002 (monmap changed)... 2023-12-17T12:01:40.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:40 smithi002 ceph-mon[211741]: Reconfiguring daemon crash.smithi002 on smithi002 2023-12-17T12:01:40.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:40 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:40.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:40 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:40.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:40 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T12:01:40.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:40 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:40 smithi119 ceph-mon[177559]: Reconfiguring crash.smithi002 (monmap changed)... 2023-12-17T12:01:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:40 smithi119 ceph-mon[177559]: Reconfiguring daemon crash.smithi002 on smithi002 2023-12-17T12:01:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:40 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:40 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:40 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T12:01:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:40 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:41.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:41 smithi002 ceph-mon[211741]: Reconfiguring osd.0 (monmap changed)... 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:41 smithi002 ceph-mon[211741]: Reconfiguring daemon osd.0 on smithi002 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:41 smithi002 ceph-mon[211741]: pgmap v17: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:41 smithi119 ceph-mon[177559]: Reconfiguring osd.0 (monmap changed)... 2023-12-17T12:01:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:41 smithi119 ceph-mon[177559]: Reconfiguring daemon osd.0 on smithi002 2023-12-17T12:01:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:41 smithi119 ceph-mon[177559]: pgmap v17: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:42.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:42.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:42.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:42 smithi002 ceph-mon[211741]: Reconfiguring osd.1 (monmap changed)... 2023-12-17T12:01:42.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T12:01:42.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:42.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:42 smithi002 ceph-mon[211741]: Reconfiguring daemon osd.1 on smithi002 2023-12-17T12:01:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:42 smithi119 ceph-mon[177559]: Reconfiguring osd.1 (monmap changed)... 2023-12-17T12:01:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T12:01:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:42 smithi119 ceph-mon[177559]: Reconfiguring daemon osd.1 on smithi002 2023-12-17T12:01:43.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:43 smithi002 ceph-mon[211741]: pgmap v18: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:43.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:43.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:43.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:43.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T12:01:43.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:43 smithi119 ceph-mon[177559]: pgmap v18: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:43.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T12:01:43.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:44.557 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:44 smithi002 ceph-mon[211741]: Reconfiguring osd.2 (monmap changed)... 2023-12-17T12:01:44.558 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:44 smithi002 ceph-mon[211741]: Reconfiguring daemon osd.2 on smithi002 2023-12-17T12:01:44.558 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:44 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:44.558 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:44 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:44.558 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:44 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.ercyvj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:44.558 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:44 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:44.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:44 smithi119 ceph-mon[177559]: Reconfiguring osd.2 (monmap changed)... 2023-12-17T12:01:44.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:44 smithi119 ceph-mon[177559]: Reconfiguring daemon osd.2 on smithi002 2023-12-17T12:01:44.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:44 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:44.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:44 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:44.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:44 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.ercyvj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:44.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:44 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: Reconfiguring mds.cephfs.smithi002.ercyvj (monmap changed)... 2023-12-17T12:01:45.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: Reconfiguring daemon mds.cephfs.smithi002.ercyvj on smithi002 2023-12-17T12:01:45.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: pgmap v19: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:45.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:45.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:45.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.atwfoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:45.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:45 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: Reconfiguring mds.cephfs.smithi002.ercyvj (monmap changed)... 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: Reconfiguring daemon mds.cephfs.smithi002.ercyvj on smithi002 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: pgmap v19: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi002.atwfoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:45 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:46.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:46 smithi002 ceph-mon[211741]: Reconfiguring mds.cephfs.smithi002.atwfoy (monmap changed)... 2023-12-17T12:01:46.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:46 smithi002 ceph-mon[211741]: Reconfiguring daemon mds.cephfs.smithi002.atwfoy on smithi002 2023-12-17T12:01:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:46 smithi119 ceph-mon[177559]: Reconfiguring mds.cephfs.smithi002.atwfoy (monmap changed)... 2023-12-17T12:01:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:46 smithi119 ceph-mon[177559]: Reconfiguring daemon mds.cephfs.smithi002.atwfoy on smithi002 2023-12-17T12:01:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:47 smithi119 ceph-mon[177559]: pgmap v20: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:01:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:47.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:47 smithi002 ceph-mon[211741]: pgmap v20: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:47.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:47.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:47.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:01:47.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: Reconfiguring crash.smithi119 (monmap changed)... 2023-12-17T12:01:48.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: Reconfiguring daemon crash.smithi119 on smithi119 2023-12-17T12:01:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T12:01:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T12:01:48.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:48 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: Reconfiguring crash.smithi119 (monmap changed)... 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: Reconfiguring daemon crash.smithi119 on smithi119 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi119.nzblpy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T12:01:48.663 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:48 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:49.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: Reconfiguring mgr.smithi119.nzblpy (monmap changed)... 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: Reconfiguring daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: pgmap v21: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: Reconfiguring mon.smithi119 (monmap changed)... 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:49.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:49 smithi119 ceph-mon[177559]: Reconfiguring daemon mon.smithi119 on smithi119 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: Reconfiguring mgr.smithi119.nzblpy (monmap changed)... 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: Reconfiguring daemon mgr.smithi119.nzblpy on smithi119 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: pgmap v21: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: Reconfiguring mon.smithi119 (monmap changed)... 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:49.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:49 smithi002 ceph-mon[211741]: Reconfiguring daemon mon.smithi119 on smithi119 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: Reconfiguring osd.3 (monmap changed)... 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: Reconfiguring daemon osd.3 on smithi119 2023-12-17T12:01:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:51 smithi119 ceph-mon[177559]: pgmap v22: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:51.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:51.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:51.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: Reconfiguring osd.3 (monmap changed)... 2023-12-17T12:01:51.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T12:01:51.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:51.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: Reconfiguring daemon osd.3 on smithi119 2023-12-17T12:01:51.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:51 smithi002 ceph-mon[211741]: pgmap v22: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:52.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:52 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:52.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:52 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:52.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:52 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T12:01:52.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:52 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:52.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:52 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:52.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:52 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:52.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:52 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T12:01:52.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:52 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:53.513 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: Reconfiguring osd.4 (monmap changed)... 2023-12-17T12:01:53.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: Reconfiguring daemon osd.4 on smithi119 2023-12-17T12:01:53.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: pgmap v23: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:53.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:53.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:53.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T12:01:53.514 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:53 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:53.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: Reconfiguring osd.4 (monmap changed)... 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: Reconfiguring daemon osd.4 on smithi119 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: pgmap v23: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:53 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:54.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:54 smithi119 ceph-mon[177559]: Reconfiguring osd.5 (monmap changed)... 2023-12-17T12:01:54.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:54 smithi119 ceph-mon[177559]: Reconfiguring daemon osd.5 on smithi119 2023-12-17T12:01:54.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:54 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:54.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:54 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:54.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:54 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.mzkvrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:54.591 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:54 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:54 smithi002 ceph-mon[211741]: Reconfiguring osd.5 (monmap changed)... 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:54 smithi002 ceph-mon[211741]: Reconfiguring daemon osd.5 on smithi119 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:54 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:54 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:54 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.mzkvrk", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:54 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: Reconfiguring mds.cephfs.smithi119.mzkvrk (monmap changed)... 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: Reconfiguring daemon mds.cephfs.smithi119.mzkvrk on smithi119 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: pgmap v24: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.qgnwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:55.630 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:55 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: Reconfiguring mds.cephfs.smithi119.mzkvrk (monmap changed)... 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: Reconfiguring daemon mds.cephfs.smithi119.mzkvrk on smithi119 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: pgmap v24: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi119.qgnwfs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:01:55.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:55 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: Reconfiguring mds.cephfs.smithi119.qgnwfs (monmap changed)... 2023-12-17T12:01:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: Reconfiguring daemon mds.cephfs.smithi119.qgnwfs on smithi119 2023-12-17T12:01:56.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]: dispatch 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]': finished 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]: dispatch 2023-12-17T12:01:56.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:56 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]': finished 2023-12-17T12:01:56.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: Reconfiguring mds.cephfs.smithi119.qgnwfs (monmap changed)... 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: Reconfiguring daemon mds.cephfs.smithi119.qgnwfs on smithi119 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]: dispatch 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi002"}]': finished 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]: dispatch 2023-12-17T12:01:56.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:56 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi119"}]': finished 2023-12-17T12:01:57.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:57 smithi002 ceph-mon[211741]: pgmap v25: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:57 smithi002 ceph-mon[211741]: Upgrade: Setting container_image for all mon 2023-12-17T12:01:57.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:57 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:57 smithi119 ceph-mon[177559]: pgmap v25: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:57 smithi119 ceph-mon[177559]: Upgrade: Setting container_image for all mon 2023-12-17T12:01:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:57 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:01:58.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:58 smithi002 ceph-mon[211741]: Upgrade: Updating crash.smithi002 (1/2) 2023-12-17T12:01:58.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:58.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:01:58.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:58.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:58 smithi002 ceph-mon[211741]: Deploying daemon crash.smithi002 on smithi002 2023-12-17T12:01:58.774 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:01:58 smithi002 ceph-mon[211741]: pgmap v26: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:58 smithi119 ceph-mon[177559]: Upgrade: Updating crash.smithi002 (1/2) 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi002", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:58.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:58 smithi119 ceph-mon[177559]: Deploying daemon crash.smithi002 on smithi002 2023-12-17T12:01:58.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:01:58 smithi119 ceph-mon[177559]: pgmap v26: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:01.545 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:01 smithi002 ceph-mon[211741]: pgmap v27: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:01.545 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:01 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:01.545 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:01 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:01.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:01 smithi119 ceph-mon[177559]: pgmap v27: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:01.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:01 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:01.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:01 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:03.289 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:03 smithi119 ceph-mon[177559]: Upgrade: Updating crash.smithi119 (2/2) 2023-12-17T12:02:03.290 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:03 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:03.290 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:03 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:02:03.290 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:03 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:03.290 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:03 smithi119 ceph-mon[177559]: Deploying daemon crash.smithi119 on smithi119 2023-12-17T12:02:03.290 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:03 smithi119 ceph-mon[177559]: pgmap v28: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:03.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:03 smithi002 ceph-mon[211741]: Upgrade: Updating crash.smithi119 (2/2) 2023-12-17T12:02:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:03 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:03 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi119", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-17T12:02:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:03 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:03 smithi002 ceph-mon[211741]: Deploying daemon crash.smithi119 on smithi119 2023-12-17T12:02:03.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:03 smithi002 ceph-mon[211741]: pgmap v28: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:04.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 -- 172.21.15.2:0/684681101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 msgr2=0x7f1bd8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 --2- 172.21.15.2:0/684681101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd8102fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4004940 tx=0x7f1bd4009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:04.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 -- 172.21.15.2:0/684681101 shutdown_connections 2023-12-17T12:02:04.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 --2- 172.21.15.2:0/684681101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 0x7f1bd80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 --2- 172.21.15.2:0/684681101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd8102fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 -- 172.21.15.2:0/684681101 >> 172.21.15.2:0/684681101 conn(0x7f1bd80f8790 msgr2=0x7f1bd80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 -- 172.21.15.2:0/684681101 shutdown_connections 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.255+0000 7f1be0653700 1 -- 172.21.15.2:0/684681101 wait complete. 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.256+0000 7f1be0653700 1 Processor -- start 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.256+0000 7f1be0653700 1 -- start start 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1be0653700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd81157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1be0653700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 0x7f1bd8115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1be0653700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd8116360 con 0x7f1bd8102c00 2023-12-17T12:02:04.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1be0653700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd810f690 con 0x7f1bd81035a0 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1bde3ef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd81157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1bde3ef700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd81157d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58408/0 (socket says 172.21.15.2:58408) 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1bde3ef700 1 -- 172.21.15.2:0/2885102571 learned_addr learned my addr 172.21.15.2:0/2885102571 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.257+0000 7f1bddbee700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 0x7f1bd8115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.258+0000 7f1bde3ef700 1 -- 172.21.15.2:0/2885102571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 msgr2=0x7f1bd8115d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.258+0000 7f1bde3ef700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 0x7f1bd8115d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.258+0000 7f1bde3ef700 1 -- 172.21.15.2:0/2885102571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4005040 con 0x7f1bd8102c00 2023-12-17T12:02:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.258+0000 7f1bddbee700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 0x7f1bd8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:04.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.258+0000 7f1bde3ef700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd81157d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4008d80 tx=0x7f1bd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.260+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd400e030 con 0x7f1bd8102c00 2023-12-17T12:02:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.260+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bd4004290 con 0x7f1bd8102c00 2023-12-17T12:02:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.260+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd810f910 con 0x7f1bd8102c00 2023-12-17T12:02:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.260+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bd401ce60 con 0x7f1bd8102c00 2023-12-17T12:02:04.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.261+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd810fe50 con 0x7f1bd8102c00 2023-12-17T12:02:04.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.262+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd80fc390 con 0x7f1bd8102c00 2023-12-17T12:02:04.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.263+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f1bd401c690 con 0x7f1bd8102c00 2023-12-17T12:02:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.264+0000 7f1bceffd700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1bc406cf10 0x7f1bc406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.264+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1bd408df70 con 0x7f1bd8102c00 2023-12-17T12:02:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.264+0000 7f1bddbee700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1bc406cf10 0x7f1bc406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.265+0000 7f1bddbee700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1bc406cf10 0x7f1bc406f3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8004600 tx=0x7f1bc800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:04.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.269+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1bd405b6a0 con 0x7f1bd8102c00 2023-12-17T12:02:04.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.500+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd8110e20 con 0x7f1bc406cf10 2023-12-17T12:02:04.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.502+0000 7f1bceffd700 1 -- 172.21.15.2:0/2885102571 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f1bd8110e20 con 0x7f1bc406cf10 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1bc406cf10 msgr2=0x7f1bc406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1bc406cf10 0x7f1bc406f3c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8004600 tx=0x7f1bc800b040 comp rx=0 tx=0).stop 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 msgr2=0x7f1bd81157d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd81157d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4008d80 tx=0x7f1bd4009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 shutdown_connections 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1bc406cf10 0x7f1bc406f3c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bd8102c00 0x7f1bd81157d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 --2- 172.21.15.2:0/2885102571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd81035a0 0x7f1bd8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 >> 172.21.15.2:0/2885102571 conn(0x7f1bd80f8790 msgr2=0x7f1bd80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 shutdown_connections 2023-12-17T12:02:04.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.504+0000 7f1be0653700 1 -- 172.21.15.2:0/2885102571 wait complete. 2023-12-17T12:02:04.521 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 -- 172.21.15.2:0/2732201926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278070520 msgr2=0x7fb278070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/2732201926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278070520 0x7fb278070990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb26c004970 tx=0x7fb26c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 -- 172.21.15.2:0/2732201926 shutdown_connections 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/2732201926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278070520 0x7fb278070990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/2732201926 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278071c10 0x7fb27806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 -- 172.21.15.2:0/2732201926 >> 172.21.15.2:0/2732201926 conn(0x7fb2780f8790 msgr2=0x7fb2780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.645+0000 7fb27d6c4700 1 -- 172.21.15.2:0/2732201926 shutdown_connections 2023-12-17T12:02:04.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.646+0000 7fb27d6c4700 1 -- 172.21.15.2:0/2732201926 wait complete. 2023-12-17T12:02:04.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.646+0000 7fb27d6c4700 1 Processor -- start 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.646+0000 7fb27d6c4700 1 -- start start 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb27d6c4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278070520 0x7fb278119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb27d6c4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 0x7fb27811a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb27d6c4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27811a8a0 con 0x7fb278071c10 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb27d6c4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb278113b40 con 0x7fb278070520 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb2767fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 0x7fb27811a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb2767fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 0x7fb27811a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58436/0 (socket says 172.21.15.2:58436) 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb2767fc700 1 -- 172.21.15.2:0/3237192404 learned_addr learned my addr 172.21.15.2:0/3237192404 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.647+0000 7fb276ffd700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278070520 0x7fb278119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb2767fc700 1 -- 172.21.15.2:0/3237192404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278070520 msgr2=0x7fb278119c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb2767fc700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278070520 0x7fb278119c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb2767fc700 1 -- 172.21.15.2:0/3237192404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c005040 con 0x7fb278071c10 2023-12-17T12:02:04.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb276ffd700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278070520 0x7fb278119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:04.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb2767fc700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 0x7fb27811a1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb26c004f50 tx=0x7fb26c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:04.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c00e040 con 0x7fb278071c10 2023-12-17T12:02:04.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb26c00bc10 con 0x7fb278071c10 2023-12-17T12:02:04.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb278113dc0 con 0x7fb278071c10 2023-12-17T12:02:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb26c01c630 con 0x7fb278071c10 2023-12-17T12:02:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.648+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb278114300 con 0x7fb278071c10 2023-12-17T12:02:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.649+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2780fe0b0 con 0x7fb278071c10 2023-12-17T12:02:04.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.650+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fb26c013420 con 0x7fb278071c10 2023-12-17T12:02:04.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.651+0000 7fb25f7fe700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fb26006cf80 0x7fb26006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:04.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.651+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb26c08da60 con 0x7fb278071c10 2023-12-17T12:02:04.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.652+0000 7fb276ffd700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fb26006cf80 0x7fb26006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:04.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.652+0000 7fb276ffd700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fb26006cf80 0x7fb26006f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb268009b10 tx=0x7fb268008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:04.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.656+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb26c05b1b0 con 0x7fb278071c10 2023-12-17T12:02:04.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.887+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb278119950 con 0x7fb26006cf80 2023-12-17T12:02:04.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.889+0000 7fb25f7fe700 1 -- 172.21.15.2:0/3237192404 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb278119950 con 0x7fb26006cf80 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fb26006cf80 msgr2=0x7fb26006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fb26006cf80 0x7fb26006f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb268009b10 tx=0x7fb268008040 comp rx=0 tx=0).stop 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 msgr2=0x7fb27811a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 0x7fb27811a1c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb26c004f50 tx=0x7fb26c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 shutdown_connections 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fb26006cf80 0x7fb26006f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb278070520 0x7fb278119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 --2- 172.21.15.2:0/3237192404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb278071c10 0x7fb27811a1c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 >> 172.21.15.2:0/3237192404 conn(0x7fb2780f8790 msgr2=0x7fb2780fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 shutdown_connections 2023-12-17T12:02:04.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:04.891+0000 7fb27d6c4700 1 -- 172.21.15.2:0/3237192404 wait complete. 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.030+0000 7f309c87d700 1 -- 172.21.15.2:0/3292366454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30981035a0 msgr2=0x7f30980fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.030+0000 7f309c87d700 1 --2- 172.21.15.2:0/3292366454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30981035a0 0x7f30980fcc10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f308c004940 tx=0x7f308c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.030+0000 7f309c87d700 1 -- 172.21.15.2:0/3292366454 shutdown_connections 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.030+0000 7f309c87d700 1 --2- 172.21.15.2:0/3292366454 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30981035a0 0x7f30980fcc10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.030+0000 7f309c87d700 1 --2- 172.21.15.2:0/3292366454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3098102c00 0x7f3098102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.030+0000 7f309c87d700 1 -- 172.21.15.2:0/3292366454 >> 172.21.15.2:0/3292366454 conn(0x7f30980f8790 msgr2=0x7f30980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.031+0000 7f309c87d700 1 -- 172.21.15.2:0/3292366454 shutdown_connections 2023-12-17T12:02:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.031+0000 7f309c87d700 1 -- 172.21.15.2:0/3292366454 wait complete. 2023-12-17T12:02:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.031+0000 7f309c87d700 1 Processor -- start 2023-12-17T12:02:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309c87d700 1 -- start start 2023-12-17T12:02:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309c87d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 0x7f30981135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309c87d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30981035a0 0x7f3098113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309c87d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098114160 con 0x7f3098102c00 2023-12-17T12:02:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309c87d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309810d490 con 0x7f30981035a0 2023-12-17T12:02:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 0x7f30981135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 0x7f30981135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58460/0 (socket says 172.21.15.2:58460) 2023-12-17T12:02:05.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.032+0000 7f309659c700 1 -- 172.21.15.2:0/3704746689 learned_addr learned my addr 172.21.15.2:0/3704746689 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f309659c700 1 -- 172.21.15.2:0/3704746689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30981035a0 msgr2=0x7f3098113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f309659c700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30981035a0 0x7f3098113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f309659c700 1 -- 172.21.15.2:0/3704746689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c005040 con 0x7f3098102c00 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f309659c700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 0x7f30981135d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f308800eb40 tx=0x7f308800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3088007cc0 con 0x7f3098102c00 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f308800f040 con 0x7f3098102c00 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309810d710 con 0x7f3098102c00 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3088009570 con 0x7f3098102c00 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.033+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309810dc50 con 0x7f3098102c00 2023-12-17T12:02:05.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.034+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30980fc390 con 0x7f3098102c00 2023-12-17T12:02:05.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.035+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f30880096d0 con 0x7f3098102c00 2023-12-17T12:02:05.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.036+0000 7f3086ffd700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f308006cf80 0x7f308006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.036+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f308808c270 con 0x7f3098102c00 2023-12-17T12:02:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.037+0000 7f3095d9b700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f308006cf80 0x7f308006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.037+0000 7f3095d9b700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f308006cf80 0x7f308006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f308c00b0d0 tx=0x7f308c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:05.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.041+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3088059a10 con 0x7f3098102c00 2023-12-17T12:02:05.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.267+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f309810ec20 con 0x7f308006cf80 2023-12-17T12:02:05.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.277+0000 7f3086ffd700 1 -- 172.21.15.2:0/3704746689 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f309810ec20 con 0x7f308006cf80 2023-12-17T12:02:05.279 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (2m) 48s ago 11m 15.6M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 starting - - - - 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 starting - - - - 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 48s ago 11m 78.0M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (7m) 48s ago 7m 6649M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (7m) 48s ago 7m 15.2M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (7m) 33s ago 7m 5123M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (6m) 33s ago 6m 15.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (4m) 48s ago 13m 483M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (3m) 33s ago 10m 450M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (62s) 48s ago 13m 30.7M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (36s) 33s ago 10m 27.3M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:02:05.280 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (2m) 48s ago 11m 8350k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (2m) 33s ago 10m 8196k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 48s ago 10m 764M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9aaa5d874f47 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (9m) 48s ago 9m 872M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (9m) 48s ago 9m 638M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (8m) 33s ago 8m 979M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (8m) 33s ago 8m 742M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (8m) 33s ago 8m 860M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:02:05.281 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (2m) 48s ago 11m 48.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:02:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f308006cf80 msgr2=0x7f308006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f308006cf80 0x7f308006f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f308c00b0d0 tx=0x7f308c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 msgr2=0x7f30981135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 0x7f30981135d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f308800eb40 tx=0x7f308800b040 comp rx=0 tx=0).stop 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 shutdown_connections 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f308006cf80 0x7f308006f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3098102c00 0x7f30981135d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 --2- 172.21.15.2:0/3704746689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30981035a0 0x7f3098113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 >> 172.21.15.2:0/3704746689 conn(0x7f30980f8790 msgr2=0x7f30980fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 shutdown_connections 2023-12-17T12:02:05.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.280+0000 7f309c87d700 1 -- 172.21.15.2:0/3704746689 wait complete. 2023-12-17T12:02:05.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:05 smithi119 ceph-mon[177559]: pgmap v29: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:05.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:05 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:05.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:05 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:05.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:05 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.424+0000 7f728d311700 1 -- 172.21.15.2:0/1210222779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 msgr2=0x7f7288102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.424+0000 7f728d311700 1 --2- 172.21.15.2:0/1210222779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288102fd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7278004880 tx=0x7f7278009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.424+0000 7f728d311700 1 -- 172.21.15.2:0/1210222779 shutdown_connections 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.424+0000 7f728d311700 1 --2- 172.21.15.2:0/1210222779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72881035a0 0x7f72880fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.424+0000 7f728d311700 1 --2- 172.21.15.2:0/1210222779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288102fd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.424+0000 7f728d311700 1 -- 172.21.15.2:0/1210222779 >> 172.21.15.2:0/1210222779 conn(0x7f72880f8790 msgr2=0x7f72880faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.425+0000 7f728d311700 1 -- 172.21.15.2:0/1210222779 shutdown_connections 2023-12-17T12:02:05.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.425+0000 7f728d311700 1 -- 172.21.15.2:0/1210222779 wait complete. 2023-12-17T12:02:05.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.425+0000 7f728d311700 1 Processor -- start 2023-12-17T12:02:05.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.426+0000 7f728d311700 1 -- start start 2023-12-17T12:02:05.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.426+0000 7f728d311700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.426+0000 7f728d311700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72881035a0 0x7f7288115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.426+0000 7f728d311700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72881163e0 con 0x7f72881035a0 2023-12-17T12:02:05.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.426+0000 7f728d311700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728810f710 con 0x7f7288102c00 2023-12-17T12:02:05.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.426+0000 7f7286ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f7286ffd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.2:41364/0 (socket says 172.21.15.2:41364) 2023-12-17T12:02:05.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f72867fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72881035a0 0x7f7288115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f7286ffd700 1 -- 172.21.15.2:0/3408588112 learned_addr learned my addr 172.21.15.2:0/3408588112 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:05.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f7286ffd700 1 -- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72881035a0 msgr2=0x7f7288115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f7286ffd700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72881035a0 0x7f7288115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f7286ffd700 1 -- 172.21.15.2:0/3408588112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c005040 con 0x7f7288102c00 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f7286ffd700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288115850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72780134a0 tx=0x7f7278009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.427+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f727800e030 con 0x7f7288102c00 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.428+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f727801c400 con 0x7f7288102c00 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.428+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7278005040 con 0x7f7288102c00 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.428+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72780125e0 con 0x7f7288102c00 2023-12-17T12:02:05.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.428+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728810fd40 con 0x7f7288102c00 2023-12-17T12:02:05.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.429+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72880fc390 con 0x7f7288102c00 2023-12-17T12:02:05.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.430+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f727801c570 con 0x7f7288102c00 2023-12-17T12:02:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.431+0000 7f726f7fe700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f727006cf80 0x7f727006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.431+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f727808df70 con 0x7f7288102c00 2023-12-17T12:02:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.431+0000 7f72867fc700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f727006cf80 0x7f727006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.432+0000 7f72867fc700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f727006cf80 0x7f727006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7288111080 tx=0x7f727c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:05.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.439+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f727805b720 con 0x7f7288102c00 2023-12-17T12:02:05.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:05 smithi002 ceph-mon[211741]: pgmap v29: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:05 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:05 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:05.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:05 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:05.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.772+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7288110e60 con 0x7f7288102c00 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.773+0000 7f726f7fe700 1 -- 172.21.15.2:0/3408588112 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+730 (secure 0 0 0) 0x7f727801c820 con 0x7f7288102c00 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:02:05.775 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 10, 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 4 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:02:05.776 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f727006cf80 msgr2=0x7f727006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f727006cf80 0x7f727006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7288111080 tx=0x7f727c00b040 comp rx=0 tx=0).stop 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 msgr2=0x7f7288115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288115850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f72780134a0 tx=0x7f7278009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 shutdown_connections 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f727006cf80 0x7f727006f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7288102c00 0x7f7288115850 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 --2- 172.21.15.2:0/3408588112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72881035a0 0x7f7288115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 >> 172.21.15.2:0/3408588112 conn(0x7f72880f8790 msgr2=0x7f72880fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.775+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 shutdown_connections 2023-12-17T12:02:05.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.776+0000 7f728d311700 1 -- 172.21.15.2:0/3408588112 wait complete. 2023-12-17T12:02:05.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 -- 172.21.15.2:0/130895492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 msgr2=0x7fdf2406ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 --2- 172.21.15.2:0/130895492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2406ffe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf14004970 tx=0x7fdf14009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 -- 172.21.15.2:0/130895492 shutdown_connections 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 --2- 172.21.15.2:0/130895492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 0x7fdf24070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 --2- 172.21.15.2:0/130895492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2406ffe0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 -- 172.21.15.2:0/130895492 >> 172.21.15.2:0/130895492 conn(0x7fdf240f8790 msgr2=0x7fdf240faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 -- 172.21.15.2:0/130895492 shutdown_connections 2023-12-17T12:02:05.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.939+0000 7fdf29041700 1 -- 172.21.15.2:0/130895492 wait complete. 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.940+0000 7fdf29041700 1 Processor -- start 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.940+0000 7fdf29041700 1 -- start start 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.940+0000 7fdf29041700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 0x7fdf24119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.940+0000 7fdf29041700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2411a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.940+0000 7fdf29041700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2411a870 con 0x7fdf24071c10 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.940+0000 7fdf29041700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf24113bc0 con 0x7fdf24070520 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2411a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf22d9d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 0x7fdf24119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2411a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58500/0 (socket says 172.21.15.2:58500) 2023-12-17T12:02:05.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 -- 172.21.15.2:0/3925735164 learned_addr learned my addr 172.21.15.2:0/3925735164 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 -- 172.21.15.2:0/3925735164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 msgr2=0x7fdf24119ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 0x7fdf24119ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:05.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 -- 172.21.15.2:0/3925735164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14005040 con 0x7fdf24071c10 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf22d9d700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 0x7fdf24119ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.941+0000 7fdf2259c700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2411a220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800eb40 tx=0x7fdf1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.942+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf18007cc0 con 0x7fdf24071c10 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.942+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf24113e40 con 0x7fdf24071c10 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.942+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf1800f040 con 0x7fdf24071c10 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.942+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf1800c990 con 0x7fdf24071c10 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.942+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf24114380 con 0x7fdf24071c10 2023-12-17T12:02:05.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.943+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf240fe0b0 con 0x7fdf24071c10 2023-12-17T12:02:05.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.945+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fdf1800caf0 con 0x7fdf24071c10 2023-12-17T12:02:05.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.946+0000 7fdf0b7fe700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdf0c06cf80 0x7fdf0c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:05.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.946+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdf1808c110 con 0x7fdf24071c10 2023-12-17T12:02:05.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.946+0000 7fdf22d9d700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdf0c06cf80 0x7fdf0c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:05.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.947+0000 7fdf22d9d700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdf0c06cf80 0x7fdf0c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf14004560 tx=0x7fdf14009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:05.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:05.951+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdf18055e60 con 0x7fdf24071c10 2023-12-17T12:02:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.213+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf2404bb80 con 0x7fdf24071c10 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.213+0000 7fdf0b7fe700 1 -- 172.21.15.2:0/3925735164 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1883 (secure 0 0 0) 0x7fdf18059480 con 0x7fdf24071c10 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:e17 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:02:06.216 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 17 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T11:58:06.999510+0000 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:02:06.217 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:06.218 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:02:06.219 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:06.219 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:06.219 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:06.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdf0c06cf80 msgr2=0x7fdf0c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdf0c06cf80 0x7fdf0c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf14004560 tx=0x7fdf14009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:06.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 msgr2=0x7fdf2411a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2411a220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800eb40 tx=0x7fdf1800b040 comp rx=0 tx=0).stop 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 shutdown_connections 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdf0c06cf80 0x7fdf0c06f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf24070520 0x7fdf24119ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 --2- 172.21.15.2:0/3925735164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdf24071c10 0x7fdf2411a220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 >> 172.21.15.2:0/3925735164 conn(0x7fdf240f8790 msgr2=0x7fdf240faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 shutdown_connections 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.216+0000 7fdf29041700 1 -- 172.21.15.2:0/3925735164 wait complete. 2023-12-17T12:02:06.220 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2023-12-17T12:02:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.361+0000 7fd8b9238700 1 -- 172.21.15.2:0/3964865008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 msgr2=0x7fd8b4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.361+0000 7fd8b9238700 1 --2- 172.21.15.2:0/3964865008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b4102fd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4004940 tx=0x7fd8a4009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.362+0000 7fd8b9238700 1 -- 172.21.15.2:0/3964865008 shutdown_connections 2023-12-17T12:02:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.362+0000 7fd8b9238700 1 --2- 172.21.15.2:0/3964865008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b41035a0 0x7fd8b40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.362+0000 7fd8b9238700 1 --2- 172.21.15.2:0/3964865008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b4102fd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.362+0000 7fd8b9238700 1 -- 172.21.15.2:0/3964865008 >> 172.21.15.2:0/3964865008 conn(0x7fd8b40f8790 msgr2=0x7fd8b40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.362+0000 7fd8b9238700 1 -- 172.21.15.2:0/3964865008 shutdown_connections 2023-12-17T12:02:06.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.362+0000 7fd8b9238700 1 -- 172.21.15.2:0/3964865008 wait complete. 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b9238700 1 Processor -- start 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b9238700 1 -- start start 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b9238700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b9238700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b41035a0 0x7fd8b4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b9238700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4070a80 con 0x7fd8b4102c00 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b9238700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4070bf0 con 0x7fd8b41035a0 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.363+0000 7fd8b2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b2d9d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58520/0 (socket says 172.21.15.2:58520) 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b2d9d700 1 -- 172.21.15.2:0/1112384611 learned_addr learned my addr 172.21.15.2:0/1112384611 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:06.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b259c700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b41035a0 0x7fd8b4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b2d9d700 1 -- 172.21.15.2:0/1112384611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b41035a0 msgr2=0x7fd8b4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b2d9d700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b41035a0 0x7fd8b4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b2d9d700 1 -- 172.21.15.2:0/1112384611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a4005040 con 0x7fd8b4102c00 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd8b2d9d700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b406ff40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009fd0 tx=0x7fd8a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.364+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8a400e040 con 0x7fd8b4102c00 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.365+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8a4013420 con 0x7fd8b4102c00 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.365+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8a401c630 con 0x7fd8b4102c00 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.365+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b4119850 con 0x7fd8b4102c00 2023-12-17T12:02:06.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.365+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b4119cb0 con 0x7fd8b4102c00 2023-12-17T12:02:06.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.366+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40fff10 con 0x7fd8b4102c00 2023-12-17T12:02:06.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.367+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fd8a4013590 con 0x7fd8b4102c00 2023-12-17T12:02:06.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.368+0000 7fd89b7fe700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd89c06cf80 0x7fd89c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.368+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd8a408d7c0 con 0x7fd8b4102c00 2023-12-17T12:02:06.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.368+0000 7fd8b259c700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd89c06cf80 0x7fd89c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.369+0000 7fd8b259c700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd89c06cf80 0x7fd89c06f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4071940 tx=0x7fd8a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:06.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.372+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd8a40574e0 con 0x7fd8b4102c00 2023-12-17T12:02:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:06 smithi002 ceph-mon[211741]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:06 smithi002 ceph-mon[211741]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:06 smithi002 ceph-mon[211741]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:06 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3408588112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:06 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3925735164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:02:06.598 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:06 smithi119 ceph-mon[177559]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:06.599 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:06 smithi119 ceph-mon[177559]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:06.599 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:06 smithi119 ceph-mon[177559]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:06.599 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:06 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3408588112' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:06.599 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:06 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3925735164' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:02:06.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.626+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b404bc20 con 0x7fd89c06cf80 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.628+0000 7fd89b7fe700 1 -- 172.21.15.2:0/1112384611 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fd8a800f040 con 0x7fd89c06cf80 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:02:06.630 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:02:06.631 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:02:06.631 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "4/21 daemons upgraded", 2023-12-17T12:02:06.631 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading crash daemons", 2023-12-17T12:02:06.631 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:02:06.631 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.630+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd89c06cf80 msgr2=0x7fd89c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.630+0000 7fd8b9238700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd89c06cf80 0x7fd89c06f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4071940 tx=0x7fd8a800b040 comp rx=0 tx=0).stop 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.630+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 msgr2=0x7fd8b406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.630+0000 7fd8b9238700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b406ff40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009fd0 tx=0x7fd8a4009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 shutdown_connections 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd89c06cf80 0x7fd89c06f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b4102c00 0x7fd8b406ff40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 --2- 172.21.15.2:0/1112384611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8b41035a0 0x7fd8b4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 >> 172.21.15.2:0/1112384611 conn(0x7fd8b40f8790 msgr2=0x7fd8b40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:06.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 shutdown_connections 2023-12-17T12:02:06.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.631+0000 7fd8b9238700 1 -- 172.21.15.2:0/1112384611 wait complete. 2023-12-17T12:02:06.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 -- 172.21.15.2:0/919728923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 msgr2=0x7ff018108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/919728923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018108f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff008004970 tx=0x7ff008009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 -- 172.21.15.2:0/919728923 shutdown_connections 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/919728923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018108f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/919728923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff01806ffe0 0x7ff0180703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 -- 172.21.15.2:0/919728923 >> 172.21.15.2:0/919728923 conn(0x7ff0180f87a0 msgr2=0x7ff0180fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 -- 172.21.15.2:0/919728923 shutdown_connections 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.781+0000 7ff01f9b0700 1 -- 172.21.15.2:0/919728923 wait complete. 2023-12-17T12:02:06.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.783+0000 7ff01f9b0700 1 Processor -- start 2023-12-17T12:02:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.783+0000 7ff01f9b0700 1 -- start start 2023-12-17T12:02:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.783+0000 7ff01f9b0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff01806ffe0 0x7ff018115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.783+0000 7ff01f9b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.783+0000 7ff01f9b0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff018116390 con 0x7ff0180708f0 2023-12-17T12:02:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.783+0000 7ff01f9b0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01810f6c0 con 0x7ff01806ffe0 2023-12-17T12:02:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018115d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58540/0 (socket says 172.21.15.2:58540) 2023-12-17T12:02:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 -- 172.21.15.2:0/1325064841 learned_addr learned my addr 172.21.15.2:0/1325064841 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:06.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01d74c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff01806ffe0 0x7ff018115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 -- 172.21.15.2:0/1325064841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff01806ffe0 msgr2=0x7ff018115800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff01806ffe0 0x7ff018115800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 -- 172.21.15.2:0/1325064841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008005040 con 0x7ff0180708f0 2023-12-17T12:02:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.784+0000 7ff01cf4b700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018115d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff008000c00 tx=0x7ff008009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:06.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.785+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff00800e040 con 0x7ff0180708f0 2023-12-17T12:02:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.785+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01810f940 con 0x7ff0180708f0 2023-12-17T12:02:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.785+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff008004290 con 0x7ff0180708f0 2023-12-17T12:02:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.785+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff008013e40 con 0x7ff0180708f0 2023-12-17T12:02:06.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.785+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01810fe80 con 0x7ff0180708f0 2023-12-17T12:02:06.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.787+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0181065c0 con 0x7ff0180708f0 2023-12-17T12:02:06.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.787+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7ff008009480 con 0x7ff0180708f0 2023-12-17T12:02:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.788+0000 7ff00dffb700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff00406cf10 0x7ff00406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.788+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff00808d8f0 con 0x7ff0180708f0 2023-12-17T12:02:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.789+0000 7ff01d74c700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff00406cf10 0x7ff00406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.789+0000 7ff01d74c700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff00406cf10 0x7ff00406f3c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff014009b80 tx=0x7ff01400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:06.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:06.793+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff00805afa0 con 0x7ff0180708f0 2023-12-17T12:02:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.116+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff018110de0 con 0x7ff0180708f0 2023-12-17T12:02:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.117+0000 7ff00dffb700 1 -- 172.21.15.2:0/1325064841 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff008009730 con 0x7ff0180708f0 2023-12-17T12:02:07.119 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:02:07.119 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:02:07.119 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff00406cf10 msgr2=0x7ff00406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff00406cf10 0x7ff00406f3c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff014009b80 tx=0x7ff01400b040 comp rx=0 tx=0).stop 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 msgr2=0x7ff018115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018115d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff008000c00 tx=0x7ff008009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 shutdown_connections 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff00406cf10 0x7ff00406f3c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff01806ffe0 0x7ff018115800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 --2- 172.21.15.2:0/1325064841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0180708f0 0x7ff018115d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.119+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 >> 172.21.15.2:0/1325064841 conn(0x7ff0180f87a0 msgr2=0x7ff018103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.120+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 shutdown_connections 2023-12-17T12:02:07.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:07.120+0000 7ff01f9b0700 1 -- 172.21.15.2:0/1325064841 wait complete. 2023-12-17T12:02:07.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:07 smithi119 ceph-mon[177559]: pgmap v30: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:07.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:07 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1325064841' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:02:07.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:07 smithi002 ceph-mon[211741]: pgmap v30: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:07.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:07 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1325064841' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:02:08.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:08 smithi002 ceph-mon[211741]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:08.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:08.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:08.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:08 smithi119 ceph-mon[177559]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:08.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:08.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:09.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:09 smithi002 ceph-mon[211741]: pgmap v31: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:09.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:09.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:09.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:09 smithi119 ceph-mon[177559]: pgmap v31: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:09.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:09.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:10.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:10 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:10.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:10 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:10.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:10 smithi119 ceph-mon[177559]: pgmap v32: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:10.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:10 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:10 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:10.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:10 smithi002 ceph-mon[211741]: pgmap v32: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:11.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:11 smithi002 ceph-mon[211741]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:02:11.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:11 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:11.819 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:11 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:12.123 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:11 smithi119 ceph-mon[177559]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:02:12.123 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:11 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:12.123 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:11 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:12 smithi119 ceph-mon[177559]: pgmap v33: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:13.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:13.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:12 smithi002 ceph-mon[211741]: pgmap v33: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:13.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:13.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:13.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:14.021 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:13 smithi002 ceph-mon[211741]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:02:14.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:13 smithi119 ceph-mon[177559]: fsmap cephfs:2 {0=cephfs.smithi002.atwfoy=up:active,1=cephfs.smithi119.mzkvrk=up:active} 2 up:standby 2023-12-17T12:02:15.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:14 smithi119 ceph-mon[177559]: pgmap v34: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:15.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:15.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:14 smithi002 ceph-mon[211741]: pgmap v34: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:15.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:15.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:15.227 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: Upgrade: Setting container_image for all crash 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]': finished 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]': finished 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-17T12:02:15.853 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:15 smithi002 ceph-mon[211741]: Upgrade: osd.0 is safe to restart 2023-12-17T12:02:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:16.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: Upgrade: Setting container_image for all crash 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]: dispatch 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi002"}]': finished 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]: dispatch 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi119"}]': finished 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-17T12:02:16.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:15 smithi119 ceph-mon[177559]: Upgrade: osd.0 is safe to restart 2023-12-17T12:02:17.075 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:16 smithi002 ceph-mon[211741]: pgmap v35: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:17.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:16 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:17.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:16 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T12:02:17.076 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:16 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:16 smithi119 ceph-mon[177559]: pgmap v35: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:16 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:16 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T12:02:17.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:16 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:18.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:17 smithi002 ceph-mon[211741]: Upgrade: Updating osd.0 2023-12-17T12:02:18.002 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:17 smithi002 ceph-mon[211741]: Deploying daemon osd.0 on smithi002 2023-12-17T12:02:18.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:17 smithi119 ceph-mon[177559]: Upgrade: Updating osd.0 2023-12-17T12:02:18.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:17 smithi119 ceph-mon[177559]: Deploying daemon osd.0 on smithi002 2023-12-17T12:02:19.371 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:18 smithi002 ceph-mon[211741]: pgmap v36: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:18 smithi119 ceph-mon[177559]: pgmap v36: 65 pgs: 65 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:19.647 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:19 smithi002 systemd[1]: Stopping Ceph osd.0 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:19.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:19 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[131333]: 2023-12-17T12:02:19.644+0000 7f3bfb566700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:02:19.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:19 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[131333]: 2023-12-17T12:02:19.644+0000 7f3bfb566700 -1 osd.0 52 *** Got signal Terminated *** 2023-12-17T12:02:19.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:19 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[131333]: 2023-12-17T12:02:19.644+0000 7f3bfb566700 -1 osd.0 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:02:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:19 smithi119 ceph-mon[177559]: osd.0 marked itself down and dead 2023-12-17T12:02:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:19 smithi002 ceph-mon[211741]: osd.0 marked itself down and dead 2023-12-17T12:02:20.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:20 smithi002 bash[225235]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0 2023-12-17T12:02:21.277 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:20 smithi002 ceph-mon[211741]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:02:21.278 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:20 smithi002 ceph-mon[211741]: failed to encode map e53 with expected crc 2023-12-17T12:02:21.278 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:20 smithi002 ceph-mon[211741]: osdmap e53: 6 total, 5 up, 6 in 2023-12-17T12:02:21.278 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:20 smithi002 ceph-mon[211741]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:21.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:20 smithi119 ceph-mon[177559]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:02:21.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:20 smithi119 ceph-mon[177559]: failed to encode map e53 with expected crc 2023-12-17T12:02:21.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:20 smithi119 ceph-mon[177559]: osdmap e53: 6 total, 5 up, 6 in 2023-12-17T12:02:21.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:20 smithi119 ceph-mon[177559]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:22.226 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:22 smithi002 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.0.service: Succeeded. 2023-12-17T12:02:22.226 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:22 smithi002 systemd[1]: Stopped Ceph osd.0 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: osdmap e54: 6 total, 5 up, 6 in 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:22 smithi002 ceph-mon[211741]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: osdmap e54: 6 total, 5 up, 6 in 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:22 smithi119 ceph-mon[177559]: failed to encode map e54 with expected crc 2023-12-17T12:02:22.725 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:22 smithi002 systemd[1]: Starting Ceph osd.0 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:23.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:23 smithi002 ceph-mon[211741]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:23.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:23 smithi119 ceph-mon[177559]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:23.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-17T12:02:23.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-17T12:02:23.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-17T12:02:23.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-17T12:02:23.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-17T12:02:23.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-17T12:02:23.976 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:23 smithi002 bash[225498]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-17T12:02:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:24 smithi119 ceph-mon[177559]: Health check failed: Degraded data redundancy: 72/381 objects degraded (18.898%), 20 pgs degraded (PG_DEGRADED) 2023-12-17T12:02:24.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:24 smithi002 ceph-mon[211741]: Health check failed: Degraded data redundancy: 72/381 objects degraded (18.898%), 20 pgs degraded (PG_DEGRADED) 2023-12-17T12:02:24.726 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:24 smithi002 bash[225747]: 645479c5215a53f9494e2d408d3b98262a4ae829e53617f025283719d553a4be 2023-12-17T12:02:24.726 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:24 smithi002 systemd[1]: Started Ceph osd.0 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:24.726 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:24 smithi002 ceph-osd[225785]: -- 172.21.15.2:0/3552689355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55be3fbdf6c0 con 0x55be3fbaf000 2023-12-17T12:02:25.226 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:24 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:02:24.962+0000 7fb8479b4640 -1 Falling back to public interface 2023-12-17T12:02:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:25 smithi119 ceph-mon[177559]: pgmap v41: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:25 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:25 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:25 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:25 smithi002 ceph-mon[211741]: pgmap v41: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:25.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:27.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:27 smithi002 ceph-mon[211741]: pgmap v42: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:27.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:27 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:27.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:27 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:27 smithi119 ceph-mon[177559]: pgmap v42: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:27 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:27 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:28 smithi119 ceph-mon[177559]: pgmap v43: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:29.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:29.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:28 smithi002 ceph-mon[211741]: pgmap v43: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:29.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:29.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:29.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:29 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:02:29.487+0000 7fb8479b4640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-17T12:02:30.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:29 smithi119 ceph-mon[177559]: from='osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T12:02:30.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:29 smithi002 ceph-mon[211741]: from='osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T12:02:30.476 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:29 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:02:29.979+0000 7fb8479b4640 -1 osd.0 52 log_to_monitors true 2023-12-17T12:02:30.476 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:02:30 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:02:30.021+0000 7fb836e21700 -1 osd.0 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: from='osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: failed to encode map e55 with expected crc 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: osdmap e55: 6 total, 5 up, 6 in 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: from='osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:31.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:31 smithi002 ceph-mon[211741]: pgmap v45: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: from='osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: failed to encode map e55 with expected crc 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: osdmap e55: 6 total, 5 up, 6 in 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: from='osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:31 smithi119 ceph-mon[177559]: pgmap v45: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:32 smithi119 ceph-mon[177559]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:02:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:32 smithi119 ceph-mon[177559]: failed to encode map e55 with expected crc 2023-12-17T12:02:32.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:32 smithi119 ceph-mon[177559]: osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356] boot 2023-12-17T12:02:32.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:32 smithi119 ceph-mon[177559]: osdmap e56: 6 total, 6 up, 6 in 2023-12-17T12:02:32.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:32 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T12:02:32.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:32 smithi002 ceph-mon[211741]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:02:32.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:32 smithi002 ceph-mon[211741]: failed to encode map e55 with expected crc 2023-12-17T12:02:32.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:32 smithi002 ceph-mon[211741]: osd.0 [v2:172.21.15.2:6802/1023971356,v1:172.21.15.2:6803/1023971356] boot 2023-12-17T12:02:32.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:32 smithi002 ceph-mon[211741]: osdmap e56: 6 total, 6 up, 6 in 2023-12-17T12:02:32.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:32 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: osdmap e57: 6 total, 6 up, 6 in 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.313 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.314 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:33 smithi002 ceph-mon[211741]: pgmap v48: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: osdmap e57: 6 total, 6 up, 6 in 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: failed to encode map e57 with expected crc 2023-12-17T12:02:33.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:33 smithi119 ceph-mon[177559]: pgmap v48: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 72/381 objects degraded (18.898%) 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:34.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:34.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:34.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:34.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:34.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:34.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-17T12:02:34.977 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:34 smithi002 ceph-mon[211741]: pgmap v49: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12/381 objects degraded (3.150%) 2023-12-17T12:02:35.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-17T12:02:35.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:34 smithi119 ceph-mon[177559]: pgmap v49: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12/381 objects degraded (3.150%) 2023-12-17T12:02:35.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:35 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 12/381 objects degraded (3.150%), 3 pgs degraded (PG_DEGRADED) 2023-12-17T12:02:36.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:35 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 12/381 objects degraded (3.150%), 3 pgs degraded (PG_DEGRADED) 2023-12-17T12:02:36.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:36 smithi002 ceph-mon[211741]: pgmap v50: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:37.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:36 smithi119 ceph-mon[177559]: pgmap v50: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:37.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.276+0000 7fa54706f700 1 -- 172.21.15.2:0/2479748923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400708f0 msgr2=0x7fa540108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.276+0000 7fa54706f700 1 --2- 172.21.15.2:0/2479748923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400708f0 0x7fa540108f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa52c004970 tx=0x7fa52c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:37.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.276+0000 7fa54706f700 1 -- 172.21.15.2:0/2479748923 shutdown_connections 2023-12-17T12:02:37.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.276+0000 7fa54706f700 1 --2- 172.21.15.2:0/2479748923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400708f0 0x7fa540108f10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.276+0000 7fa54706f700 1 --2- 172.21.15.2:0/2479748923 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa54006ffe0 0x7fa5400703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.276+0000 7fa54706f700 1 -- 172.21.15.2:0/2479748923 >> 172.21.15.2:0/2479748923 conn(0x7fa5400f8790 msgr2=0x7fa5400faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:37.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.277+0000 7fa54706f700 1 -- 172.21.15.2:0/2479748923 shutdown_connections 2023-12-17T12:02:37.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.277+0000 7fa54706f700 1 -- 172.21.15.2:0/2479748923 wait complete. 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.277+0000 7fa54706f700 1 Processor -- start 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa54706f700 1 -- start start 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa54706f700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 0x7fa540115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa54706f700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5400708f0 0x7fa540115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa54706f700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401163a0 con 0x7fa54006ffe0 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa54706f700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54010f6d0 con 0x7fa5400708f0 2023-12-17T12:02:37.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa544e0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 0x7fa540115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa544e0b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 0x7fa540115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57536/0 (socket says 172.21.15.2:57536) 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.278+0000 7fa544e0b700 1 -- 172.21.15.2:0/1271571915 learned_addr learned my addr 172.21.15.2:0/1271571915 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa53ffff700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5400708f0 0x7fa540115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa544e0b700 1 -- 172.21.15.2:0/1271571915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5400708f0 msgr2=0x7fa540115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa544e0b700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5400708f0 0x7fa540115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa544e0b700 1 -- 172.21.15.2:0/1271571915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c005040 con 0x7fa54006ffe0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa544e0b700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 0x7fa540115810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c8c0 tx=0x7fa5340044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53400a760 con 0x7fa54006ffe0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54010f9b0 con 0x7fa54006ffe0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa53400ad70 con 0x7fa54006ffe0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.279+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5340113a0 con 0x7fa54006ffe0 2023-12-17T12:02:37.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.280+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54010fec0 con 0x7fa54006ffe0 2023-12-17T12:02:37.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.281+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5401065d0 con 0x7fa54006ffe0 2023-12-17T12:02:37.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.282+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fa534012400 con 0x7fa54006ffe0 2023-12-17T12:02:37.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.283+0000 7fa53d7fa700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa53006cf80 0x7fa53006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.283+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa53408c520 con 0x7fa54006ffe0 2023-12-17T12:02:37.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.283+0000 7fa53ffff700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa53006cf80 0x7fa53006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.284+0000 7fa53ffff700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa53006cf80 0x7fa53006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa52c004940 tx=0x7fa52c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:37.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.288+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa534059d60 con 0x7fa54006ffe0 2023-12-17T12:02:37.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.524+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa54004bb80 con 0x7fa53006cf80 2023-12-17T12:02:37.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.525+0000 7fa53d7fa700 1 -- 172.21.15.2:0/1271571915 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa54004bb80 con 0x7fa53006cf80 2023-12-17T12:02:37.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa53006cf80 msgr2=0x7fa53006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa53006cf80 0x7fa53006f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa52c004940 tx=0x7fa52c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 msgr2=0x7fa540115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 0x7fa540115810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa53400c8c0 tx=0x7fa5340044c0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 shutdown_connections 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa53006cf80 0x7fa53006f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa54006ffe0 0x7fa540115810 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 --2- 172.21.15.2:0/1271571915 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5400708f0 0x7fa540115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 >> 172.21.15.2:0/1271571915 conn(0x7fa5400f8790 msgr2=0x7fa540103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:37.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 shutdown_connections 2023-12-17T12:02:37.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.528+0000 7fa54706f700 1 -- 172.21.15.2:0/1271571915 wait complete. 2023-12-17T12:02:37.546 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 -- 172.21.15.2:0/235204246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 msgr2=0x7fbcf40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 --2- 172.21.15.2:0/235204246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf40fcc10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbce8004940 tx=0x7fbce8009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 -- 172.21.15.2:0/235204246 shutdown_connections 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 --2- 172.21.15.2:0/235204246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf40fcc10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 --2- 172.21.15.2:0/235204246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf4102c00 0x7fbcf4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 -- 172.21.15.2:0/235204246 >> 172.21.15.2:0/235204246 conn(0x7fbcf40f8790 msgr2=0x7fbcf40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 -- 172.21.15.2:0/235204246 shutdown_connections 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.669+0000 7fbcfa339700 1 -- 172.21.15.2:0/235204246 wait complete. 2023-12-17T12:02:37.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.670+0000 7fbcfa339700 1 Processor -- start 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.670+0000 7fbcfa339700 1 -- start start 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.670+0000 7fbcfa339700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf4102c00 0x7fbcf4115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.670+0000 7fbcfa339700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf4115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.670+0000 7fbcfa339700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf41163d0 con 0x7fbcf41035a0 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.670+0000 7fbcfa339700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf410f700 con 0x7fbcf4102c00 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf4115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf3fff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf4102c00 0x7fbcf4115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf4115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57564/0 (socket says 172.21.15.2:57564) 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 -- 172.21.15.2:0/1126176145 learned_addr learned my addr 172.21.15.2:0/1126176145 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 -- 172.21.15.2:0/1126176145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf4102c00 msgr2=0x7fbcf4115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf4102c00 0x7fbcf4115840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 -- 172.21.15.2:0/1126176145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8005040 con 0x7fbcf41035a0 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.671+0000 7fbcf37fe700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf4115d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009360 tx=0x7fbce8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.672+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce800e040 con 0x7fbcf41035a0 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.672+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbce8013420 con 0x7fbcf41035a0 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.672+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce801c610 con 0x7fbcf41035a0 2023-12-17T12:02:37.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.672+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf410f980 con 0x7fbcf41035a0 2023-12-17T12:02:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.672+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf410fec0 con 0x7fbcf41035a0 2023-12-17T12:02:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.673+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf40fc390 con 0x7fbcf41035a0 2023-12-17T12:02:37.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.674+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fbce8013590 con 0x7fbcf41035a0 2023-12-17T12:02:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.676+0000 7fbcf0ff9700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbcdc06cf80 0x7fbcdc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.676+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbce808d750 con 0x7fbcf41035a0 2023-12-17T12:02:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.676+0000 7fbcf3fff700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbcdc06cf80 0x7fbcdc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.677+0000 7fbcf3fff700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbcdc06cf80 0x7fbcdc06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbce4007fd0 tx=0x7fbce4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:37.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.680+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbce805ae80 con 0x7fbcf41035a0 2023-12-17T12:02:37.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.913+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcf404bb80 con 0x7fbcdc06cf80 2023-12-17T12:02:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.914+0000 7fbcf0ff9700 1 -- 172.21.15.2:0/1126176145 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbcf404bb80 con 0x7fbcdc06cf80 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.916+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbcdc06cf80 msgr2=0x7fbcdc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.916+0000 7fbcfa339700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbcdc06cf80 0x7fbcdc06f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbce4007fd0 tx=0x7fbce4009040 comp rx=0 tx=0).stop 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.916+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 msgr2=0x7fbcf4115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.916+0000 7fbcfa339700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf4115d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009360 tx=0x7fbce8009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 shutdown_connections 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbcdc06cf80 0x7fbcdc06f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf4102c00 0x7fbcf4115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 --2- 172.21.15.2:0/1126176145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbcf41035a0 0x7fbcf4115d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 >> 172.21.15.2:0/1126176145 conn(0x7fbcf40f8790 msgr2=0x7fbcf40fa190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 shutdown_connections 2023-12-17T12:02:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:37.917+0000 7fbcfa339700 1 -- 172.21.15.2:0/1126176145 wait complete. 2023-12-17T12:02:37.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:37 smithi002 ceph-mon[211741]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/381 objects degraded (3.150%), 3 pgs degraded) 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 -- 172.21.15.2:0/544956698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 msgr2=0x7f7fe0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 --2- 172.21.15.2:0/544956698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0102fd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0004940 tx=0x7f7fd0009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 -- 172.21.15.2:0/544956698 shutdown_connections 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 --2- 172.21.15.2:0/544956698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 0x7f7fe00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 --2- 172.21.15.2:0/544956698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0102fd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 -- 172.21.15.2:0/544956698 >> 172.21.15.2:0/544956698 conn(0x7f7fe00f8790 msgr2=0x7f7fe00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 -- 172.21.15.2:0/544956698 shutdown_connections 2023-12-17T12:02:38.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.056+0000 7f7fe610b700 1 -- 172.21.15.2:0/544956698 wait complete. 2023-12-17T12:02:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.057+0000 7f7fe610b700 1 Processor -- start 2023-12-17T12:02:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.057+0000 7f7fe610b700 1 -- start start 2023-12-17T12:02:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fe610b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fe610b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 0x7f7fe0115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fe610b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01163d0 con 0x7f7fe0102c00 2023-12-17T12:02:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fe610b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe010f700 con 0x7f7fe01035a0 2023-12-17T12:02:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdf7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57594/0 (socket says 172.21.15.2:57594) 2023-12-17T12:02:38.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdf7fe700 1 -- 172.21.15.2:0/1184900374 learned_addr learned my addr 172.21.15.2:0/1184900374 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdeffd700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 0x7f7fe0115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdf7fe700 1 -- 172.21.15.2:0/1184900374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 msgr2=0x7f7fe0115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdf7fe700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 0x7f7fe0115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.058+0000 7f7fdf7fe700 1 -- 172.21.15.2:0/1184900374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0005040 con 0x7f7fe0102c00 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fdeffd700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 0x7f7fe0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fdf7fe700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0115840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009360 tx=0x7f7fd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd000e040 con 0x7f7fe0102c00 2023-12-17T12:02:38.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7fd000bc50 con 0x7f7fe0102c00 2023-12-17T12:02:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe010f980 con 0x7f7fe0102c00 2023-12-17T12:02:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd001c630 con 0x7f7fe0102c00 2023-12-17T12:02:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.059+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe010fec0 con 0x7f7fe0102c00 2023-12-17T12:02:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.060+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe00fc390 con 0x7f7fe0102c00 2023-12-17T12:02:38.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.061+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f7fd0013420 con 0x7f7fe0102c00 2023-12-17T12:02:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.062+0000 7f7fc7fff700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7fc806cf80 0x7f7fc806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.062+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7fd008d800 con 0x7f7fe0102c00 2023-12-17T12:02:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.062+0000 7f7fdeffd700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7fc806cf80 0x7f7fc806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.063+0000 7f7fdeffd700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7fc806cf80 0x7f7fc806f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4007fd0 tx=0x7f7fd4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:38.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.067+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7fd005afb0 con 0x7f7fe0102c00 2023-12-17T12:02:38.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:37 smithi119 ceph-mon[177559]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/381 objects degraded (3.150%), 3 pgs degraded) 2023-12-17T12:02:38.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.291+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fe0110e90 con 0x7f7fc806cf80 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.302+0000 7f7fc7fff700 1 -- 172.21.15.2:0/1184900374 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7fe0110e90 con 0x7f7fc806cf80 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (2m) 9s ago 12m 15.7M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (37s) 9s ago 12m 7864k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (33s) 30s ago 11m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (2m) 9s ago 11m 78.7M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (7m) 9s ago 7m 6651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:02:38.305 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (7m) 9s ago 7m 15.6M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (7m) 30s ago 7m 5123M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (7m) 30s ago 7m 15.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (4m) 9s ago 13m 512M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (3m) 30s ago 11m 451M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (95s) 9s ago 13m 55.4M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (69s) 30s ago 11m 41.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (3m) 9s ago 12m 8354k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (3m) 30s ago 11m 8456k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (14s) 9s ago 10m 12.6M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (10m) 9s ago 10m 875M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 9d3f26ad6544 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (9m) 9s ago 9m 641M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (9m) 30s ago 9m 980M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (9m) 30s ago 9m 744M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (8m) 30s ago 8m 861M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:02:38.306 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 9s ago 11m 57.5M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:02:38.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7fc806cf80 msgr2=0x7f7fc806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7fc806cf80 0x7f7fc806f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4007fd0 tx=0x7f7fd4009040 comp rx=0 tx=0).stop 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 msgr2=0x7f7fe0115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0115840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009360 tx=0x7f7fd0009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 shutdown_connections 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7fc806cf80 0x7f7fc806f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fe0102c00 0x7f7fe0115840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 --2- 172.21.15.2:0/1184900374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe01035a0 0x7f7fe0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.304+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 >> 172.21.15.2:0/1184900374 conn(0x7f7fe00f8790 msgr2=0x7f7fe00fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.305+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 shutdown_connections 2023-12-17T12:02:38.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.305+0000 7f7fe610b700 1 -- 172.21.15.2:0/1184900374 wait complete. 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.442+0000 7fcc338a6700 1 -- 172.21.15.2:0/2735629571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c102c00 msgr2=0x7fcc2c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.442+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2735629571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c102c00 0x7fcc2c102fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcc28004940 tx=0x7fcc28009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.443+0000 7fcc338a6700 1 -- 172.21.15.2:0/2735629571 shutdown_connections 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.443+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2735629571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.443+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2735629571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c102c00 0x7fcc2c102fd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.443+0000 7fcc338a6700 1 -- 172.21.15.2:0/2735629571 >> 172.21.15.2:0/2735629571 conn(0x7fcc2c0f8790 msgr2=0x7fcc2c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:38.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.443+0000 7fcc338a6700 1 -- 172.21.15.2:0/2735629571 shutdown_connections 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.443+0000 7fcc338a6700 1 -- 172.21.15.2:0/2735629571 wait complete. 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.444+0000 7fcc338a6700 1 Processor -- start 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.444+0000 7fcc338a6700 1 -- start start 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.444+0000 7fcc338a6700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c102c00 0x7fcc2c115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.444+0000 7fcc338a6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.444+0000 7fcc338a6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c1163e0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.444+0000 7fcc338a6700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c10f710 con 0x7fcc2c102c00 2023-12-17T12:02:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57612/0 (socket says 172.21.15.2:57612) 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 -- 172.21.15.2:0/2913862474 learned_addr learned my addr 172.21.15.2:0/2913862474 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc31642700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c102c00 0x7fcc2c115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 -- 172.21.15.2:0/2913862474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c102c00 msgr2=0x7fcc2c115850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c102c00 0x7fcc2c115850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 -- 172.21.15.2:0/2913862474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28005040 con 0x7fcc2c1035a0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc30e41700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c115d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c890 tx=0x7fcc1c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1c00a7d0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc1c00ade0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c10f9f0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.445+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc1c0113a0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.446+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c10ff30 con 0x7fcc2c1035a0 2023-12-17T12:02:38.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.447+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c0fc390 con 0x7fcc2c1035a0 2023-12-17T12:02:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.448+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fcc1c012400 con 0x7fcc2c1035a0 2023-12-17T12:02:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.448+0000 7fcc21ffb700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fcc1806cf80 0x7fcc1806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.449+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcc1c08c4f0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.449+0000 7fcc31642700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fcc1806cf80 0x7fcc1806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.449+0000 7fcc31642700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fcc1806cf80 0x7fcc1806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3b0 tx=0x7fcc28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:38.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.453+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcc1c059db0 con 0x7fcc2c1035a0 2023-12-17T12:02:38.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.749+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcc2c04bb80 con 0x7fcc2c1035a0 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.750+0000 7fcc21ffb700 1 -- 172.21.15.2:0/2913862474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7fcc1c059940 con 0x7fcc2c1035a0 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5, 2023-12-17T12:02:38.753 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 1 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 9, 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 5 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:02:38.754 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:02:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fcc1806cf80 msgr2=0x7fcc1806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fcc1806cf80 0x7fcc1806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800b3b0 tx=0x7fcc28009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 msgr2=0x7fcc2c115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c115d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c890 tx=0x7fcc1c0044c0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 shutdown_connections 2023-12-17T12:02:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fcc1806cf80 0x7fcc1806f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c102c00 0x7fcc2c115850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 --2- 172.21.15.2:0/2913862474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc2c1035a0 0x7fcc2c115d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 >> 172.21.15.2:0/2913862474 conn(0x7fcc2c0f8790 msgr2=0x7fcc2c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:38.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 shutdown_connections 2023-12-17T12:02:38.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.753+0000 7fcc338a6700 1 -- 172.21.15.2:0/2913862474 wait complete. 2023-12-17T12:02:38.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 -- 172.21.15.2:0/2933417844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a006ffe0 msgr2=0x7fe1a00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 --2- 172.21.15.2:0/2933417844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a006ffe0 0x7fe1a00703b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe190004970 tx=0x7fe190009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 -- 172.21.15.2:0/2933417844 shutdown_connections 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 --2- 172.21.15.2:0/2933417844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a00708f0 0x7fe1a0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 --2- 172.21.15.2:0/2933417844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a006ffe0 0x7fe1a00703b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 -- 172.21.15.2:0/2933417844 >> 172.21.15.2:0/2933417844 conn(0x7fe1a00f8790 msgr2=0x7fe1a00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 -- 172.21.15.2:0/2933417844 shutdown_connections 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.891+0000 7fe1a51db700 1 -- 172.21.15.2:0/2933417844 wait complete. 2023-12-17T12:02:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.892+0000 7fe1a51db700 1 Processor -- start 2023-12-17T12:02:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.893+0000 7fe1a51db700 1 -- start start 2023-12-17T12:02:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.893+0000 7fe1a51db700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a006ffe0 0x7fe1a01157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.893+0000 7fe1a51db700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 0x7fe1a0115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.893+0000 7fe1a51db700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a0116380 con 0x7fe1a00708f0 2023-12-17T12:02:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.893+0000 7fe1a51db700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a010f6b0 con 0x7fe1a006ffe0 2023-12-17T12:02:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.893+0000 7fe19e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 0x7fe1a0115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19e59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 0x7fe1a0115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57630/0 (socket says 172.21.15.2:57630) 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19e59c700 1 -- 172.21.15.2:0/135295687 learned_addr learned my addr 172.21.15.2:0/135295687 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19ed9d700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a006ffe0 0x7fe1a01157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19e59c700 1 -- 172.21.15.2:0/135295687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a006ffe0 msgr2=0x7fe1a01157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19e59c700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a006ffe0 0x7fe1a01157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19e59c700 1 -- 172.21.15.2:0/135295687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190005040 con 0x7fe1a00708f0 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19ed9d700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a006ffe0 0x7fe1a01157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe19e59c700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 0x7fe1a0115d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe19400eb40 tx=0x7fe19400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194007cc0 con 0x7fe1a00708f0 2023-12-17T12:02:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a010f930 con 0x7fe1a00708f0 2023-12-17T12:02:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe19400f040 con 0x7fe1a00708f0 2023-12-17T12:02:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.894+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194009570 con 0x7fe1a00708f0 2023-12-17T12:02:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.895+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a010fe70 con 0x7fe1a00708f0 2023-12-17T12:02:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.896+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a01065d0 con 0x7fe1a00708f0 2023-12-17T12:02:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.897+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7fe1940096d0 con 0x7fe1a00708f0 2023-12-17T12:02:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.898+0000 7fe1877fe700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe18806cf80 0x7fe18806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.898+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe19408c210 con 0x7fe1a00708f0 2023-12-17T12:02:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.898+0000 7fe19ed9d700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe18806cf80 0x7fe18806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:38.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.899+0000 7fe19ed9d700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe18806cf80 0x7fe18806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1900043d0 tx=0x7fe190009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:38.902+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe194059a10 con 0x7fe1a00708f0 2023-12-17T12:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.165+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1a0110e40 con 0x7fe1a00708f0 2023-12-17T12:02:39.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.166+0000 7fe1877fe700 1 -- 172.21.15.2:0/135295687 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fe1a0110e40 con 0x7fe1a00708f0 2023-12-17T12:02:39.169 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2023-12-17T12:02:39.169 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T12:02:11.885042+0000 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:02:39.170 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:02:39.171 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:39.172 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.168+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe18806cf80 msgr2=0x7fe18806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.168+0000 7fe1a51db700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe18806cf80 0x7fe18806f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe1900043d0 tx=0x7fe190009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.168+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 msgr2=0x7fe1a0115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.168+0000 7fe1a51db700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 0x7fe1a0115d30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe19400eb40 tx=0x7fe19400b040 comp rx=0 tx=0).stop 2023-12-17T12:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 shutdown_connections 2023-12-17T12:02:39.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fe18806cf80 0x7fe18806f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a006ffe0 0x7fe1a01157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 --2- 172.21.15.2:0/135295687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe1a00708f0 0x7fe1a0115d30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 >> 172.21.15.2:0/135295687 conn(0x7fe1a00f8790 msgr2=0x7fe1a0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 shutdown_connections 2023-12-17T12:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.169+0000 7fe1a51db700 1 -- 172.21.15.2:0/135295687 wait complete. 2023-12-17T12:02:39.174 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 -- 172.21.15.2:0/3374424593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb30102c00 msgr2=0x7ffb30102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3374424593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb30102c00 0x7ffb30102fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c004940 tx=0x7ffb2c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 -- 172.21.15.2:0/3374424593 shutdown_connections 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3374424593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb301035a0 0x7ffb300fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3374424593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb30102c00 0x7ffb30102fd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 -- 172.21.15.2:0/3374424593 >> 172.21.15.2:0/3374424593 conn(0x7ffb300f8790 msgr2=0x7ffb300faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 -- 172.21.15.2:0/3374424593 shutdown_connections 2023-12-17T12:02:39.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.309+0000 7ffb3835d700 1 -- 172.21.15.2:0/3374424593 wait complete. 2023-12-17T12:02:39.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.310+0000 7ffb3835d700 1 Processor -- start 2023-12-17T12:02:39.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.310+0000 7ffb3835d700 1 -- start start 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb3835d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb30102c00 0x7ffb30113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb3835d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 0x7ffb30113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb3835d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb301141e0 con 0x7ffb301035a0 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb3835d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3010d4d0 con 0x7ffb30102c00 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb358f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 0x7ffb30113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb358f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 0x7ffb30113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60856/0 (socket says 172.21.15.2:60856) 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.311+0000 7ffb358f8700 1 -- 172.21.15.2:0/3328154911 learned_addr learned my addr 172.21.15.2:0/3328154911 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb360f9700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb30102c00 0x7ffb30113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb358f8700 1 -- 172.21.15.2:0/3328154911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb30102c00 msgr2=0x7ffb30113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb358f8700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb30102c00 0x7ffb30113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb358f8700 1 -- 172.21.15.2:0/3328154911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c005040 con 0x7ffb301035a0 2023-12-17T12:02:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb360f9700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb30102c00 0x7ffb30113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb358f8700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 0x7ffb30113b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb20002a50 tx=0x7ffb20004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb20007cc0 con 0x7ffb301035a0 2023-12-17T12:02:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3010d760 con 0x7ffb301035a0 2023-12-17T12:02:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb2000f040 con 0x7ffb301035a0 2023-12-17T12:02:39.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.312+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb2000d9a0 con 0x7ffb301035a0 2023-12-17T12:02:39.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.313+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3010dca0 con 0x7ffb301035a0 2023-12-17T12:02:39.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.314+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb300fff10 con 0x7ffb301035a0 2023-12-17T12:02:39.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.315+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7ffb2000dc60 con 0x7ffb301035a0 2023-12-17T12:02:39.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.317+0000 7ffb26ffd700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ffb1c06cf80 0x7ffb1c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:39.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.317+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffb2008c460 con 0x7ffb301035a0 2023-12-17T12:02:39.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.317+0000 7ffb360f9700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ffb1c06cf80 0x7ffb1c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.317+0000 7ffb360f9700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ffb1c06cf80 0x7ffb1c06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00b840 tx=0x7ffb2c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:39.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.321+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffb20059b10 con 0x7ffb301035a0 2023-12-17T12:02:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:38 smithi119 ceph-mon[177559]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:38 smithi119 ceph-mon[177559]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:38 smithi119 ceph-mon[177559]: pgmap v51: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:38 smithi119 ceph-mon[177559]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:39.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:38 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2913862474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:38 smithi002 ceph-mon[211741]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:38 smithi002 ceph-mon[211741]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:38 smithi002 ceph-mon[211741]: pgmap v51: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:38 smithi002 ceph-mon[211741]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:39.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:38 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2913862474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:02:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.554+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb3010ebf0 con 0x7ffb1c06cf80 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.555+0000 7ffb26ffd700 1 -- 172.21.15.2:0/3328154911 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffb3010ebf0 con 0x7ffb1c06cf80 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:02:39.558 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "7/21 daemons upgraded", 2023-12-17T12:02:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2023-12-17T12:02:39.559 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:02:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:02:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.557+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ffb1c06cf80 msgr2=0x7ffb1c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.557+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ffb1c06cf80 0x7ffb1c06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00b840 tx=0x7ffb2c009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.557+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 msgr2=0x7ffb30113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.557+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 0x7ffb30113b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb20002a50 tx=0x7ffb20004600 comp rx=0 tx=0).stop 2023-12-17T12:02:39.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 shutdown_connections 2023-12-17T12:02:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ffb1c06cf80 0x7ffb1c06f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb30102c00 0x7ffb30113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 --2- 172.21.15.2:0/3328154911 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb301035a0 0x7ffb30113b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 >> 172.21.15.2:0/3328154911 conn(0x7ffb300f8790 msgr2=0x7ffb300fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 shutdown_connections 2023-12-17T12:02:39.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.558+0000 7ffb3835d700 1 -- 172.21.15.2:0/3328154911 wait complete. 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 -- 172.21.15.2:0/1325081174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3460102c00 msgr2=0x7f3460102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 --2- 172.21.15.2:0/1325081174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3460102c00 0x7f3460102fd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3450004940 tx=0x7f3450009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 -- 172.21.15.2:0/1325081174 shutdown_connections 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 --2- 172.21.15.2:0/1325081174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34601035a0 0x7f34600fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 --2- 172.21.15.2:0/1325081174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3460102c00 0x7f3460102fd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 -- 172.21.15.2:0/1325081174 >> 172.21.15.2:0/1325081174 conn(0x7f34600f8790 msgr2=0x7f34600faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 -- 172.21.15.2:0/1325081174 shutdown_connections 2023-12-17T12:02:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.697+0000 7f3464988700 1 -- 172.21.15.2:0/1325081174 wait complete. 2023-12-17T12:02:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.698+0000 7f3464988700 1 Processor -- start 2023-12-17T12:02:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.698+0000 7f3464988700 1 -- start start 2023-12-17T12:02:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.698+0000 7f3464988700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3460102c00 0x7f34601135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.698+0000 7f3464988700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 0x7f3460113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.698+0000 7f3464988700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34601141c0 con 0x7f34601035a0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.698+0000 7f3464988700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346010d4b0 con 0x7f3460102c00 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 0x7f3460113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 0x7f3460113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60868/0 (socket says 172.21.15.2:60868) 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 -- 172.21.15.2:0/2369070344 learned_addr learned my addr 172.21.15.2:0/2369070344 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345e59c700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3460102c00 0x7f34601135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 -- 172.21.15.2:0/2369070344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3460102c00 msgr2=0x7f34601135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3460102c00 0x7f34601135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 -- 172.21.15.2:0/2369070344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450005040 con 0x7f34601035a0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.699+0000 7f345dd9b700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 0x7f3460113b70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f345400eb40 tx=0x7f345400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.700+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3454007cc0 con 0x7f34601035a0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.700+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346010d6e0 con 0x7f34601035a0 2023-12-17T12:02:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.700+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f345400f040 con 0x7f34601035a0 2023-12-17T12:02:39.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.700+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346010dc20 con 0x7f34601035a0 2023-12-17T12:02:39.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.700+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345400c9d0 con 0x7f34601035a0 2023-12-17T12:02:39.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.701+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34600fc390 con 0x7f34601035a0 2023-12-17T12:02:39.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.702+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 39) v1 ==== 91036+0+0 (secure 0 0 0) 0x7f345400cb30 con 0x7f34601035a0 2023-12-17T12:02:39.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.703+0000 7f344effd700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344806cf80 0x7f344806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:39.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.703+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f345408bfe0 con 0x7f34601035a0 2023-12-17T12:02:39.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.703+0000 7f345e59c700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344806cf80 0x7f344806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.704+0000 7f345e59c700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344806cf80 0x7f344806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3450009fd0 tx=0x7f3450009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:39.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:39.708+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f34540bf2f0 con 0x7f34601035a0 2023-12-17T12:02:40.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.002+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f346010ec70 con 0x7f34601035a0 2023-12-17T12:02:40.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.003+0000 7f344effd700 1 -- 172.21.15.2:0/2369070344 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f3454059740 con 0x7f34601035a0 2023-12-17T12:02:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:02:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:02:40.006 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:02:40.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344806cf80 msgr2=0x7f344806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344806cf80 0x7f344806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3450009fd0 tx=0x7f3450009e30 comp rx=0 tx=0).stop 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 msgr2=0x7f3460113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 0x7f3460113b70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f345400eb40 tx=0x7f345400b040 comp rx=0 tx=0).stop 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 shutdown_connections 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344806cf80 0x7f344806f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3460102c00 0x7f34601135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 --2- 172.21.15.2:0/2369070344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34601035a0 0x7f3460113b70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 >> 172.21.15.2:0/2369070344 conn(0x7f34600f8790 msgr2=0x7f34600fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:40.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 shutdown_connections 2023-12-17T12:02:40.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:02:40.005+0000 7f3464988700 1 -- 172.21.15.2:0/2369070344 wait complete. 2023-12-17T12:02:40.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:39 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/135295687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:02:40.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:39 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/135295687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:02:41.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:41 smithi119 ceph-mon[177559]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:41.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:41 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2369070344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:02:41.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:41 smithi119 ceph-mon[177559]: pgmap v52: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:41.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:41 smithi002 ceph-mon[211741]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:41.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:41 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2369070344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:02:41.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:41 smithi002 ceph-mon[211741]: pgmap v52: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:43 smithi119 ceph-mon[177559]: pgmap v53: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:43.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:43.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:43 smithi002 ceph-mon[211741]: pgmap v53: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:45 smithi119 ceph-mon[177559]: pgmap v54: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:45 smithi119 ceph-mon[177559]: mgrmap e40: smithi002.cqnuqs(active, since 92s), standbys: smithi119.nzblpy 2023-12-17T12:02:45.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:45 smithi002 ceph-mon[211741]: pgmap v54: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:45 smithi002 ceph-mon[211741]: mgrmap e40: smithi002.cqnuqs(active, since 92s), standbys: smithi119.nzblpy 2023-12-17T12:02:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:47 smithi119 ceph-mon[177559]: pgmap v55: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:47.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:47 smithi002 ceph-mon[211741]: pgmap v55: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:49 smithi119 ceph-mon[177559]: pgmap v56: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:49 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:49 smithi002 ceph-mon[211741]: pgmap v56: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:49 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:50.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:50 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:50.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:50 smithi002 ceph-mon[211741]: Upgrade: osd.1 is safe to restart 2023-12-17T12:02:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:50 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-17T12:02:50.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:50 smithi119 ceph-mon[177559]: Upgrade: osd.1 is safe to restart 2023-12-17T12:02:51.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:51 smithi002 ceph-mon[211741]: pgmap v57: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:51.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:51.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T12:02:51.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:51 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:51 smithi119 ceph-mon[177559]: pgmap v57: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T12:02:51.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:51 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:52.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:52 smithi002 ceph-mon[211741]: Upgrade: Updating osd.1 2023-12-17T12:02:52.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:52 smithi002 ceph-mon[211741]: Deploying daemon osd.1 on smithi002 2023-12-17T12:02:52.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:52 smithi119 ceph-mon[177559]: Upgrade: Updating osd.1 2023-12-17T12:02:52.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:52 smithi119 ceph-mon[177559]: Deploying daemon osd.1 on smithi002 2023-12-17T12:02:53.346 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:53 smithi002 ceph-mon[211741]: pgmap v58: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:53.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:53 smithi119 ceph-mon[177559]: pgmap v58: 65 pgs: 65 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-17T12:02:53.725 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:53 smithi002 systemd[1]: Stopping Ceph osd.1 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:53.726 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[140981]: 2023-12-17T12:02:53.604+0000 7fbb3cbf0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:02:53.726 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[140981]: 2023-12-17T12:02:53.604+0000 7fbb3cbf0700 -1 osd.1 57 *** Got signal Terminated *** 2023-12-17T12:02:53.726 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:53 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[140981]: 2023-12-17T12:02:53.604+0000 7fbb3cbf0700 -1 osd.1 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:02:54.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:54 smithi119 ceph-mon[177559]: osd.1 marked itself down and dead 2023-12-17T12:02:54.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:54 smithi002 ceph-mon[211741]: osd.1 marked itself down and dead 2023-12-17T12:02:54.975 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:54 smithi002 bash[232453]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: osdmap e58: 6 total, 5 up, 6 in 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:55 smithi119 ceph-mon[177559]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:55.456 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:02:55.456 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: osdmap e58: 6 total, 5 up, 6 in 2023-12-17T12:02:55.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: failed to encode map e58 with expected crc 2023-12-17T12:02:55.457 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:55 smithi002 ceph-mon[211741]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:56 smithi002 ceph-mon[211741]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:56 smithi002 ceph-mon[211741]: osdmap e59: 6 total, 5 up, 6 in 2023-12-17T12:02:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:56 smithi002 ceph-mon[211741]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:56 smithi002 ceph-mon[211741]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:56 smithi002 ceph-mon[211741]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:56 smithi002 ceph-mon[211741]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:56 smithi119 ceph-mon[177559]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:56 smithi119 ceph-mon[177559]: osdmap e59: 6 total, 5 up, 6 in 2023-12-17T12:02:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:56 smithi119 ceph-mon[177559]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:56 smithi119 ceph-mon[177559]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:56 smithi119 ceph-mon[177559]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:56 smithi119 ceph-mon[177559]: failed to encode map e59 with expected crc 2023-12-17T12:02:56.616 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:56 smithi002 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.1.service: Succeeded. 2023-12-17T12:02:56.616 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:56 smithi002 systemd[1]: Stopped Ceph osd.1 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:56.976 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:56 smithi002 systemd[1]: Starting Ceph osd.1 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:57.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:57 smithi119 ceph-mon[177559]: pgmap v62: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:57.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:57 smithi002 ceph-mon[211741]: pgmap v62: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-17T12:02:58.036 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:57 smithi002 bash[232723]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-17T12:02:58.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:58 smithi119 ceph-mon[177559]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-17T12:02:58.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:58.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:58 smithi002 ceph-mon[211741]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:02:58.975 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:58 smithi002 bash[232999]: a68897527efb9367ed531898239f80ce237d72bc06e9fd2d9ae86293346aafa9 2023-12-17T12:02:58.976 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:58 smithi002 systemd[1]: Started Ceph osd.1 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:58.976 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:58 smithi002 ceph-osd[233036]: -- 172.21.15.2:0/2086428916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560ae82796c0 con 0x560ae8249000 2023-12-17T12:02:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:59 smithi119 ceph-mon[177559]: pgmap v63: 65 pgs: 14 active+undersized+degraded, 5 peering, 15 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/381 objects degraded (13.123%) 2023-12-17T12:02:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:59 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:59 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:59.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:02:59 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:59.475 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:02:59 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:02:59.150+0000 7f4ffd494640 -1 Falling back to public interface 2023-12-17T12:02:59.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:59 smithi002 ceph-mon[211741]: pgmap v63: 65 pgs: 14 active+undersized+degraded, 5 peering, 15 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/381 objects degraded (13.123%) 2023-12-17T12:02:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:59 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:59 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:02:59.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:02:59 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.370 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:00 smithi002 ceph-mon[211741]: Health check failed: Degraded data redundancy: 50/381 objects degraded (13.123%), 14 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:00.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:00 smithi119 ceph-mon[177559]: Health check failed: Degraded data redundancy: 50/381 objects degraded (13.123%), 14 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:01.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:01 smithi119 ceph-mon[177559]: pgmap v64: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:01.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:01 smithi002 ceph-mon[211741]: pgmap v64: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:02.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:02 smithi119 ceph-mon[177559]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-17T12:03:02.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:02 smithi002 ceph-mon[211741]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-17T12:03:03.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:03 smithi119 ceph-mon[177559]: pgmap v65: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:03.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:03 smithi002 ceph-mon[211741]: pgmap v65: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:04.471 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:03:04 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:03:04.017+0000 7f4ffd494640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-17T12:03:04.726 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:03:04 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:03:04.690+0000 7f4ffd494640 -1 osd.1 57 log_to_monitors true 2023-12-17T12:03:04.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:04 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:04.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:04 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:04.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:04 smithi002 ceph-mon[211741]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:04.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:04 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:04.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:04 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:04.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:04 smithi119 ceph-mon[177559]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:05.864 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:03:05 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:03:05.500+0000 7f4feb8ff700 -1 osd.1 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:03:05.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:05 smithi002 ceph-mon[211741]: from='osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T12:03:05.864 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:05 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:05.865 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:05 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:05.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:05 smithi119 ceph-mon[177559]: from='osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T12:03:05.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:05 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:05.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:05 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:06.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:06 smithi002 ceph-mon[211741]: from='osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T12:03:06.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:06 smithi002 ceph-mon[211741]: osdmap e60: 6 total, 5 up, 6 in 2023-12-17T12:03:06.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:06 smithi002 ceph-mon[211741]: from='osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T12:03:06.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:06 smithi002 ceph-mon[211741]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:06 smithi119 ceph-mon[177559]: from='osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T12:03:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:06 smithi119 ceph-mon[177559]: osdmap e60: 6 total, 5 up, 6 in 2023-12-17T12:03:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:06 smithi119 ceph-mon[177559]: from='osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T12:03:06.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:06 smithi119 ceph-mon[177559]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 57/381 objects degraded (14.961%) 2023-12-17T12:03:07.870 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:07 smithi002 ceph-mon[211741]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:03:07.871 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:07 smithi002 ceph-mon[211741]: failed to encode map e60 with expected crc 2023-12-17T12:03:07.871 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:07 smithi002 ceph-mon[211741]: osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903] boot 2023-12-17T12:03:07.871 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:07 smithi002 ceph-mon[211741]: osdmap e61: 6 total, 6 up, 6 in 2023-12-17T12:03:07.871 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:07 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T12:03:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:07 smithi119 ceph-mon[177559]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:03:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:07 smithi119 ceph-mon[177559]: failed to encode map e60 with expected crc 2023-12-17T12:03:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:07 smithi119 ceph-mon[177559]: osd.1 [v2:172.21.15.2:6810/1573545903,v1:172.21.15.2:6811/1573545903] boot 2023-12-17T12:03:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:07 smithi119 ceph-mon[177559]: osdmap e61: 6 total, 6 up, 6 in 2023-12-17T12:03:07.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:07 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T12:03:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: osdmap e62: 6 total, 6 up, 6 in 2023-12-17T12:03:08.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 57/381 objects degraded (14.961%), 16 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: pgmap v71: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 24/381 objects degraded (6.299%) 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:08.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:08 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:08.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: osdmap e62: 6 total, 6 up, 6 in 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: failed to encode map e62 with expected crc 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 57/381 objects degraded (14.961%), 16 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: pgmap v71: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 24/381 objects degraded (6.299%) 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:08.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:08 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:09.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:09.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:09.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:09.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:09.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:09.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:09.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:09 smithi119 ceph-mon[177559]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:09.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:09 smithi002 ceph-mon[211741]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 -- 172.21.15.2:0/1955913192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77901035a0 msgr2=0x7f77900fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 --2- 172.21.15.2:0/1955913192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77901035a0 0x7f77900fcc10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7784004940 tx=0x7f7784009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 -- 172.21.15.2:0/1955913192 shutdown_connections 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 --2- 172.21.15.2:0/1955913192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77901035a0 0x7f77900fcc10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 --2- 172.21.15.2:0/1955913192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7790102c00 0x7f7790102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 -- 172.21.15.2:0/1955913192 >> 172.21.15.2:0/1955913192 conn(0x7f77900f8790 msgr2=0x7f77900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 -- 172.21.15.2:0/1955913192 shutdown_connections 2023-12-17T12:03:10.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.163+0000 7f779689d700 1 -- 172.21.15.2:0/1955913192 wait complete. 2023-12-17T12:03:10.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.164+0000 7f779689d700 1 Processor -- start 2023-12-17T12:03:10.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.164+0000 7f779689d700 1 -- start start 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f779689d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 0x7f77901135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f779689d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77901035a0 0x7f7790113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f779689d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7790114160 con 0x7f7790102c00 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f779689d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779010d490 con 0x7f77901035a0 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 0x7f77901135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778ffff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 0x7f77901135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41906/0 (socket says 172.21.15.2:41906) 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778ffff700 1 -- 172.21.15.2:0/2838019917 learned_addr learned my addr 172.21.15.2:0/2838019917 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778f7fe700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77901035a0 0x7f7790113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778ffff700 1 -- 172.21.15.2:0/2838019917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77901035a0 msgr2=0x7f7790113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778ffff700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77901035a0 0x7f7790113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.165+0000 7f778ffff700 1 -- 172.21.15.2:0/2838019917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784005040 con 0x7f7790102c00 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.166+0000 7f778ffff700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 0x7f77901135d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f778000eb40 tx=0x7f778000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.166+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7780007cc0 con 0x7f7790102c00 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.166+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f778000f040 con 0x7f7790102c00 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.166+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779010d710 con 0x7f7790102c00 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.166+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f778000c990 con 0x7f7790102c00 2023-12-17T12:03:10.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.166+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779010dc20 con 0x7f7790102c00 2023-12-17T12:03:10.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.167+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77900fc390 con 0x7f7790102c00 2023-12-17T12:03:10.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.168+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f778000cc00 con 0x7f7790102c00 2023-12-17T12:03:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.170+0000 7f778cff9700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f777806ce60 0x7f777806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.170+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f778008bed0 con 0x7f7790102c00 2023-12-17T12:03:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.171+0000 7f778f7fe700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f777806ce60 0x7f777806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.171+0000 7f778f7fe700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f777806ce60 0x7f777806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7784000c00 tx=0x7f7784009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:10.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.175+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f77800598f0 con 0x7f7790102c00 2023-12-17T12:03:10.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.411+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f779010ecc0 con 0x7f777806ce60 2023-12-17T12:03:10.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.412+0000 7f778cff9700 1 -- 172.21.15.2:0/2838019917 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f779010ecc0 con 0x7f777806ce60 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f777806ce60 msgr2=0x7f777806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f777806ce60 0x7f777806f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7784000c00 tx=0x7f7784009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 msgr2=0x7f77901135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 0x7f77901135d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f778000eb40 tx=0x7f778000b040 comp rx=0 tx=0).stop 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 shutdown_connections 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f777806ce60 0x7f777806f310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7790102c00 0x7f77901135d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 --2- 172.21.15.2:0/2838019917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77901035a0 0x7f7790113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 >> 172.21.15.2:0/2838019917 conn(0x7f77900f8790 msgr2=0x7f77900fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 shutdown_connections 2023-12-17T12:03:10.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.415+0000 7f779689d700 1 -- 172.21.15.2:0/2838019917 wait complete. 2023-12-17T12:03:10.433 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:03:10.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 -- 172.21.15.2:0/1479258928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 msgr2=0x7fa42c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1479258928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c0703b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa41c004970 tx=0x7fa41c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:10.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 -- 172.21.15.2:0/1479258928 shutdown_connections 2023-12-17T12:03:10.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1479258928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 0x7fa42c108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1479258928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c0703b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 -- 172.21.15.2:0/1479258928 >> 172.21.15.2:0/1479258928 conn(0x7fa42c0f8790 msgr2=0x7fa42c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.557+0000 7fa431ca7700 1 -- 172.21.15.2:0/1479258928 shutdown_connections 2023-12-17T12:03:10.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.558+0000 7fa431ca7700 1 -- 172.21.15.2:0/1479258928 wait complete. 2023-12-17T12:03:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.558+0000 7fa431ca7700 1 Processor -- start 2023-12-17T12:03:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.558+0000 7fa431ca7700 1 -- start start 2023-12-17T12:03:10.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa431ca7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c1157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa431ca7700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 0x7fa42c115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa431ca7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c116380 con 0x7fa42c06ffe0 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa431ca7700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c10f6b0 con 0x7fa42c0708f0 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa42b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c1157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa42b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c1157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41928/0 (socket says 172.21.15.2:41928) 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa42b7fe700 1 -- 172.21.15.2:0/1910283834 learned_addr learned my addr 172.21.15.2:0/1910283834 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.559+0000 7fa42affd700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 0x7fa42c115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa42b7fe700 1 -- 172.21.15.2:0/1910283834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 msgr2=0x7fa42c115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa42b7fe700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 0x7fa42c115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa42b7fe700 1 -- 172.21.15.2:0/1910283834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c005040 con 0x7fa42c06ffe0 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa42affd700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 0x7fa42c115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:10.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa42b7fe700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c1157f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009360 tx=0x7fa41c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:10.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41c00e040 con 0x7fa42c06ffe0 2023-12-17T12:03:10.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa41c004290 con 0x7fa42c06ffe0 2023-12-17T12:03:10.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c10f930 con 0x7fa42c06ffe0 2023-12-17T12:03:10.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41c013ea0 con 0x7fa42c06ffe0 2023-12-17T12:03:10.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.560+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c10fe70 con 0x7fa42c06ffe0 2023-12-17T12:03:10.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.561+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c1065d0 con 0x7fa42c06ffe0 2023-12-17T12:03:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.562+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fa41c00bc10 con 0x7fa42c06ffe0 2023-12-17T12:03:10.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.563+0000 7fa413fff700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa41406ce70 0x7fa41406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.563+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa41c08d6c0 con 0x7fa42c06ffe0 2023-12-17T12:03:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.563+0000 7fa42affd700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa41406ce70 0x7fa41406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.564+0000 7fa42affd700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa41406ce70 0x7fa41406f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa420009fd0 tx=0x7fa42000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:10.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.568+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa41c05b0b0 con 0x7fa42c06ffe0 2023-12-17T12:03:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.801+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa42c04bb80 con 0x7fa41406ce70 2023-12-17T12:03:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.802+0000 7fa413fff700 1 -- 172.21.15.2:0/1910283834 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa42c04bb80 con 0x7fa41406ce70 2023-12-17T12:03:10.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa41406ce70 msgr2=0x7fa41406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa41406ce70 0x7fa41406f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa420009fd0 tx=0x7fa42000b040 comp rx=0 tx=0).stop 2023-12-17T12:03:10.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 msgr2=0x7fa42c1157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c1157f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009360 tx=0x7fa41c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:10.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 shutdown_connections 2023-12-17T12:03:10.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa41406ce70 0x7fa41406f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa42c06ffe0 0x7fa42c1157f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 --2- 172.21.15.2:0/1910283834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa42c0708f0 0x7fa42c115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.804+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 >> 172.21.15.2:0/1910283834 conn(0x7fa42c0f8790 msgr2=0x7fa42c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:10.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.805+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 shutdown_connections 2023-12-17T12:03:10.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.805+0000 7fa431ca7700 1 -- 172.21.15.2:0/1910283834 wait complete. 2023-12-17T12:03:10.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:10 smithi119 ceph-mon[177559]: pgmap v72: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 24/381 objects degraded (6.299%) 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 -- 172.21.15.2:0/1561770602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe840708f0 msgr2=0x7fbe84108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 --2- 172.21.15.2:0/1561770602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe840708f0 0x7fbe84108f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe78004970 tx=0x7fbe78009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 -- 172.21.15.2:0/1561770602 shutdown_connections 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 --2- 172.21.15.2:0/1561770602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe840708f0 0x7fbe84108f10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 --2- 172.21.15.2:0/1561770602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe8406ffe0 0x7fbe840703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 -- 172.21.15.2:0/1561770602 >> 172.21.15.2:0/1561770602 conn(0x7fbe840f8790 msgr2=0x7fbe840faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 -- 172.21.15.2:0/1561770602 shutdown_connections 2023-12-17T12:03:10.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.944+0000 7fbe8a261700 1 -- 172.21.15.2:0/1561770602 wait complete. 2023-12-17T12:03:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.945+0000 7fbe8a261700 1 Processor -- start 2023-12-17T12:03:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.945+0000 7fbe8a261700 1 -- start start 2023-12-17T12:03:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe8a261700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 0x7fbe84115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe8a261700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe840708f0 0x7fbe84115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe8a261700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841163a0 con 0x7fbe8406ffe0 2023-12-17T12:03:10.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe8a261700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8410f6d0 con 0x7fbe840708f0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe837fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 0x7fbe84115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe837fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 0x7fbe84115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41950/0 (socket says 172.21.15.2:41950) 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe837fe700 1 -- 172.21.15.2:0/2926779236 learned_addr learned my addr 172.21.15.2:0/2926779236 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe82ffd700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe840708f0 0x7fbe84115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe837fe700 1 -- 172.21.15.2:0/2926779236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe840708f0 msgr2=0x7fbe84115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe837fe700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe840708f0 0x7fbe84115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.946+0000 7fbe837fe700 1 -- 172.21.15.2:0/2926779236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78005040 con 0x7fbe8406ffe0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.947+0000 7fbe837fe700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 0x7fbe84115810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400eb40 tx=0x7fbe7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.947+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe74007cc0 con 0x7fbe8406ffe0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.947+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe7400f040 con 0x7fbe8406ffe0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.947+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe74009570 con 0x7fbe8406ffe0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.947+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8410f950 con 0x7fbe8406ffe0 2023-12-17T12:03:10.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.947+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8410fe90 con 0x7fbe8406ffe0 2023-12-17T12:03:10.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.948+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe841065d0 con 0x7fbe8406ffe0 2023-12-17T12:03:10.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.949+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fbe740096d0 con 0x7fbe8406ffe0 2023-12-17T12:03:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.950+0000 7fbe6bfff700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbe6c06ce70 0x7fbe6c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.950+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbe7408bf90 con 0x7fbe8406ffe0 2023-12-17T12:03:10.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.950+0000 7fbe82ffd700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbe6c06ce70 0x7fbe6c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:10.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.951+0000 7fbe82ffd700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbe6c06ce70 0x7fbe6c06f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b370 tx=0x7fbe78009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:10.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:10.954+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbe740599b0 con 0x7fbe8406ffe0 2023-12-17T12:03:10.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:10 smithi002 ceph-mon[211741]: pgmap v72: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 24/381 objects degraded (6.299%) 2023-12-17T12:03:11.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.179+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe8404bbf0 con 0x7fbe6c06ce70 2023-12-17T12:03:11.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.189+0000 7fbe6bfff700 1 -- 172.21.15.2:0/2926779236 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fbe8404bbf0 con 0x7fbe6c06ce70 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 7s ago 12m 15.7M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (70s) 7s ago 13m 7864k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (66s) 63s ago 11m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 7s ago 12m 78.0M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (8m) 7s ago 8m 6651M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (8m) 7s ago 8m 15.7M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (8m) 63s ago 8m 5123M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (8m) 63s ago 8m 15.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:03:11.192 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (5m) 7s ago 14m 514M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (4m) 63s ago 11m 451M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (2m) 7s ago 14m 60.8M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (102s) 63s ago 11m 41.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 7s ago 13m 8548k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (3m) 63s ago 11m 8456k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (47s) 7s ago 11m 113M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (12s) 7s ago 10m 12.6M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a68897527efb 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (10m) 7s ago 10m 647M 1620M 17.2.7-125-g1f2f5510 60cc83a9c8f1 5a854b400f17 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (10m) 63s ago 10m 980M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:03:11.193 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (9m) 63s ago 9m 744M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:03:11.194 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (9m) 63s ago 9m 861M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:03:11.194 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (3m) 7s ago 12m 58.2M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:03:11.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbe6c06ce70 msgr2=0x7fbe6c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbe6c06ce70 0x7fbe6c06f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b370 tx=0x7fbe78009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 msgr2=0x7fbe84115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 0x7fbe84115810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400eb40 tx=0x7fbe7400b040 comp rx=0 tx=0).stop 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 shutdown_connections 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbe6c06ce70 0x7fbe6c06f320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe8406ffe0 0x7fbe84115810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 --2- 172.21.15.2:0/2926779236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe840708f0 0x7fbe84115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 >> 172.21.15.2:0/2926779236 conn(0x7fbe840f8790 msgr2=0x7fbe84103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 shutdown_connections 2023-12-17T12:03:11.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.192+0000 7fbe8a261700 1 -- 172.21.15.2:0/2926779236 wait complete. 2023-12-17T12:03:11.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 -- 172.21.15.2:0/4189924116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 msgr2=0x7fd3c0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 --2- 172.21.15.2:0/4189924116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0102fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc004940 tx=0x7fd3bc009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 -- 172.21.15.2:0/4189924116 shutdown_connections 2023-12-17T12:03:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 --2- 172.21.15.2:0/4189924116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3c01035a0 0x7fd3c00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 --2- 172.21.15.2:0/4189924116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0102fd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 -- 172.21.15.2:0/4189924116 >> 172.21.15.2:0/4189924116 conn(0x7fd3c00f8790 msgr2=0x7fd3c00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 -- 172.21.15.2:0/4189924116 shutdown_connections 2023-12-17T12:03:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.330+0000 7fd3c8414700 1 -- 172.21.15.2:0/4189924116 wait complete. 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.331+0000 7fd3c8414700 1 Processor -- start 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.331+0000 7fd3c8414700 1 -- start start 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c8414700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c8414700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3c01035a0 0x7fd3c0115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c8414700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c01163d0 con 0x7fd3c0102c00 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c8414700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c010f700 con 0x7fd3c01035a0 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41974/0 (socket says 172.21.15.2:41974) 2023-12-17T12:03:11.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 -- 172.21.15.2:0/2955160429 learned_addr learned my addr 172.21.15.2:0/2955160429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c59af700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3c01035a0 0x7fd3c0115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 -- 172.21.15.2:0/2955160429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3c01035a0 msgr2=0x7fd3c0115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3c01035a0 0x7fd3c0115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 -- 172.21.15.2:0/2955160429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc005040 con 0x7fd3c0102c00 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.332+0000 7fd3c61b0700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0115840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009360 tx=0x7fd3bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.333+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc00e040 con 0x7fd3c0102c00 2023-12-17T12:03:11.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.333+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd3bc013420 con 0x7fd3c0102c00 2023-12-17T12:03:11.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.333+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c010f980 con 0x7fd3c0102c00 2023-12-17T12:03:11.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.333+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c010fec0 con 0x7fd3c0102c00 2023-12-17T12:03:11.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.333+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3bc0255e0 con 0x7fd3c0102c00 2023-12-17T12:03:11.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.334+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c00fc390 con 0x7fd3c0102c00 2023-12-17T12:03:11.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.335+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fd3bc013590 con 0x7fd3c0102c00 2023-12-17T12:03:11.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.336+0000 7fd3b6ffd700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd3ac06ce70 0x7fd3ac06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:11.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.336+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd3bc08d560 con 0x7fd3c0102c00 2023-12-17T12:03:11.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.337+0000 7fd3c59af700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd3ac06ce70 0x7fd3ac06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:11.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.337+0000 7fd3c59af700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd3ac06ce70 0x7fd3ac06f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0111070 tx=0x7fd3b000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:11.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.341+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd3bc05aee0 con 0x7fd3c0102c00 2023-12-17T12:03:11.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.641+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3c0110e20 con 0x7fd3c0102c00 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.642+0000 7fd3b6ffd700 1 -- 172.21.15.2:0/2955160429 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7fd3bc05aa70 con 0x7fd3c0102c00 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:03:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 8, 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 6 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:03:11.645 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:03:11.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd3ac06ce70 msgr2=0x7fd3ac06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd3ac06ce70 0x7fd3ac06f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0111070 tx=0x7fd3b000b040 comp rx=0 tx=0).stop 2023-12-17T12:03:11.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 msgr2=0x7fd3c0115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0115840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009360 tx=0x7fd3bc009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:11.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 shutdown_connections 2023-12-17T12:03:11.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd3ac06ce70 0x7fd3ac06f320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3c0102c00 0x7fd3c0115840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 --2- 172.21.15.2:0/2955160429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3c01035a0 0x7fd3c0115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 >> 172.21.15.2:0/2955160429 conn(0x7fd3c00f8790 msgr2=0x7fd3c00fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:11.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 shutdown_connections 2023-12-17T12:03:11.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.645+0000 7fd3c8414700 1 -- 172.21.15.2:0/2955160429 wait complete. 2023-12-17T12:03:11.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.784+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4238372546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd681035a0 msgr2=0x7fbd680fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.784+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4238372546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd681035a0 0x7fbd680fcc10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004940 tx=0x7fbd58009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.784+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4238372546 shutdown_connections 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.784+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4238372546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd681035a0 0x7fbd680fcc10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.784+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4238372546 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd68102c00 0x7fbd68102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.784+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4238372546 >> 172.21.15.2:0/4238372546 conn(0x7fbd680f8790 msgr2=0x7fbd680faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.785+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4238372546 shutdown_connections 2023-12-17T12:03:11.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.785+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4238372546 wait complete. 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.785+0000 7fbd6fa4d700 1 Processor -- start 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6fa4d700 1 -- start start 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6fa4d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 0x7fbd68113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6fa4d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd681035a0 0x7fbd68113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6fa4d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd68114210 con 0x7fbd68102c00 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6fa4d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6810d500 con 0x7fbd681035a0 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6d7e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 0x7fbd68113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6d7e9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 0x7fbd68113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41992/0 (socket says 172.21.15.2:41992) 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.786+0000 7fbd6d7e9700 1 -- 172.21.15.2:0/4013289299 learned_addr learned my addr 172.21.15.2:0/4013289299 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd6d7e9700 1 -- 172.21.15.2:0/4013289299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd681035a0 msgr2=0x7fbd68113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd6d7e9700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd681035a0 0x7fbd68113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd6d7e9700 1 -- 172.21.15.2:0/4013289299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58005040 con 0x7fbd68102c00 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd6d7e9700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 0x7fbd68113680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd64002a50 tx=0x7fbd640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd64007cc0 con 0x7fbd68102c00 2023-12-17T12:03:11.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd6400f040 con 0x7fbd68102c00 2023-12-17T12:03:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6810d7e0 con 0x7fbd68102c00 2023-12-17T12:03:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd64009540 con 0x7fbd68102c00 2023-12-17T12:03:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.787+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6810dd20 con 0x7fbd68102c00 2023-12-17T12:03:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.788+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd68113330 con 0x7fbd68102c00 2023-12-17T12:03:11.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.789+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fbd640096a0 con 0x7fbd68102c00 2023-12-17T12:03:11.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.790+0000 7fbd5dffb700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbd5406ce70 0x7fbd5406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.791+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbd6408c080 con 0x7fbd68102c00 2023-12-17T12:03:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.791+0000 7fbd6cfe8700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbd5406ce70 0x7fbd5406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:11.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.791+0000 7fbd6cfe8700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbd5406ce70 0x7fbd5406f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004f90 tx=0x7fbd58009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:11.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:11.795+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbd640599d0 con 0x7fbd68102c00 2023-12-17T12:03:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:11 smithi119 ceph-mon[177559]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:11 smithi119 ceph-mon[177559]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:11.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:11 smithi119 ceph-mon[177559]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:11 smithi002 ceph-mon[211741]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:11 smithi002 ceph-mon[211741]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:11.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:11 smithi002 ceph-mon[211741]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:12.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.051+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd6810ec20 con 0x7fbd68102c00 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.052+0000 7fbd5dffb700 1 -- 172.21.15.2:0/4013289299 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fbd64059560 con 0x7fbd68102c00 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T12:02:11.885042+0000 2023-12-17T12:03:12.092 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:03:12.093 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:12.094 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbd5406ce70 msgr2=0x7fbd5406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbd5406ce70 0x7fbd5406f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004f90 tx=0x7fbd58009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 msgr2=0x7fbd68113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 0x7fbd68113680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbd64002a50 tx=0x7fbd640046b0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 shutdown_connections 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbd5406ce70 0x7fbd5406f320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd68102c00 0x7fbd68113680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 --2- 172.21.15.2:0/4013289299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd681035a0 0x7fbd68113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.054+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 >> 172.21.15.2:0/4013289299 conn(0x7fbd680f8790 msgr2=0x7fbd680fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.055+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 shutdown_connections 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.055+0000 7fbd6fa4d700 1 -- 172.21.15.2:0/4013289299 wait complete. 2023-12-17T12:03:12.095 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2023-12-17T12:03:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 -- 172.21.15.2:0/999923951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 msgr2=0x7f75a00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 --2- 172.21.15.2:0/999923951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a00703b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f759c004970 tx=0x7f759c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 -- 172.21.15.2:0/999923951 shutdown_connections 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 --2- 172.21.15.2:0/999923951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a00708f0 0x7f75a0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 --2- 172.21.15.2:0/999923951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a00703b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 -- 172.21.15.2:0/999923951 >> 172.21.15.2:0/999923951 conn(0x7f75a00f8790 msgr2=0x7f75a00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 -- 172.21.15.2:0/999923951 shutdown_connections 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.195+0000 7f75a7a57700 1 -- 172.21.15.2:0/999923951 wait complete. 2023-12-17T12:03:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.196+0000 7f75a7a57700 1 Processor -- start 2023-12-17T12:03:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.197+0000 7f75a7a57700 1 -- start start 2023-12-17T12:03:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.197+0000 7f75a7a57700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a01157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.197+0000 7f75a7a57700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a00708f0 0x7f75a0115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.197+0000 7f75a7a57700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0116380 con 0x7f75a006ffe0 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.197+0000 7f75a7a57700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a010f6b0 con 0x7f75a00708f0 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a01157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a01157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42008/0 (socket says 172.21.15.2:42008) 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 -- 172.21.15.2:0/784771535 learned_addr learned my addr 172.21.15.2:0/784771535 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a4ff2700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a00708f0 0x7f75a0115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 -- 172.21.15.2:0/784771535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a00708f0 msgr2=0x7f75a0115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a00708f0 0x7f75a0115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 -- 172.21.15.2:0/784771535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c005040 con 0x7f75a006ffe0 2023-12-17T12:03:12.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f75a57f3700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a01157f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f759c004f50 tx=0x7f759c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:12.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.198+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f759c00e040 con 0x7f75a006ffe0 2023-12-17T12:03:12.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.199+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f759c00bc10 con 0x7f75a006ffe0 2023-12-17T12:03:12.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.199+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a010f930 con 0x7f75a006ffe0 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.199+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f759c01c3f0 con 0x7f75a006ffe0 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.199+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a010fe70 con 0x7f75a006ffe0 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.200+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a01065d0 con 0x7f75a006ffe0 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.201+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f759c013420 con 0x7f75a006ffe0 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.202+0000 7f7595ffb700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f758c06ce70 0x7f758c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.202+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f759c08d770 con 0x7f75a006ffe0 2023-12-17T12:03:12.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.202+0000 7f75a4ff2700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f758c06ce70 0x7f758c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:12.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.203+0000 7f75a4ff2700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f758c06ce70 0x7f758c06f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7590007fd0 tx=0x7f7590009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:12.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.207+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f759c05b0e0 con 0x7f75a006ffe0 2023-12-17T12:03:12.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.440+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75a004bb80 con 0x7f758c06ce70 2023-12-17T12:03:12.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.441+0000 7f7595ffb700 1 -- 172.21.15.2:0/784771535 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f75a004bb80 con 0x7f758c06ce70 2023-12-17T12:03:12.443 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:03:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:03:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:03:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "8/21 daemons upgraded", 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:03:12.444 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.443+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f758c06ce70 msgr2=0x7f758c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.443+0000 7f75a7a57700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f758c06ce70 0x7f758c06f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7590007fd0 tx=0x7f7590009040 comp rx=0 tx=0).stop 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.443+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 msgr2=0x7f75a01157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.443+0000 7f75a7a57700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a01157f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f759c004f50 tx=0x7f759c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 shutdown_connections 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f758c06ce70 0x7f758c06f320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75a006ffe0 0x7f75a01157f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 --2- 172.21.15.2:0/784771535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a00708f0 0x7f75a0115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 >> 172.21.15.2:0/784771535 conn(0x7f75a00f8790 msgr2=0x7f75a0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 shutdown_connections 2023-12-17T12:03:12.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.444+0000 7f75a7a57700 1 -- 172.21.15.2:0/784771535 wait complete. 2023-12-17T12:03:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 -- 172.21.15.2:0/3951642206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 msgr2=0x7f0fa80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 --2- 172.21.15.2:0/3951642206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa80fcc10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c004940 tx=0x7f0f9c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 -- 172.21.15.2:0/3951642206 shutdown_connections 2023-12-17T12:03:12.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 --2- 172.21.15.2:0/3951642206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa80fcc10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 --2- 172.21.15.2:0/3951642206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8102c00 0x7f0fa8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 -- 172.21.15.2:0/3951642206 >> 172.21.15.2:0/3951642206 conn(0x7f0fa80f8790 msgr2=0x7f0fa80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 -- 172.21.15.2:0/3951642206 shutdown_connections 2023-12-17T12:03:12.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.584+0000 7f0fae166700 1 -- 172.21.15.2:0/3951642206 wait complete. 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.585+0000 7f0fae166700 1 Processor -- start 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.585+0000 7f0fae166700 1 -- start start 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.585+0000 7f0fae166700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8102c00 0x7f0fa806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.585+0000 7f0fae166700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.585+0000 7f0fae166700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8070a80 con 0x7f0fa81035a0 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.585+0000 7f0fae166700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8070bf0 con 0x7f0fa8102c00 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa8070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42014/0 (socket says 172.21.15.2:42014) 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 -- 172.21.15.2:0/374599994 learned_addr learned my addr 172.21.15.2:0/374599994 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:12.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa77fe700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8102c00 0x7f0fa806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 -- 172.21.15.2:0/374599994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8102c00 msgr2=0x7f0fa806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8102c00 0x7f0fa806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 -- 172.21.15.2:0/374599994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c005040 con 0x7f0fa81035a0 2023-12-17T12:03:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.586+0000 7f0fa6ffd700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa8070480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009fd0 tx=0x7f0f9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:12.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.587+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9c021070 con 0x7f0fa81035a0 2023-12-17T12:03:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.587+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f9c0093b0 con 0x7f0fa81035a0 2023-12-17T12:03:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.587+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa81198c0 con 0x7f0fa81035a0 2023-12-17T12:03:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.587+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9c00e070 con 0x7f0fa81035a0 2023-12-17T12:03:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.587+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa8119cc0 con 0x7f0fa81035a0 2023-12-17T12:03:12.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.588+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa81050d0 con 0x7f0fa81035a0 2023-12-17T12:03:12.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.589+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f0f9c013a50 con 0x7f0fa81035a0 2023-12-17T12:03:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.590+0000 7f0f8ffff700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f0f9006ce70 0x7f0f9006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.590+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0f9c08d3d0 con 0x7f0fa81035a0 2023-12-17T12:03:12.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.590+0000 7f0fa77fe700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f0f9006ce70 0x7f0f9006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:12.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.591+0000 7f0fa77fe700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f0f9006ce70 0x7f0f9006f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009b80 tx=0x7f0f9800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.594+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0f9c057310 con 0x7f0fa81035a0 2023-12-17T12:03:12.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.890+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0fa8071680 con 0x7f0fa81035a0 2023-12-17T12:03:12.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.890+0000 7f0f8ffff700 1 -- 172.21.15.2:0/374599994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0f9c05fe60 con 0x7f0fa81035a0 2023-12-17T12:03:12.893 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2023-12-17T12:03:12.893 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:03:12.893 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:03:12.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f0f9006ce70 msgr2=0x7f0f9006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f0f9006ce70 0x7f0f9006f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009b80 tx=0x7f0f9800b040 comp rx=0 tx=0).stop 2023-12-17T12:03:12.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 msgr2=0x7f0fa8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:12.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa8070480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009fd0 tx=0x7f0f9c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:12.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 shutdown_connections 2023-12-17T12:03:12.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f0f9006ce70 0x7f0f9006f320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fa8102c00 0x7f0fa806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 --2- 172.21.15.2:0/374599994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fa81035a0 0x7f0fa8070480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:12.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 >> 172.21.15.2:0/374599994 conn(0x7f0fa80f8790 msgr2=0x7f0fa80fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:12.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 shutdown_connections 2023-12-17T12:03:12.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:12.893+0000 7f0fae166700 1 -- 172.21.15.2:0/374599994 wait complete. 2023-12-17T12:03:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:12 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2955160429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:12 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/4013289299' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:03:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:12 smithi119 ceph-mon[177559]: pgmap v73: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:12.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:12.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:12 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2955160429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:12.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:12 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/4013289299' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:03:12.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:12 smithi002 ceph-mon[211741]: pgmap v73: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:12.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:12.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:13.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:13 smithi119 ceph-mon[177559]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:13.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:13 smithi119 ceph-mon[177559]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/381 objects degraded (6.299%), 7 pgs degraded) 2023-12-17T12:03:13.909 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:13 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/374599994' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:03:13.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:13 smithi002 ceph-mon[211741]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:13.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:13 smithi002 ceph-mon[211741]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/381 objects degraded (6.299%), 7 pgs degraded) 2023-12-17T12:03:13.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:13 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/374599994' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:03:14.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:14 smithi119 ceph-mon[177559]: pgmap v74: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:14.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:14 smithi002 ceph-mon[211741]: pgmap v74: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:17.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:17 smithi119 ceph-mon[177559]: pgmap v75: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:17.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:17 smithi002 ceph-mon[211741]: pgmap v75: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:18.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:18.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:19.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:19 smithi119 ceph-mon[177559]: pgmap v76: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:19.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:19 smithi002 ceph-mon[211741]: pgmap v76: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:21.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:21 smithi119 ceph-mon[177559]: pgmap v77: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:21.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:21 smithi002 ceph-mon[211741]: pgmap v77: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:23.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:23 smithi119 ceph-mon[177559]: pgmap v78: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:23.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:23 smithi002 ceph-mon[211741]: pgmap v78: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:24 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:24.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:24 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:25.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:25 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:25.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:25 smithi002 ceph-mon[211741]: Upgrade: osd.2 is safe to restart 2023-12-17T12:03:25.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:25 smithi002 ceph-mon[211741]: pgmap v79: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:25.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:25.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T12:03:25.573 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:25 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:25 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-17T12:03:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:25 smithi119 ceph-mon[177559]: Upgrade: osd.2 is safe to restart 2023-12-17T12:03:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:25 smithi119 ceph-mon[177559]: pgmap v79: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:25 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:25 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T12:03:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:25 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:26 smithi119 ceph-mon[177559]: Upgrade: Updating osd.2 2023-12-17T12:03:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:26 smithi119 ceph-mon[177559]: Deploying daemon osd.2 on smithi002 2023-12-17T12:03:26.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:26 smithi002 ceph-mon[211741]: Upgrade: Updating osd.2 2023-12-17T12:03:26.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:26 smithi002 ceph-mon[211741]: Deploying daemon osd.2 on smithi002 2023-12-17T12:03:27.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:27 smithi002 ceph-mon[211741]: pgmap v80: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:27.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:27 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:27.390 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:27 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:27 smithi119 ceph-mon[177559]: pgmap v80: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:27 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:27.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:27 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:27.994 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:27 smithi002 systemd[1]: Stopping Ceph osd.2 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:03:28.327 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:27 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[150361]: 2023-12-17T12:03:27.991+0000 7f8c30964700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:03:28.327 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:27 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[150361]: 2023-12-17T12:03:27.991+0000 7f8c30964700 -1 osd.2 62 *** Got signal Terminated *** 2023-12-17T12:03:28.327 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:27 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[150361]: 2023-12-17T12:03:27.991+0000 7f8c30964700 -1 osd.2 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:03:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:28 smithi119 ceph-mon[177559]: osd.2 marked itself down and dead 2023-12-17T12:03:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:28 smithi002 ceph-mon[211741]: osd.2 marked itself down and dead 2023-12-17T12:03:29.328 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:29 smithi002 bash[238974]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2 2023-12-17T12:03:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:29 smithi119 ceph-mon[177559]: pgmap v81: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:29 smithi119 ceph-mon[177559]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:03:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:29 smithi119 ceph-mon[177559]: osdmap e63: 6 total, 5 up, 6 in 2023-12-17T12:03:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:29 smithi119 ceph-mon[177559]: failed to encode map e63 with expected crc 2023-12-17T12:03:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:29 smithi119 ceph-mon[177559]: failed to encode map e63 with expected crc 2023-12-17T12:03:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:29 smithi119 ceph-mon[177559]: failed to encode map e63 with expected crc 2023-12-17T12:03:29.698 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:29 smithi002 ceph-mon[211741]: pgmap v81: 65 pgs: 65 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:29.698 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:29 smithi002 ceph-mon[211741]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:03:29.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:29 smithi002 ceph-mon[211741]: osdmap e63: 6 total, 5 up, 6 in 2023-12-17T12:03:29.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:29 smithi002 ceph-mon[211741]: failed to encode map e63 with expected crc 2023-12-17T12:03:29.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:29 smithi002 ceph-mon[211741]: failed to encode map e63 with expected crc 2023-12-17T12:03:29.699 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:29 smithi002 ceph-mon[211741]: failed to encode map e63 with expected crc 2023-12-17T12:03:30.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: osdmap e64: 6 total, 5 up, 6 in 2023-12-17T12:03:30.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:30 smithi002 ceph-mon[211741]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: osdmap e64: 6 total, 5 up, 6 in 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:30 smithi119 ceph-mon[177559]: failed to encode map e64 with expected crc 2023-12-17T12:03:30.890 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:30 smithi002 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.2.service: Succeeded. 2023-12-17T12:03:30.890 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:30 smithi002 systemd[1]: Stopped Ceph osd.2 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:03:31.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:30 smithi002 systemd[1]: Starting Ceph osd.2 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:03:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:31 smithi002 ceph-mon[211741]: pgmap v84: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 14/381 objects degraded (3.675%) 2023-12-17T12:03:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:31 smithi002 ceph-mon[211741]: Health check failed: Degraded data redundancy: 14/381 objects degraded (3.675%), 4 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:31.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:31 smithi119 ceph-mon[177559]: pgmap v84: 65 pgs: 4 active+undersized+degraded, 6 stale+active+clean, 4 active+undersized, 51 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 14/381 objects degraded (3.675%) 2023-12-17T12:03:31.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:31 smithi119 ceph-mon[177559]: Health check failed: Degraded data redundancy: 14/381 objects degraded (3.675%), 4 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:32.475 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-17T12:03:32.475 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-17T12:03:32.475 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-17T12:03:32.476 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-17T12:03:32.476 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-17T12:03:32.476 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-17T12:03:32.476 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239240]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-17T12:03:33.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 bash[239494]: 02b7236a4a7b9631ddcaff2f4580212ea1dc829576ca4f2d17f5a86494a59c04 2023-12-17T12:03:33.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 systemd[1]: Started Ceph osd.2 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:03:33.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:32 smithi002 ceph-osd[239532]: -- 172.21.15.2:0/1711197459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56304dabb6c0 con 0x56304da8b000 2023-12-17T12:03:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:33 smithi119 ceph-mon[177559]: pgmap v85: 65 pgs: 7 active+undersized+degraded, 2 stale+active+clean, 8 active+undersized, 48 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 27/381 objects degraded (7.087%) 2023-12-17T12:03:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:33 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:33 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:33.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:33 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:33.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:33 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:03:33.360+0000 7fc691608640 -1 Falling back to public interface 2023-12-17T12:03:33.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:33 smithi002 ceph-mon[211741]: pgmap v85: 65 pgs: 7 active+undersized+degraded, 2 stale+active+clean, 8 active+undersized, 48 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 27/381 objects degraded (7.087%) 2023-12-17T12:03:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:33 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:33 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:33.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:33 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:34 smithi119 ceph-mon[177559]: pgmap v86: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:34.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:34 smithi002 ceph-mon[211741]: pgmap v86: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:37.618 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:37 smithi002 ceph-mon[211741]: pgmap v87: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:37.618 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:37.618 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:37 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:37 smithi119 ceph-mon[177559]: pgmap v87: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:37.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:37.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:37 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:37.975 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:37 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:03:37.614+0000 7fc691608640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-17T12:03:38.475 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:38 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:03:38.096+0000 7fc691608640 -1 osd.2 62 log_to_monitors true 2023-12-17T12:03:38.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:38 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 46/381 objects degraded (12.073%), 13 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:38.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:38 smithi002 ceph-mon[211741]: from='osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T12:03:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:38 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 46/381 objects degraded (12.073%), 13 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:38.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:38 smithi119 ceph-mon[177559]: from='osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T12:03:39.283 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:03:39.029+0000 7fc682278700 -1 osd.2 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:03:39.608 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-mon[211741]: pgmap v88: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:39.608 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:39.609 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:39.609 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-mon[211741]: from='osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T12:03:39.609 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-mon[211741]: osdmap e65: 6 total, 5 up, 6 in 2023-12-17T12:03:39.609 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:39 smithi002 ceph-mon[211741]: from='osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T12:03:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:39 smithi119 ceph-mon[177559]: pgmap v88: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:39 smithi119 ceph-mon[177559]: from='osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T12:03:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:39 smithi119 ceph-mon[177559]: osdmap e65: 6 total, 5 up, 6 in 2023-12-17T12:03:39.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:39 smithi119 ceph-mon[177559]: from='osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: failed to encode map e65 with expected crc 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: failed to encode map e65 with expected crc 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593] boot 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: osdmap e66: 6 total, 6 up, 6 in 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T12:03:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: failed to encode map e66 with expected crc 2023-12-17T12:03:40.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:40 smithi119 ceph-mon[177559]: failed to encode map e66 with expected crc 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: failed to encode map e65 with expected crc 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: failed to encode map e65 with expected crc 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: osd.2 [v2:172.21.15.2:6818/3504198593,v1:172.21.15.2:6819/3504198593] boot 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: osdmap e66: 6 total, 6 up, 6 in 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: failed to encode map e66 with expected crc 2023-12-17T12:03:40.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:40 smithi002 ceph-mon[211741]: failed to encode map e66 with expected crc 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: failed to encode map e65 with expected crc 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: failed to encode map e66 with expected crc 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: pgmap v91: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: failed to encode map e67 with expected crc 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: osdmap e67: 6 total, 6 up, 6 in 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: failed to encode map e67 with expected crc 2023-12-17T12:03:41.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:41 smithi002 ceph-mon[211741]: failed to encode map e67 with expected crc 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: failed to encode map e65 with expected crc 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: failed to encode map e66 with expected crc 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: pgmap v91: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: failed to encode map e67 with expected crc 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: osdmap e67: 6 total, 6 up, 6 in 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: failed to encode map e67 with expected crc 2023-12-17T12:03:41.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:41 smithi119 ceph-mon[177559]: failed to encode map e67 with expected crc 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: failed to encode map e67 with expected crc 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:42.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: failed to encode map e67 with expected crc 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:42.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:43.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 -- 172.21.15.2:0/2186938977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 msgr2=0x7f6ae0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/2186938977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae0102fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0004940 tx=0x7f6ad0009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:43.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 -- 172.21.15.2:0/2186938977 shutdown_connections 2023-12-17T12:03:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/2186938977 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae01035a0 0x7f6ae00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/2186938977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae0102fd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 -- 172.21.15.2:0/2186938977 >> 172.21.15.2:0/2186938977 conn(0x7f6ae00f8790 msgr2=0x7f6ae00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 -- 172.21.15.2:0/2186938977 shutdown_connections 2023-12-17T12:03:43.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.050+0000 7f6ae4a56700 1 -- 172.21.15.2:0/2186938977 wait complete. 2023-12-17T12:03:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.051+0000 7f6ae4a56700 1 Processor -- start 2023-12-17T12:03:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.051+0000 7f6ae4a56700 1 -- start start 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.051+0000 7f6ae4a56700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae01157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.051+0000 7f6ae4a56700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae01035a0 0x7f6ae0115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.051+0000 7f6ae4a56700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0116370 con 0x7f6ae0102c00 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.051+0000 7f6ae4a56700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae010f6a0 con 0x7f6ae01035a0 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae01157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae01157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47336/0 (socket says 172.21.15.2:47336) 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 -- 172.21.15.2:0/1676987460 learned_addr learned my addr 172.21.15.2:0/1676987460 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6addd9b700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae01035a0 0x7f6ae0115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 -- 172.21.15.2:0/1676987460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae01035a0 msgr2=0x7f6ae0115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae01035a0 0x7f6ae0115d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 -- 172.21.15.2:0/1676987460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0005040 con 0x7f6ae0102c00 2023-12-17T12:03:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.052+0000 7f6ade59c700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae01157e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00040d0 tx=0x7f6ad0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.053+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ad0021070 con 0x7f6ae0102c00 2023-12-17T12:03:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.053+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ad001c400 con 0x7f6ae0102c00 2023-12-17T12:03:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.053+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ad000e070 con 0x7f6ae0102c00 2023-12-17T12:03:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.053+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae010f920 con 0x7f6ae0102c00 2023-12-17T12:03:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.053+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae010fe60 con 0x7f6ae0102c00 2023-12-17T12:03:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.054+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae00fc390 con 0x7f6ae0102c00 2023-12-17T12:03:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.055+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f6ad001c9c0 con 0x7f6ae0102c00 2023-12-17T12:03:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.056+0000 7f6aceffd700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6ac806ce70 0x7f6ac806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.056+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6ad008d500 con 0x7f6ae0102c00 2023-12-17T12:03:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.056+0000 7f6addd9b700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6ac806ce70 0x7f6ac806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.057+0000 7f6addd9b700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6ac806ce70 0x7f6ac806f320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0111010 tx=0x7f6ad400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.061+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6ad005aed0 con 0x7f6ae0102c00 2023-12-17T12:03:43.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.295+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ae0110e30 con 0x7f6ac806ce70 2023-12-17T12:03:43.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.296+0000 7f6aceffd700 1 -- 172.21.15.2:0/1676987460 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ae0110e30 con 0x7f6ac806ce70 2023-12-17T12:03:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6ac806ce70 msgr2=0x7f6ac806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6ac806ce70 0x7f6ac806f320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0111010 tx=0x7f6ad400b040 comp rx=0 tx=0).stop 2023-12-17T12:03:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 msgr2=0x7f6ae01157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae01157e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00040d0 tx=0x7f6ad0009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:43.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 shutdown_connections 2023-12-17T12:03:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6ac806ce70 0x7f6ac806f320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ae0102c00 0x7f6ae01157e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 --2- 172.21.15.2:0/1676987460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ae01035a0 0x7f6ae0115d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 >> 172.21.15.2:0/1676987460 conn(0x7f6ae00f8790 msgr2=0x7f6ae00fa060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 shutdown_connections 2023-12-17T12:03:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.299+0000 7f6ae4a56700 1 -- 172.21.15.2:0/1676987460 wait complete. 2023-12-17T12:03:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:03:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 -- 172.21.15.2:0/673653573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7400102c00 msgr2=0x7f7400102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 --2- 172.21.15.2:0/673653573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7400102c00 0x7f7400102fd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f73fc004940 tx=0x7f73fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 -- 172.21.15.2:0/673653573 shutdown_connections 2023-12-17T12:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 --2- 172.21.15.2:0/673653573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74001035a0 0x7f74000fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 --2- 172.21.15.2:0/673653573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7400102c00 0x7f7400102fd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 -- 172.21.15.2:0/673653573 >> 172.21.15.2:0/673653573 conn(0x7f74000f8790 msgr2=0x7f74000faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.441+0000 7f740832b700 1 -- 172.21.15.2:0/673653573 shutdown_connections 2023-12-17T12:03:43.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.442+0000 7f740832b700 1 -- 172.21.15.2:0/673653573 wait complete. 2023-12-17T12:03:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.442+0000 7f740832b700 1 Processor -- start 2023-12-17T12:03:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.442+0000 7f740832b700 1 -- start start 2023-12-17T12:03:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f740832b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7400102c00 0x7f7400113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f740832b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 0x7f7400113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f740832b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7400114210 con 0x7f74001035a0 2023-12-17T12:03:43.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f740832b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740010d500 con 0x7f7400102c00 2023-12-17T12:03:43.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f74058c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 0x7f7400113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f74058c6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 0x7f7400113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47340/0 (socket says 172.21.15.2:47340) 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.443+0000 7f74058c6700 1 -- 172.21.15.2:0/2736006775 learned_addr learned my addr 172.21.15.2:0/2736006775 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f74060c7700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7400102c00 0x7f7400113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f74058c6700 1 -- 172.21.15.2:0/2736006775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7400102c00 msgr2=0x7f7400113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f74058c6700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7400102c00 0x7f7400113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f74058c6700 1 -- 172.21.15.2:0/2736006775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc005040 con 0x7f74001035a0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f74058c6700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 0x7f7400113bc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73f0002a50 tx=0x7f73f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f0007cc0 con 0x7f74001035a0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73f000f040 con 0x7f74001035a0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740010d790 con 0x7f74001035a0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f00095d0 con 0x7f74001035a0 2023-12-17T12:03:43.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.444+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740010dcd0 con 0x7f74001035a0 2023-12-17T12:03:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.445+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74000fff10 con 0x7f74001035a0 2023-12-17T12:03:43.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.446+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f73f0009730 con 0x7f74001035a0 2023-12-17T12:03:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.447+0000 7f73f6ffd700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73ec06ce70 0x7f73ec06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.447+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f73f008bf60 con 0x7f74001035a0 2023-12-17T12:03:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.448+0000 7f74060c7700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73ec06ce70 0x7f73ec06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.448+0000 7f74060c7700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73ec06ce70 0x7f73ec06f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b3b0 tx=0x7f73fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.452+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f73f0059960 con 0x7f74001035a0 2023-12-17T12:03:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:43 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:43 smithi119 ceph-mon[177559]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-17T12:03:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:43 smithi119 ceph-mon[177559]: pgmap v93: 65 pgs: 3 peering, 12 active+undersized+degraded, 12 active+undersized, 38 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 43/381 objects degraded (11.286%) 2023-12-17T12:03:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:43.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:43 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 43/381 objects degraded (11.286%), 12 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:43.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.688+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f740010ec20 con 0x7f73ec06ce70 2023-12-17T12:03:43.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.689+0000 7f73f6ffd700 1 -- 172.21.15.2:0/2736006775 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f740010ec20 con 0x7f73ec06ce70 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.691+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73ec06ce70 msgr2=0x7f73ec06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.691+0000 7f740832b700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73ec06ce70 0x7f73ec06f320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00b3b0 tx=0x7f73fc009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.691+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 msgr2=0x7f7400113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.691+0000 7f740832b700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 0x7f7400113bc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73f0002a50 tx=0x7f73f00046b0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 shutdown_connections 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73ec06ce70 0x7f73ec06f320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7400102c00 0x7f7400113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 --2- 172.21.15.2:0/2736006775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74001035a0 0x7f7400113bc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 >> 172.21.15.2:0/2736006775 conn(0x7f74000f8790 msgr2=0x7f74000fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 shutdown_connections 2023-12-17T12:03:43.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.692+0000 7f740832b700 1 -- 172.21.15.2:0/2736006775 wait complete. 2023-12-17T12:03:43.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:43 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:43.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:43 smithi002 ceph-mon[211741]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-17T12:03:43.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:43 smithi002 ceph-mon[211741]: pgmap v93: 65 pgs: 3 peering, 12 active+undersized+degraded, 12 active+undersized, 38 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 43/381 objects degraded (11.286%) 2023-12-17T12:03:43.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:43.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:43 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 43/381 objects degraded (11.286%), 12 pgs degraded (PG_DEGRADED) 2023-12-17T12:03:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 -- 172.21.15.2:0/2580714871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf01035a0 msgr2=0x7f4bf00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2580714871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf01035a0 0x7f4bf00fcc10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4be4004940 tx=0x7f4be4009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 -- 172.21.15.2:0/2580714871 shutdown_connections 2023-12-17T12:03:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2580714871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf01035a0 0x7f4bf00fcc10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2580714871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf0102c00 0x7f4bf0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 -- 172.21.15.2:0/2580714871 >> 172.21.15.2:0/2580714871 conn(0x7f4bf00f8790 msgr2=0x7f4bf00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 -- 172.21.15.2:0/2580714871 shutdown_connections 2023-12-17T12:03:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.831+0000 7f4bf535a700 1 -- 172.21.15.2:0/2580714871 wait complete. 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.832+0000 7f4bf535a700 1 Processor -- start 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.832+0000 7f4bf535a700 1 -- start start 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4bf535a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 0x7f4bf0113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4bf535a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf01035a0 0x7f4bf0113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4bf535a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0114210 con 0x7f4bf0102c00 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4bf535a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf010d500 con 0x7f4bf01035a0 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4beeffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 0x7f4bf0113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4beeffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 0x7f4bf0113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47358/0 (socket says 172.21.15.2:47358) 2023-12-17T12:03:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4beeffd700 1 -- 172.21.15.2:0/2805110491 learned_addr learned my addr 172.21.15.2:0/2805110491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4bee7fc700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf01035a0 0x7f4bf0113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4beeffd700 1 -- 172.21.15.2:0/2805110491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf01035a0 msgr2=0x7f4bf0113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4beeffd700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf01035a0 0x7f4bf0113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.833+0000 7f4beeffd700 1 -- 172.21.15.2:0/2805110491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4005040 con 0x7f4bf0102c00 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.834+0000 7f4beeffd700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 0x7f4bf0113680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4be0002a50 tx=0x7f4be00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.834+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be0007cc0 con 0x7f4bf0102c00 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.834+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4be000f040 con 0x7f4bf0102c00 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.834+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf010d7e0 con 0x7f4bf0102c00 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.834+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be000d9c0 con 0x7f4bf0102c00 2023-12-17T12:03:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.834+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf010dd20 con 0x7f4bf0102c00 2023-12-17T12:03:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.835+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf0113330 con 0x7f4bf0102c00 2023-12-17T12:03:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.836+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f4be000db20 con 0x7f4bf0102c00 2023-12-17T12:03:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.837+0000 7f4bd77fe700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4bd806ce70 0x7f4bd806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.837+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4be008c0a0 con 0x7f4bf0102c00 2023-12-17T12:03:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.837+0000 7f4bee7fc700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4bd806ce70 0x7f4bd806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.838+0000 7f4bee7fc700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4bd806ce70 0x7f4bd806f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4bf010eee0 tx=0x7f4be4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:43.841+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4be0059970 con 0x7f4bf0102c00 2023-12-17T12:03:44.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.065+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bf010ec20 con 0x7f4bd806ce70 2023-12-17T12:03:44.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.075+0000 7f4bd77fe700 1 -- 172.21.15.2:0/2805110491 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4bf010ec20 con 0x7f4bd806ce70 2023-12-17T12:03:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:03:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (3m) 7s ago 13m 16.0M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:03:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (103s) 7s ago 13m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:03:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (99s) 96s ago 12m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (3m) 7s ago 13m 79.6M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (8m) 7s ago 8m 6652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (8m) 7s ago 8m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (8m) 96s ago 8m 5123M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (8m) 96s ago 8m 15.5M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (5m) 7s ago 14m 520M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (4m) 96s ago 12m 451M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (2m) 7s ago 14m 66.4M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (2m) 96s ago 12m 41.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (4m) 7s ago 13m 8288k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (4m) 96s ago 12m 8456k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (79s) 7s ago 11m 120M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (45s) 7s ago 11m 125M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a68897527efb 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (11s) 7s ago 10m 12.8M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 02b7236a4a7b 2023-12-17T12:03:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (10m) 96s ago 10m 980M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 1b0d5d00656c 2023-12-17T12:03:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (10m) 96s ago 10m 744M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:03:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (9m) 96s ago 9m 861M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:03:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 7s ago 12m 59.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.077+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4bd806ce70 msgr2=0x7f4bd806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.077+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4bd806ce70 0x7f4bd806f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4bf010eee0 tx=0x7f4be4009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.077+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 msgr2=0x7f4bf0113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.077+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 0x7f4bf0113680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4be0002a50 tx=0x7f4be00046b0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 shutdown_connections 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4bd806ce70 0x7f4bd806f320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bf0102c00 0x7f4bf0113680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 --2- 172.21.15.2:0/2805110491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bf01035a0 0x7f4bf0113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 >> 172.21.15.2:0/2805110491 conn(0x7f4bf00f8790 msgr2=0x7f4bf00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 shutdown_connections 2023-12-17T12:03:44.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.078+0000 7f4bf535a700 1 -- 172.21.15.2:0/2805110491 wait complete. 2023-12-17T12:03:44.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 -- 172.21.15.2:0/4134768534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34641035a0 msgr2=0x7f34640fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 --2- 172.21.15.2:0/4134768534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34641035a0 0x7f34640fcc10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3458004940 tx=0x7f3458009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:44.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 -- 172.21.15.2:0/4134768534 shutdown_connections 2023-12-17T12:03:44.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 --2- 172.21.15.2:0/4134768534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34641035a0 0x7f34640fcc10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 --2- 172.21.15.2:0/4134768534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3464102c00 0x7f3464102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 -- 172.21.15.2:0/4134768534 >> 172.21.15.2:0/4134768534 conn(0x7f34640f8790 msgr2=0x7f34640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 -- 172.21.15.2:0/4134768534 shutdown_connections 2023-12-17T12:03:44.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.218+0000 7f346960c700 1 -- 172.21.15.2:0/4134768534 wait complete. 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.219+0000 7f346960c700 1 Processor -- start 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.219+0000 7f346960c700 1 -- start start 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.219+0000 7f346960c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 0x7f3464115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.219+0000 7f346960c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34641035a0 0x7f3464115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.219+0000 7f346960c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34641163c0 con 0x7f3464102c00 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.219+0000 7f346960c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346410f6f0 con 0x7f34641035a0 2023-12-17T12:03:44.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 0x7f3464115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 0x7f3464115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47378/0 (socket says 172.21.15.2:47378) 2023-12-17T12:03:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 -- 172.21.15.2:0/671161462 learned_addr learned my addr 172.21.15.2:0/671161462 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f34627fc700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34641035a0 0x7f3464115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 -- 172.21.15.2:0/671161462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34641035a0 msgr2=0x7f3464115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34641035a0 0x7f3464115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 -- 172.21.15.2:0/671161462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458005040 con 0x7f3464102c00 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.220+0000 7f3462ffd700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 0x7f3464115830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3454002a50 tx=0x7f34540046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.221+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3454007cc0 con 0x7f3464102c00 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.221+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f345400f040 con 0x7f3464102c00 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.221+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346410f9d0 con 0x7f3464102c00 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.221+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345400d9c0 con 0x7f3464102c00 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.221+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346410fee0 con 0x7f3464102c00 2023-12-17T12:03:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.222+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640fc390 con 0x7f3464102c00 2023-12-17T12:03:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.223+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f345400db20 con 0x7f3464102c00 2023-12-17T12:03:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.224+0000 7f344b7fe700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344c06ce70 0x7f344c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.224+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f345408c0a0 con 0x7f3464102c00 2023-12-17T12:03:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.224+0000 7f34627fc700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344c06ce70 0x7f344c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.225+0000 7f34627fc700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344c06ce70 0x7f344c06f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3464110a20 tx=0x7f3458009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:44.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.229+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3454059970 con 0x7f3464102c00 2023-12-17T12:03:44.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.526+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3464110e10 con 0x7f3464102c00 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.527+0000 7f344b7fe700 1 -- 172.21.15.2:0/671161462 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f3454059500 con 0x7f3464102c00 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:44.529 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 3, 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 3 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 7, 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 7 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:03:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344c06ce70 msgr2=0x7f344c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344c06ce70 0x7f344c06f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3464110a20 tx=0x7f3458009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 msgr2=0x7f3464115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 0x7f3464115830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3454002a50 tx=0x7f34540046b0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 shutdown_connections 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f344c06ce70 0x7f344c06f320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3464102c00 0x7f3464115830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 --2- 172.21.15.2:0/671161462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34641035a0 0x7f3464115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.529+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 >> 172.21.15.2:0/671161462 conn(0x7f34640f8790 msgr2=0x7f34640fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.530+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 shutdown_connections 2023-12-17T12:03:44.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.530+0000 7f346960c700 1 -- 172.21.15.2:0/671161462 wait complete. 2023-12-17T12:03:44.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:44 smithi119 ceph-mon[177559]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:44.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 -- 172.21.15.2:0/4242822207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c1035a0 msgr2=0x7ff96c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 --2- 172.21.15.2:0/4242822207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c1035a0 0x7ff96c0fcc10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff95c004940 tx=0x7ff95c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 -- 172.21.15.2:0/4242822207 shutdown_connections 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 --2- 172.21.15.2:0/4242822207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c1035a0 0x7ff96c0fcc10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 --2- 172.21.15.2:0/4242822207 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c102c00 0x7ff96c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 -- 172.21.15.2:0/4242822207 >> 172.21.15.2:0/4242822207 conn(0x7ff96c0f8790 msgr2=0x7ff96c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 -- 172.21.15.2:0/4242822207 shutdown_connections 2023-12-17T12:03:44.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.669+0000 7ff973341700 1 -- 172.21.15.2:0/4242822207 wait complete. 2023-12-17T12:03:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.670+0000 7ff973341700 1 Processor -- start 2023-12-17T12:03:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.670+0000 7ff973341700 1 -- start start 2023-12-17T12:03:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff973341700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 0x7ff96c1157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff973341700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c1035a0 0x7ff96c115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff973341700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c116350 con 0x7ff96c102c00 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff973341700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c10f680 con 0x7ff96c1035a0 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9710dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 0x7ff96c1157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9710dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 0x7ff96c1157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47394/0 (socket says 172.21.15.2:47394) 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9710dd700 1 -- 172.21.15.2:0/3848838053 learned_addr learned my addr 172.21.15.2:0/3848838053 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9708dc700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c1035a0 0x7ff96c115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9710dd700 1 -- 172.21.15.2:0/3848838053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c1035a0 msgr2=0x7ff96c115d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9710dd700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c1035a0 0x7ff96c115d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.671+0000 7ff9710dd700 1 -- 172.21.15.2:0/3848838053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c005040 con 0x7ff96c102c00 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.672+0000 7ff9710dd700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 0x7ff96c1157c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff96800eb40 tx=0x7ff96800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.672+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff968007cc0 con 0x7ff96c102c00 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.672+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff96800f040 con 0x7ff96c102c00 2023-12-17T12:03:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.672+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c10f900 con 0x7ff96c102c00 2023-12-17T12:03:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.672+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff968009570 con 0x7ff96c102c00 2023-12-17T12:03:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.672+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c10fe40 con 0x7ff96c102c00 2023-12-17T12:03:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.673+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c0fc390 con 0x7ff96c102c00 2023-12-17T12:03:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.674+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7ff9680096d0 con 0x7ff96c102c00 2023-12-17T12:03:44.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.675+0000 7ff961ffb700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff95806ce70 0x7ff95806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.675+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff96808bff0 con 0x7ff96c102c00 2023-12-17T12:03:44.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.675+0000 7ff9708dc700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff95806ce70 0x7ff95806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.676+0000 7ff9708dc700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff95806ce70 0x7ff95806f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b0d0 tx=0x7ff95c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:44.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.679+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff9680599b0 con 0x7ff96c102c00 2023-12-17T12:03:44.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:44 smithi002 ceph-mon[211741]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.940+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff96c110da0 con 0x7ff96c102c00 2023-12-17T12:03:44.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.940+0000 7ff961ffb700 1 -- 172.21.15.2:0/3848838053 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1849 (secure 0 0 0) 0x7ff968059540 con 0x7ff96c102c00 2023-12-17T12:03:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T12:02:11.885042+0000 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:03:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:03:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:03:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:03:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff95806ce70 msgr2=0x7ff95806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff95806ce70 0x7ff95806f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b0d0 tx=0x7ff95c009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 msgr2=0x7ff96c1157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 0x7ff96c1157c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff96800eb40 tx=0x7ff96800b040 comp rx=0 tx=0).stop 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 shutdown_connections 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff95806ce70 0x7ff95806f320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff96c102c00 0x7ff96c1157c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 --2- 172.21.15.2:0/3848838053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c1035a0 0x7ff96c115d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 >> 172.21.15.2:0/3848838053 conn(0x7ff96c0f8790 msgr2=0x7ff96c070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 shutdown_connections 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:44.943+0000 7ff973341700 1 -- 172.21.15.2:0/3848838053 wait complete. 2023-12-17T12:03:44.948 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2023-12-17T12:03:45.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 -- 172.21.15.2:0/2998300253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c1035a0 msgr2=0x7f525c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 --2- 172.21.15.2:0/2998300253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c1035a0 0x7f525c0fcc10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5248004940 tx=0x7f5248009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:45.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 -- 172.21.15.2:0/2998300253 shutdown_connections 2023-12-17T12:03:45.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 --2- 172.21.15.2:0/2998300253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c1035a0 0x7f525c0fcc10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 --2- 172.21.15.2:0/2998300253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c102c00 0x7f525c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 -- 172.21.15.2:0/2998300253 >> 172.21.15.2:0/2998300253 conn(0x7f525c0f8790 msgr2=0x7f525c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 -- 172.21.15.2:0/2998300253 shutdown_connections 2023-12-17T12:03:45.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.082+0000 7f52630a2700 1 -- 172.21.15.2:0/2998300253 wait complete. 2023-12-17T12:03:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.083+0000 7f52630a2700 1 Processor -- start 2023-12-17T12:03:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.083+0000 7f52630a2700 1 -- start start 2023-12-17T12:03:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f52630a2700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 0x7f525c115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f52630a2700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c1035a0 0x7f525c115dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f52630a2700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c116420 con 0x7f525c102c00 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f52630a2700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c10f750 con 0x7f525c1035a0 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f5260e3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 0x7f525c115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f5260e3e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 0x7f525c115890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47418/0 (socket says 172.21.15.2:47418) 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f5260e3e700 1 -- 172.21.15.2:0/2516598956 learned_addr learned my addr 172.21.15.2:0/2516598956 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f525bfff700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c1035a0 0x7f525c115dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f5260e3e700 1 -- 172.21.15.2:0/2516598956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c1035a0 msgr2=0x7f525c115dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f5260e3e700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c1035a0 0x7f525c115dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f5260e3e700 1 -- 172.21.15.2:0/2516598956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5248005040 con 0x7f525c102c00 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.084+0000 7f525bfff700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c1035a0 0x7f525c115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:45.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.085+0000 7f5260e3e700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 0x7f525c115890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5250002a50 tx=0x7f52500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.085+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5250007cc0 con 0x7f525c102c00 2023-12-17T12:03:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.085+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f525000f040 con 0x7f525c102c00 2023-12-17T12:03:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.085+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c10fa30 con 0x7f525c102c00 2023-12-17T12:03:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.085+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5250009540 con 0x7f525c102c00 2023-12-17T12:03:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.085+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c10ff70 con 0x7f525c102c00 2023-12-17T12:03:45.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.086+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c0fc390 con 0x7f525c102c00 2023-12-17T12:03:45.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.087+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f52500096a0 con 0x7f525c102c00 2023-12-17T12:03:45.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.088+0000 7f52597fa700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f524c06ce70 0x7f524c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.088+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f525008c080 con 0x7f525c102c00 2023-12-17T12:03:45.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.088+0000 7f525bfff700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f524c06ce70 0x7f524c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.089+0000 7f525bfff700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f524c06ce70 0x7f524c06f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f525c1110c0 tx=0x7f5248009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.092+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f52500599d0 con 0x7f525c102c00 2023-12-17T12:03:45.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.331+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c110e70 con 0x7f524c06ce70 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.332+0000 7f52597fa700 1 -- 172.21.15.2:0/2516598956 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f525c110e70 con 0x7f524c06ce70 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:03:45.334 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "9/21 daemons upgraded", 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:03:45.335 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:03:45.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.334+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f524c06ce70 msgr2=0x7f524c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.334+0000 7f52630a2700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f524c06ce70 0x7f524c06f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f525c1110c0 tx=0x7f5248009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.334+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 msgr2=0x7f525c115890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.334+0000 7f52630a2700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 0x7f525c115890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5250002a50 tx=0x7f52500046b0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 shutdown_connections 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f524c06ce70 0x7f524c06f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525c102c00 0x7f525c115890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 --2- 172.21.15.2:0/2516598956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f525c1035a0 0x7f525c115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 >> 172.21.15.2:0/2516598956 conn(0x7f525c0f8790 msgr2=0x7f525c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 shutdown_connections 2023-12-17T12:03:45.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.335+0000 7f52630a2700 1 -- 172.21.15.2:0/2516598956 wait complete. 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.473+0000 7fdfbcf89700 1 -- 172.21.15.2:0/62973692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 msgr2=0x7fdfb8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.473+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/62973692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb8102fd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8004940 tx=0x7fdfa8009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.473+0000 7fdfbcf89700 1 -- 172.21.15.2:0/62973692 shutdown_connections 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.473+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/62973692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb81035a0 0x7fdfb80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.473+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/62973692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb8102fd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.473+0000 7fdfbcf89700 1 -- 172.21.15.2:0/62973692 >> 172.21.15.2:0/62973692 conn(0x7fdfb80f8790 msgr2=0x7fdfb80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.474+0000 7fdfbcf89700 1 -- 172.21.15.2:0/62973692 shutdown_connections 2023-12-17T12:03:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.474+0000 7fdfbcf89700 1 -- 172.21.15.2:0/62973692 wait complete. 2023-12-17T12:03:45.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.474+0000 7fdfbcf89700 1 Processor -- start 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfbcf89700 1 -- start start 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfbcf89700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb81157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfbcf89700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb81035a0 0x7fdfb8115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfbcf89700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8116360 con 0x7fdfb8102c00 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfbcf89700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb810f690 con 0x7fdfb81035a0 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfb659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb81157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfb659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb81157d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47424/0 (socket says 172.21.15.2:47424) 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfb659c700 1 -- 172.21.15.2:0/2791382697 learned_addr learned my addr 172.21.15.2:0/2791382697 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:03:45.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.475+0000 7fdfb5d9b700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb81035a0 0x7fdfb8115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfb659c700 1 -- 172.21.15.2:0/2791382697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb81035a0 msgr2=0x7fdfb8115d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfb659c700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb81035a0 0x7fdfb8115d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfb659c700 1 -- 172.21.15.2:0/2791382697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8005040 con 0x7fdfb8102c00 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfb659c700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb81157d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8008d80 tx=0x7fdfa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa800e030 con 0x7fdfb8102c00 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfa8004290 con 0x7fdfb8102c00 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb810f910 con 0x7fdfb8102c00 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa801cda0 con 0x7fdfb8102c00 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.476+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb810fe50 con 0x7fdfb8102c00 2023-12-17T12:03:45.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.477+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb80fc390 con 0x7fdfb8102c00 2023-12-17T12:03:45.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.478+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fdfa801c600 con 0x7fdfb8102c00 2023-12-17T12:03:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.479+0000 7fdfa6ffd700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdfa006ce70 0x7fdfa006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.479+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdfa808dab0 con 0x7fdfb8102c00 2023-12-17T12:03:45.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.480+0000 7fdfb5d9b700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdfa006ce70 0x7fdfa006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.480+0000 7fdfb5d9b700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdfa006ce70 0x7fdfa006f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8111000 tx=0x7fdfac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.484+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdfa805b540 con 0x7fdfb8102c00 2023-12-17T12:03:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:45 smithi119 ceph-mon[177559]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:45 smithi119 ceph-mon[177559]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:45 smithi119 ceph-mon[177559]: pgmap v94: 65 pgs: 3 peering, 2 active+undersized+degraded, 3 active+undersized, 57 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 8/381 objects degraded (2.100%) 2023-12-17T12:03:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:45 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/671161462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:45.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:45 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3848838053' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:03:45.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:45 smithi002 ceph-mon[211741]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:45.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:45 smithi002 ceph-mon[211741]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:45.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:45 smithi002 ceph-mon[211741]: pgmap v94: 65 pgs: 3 peering, 2 active+undersized+degraded, 3 active+undersized, 57 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 8/381 objects degraded (2.100%) 2023-12-17T12:03:45.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:45 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/671161462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:03:45.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:45 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3848838053' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:03:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.781+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdfb8110db0 con 0x7fdfb8102c00 2023-12-17T12:03:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.781+0000 7fdfa6ffd700 1 -- 172.21.15.2:0/2791382697 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+481 (secure 0 0 0) 0x7fdfa805b0d0 con 0x7fdfb8102c00 2023-12-17T12:03:45.783 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 8/381 objects degraded (2.100%), 2 pgs degraded 2023-12-17T12:03:45.783 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:03:45.783 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:03:45.783 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 8/381 objects degraded (2.100%), 2 pgs degraded 2023-12-17T12:03:45.784 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2023-12-17T12:03:45.784 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.783+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdfa006ce70 msgr2=0x7fdfa006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.783+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdfa006ce70 0x7fdfa006f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8111000 tx=0x7fdfac00b040 comp rx=0 tx=0).stop 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.783+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 msgr2=0x7fdfb81157d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.783+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb81157d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8008d80 tx=0x7fdfa8009e30 comp rx=0 tx=0).stop 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 shutdown_connections 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fdfa006ce70 0x7fdfa006f320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdfb8102c00 0x7fdfb81157d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 --2- 172.21.15.2:0/2791382697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfb81035a0 0x7fdfb8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 >> 172.21.15.2:0/2791382697 conn(0x7fdfb80f8790 msgr2=0x7fdfb80701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 shutdown_connections 2023-12-17T12:03:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:03:45.784+0000 7fdfbcf89700 1 -- 172.21.15.2:0/2791382697 wait complete. 2023-12-17T12:03:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:46 smithi119 ceph-mon[177559]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:46.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:46 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2791382697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:03:46.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:46 smithi002 ceph-mon[211741]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:46.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:46 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2791382697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:03:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:47 smithi119 ceph-mon[177559]: pgmap v95: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:47.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:47 smithi119 ceph-mon[177559]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/381 objects degraded (2.100%), 2 pgs degraded) 2023-12-17T12:03:47.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:47 smithi002 ceph-mon[211741]: pgmap v95: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:47.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:47 smithi002 ceph-mon[211741]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/381 objects degraded (2.100%), 2 pgs degraded) 2023-12-17T12:03:49.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:49 smithi119 ceph-mon[177559]: pgmap v96: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:49.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:49 smithi002 ceph-mon[211741]: pgmap v96: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:51.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:51 smithi002 ceph-mon[211741]: pgmap v97: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:51.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:51 smithi119 ceph-mon[177559]: pgmap v97: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:53.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:53 smithi119 ceph-mon[177559]: pgmap v98: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:53.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:53 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:53.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:53 smithi002 ceph-mon[211741]: pgmap v98: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:53.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:53 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:55.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:55 smithi119 ceph-mon[177559]: pgmap v99: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:55.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:55 smithi002 ceph-mon[211741]: pgmap v99: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:57.606 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:57 smithi119 ceph-mon[177559]: pgmap v100: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:57.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:57 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:57.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:57 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:57.607 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:57 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:57 smithi002 ceph-mon[211741]: pgmap v100: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:57 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:57 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:57 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:03:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:58 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:58 smithi119 ceph-mon[177559]: Upgrade: osd.3 is safe to restart 2023-12-17T12:03:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T12:03:58.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:58.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:58 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-17T12:03:58.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:58 smithi002 ceph-mon[211741]: Upgrade: osd.3 is safe to restart 2023-12-17T12:03:58.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:03:58.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T12:03:58.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:59 smithi119 ceph-mon[177559]: pgmap v101: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:59 smithi119 ceph-mon[177559]: Upgrade: Updating osd.3 2023-12-17T12:03:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:03:59 smithi119 ceph-mon[177559]: Deploying daemon osd.3 on smithi119 2023-12-17T12:03:59.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:59 smithi002 ceph-mon[211741]: pgmap v101: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:03:59.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:59 smithi002 ceph-mon[211741]: Upgrade: Updating osd.3 2023-12-17T12:03:59.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:03:59 smithi002 ceph-mon[211741]: Deploying daemon osd.3 on smithi119 2023-12-17T12:04:01.158 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:01 smithi119 systemd[1]: Stopping Ceph osd.3 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:01.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:01 smithi119 ceph-mon[177559]: pgmap v102: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:04:01.658 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:01 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[123802]: 2023-12-17T12:04:01.372+0000 7f28a7362700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:01.658 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:01 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[123802]: 2023-12-17T12:04:01.372+0000 7f28a7362700 -1 osd.3 67 *** Got signal Terminated *** 2023-12-17T12:04:01.658 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:01 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[123802]: 2023-12-17T12:04:01.372+0000 7f28a7362700 -1 osd.3 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:01.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:01 smithi002 ceph-mon[211741]: pgmap v102: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:04:02.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:02 smithi119 ceph-mon[177559]: osd.3 marked itself down and dead 2023-12-17T12:04:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:02 smithi002 ceph-mon[211741]: osd.3 marked itself down and dead 2023-12-17T12:04:03.337 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:03 smithi119 bash[189023]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3 2023-12-17T12:04:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:03 smithi119 ceph-mon[177559]: pgmap v103: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:04:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:03 smithi119 ceph-mon[177559]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:04:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:03 smithi119 ceph-mon[177559]: failed to encode map e68 with expected crc 2023-12-17T12:04:03.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:03 smithi119 ceph-mon[177559]: osdmap e68: 6 total, 5 up, 6 in 2023-12-17T12:04:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:03 smithi002 ceph-mon[211741]: pgmap v103: 65 pgs: 65 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-17T12:04:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:03 smithi002 ceph-mon[211741]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:04:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:03 smithi002 ceph-mon[211741]: failed to encode map e68 with expected crc 2023-12-17T12:04:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:03 smithi002 ceph-mon[211741]: osdmap e68: 6 total, 5 up, 6 in 2023-12-17T12:04:04.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:04 smithi119 ceph-mon[177559]: osdmap e69: 6 total, 5 up, 6 in 2023-12-17T12:04:04.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:04 smithi119 ceph-mon[177559]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:04 smithi119 ceph-mon[177559]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:04 smithi119 ceph-mon[177559]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.572 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:04 smithi119 ceph-mon[177559]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:04 smithi002 ceph-mon[211741]: osdmap e69: 6 total, 5 up, 6 in 2023-12-17T12:04:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:04 smithi002 ceph-mon[211741]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:04 smithi002 ceph-mon[211741]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:04 smithi002 ceph-mon[211741]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:04 smithi002 ceph-mon[211741]: failed to encode map e69 with expected crc 2023-12-17T12:04:04.863 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:04 smithi119 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.3.service: Succeeded. 2023-12-17T12:04:04.863 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:04 smithi119 systemd[1]: Stopped Ceph osd.3 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:04:05.158 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:04 smithi119 systemd[1]: Starting Ceph osd.3 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:05 smithi119 ceph-mon[177559]: pgmap v106: 65 pgs: 2 active+undersized+degraded, 18 peering, 5 stale+active+clean, 2 active+undersized, 38 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 4/381 objects degraded (1.050%) 2023-12-17T12:04:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:05 smithi119 ceph-mon[177559]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2023-12-17T12:04:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:05 smithi119 ceph-mon[177559]: Health check failed: Degraded data redundancy: 4/381 objects degraded (1.050%), 2 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:05.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:05 smithi002 ceph-mon[211741]: pgmap v106: 65 pgs: 2 active+undersized+degraded, 18 peering, 5 stale+active+clean, 2 active+undersized, 38 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 4/381 objects degraded (1.050%) 2023-12-17T12:04:05.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:05 smithi002 ceph-mon[211741]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2023-12-17T12:04:05.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:05 smithi002 ceph-mon[211741]: Health check failed: Degraded data redundancy: 4/381 objects degraded (1.050%), 2 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:06.356 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-17T12:04:06.356 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-17T12:04:06.356 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-17T12:04:06.356 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-17T12:04:06.357 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-17T12:04:06.357 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-17T12:04:06.357 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189295]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-17T12:04:06.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:06 smithi119 ceph-mon[177559]: pgmap v107: 65 pgs: 11 active+undersized+degraded, 18 peering, 9 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 34/381 objects degraded (8.924%) 2023-12-17T12:04:06.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:06 smithi002 ceph-mon[211741]: pgmap v107: 65 pgs: 11 active+undersized+degraded, 18 peering, 9 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 34/381 objects degraded (8.924%) 2023-12-17T12:04:07.158 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 bash[189569]: a0f481fd5b199542462c8cbf2e2b192045f82d9f060783ad4af999631f8ca230 2023-12-17T12:04:07.158 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 ceph-osd[189608]: -- 172.21.15.119:0/191972035 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e37cd0f6c0 con 0x55e37ccdf000 2023-12-17T12:04:07.158 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:06 smithi119 systemd[1]: Started Ceph osd.3 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:04:07.908 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:07 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:04:07.409+0000 7f5a01779640 -1 Falling back to public interface 2023-12-17T12:04:08.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:07 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:08.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:07 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:08.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:07 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:08.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:07 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:08.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:07 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:08.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:07 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:09.308 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:09 smithi119 ceph-mon[177559]: pgmap v108: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:09.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:09 smithi002 ceph-mon[211741]: pgmap v108: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:10 smithi119 ceph-mon[177559]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2023-12-17T12:04:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:10 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:10.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:10 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:10.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:10 smithi002 ceph-mon[211741]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2023-12-17T12:04:10.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:10 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:10.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:10 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:11.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:11 smithi119 ceph-mon[177559]: pgmap v109: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:11.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:11 smithi002 ceph-mon[211741]: pgmap v109: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:12.376 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:12.376 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:12 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:12.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:12.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:12 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:12.651 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:12 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:04:12.582+0000 7f5a01779640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-17T12:04:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-mon[177559]: pgmap v110: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:13.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 81/381 objects degraded (21.260%), 20 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:13.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-mon[177559]: from='osd.3 [v2:172.21.15.119:6800/619765794,v1:172.21.15.119:6801/619765794]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T12:04:13.659 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-mon[177559]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T12:04:13.659 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:13 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:04:13.187+0000 7f5a01779640 -1 osd.3 67 log_to_monitors true 2023-12-17T12:04:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:13 smithi002 ceph-mon[211741]: pgmap v110: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:13 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 81/381 objects degraded (21.260%), 20 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:13 smithi002 ceph-mon[211741]: from='osd.3 [v2:172.21.15.119:6800/619765794,v1:172.21.15.119:6801/619765794]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T12:04:13.726 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:13 smithi002 ceph-mon[211741]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T12:04:14.408 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:04:14 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:04:14.109+0000 7f59f23e9700 -1 osd.3 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: osdmap e70: 6 total, 5 up, 6 in 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='osd.3 [v2:172.21.15.119:6800/619765794,v1:172.21.15.119:6801/619765794]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: pgmap v112: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:15.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: failed to encode map e70 with expected crc 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:15.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T12:04:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: osdmap e70: 6 total, 5 up, 6 in 2023-12-17T12:04:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='osd.3 [v2:172.21.15.119:6800/619765794,v1:172.21.15.119:6801/619765794]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:15.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: pgmap v112: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 81/381 objects degraded (21.260%) 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: failed to encode map e70 with expected crc 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:15.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 -- 172.21.15.2:0/970249398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95341035a0 msgr2=0x7f95340fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 --2- 172.21.15.2:0/970249398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95341035a0 0x7f95340fcc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f951c004940 tx=0x7f951c009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 -- 172.21.15.2:0/970249398 shutdown_connections 2023-12-17T12:04:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 --2- 172.21.15.2:0/970249398 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95341035a0 0x7f95340fcc10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 --2- 172.21.15.2:0/970249398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9534102c00 0x7f9534102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:15.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 -- 172.21.15.2:0/970249398 >> 172.21.15.2:0/970249398 conn(0x7f95340f8790 msgr2=0x7f95340faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 -- 172.21.15.2:0/970249398 shutdown_connections 2023-12-17T12:04:15.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.940+0000 7f95398f0700 1 -- 172.21.15.2:0/970249398 wait complete. 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.941+0000 7f95398f0700 1 Processor -- start 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.941+0000 7f95398f0700 1 -- start start 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.941+0000 7f95398f0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 0x7f953406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.941+0000 7f95398f0700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95341035a0 0x7f95340704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.941+0000 7f95398f0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534070af0 con 0x7f9534102c00 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.941+0000 7f95398f0700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9534070c60 con 0x7f95341035a0 2023-12-17T12:04:15.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f9532ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 0x7f953406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f9532ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 0x7f953406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59076/0 (socket says 172.21.15.2:59076) 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f9532ffd700 1 -- 172.21.15.2:0/3069342135 learned_addr learned my addr 172.21.15.2:0/3069342135 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f952bfff700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95341035a0 0x7f95340704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f9532ffd700 1 -- 172.21.15.2:0/3069342135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95341035a0 msgr2=0x7f95340704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f9532ffd700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95341035a0 0x7f95340704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.942+0000 7f9532ffd700 1 -- 172.21.15.2:0/3069342135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c005040 con 0x7f9534102c00 2023-12-17T12:04:15.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.943+0000 7f9532ffd700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 0x7f953406ff40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9524002a50 tx=0x7f95240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.943+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9524007cc0 con 0x7f9534102c00 2023-12-17T12:04:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.943+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f952400f040 con 0x7f9534102c00 2023-12-17T12:04:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.943+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9534119880 con 0x7f9534102c00 2023-12-17T12:04:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.943+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f952400d9c0 con 0x7f9534102c00 2023-12-17T12:04:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.943+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9534119dc0 con 0x7f9534102c00 2023-12-17T12:04:15.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.944+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95341050d0 con 0x7f9534102c00 2023-12-17T12:04:15.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.945+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f952400db20 con 0x7f9534102c00 2023-12-17T12:04:15.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.947+0000 7f952b7fe700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f952006ce70 0x7f952006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.947+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f952408bfb0 con 0x7f9534102c00 2023-12-17T12:04:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.947+0000 7f952bfff700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f952006ce70 0x7f952006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:15.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.948+0000 7f952bfff700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f952006ce70 0x7f952006f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9534071940 tx=0x7f951c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:15.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:15.952+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f95240bf2f0 con 0x7f9534102c00 2023-12-17T12:04:16.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.203+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9534071680 con 0x7f952006ce70 2023-12-17T12:04:16.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.205+0000 7f952b7fe700 1 -- 172.21.15.2:0/3069342135 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9534071680 con 0x7f952006ce70 2023-12-17T12:04:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f952006ce70 msgr2=0x7f952006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f952006ce70 0x7f952006f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9534071940 tx=0x7f951c009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 msgr2=0x7f953406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 0x7f953406ff40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9524002a50 tx=0x7f95240046b0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 shutdown_connections 2023-12-17T12:04:16.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f952006ce70 0x7f952006f320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9534102c00 0x7f953406ff40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 --2- 172.21.15.2:0/3069342135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95341035a0 0x7f95340704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 >> 172.21.15.2:0/3069342135 conn(0x7f95340f8790 msgr2=0x7f95340fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.207+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 shutdown_connections 2023-12-17T12:04:16.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.208+0000 7f95398f0700 1 -- 172.21.15.2:0/3069342135 wait complete. 2023-12-17T12:04:16.224 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 -- 172.21.15.2:0/3374461804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 msgr2=0x7f6b58102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 --2- 172.21.15.2:0/3374461804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b58102fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6b54004940 tx=0x7f6b54009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 -- 172.21.15.2:0/3374461804 shutdown_connections 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 --2- 172.21.15.2:0/3374461804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b581035a0 0x7f6b580fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 --2- 172.21.15.2:0/3374461804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b58102fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 -- 172.21.15.2:0/3374461804 >> 172.21.15.2:0/3374461804 conn(0x7f6b580f8790 msgr2=0x7f6b580faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:16.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 -- 172.21.15.2:0/3374461804 shutdown_connections 2023-12-17T12:04:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.348+0000 7f6b6060d700 1 -- 172.21.15.2:0/3374461804 wait complete. 2023-12-17T12:04:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.349+0000 7f6b6060d700 1 Processor -- start 2023-12-17T12:04:16.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.349+0000 7f6b6060d700 1 -- start start 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b6060d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b5806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b6060d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b581035a0 0x7f6b58070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b6060d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58070a80 con 0x7f6b58102c00 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b6060d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58070bf0 con 0x7f6b581035a0 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5e3a9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b5806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5e3a9700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b5806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59108/0 (socket says 172.21.15.2:59108) 2023-12-17T12:04:16.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5e3a9700 1 -- 172.21.15.2:0/1291519195 learned_addr learned my addr 172.21.15.2:0/1291519195 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5dba8700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b581035a0 0x7f6b58070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5e3a9700 1 -- 172.21.15.2:0/1291519195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b581035a0 msgr2=0x7f6b58070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5e3a9700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b581035a0 0x7f6b58070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.350+0000 7f6b5e3a9700 1 -- 172.21.15.2:0/1291519195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54005040 con 0x7f6b58102c00 2023-12-17T12:04:16.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.351+0000 7f6b5e3a9700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b5806ff40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009360 tx=0x7f6b54009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.351+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5400e040 con 0x7f6b58102c00 2023-12-17T12:04:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.351+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b54013420 con 0x7f6b58102c00 2023-12-17T12:04:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.351+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b58119850 con 0x7f6b58102c00 2023-12-17T12:04:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.351+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5401c610 con 0x7f6b58102c00 2023-12-17T12:04:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.351+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58119cb0 con 0x7f6b58102c00 2023-12-17T12:04:16.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.352+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b580fff10 con 0x7f6b58102c00 2023-12-17T12:04:16.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.353+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f6b54013590 con 0x7f6b58102c00 2023-12-17T12:04:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.354+0000 7f6b4effd700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6b4406ce70 0x7f6b4406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.354+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6b5408d550 con 0x7f6b58102c00 2023-12-17T12:04:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.354+0000 7f6b5dba8700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6b4406ce70 0x7f6b4406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:16.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.355+0000 7f6b5dba8700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6b4406ce70 0x7f6b4406f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b58071940 tx=0x7f6b4800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:16.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.359+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6b540574e0 con 0x7f6b58102c00 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: failed to encode map e70 with expected crc 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: failed to encode map e71 with expected crc 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: osd.3 [v2:172.21.15.119:6800/619765794,v1:172.21.15.119:6801/619765794] boot 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: osdmap e71: 6 total, 6 up, 6 in 2023-12-17T12:04:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:16 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: failed to encode map e70 with expected crc 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: failed to encode map e71 with expected crc 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: osd.3 [v2:172.21.15.119:6800/619765794,v1:172.21.15.119:6801/619765794] boot 2023-12-17T12:04:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: osdmap e71: 6 total, 6 up, 6 in 2023-12-17T12:04:16.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:16 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T12:04:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.590+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b58071680 con 0x7f6b4406ce70 2023-12-17T12:04:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.592+0000 7f6b4effd700 1 -- 172.21.15.2:0/1291519195 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f6b58071680 con 0x7f6b4406ce70 2023-12-17T12:04:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6b4406ce70 msgr2=0x7f6b4406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6b4406ce70 0x7f6b4406f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b58071940 tx=0x7f6b4800b040 comp rx=0 tx=0).stop 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 msgr2=0x7f6b5806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b5806ff40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009360 tx=0x7f6b54009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 shutdown_connections 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f6b4406ce70 0x7f6b4406f320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b58102c00 0x7f6b5806ff40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 --2- 172.21.15.2:0/1291519195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b581035a0 0x7f6b58070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.594+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 >> 172.21.15.2:0/1291519195 conn(0x7f6b580f8790 msgr2=0x7f6b580fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.595+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 shutdown_connections 2023-12-17T12:04:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.595+0000 7f6b6060d700 1 -- 172.21.15.2:0/1291519195 wait complete. 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.734+0000 7fafec77b700 1 -- 172.21.15.2:0/1752624788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe406ffe0 msgr2=0x7fafe40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.734+0000 7fafec77b700 1 --2- 172.21.15.2:0/1752624788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe406ffe0 0x7fafe40703b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fafe0004970 tx=0x7fafe0009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.734+0000 7fafec77b700 1 -- 172.21.15.2:0/1752624788 shutdown_connections 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.734+0000 7fafec77b700 1 --2- 172.21.15.2:0/1752624788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe40708f0 0x7fafe4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.734+0000 7fafec77b700 1 --2- 172.21.15.2:0/1752624788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe406ffe0 0x7fafe40703b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.734+0000 7fafec77b700 1 -- 172.21.15.2:0/1752624788 >> 172.21.15.2:0/1752624788 conn(0x7fafe40f8790 msgr2=0x7fafe40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.735+0000 7fafec77b700 1 -- 172.21.15.2:0/1752624788 shutdown_connections 2023-12-17T12:04:16.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.735+0000 7fafec77b700 1 -- 172.21.15.2:0/1752624788 wait complete. 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.735+0000 7fafec77b700 1 Processor -- start 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.735+0000 7fafec77b700 1 -- start start 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafec77b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe406ffe0 0x7fafe41157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafec77b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 0x7fafe4115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafec77b700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4116380 con 0x7fafe40708f0 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafec77b700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe410f6b0 con 0x7fafe406ffe0 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafe9d16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 0x7fafe4115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafe9d16700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 0x7fafe4115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59138/0 (socket says 172.21.15.2:59138) 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafe9d16700 1 -- 172.21.15.2:0/2913976058 learned_addr learned my addr 172.21.15.2:0/2913976058 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.736+0000 7fafea517700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe406ffe0 0x7fafe41157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafe9d16700 1 -- 172.21.15.2:0/2913976058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe406ffe0 msgr2=0x7fafe41157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafe9d16700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe406ffe0 0x7fafe41157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafe9d16700 1 -- 172.21.15.2:0/2913976058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0005040 con 0x7fafe40708f0 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafe9d16700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 0x7fafe4115d30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fafd4002a50 tx=0x7fafd40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd4007cc0 con 0x7fafe40708f0 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe410f990 con 0x7fafe40708f0 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafd400f040 con 0x7fafe40708f0 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd400d980 con 0x7fafe40708f0 2023-12-17T12:04:16.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.737+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe410fed0 con 0x7fafe40708f0 2023-12-17T12:04:16.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.738+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe41065d0 con 0x7fafe40708f0 2023-12-17T12:04:16.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.739+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fafd400db20 con 0x7fafe40708f0 2023-12-17T12:04:16.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.740+0000 7fafdaffd700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fafd006ce70 0x7fafd006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:16.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.740+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fafd408c090 con 0x7fafe40708f0 2023-12-17T12:04:16.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.741+0000 7fafea517700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fafd006ce70 0x7fafd006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.741+0000 7fafea517700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fafd006ce70 0x7fafd006f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009fd0 tx=0x7fafe0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.745+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fafd4059960 con 0x7fafe40708f0 2023-12-17T12:04:16.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.968+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fafe41154c0 con 0x7fafd006ce70 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.978+0000 7fafdaffd700 1 -- 172.21.15.2:0/2913976058 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fafe41154c0 con 0x7fafd006ce70 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (4m) 39s ago 13m 16.0M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (2m) 39s ago 14m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (2m) 7s ago 13m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 39s ago 13m 79.6M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (9m) 39s ago 9m 6652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (9m) 39s ago 9m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (9m) 7s ago 9m 5124M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:04:16.980 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (9m) 7s ago 9m 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (6m) 39s ago 15m 520M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (5m) 7s ago 12m 453M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (3m) 39s ago 15m 66.4M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (2m) 7s ago 12m 51.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 39s ago 14m 8288k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 7s ago 12m 8560k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (112s) 39s ago 12m 120M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (78s) 39s ago 11m 125M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a68897527efb 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (44s) 39s ago 11m 12.8M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 02b7236a4a7b 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (10s) 7s ago 11m 12.5M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a0f481fd5b19 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (10m) 7s ago 10m 765M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 c2fd928b80ef 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (10m) 7s ago 10m 883M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:04:16.981 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (4m) 39s ago 13m 59.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:04:16.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fafd006ce70 msgr2=0x7fafd006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fafd006ce70 0x7fafd006f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009fd0 tx=0x7fafe0009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:16.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 msgr2=0x7fafe4115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 0x7fafe4115d30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fafd4002a50 tx=0x7fafd40046b0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 shutdown_connections 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fafd006ce70 0x7fafd006f320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fafe406ffe0 0x7fafe41157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 --2- 172.21.15.2:0/2913976058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fafe40708f0 0x7fafe4115d30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 >> 172.21.15.2:0/2913976058 conn(0x7fafe40f8790 msgr2=0x7fafe4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.980+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 shutdown_connections 2023-12-17T12:04:16.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:16.981+0000 7fafec77b700 1 -- 172.21.15.2:0/2913976058 wait complete. 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 -- 172.21.15.2:0/3958970173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 msgr2=0x7f69780fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3958970173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f69780fcc10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6968004940 tx=0x7f6968009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 -- 172.21.15.2:0/3958970173 shutdown_connections 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3958970173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f69780fcc10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3958970173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 0x7f6978102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 -- 172.21.15.2:0/3958970173 >> 172.21.15.2:0/3958970173 conn(0x7f69780f8790 msgr2=0x7f69780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.119+0000 7f697f8f8700 1 -- 172.21.15.2:0/3958970173 shutdown_connections 2023-12-17T12:04:17.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.120+0000 7f697f8f8700 1 -- 172.21.15.2:0/3958970173 wait complete. 2023-12-17T12:04:17.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.120+0000 7f697f8f8700 1 Processor -- start 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697f8f8700 1 -- start start 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697f8f8700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 0x7f6978113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697f8f8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f6978113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697f8f8700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978114250 con 0x7f69781035a0 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697f8f8700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697810d540 con 0x7f6978102c00 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697ce93700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f6978113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697ce93700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f6978113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59156/0 (socket says 172.21.15.2:59156) 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697ce93700 1 -- 172.21.15.2:0/3953419000 learned_addr learned my addr 172.21.15.2:0/3953419000 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.121+0000 7f697d694700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 0x7f6978113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697ce93700 1 -- 172.21.15.2:0/3953419000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 msgr2=0x7f6978113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697ce93700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 0x7f6978113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697ce93700 1 -- 172.21.15.2:0/3953419000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6968005040 con 0x7f69781035a0 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697d694700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 0x7f6978113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697ce93700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f6978113c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6968008d80 tx=0x7f6968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6968021070 con 0x7f69781035a0 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f696801c400 con 0x7f69781035a0 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f696800e070 con 0x7f69781035a0 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697810d770 con 0x7f69781035a0 2023-12-17T12:04:17.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.122+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697810dc00 con 0x7f69781035a0 2023-12-17T12:04:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.124+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69781050d0 con 0x7f69781035a0 2023-12-17T12:04:17.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.124+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f696801c950 con 0x7f69781035a0 2023-12-17T12:04:17.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.125+0000 7f696dffb700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f696406ce70 0x7f696406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.126+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f696808d4a0 con 0x7f69781035a0 2023-12-17T12:04:17.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.126+0000 7f697d694700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f696406ce70 0x7f696406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.126+0000 7f697d694700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f696406ce70 0x7f696406f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69780f9d80 tx=0x7f697400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:17.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.130+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f696805adf0 con 0x7f69781035a0 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: osdmap e72: 6 total, 6 up, 6 in 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:17 smithi119 ceph-mon[177559]: pgmap v115: 65 pgs: 7 peering, 16 active+undersized+degraded, 15 active+undersized, 27 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 68/381 objects degraded (17.848%) 2023-12-17T12:04:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.430+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69780fc390 con 0x7f69781035a0 2023-12-17T12:04:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.431+0000 7f696dffb700 1 -- 172.21.15.2:0/3953419000 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f696805a980 con 0x7f69781035a0 2023-12-17T12:04:17.433 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:04:17.433 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:04:17.433 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:04:17.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 2, 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 4 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 6, 2023-12-17T12:04:17.434 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 8 2023-12-17T12:04:17.435 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:04:17.435 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f696406ce70 msgr2=0x7f696406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f696406ce70 0x7f696406f320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69780f9d80 tx=0x7f697400b040 comp rx=0 tx=0).stop 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 msgr2=0x7f6978113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f6978113c00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6968008d80 tx=0x7f6968009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 shutdown_connections 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f696406ce70 0x7f696406f320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6978102c00 0x7f6978113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 --2- 172.21.15.2:0/3953419000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69781035a0 0x7f6978113c00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 >> 172.21.15.2:0/3953419000 conn(0x7f69780f8790 msgr2=0x7f69780fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:17.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 shutdown_connections 2023-12-17T12:04:17.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.434+0000 7f697f8f8700 1 -- 172.21.15.2:0/3953419000 wait complete. 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: osdmap e72: 6 total, 6 up, 6 in 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: failed to encode map e72 with expected crc 2023-12-17T12:04:17.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:17.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:17 smithi002 ceph-mon[211741]: pgmap v115: 65 pgs: 7 peering, 16 active+undersized+degraded, 15 active+undersized, 27 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 68/381 objects degraded (17.848%) 2023-12-17T12:04:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 -- 172.21.15.2:0/3305978547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 msgr2=0x7f45a40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/3305978547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a40703b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45a0004970 tx=0x7f45a0009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 -- 172.21.15.2:0/3305978547 shutdown_connections 2023-12-17T12:04:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/3305978547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 0x7f45a4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/3305978547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a40703b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 -- 172.21.15.2:0/3305978547 >> 172.21.15.2:0/3305978547 conn(0x7f45a40f8790 msgr2=0x7f45a40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 -- 172.21.15.2:0/3305978547 shutdown_connections 2023-12-17T12:04:17.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.573+0000 7f45ac4b1700 1 -- 172.21.15.2:0/3305978547 wait complete. 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.574+0000 7f45ac4b1700 1 Processor -- start 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.574+0000 7f45ac4b1700 1 -- start start 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45ac4b1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a41157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45ac4b1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 0x7f45a4115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45ac4b1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4116380 con 0x7f45a406ffe0 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45ac4b1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a410f6b0 con 0x7f45a40708f0 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a41157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a41157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59186/0 (socket says 172.21.15.2:59186) 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 -- 172.21.15.2:0/1855735658 learned_addr learned my addr 172.21.15.2:0/1855735658 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 -- 172.21.15.2:0/1855735658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 msgr2=0x7f45a4115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45a9a4c700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 0x7f45a4115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 0x7f45a4115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 -- 172.21.15.2:0/1855735658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0005040 con 0x7f45a406ffe0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45a9a4c700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 0x7f45a4115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.575+0000 7f45aa24d700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a41157f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f45a0005010 tx=0x7f45a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.576+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a000e040 con 0x7f45a406ffe0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.576+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45a0004290 con 0x7f45a406ffe0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.576+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a410f930 con 0x7f45a406ffe0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.576+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a001c3f0 con 0x7f45a406ffe0 2023-12-17T12:04:17.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.576+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a410fe70 con 0x7f45a406ffe0 2023-12-17T12:04:17.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.577+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a41065d0 con 0x7f45a406ffe0 2023-12-17T12:04:17.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.578+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f45a0013420 con 0x7f45a406ffe0 2023-12-17T12:04:17.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.579+0000 7f459affd700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f459006ce70 0x7f459006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.579+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f45a008d660 con 0x7f45a406ffe0 2023-12-17T12:04:17.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.579+0000 7f45a9a4c700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f459006ce70 0x7f459006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.580+0000 7f45a9a4c700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f459006ce70 0x7f459006f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45a4111020 tx=0x7f459400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:17.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.583+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f45a005b030 con 0x7f45a406ffe0 2023-12-17T12:04:17.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.842+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f45a404bb80 con 0x7f45a406ffe0 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.843+0000 7f459affd700 1 -- 172.21.15.2:0/1855735658 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f45a005abc0 con 0x7f45a406ffe0 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:04:17.845 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T12:02:11.885042+0000 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:04:17.846 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:17.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:17.848 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:17.848 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:04:17.848 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:17.848 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:17.848 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f459006ce70 msgr2=0x7f459006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f459006ce70 0x7f459006f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45a4111020 tx=0x7f459400b040 comp rx=0 tx=0).stop 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 msgr2=0x7f45a41157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a41157f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f45a0005010 tx=0x7f45a0009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 shutdown_connections 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f459006ce70 0x7f459006f320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45a406ffe0 0x7f45a41157f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 --2- 172.21.15.2:0/1855735658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45a40708f0 0x7f45a4115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 >> 172.21.15.2:0/1855735658 conn(0x7f45a40f8790 msgr2=0x7f45a4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 shutdown_connections 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.845+0000 7f45ac4b1700 1 -- 172.21.15.2:0/1855735658 wait complete. 2023-12-17T12:04:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2023-12-17T12:04:17.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 -- 172.21.15.2:0/2176974377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 msgr2=0x7fbc3c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2176974377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c102fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c004940 tx=0x7fbc2c009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 -- 172.21.15.2:0/2176974377 shutdown_connections 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2176974377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc3c1035a0 0x7fbc3c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2176974377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c102fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 -- 172.21.15.2:0/2176974377 >> 172.21.15.2:0/2176974377 conn(0x7fbc3c0f8790 msgr2=0x7fbc3c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 -- 172.21.15.2:0/2176974377 shutdown_connections 2023-12-17T12:04:17.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.985+0000 7fbc420a1700 1 -- 172.21.15.2:0/2176974377 wait complete. 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.986+0000 7fbc420a1700 1 Processor -- start 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.986+0000 7fbc420a1700 1 -- start start 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc420a1700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc420a1700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc3c1035a0 0x7fbc3c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc420a1700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c1141e0 con 0x7fbc3c102c00 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc420a1700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c10d4d0 con 0x7fbc3c1035a0 2023-12-17T12:04:17.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3b7fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59210/0 (socket says 172.21.15.2:59210) 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3b7fe700 1 -- 172.21.15.2:0/2693329927 learned_addr learned my addr 172.21.15.2:0/2693329927 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3affd700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc3c1035a0 0x7fbc3c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3b7fe700 1 -- 172.21.15.2:0/2693329927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc3c1035a0 msgr2=0x7fbc3c113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3b7fe700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc3c1035a0 0x7fbc3c113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.987+0000 7fbc3b7fe700 1 -- 172.21.15.2:0/2693329927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c005040 con 0x7fbc3c102c00 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.988+0000 7fbc3b7fe700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c113610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009fd0 tx=0x7fbc2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.988+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc2c00e040 con 0x7fbc3c102c00 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.988+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc2c013420 con 0x7fbc3c102c00 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.988+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c10d700 con 0x7fbc3c102c00 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.988+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc2c01c630 con 0x7fbc3c102c00 2023-12-17T12:04:17.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.988+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c10dc40 con 0x7fbc3c102c00 2023-12-17T12:04:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.989+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c0fff10 con 0x7fbc3c102c00 2023-12-17T12:04:17.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.990+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fbc2c013590 con 0x7fbc3c102c00 2023-12-17T12:04:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.991+0000 7fbc23fff700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbc2406ce70 0x7fbc2406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.991+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbc2c08d540 con 0x7fbc3c102c00 2023-12-17T12:04:17.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.991+0000 7fbc3affd700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbc2406ce70 0x7fbc2406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:17.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.992+0000 7fbc3affd700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbc2406ce70 0x7fbc2406f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c10eeb0 tx=0x7fbc3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:17.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:17.996+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbc2c05af10 con 0x7fbc3c102c00 2023-12-17T12:04:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.228+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc3c10ebf0 con 0x7fbc2406ce70 2023-12-17T12:04:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.230+0000 7fbc23fff700 1 -- 172.21.15.2:0/2693329927 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbc3c10ebf0 con 0x7fbc2406ce70 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "10/21 daemons upgraded", 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:04:18.232 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:04:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbc2406ce70 msgr2=0x7fbc2406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:18.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbc2406ce70 0x7fbc2406f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c10eeb0 tx=0x7fbc3000b040 comp rx=0 tx=0).stop 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 msgr2=0x7fbc3c113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c113610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009fd0 tx=0x7fbc2c009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 shutdown_connections 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbc2406ce70 0x7fbc2406f320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc3c102c00 0x7fbc3c113610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 --2- 172.21.15.2:0/2693329927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc3c1035a0 0x7fbc3c113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.232+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 >> 172.21.15.2:0/2693329927 conn(0x7fbc3c0f8790 msgr2=0x7fbc3c0fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.233+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 shutdown_connections 2023-12-17T12:04:18.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.233+0000 7fbc420a1700 1 -- 172.21.15.2:0/2693329927 wait complete. 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/3802547215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 msgr2=0x7f1b580fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/3802547215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b580fcc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c004940 tx=0x7f1b4c009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/3802547215 shutdown_connections 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/3802547215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b580fcc10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/3802547215 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b58102c00 0x7f1b58102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/3802547215 >> 172.21.15.2:0/3802547215 conn(0x7f1b580f8790 msgr2=0x7f1b580faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/3802547215 shutdown_connections 2023-12-17T12:04:18.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.373+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/3802547215 wait complete. 2023-12-17T12:04:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.374+0000 7f1b5d6dd700 1 Processor -- start 2023-12-17T12:04:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.374+0000 7f1b5d6dd700 1 -- start start 2023-12-17T12:04:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.374+0000 7f1b5d6dd700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b58102c00 0x7f1b581157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.374+0000 7f1b5d6dd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b58115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.374+0000 7f1b5d6dd700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58116350 con 0x7f1b581035a0 2023-12-17T12:04:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.374+0000 7f1b5d6dd700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5810f680 con 0x7f1b58102c00 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b58115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b58115d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59228/0 (socket says 172.21.15.2:59228) 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 -- 172.21.15.2:0/2711550365 learned_addr learned my addr 172.21.15.2:0/2711550365 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b56ffd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b58102c00 0x7f1b581157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 -- 172.21.15.2:0/2711550365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b58102c00 msgr2=0x7f1b581157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b58102c00 0x7f1b581157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 -- 172.21.15.2:0/2711550365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c005040 con 0x7f1b581035a0 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b567fc700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b58115d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c008d80 tx=0x7f1b4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.375+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c021070 con 0x7f1b581035a0 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.376+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b4c0093b0 con 0x7f1b581035a0 2023-12-17T12:04:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.376+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c00e070 con 0x7f1b581035a0 2023-12-17T12:04:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.376+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5810f900 con 0x7f1b581035a0 2023-12-17T12:04:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.376+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5810fde0 con 0x7f1b581035a0 2023-12-17T12:04:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.377+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b580fc390 con 0x7f1b581035a0 2023-12-17T12:04:18.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.378+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f1b4c01c5e0 con 0x7f1b581035a0 2023-12-17T12:04:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.379+0000 7f1b3f7fe700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1b4006ce70 0x7f1b4006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.379+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1b4c08d350 con 0x7f1b581035a0 2023-12-17T12:04:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.379+0000 7f1b56ffd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1b4006ce70 0x7f1b4006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:18.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.380+0000 7f1b56ffd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1b4006ce70 0x7f1b4006f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009b80 tx=0x7f1b4800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.384+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1b4c05ad20 con 0x7f1b581035a0 2023-12-17T12:04:18.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:18 smithi119 ceph-mon[177559]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:18.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:18 smithi119 ceph-mon[177559]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:18.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:18 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3953419000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:18.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:18 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1855735658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:18.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:18 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 68/381 objects degraded (17.848%), 16 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:18.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:18 smithi002 ceph-mon[211741]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:18.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:18 smithi002 ceph-mon[211741]: from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:18.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:18 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3953419000' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:18.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:18 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1855735658' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:18.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:18 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 68/381 objects degraded (17.848%), 16 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:18.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.684+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1b5804bb80 con 0x7f1b581035a0 2023-12-17T12:04:18.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.684+0000 7f1b3f7fe700 1 -- 172.21.15.2:0/2711550365 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1263 (secure 0 0 0) 0x7f1b4c05a8b0 con 0x7f1b581035a0 2023-12-17T12:04:18.686 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 68/381 objects degraded (17.848%), 16 pgs degraded 2023-12-17T12:04:18.686 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 68/381 objects degraded (17.848%), 16 pgs degraded 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2023-12-17T12:04:18.687 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2023-12-17T12:04:18.688 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2023-12-17T12:04:18.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1b4006ce70 msgr2=0x7f1b4006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:18.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1b4006ce70 0x7f1b4006f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009b80 tx=0x7f1b4800b040 comp rx=0 tx=0).stop 2023-12-17T12:04:18.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 msgr2=0x7f1b58115d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:18.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b58115d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c008d80 tx=0x7f1b4c009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:18.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 shutdown_connections 2023-12-17T12:04:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1b4006ce70 0x7f1b4006f320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b58102c00 0x7f1b581157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 --2- 172.21.15.2:0/2711550365 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b581035a0 0x7f1b58115d00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 >> 172.21.15.2:0/2711550365 conn(0x7f1b580f8790 msgr2=0x7f1b58070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 shutdown_connections 2023-12-17T12:04:18.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:18.687+0000 7f1b5d6dd700 1 -- 172.21.15.2:0/2711550365 wait complete. 2023-12-17T12:04:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:19 smithi119 ceph-mon[177559]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:19 smithi119 ceph-mon[177559]: pgmap v116: 65 pgs: 7 peering, 13 active+undersized+degraded, 10 active+undersized, 35 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 56/381 objects degraded (14.698%) 2023-12-17T12:04:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:19 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2711550365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:04:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:19 smithi002 ceph-mon[211741]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:19 smithi002 ceph-mon[211741]: pgmap v116: 65 pgs: 7 peering, 13 active+undersized+degraded, 10 active+undersized, 35 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 56/381 objects degraded (14.698%) 2023-12-17T12:04:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:19 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2711550365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:04:20.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:20 smithi119 ceph-mon[177559]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/381 objects degraded (14.698%), 13 pgs degraded) 2023-12-17T12:04:20.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:20 smithi002 ceph-mon[211741]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 56/381 objects degraded (14.698%), 13 pgs degraded) 2023-12-17T12:04:21.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:21 smithi119 ceph-mon[177559]: pgmap v117: 65 pgs: 7 peering, 58 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:21.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:21 smithi002 ceph-mon[211741]: pgmap v117: 65 pgs: 7 peering, 58 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:23.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:23 smithi119 ceph-mon[177559]: pgmap v118: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:23.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:23 smithi002 ceph-mon[211741]: pgmap v118: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:25.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:25 smithi119 ceph-mon[177559]: pgmap v119: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:25.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:25 smithi002 ceph-mon[211741]: pgmap v119: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:26.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:26 smithi119 ceph-mon[177559]: pgmap v120: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:26.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:26 smithi002 ceph-mon[211741]: pgmap v120: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:29.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:29 smithi119 ceph-mon[177559]: pgmap v121: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:29.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:29 smithi002 ceph-mon[211741]: pgmap v121: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:30.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:30 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:30.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:30 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:31 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:31 smithi119 ceph-mon[177559]: Upgrade: osd.4 is safe to restart 2023-12-17T12:04:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:31 smithi119 ceph-mon[177559]: pgmap v122: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:31 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:31 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T12:04:31.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:31 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:04:31.543 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:31 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-17T12:04:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:31 smithi002 ceph-mon[211741]: Upgrade: osd.4 is safe to restart 2023-12-17T12:04:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:31 smithi002 ceph-mon[211741]: pgmap v122: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:31 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:31 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T12:04:31.544 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:31 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:04:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:32 smithi119 ceph-mon[177559]: Upgrade: Updating osd.4 2023-12-17T12:04:32.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:32 smithi119 ceph-mon[177559]: Deploying daemon osd.4 on smithi119 2023-12-17T12:04:32.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:32 smithi002 ceph-mon[211741]: Upgrade: Updating osd.4 2023-12-17T12:04:32.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:32 smithi002 ceph-mon[211741]: Deploying daemon osd.4 on smithi119 2023-12-17T12:04:33.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:33 smithi119 ceph-mon[177559]: pgmap v123: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:33.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:33 smithi002 ceph-mon[211741]: pgmap v123: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:34.278 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:34 smithi119 systemd[1]: Stopping Ceph osd.4 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:34.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:34 smithi119 ceph-mon[177559]: osd.4 marked itself down and dead 2023-12-17T12:04:34.658 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:34 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[131721]: 2023-12-17T12:04:34.275+0000 7f16f8af3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:34.658 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:34 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[131721]: 2023-12-17T12:04:34.275+0000 7f16f8af3700 -1 osd.4 72 *** Got signal Terminated *** 2023-12-17T12:04:34.658 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:34 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[131721]: 2023-12-17T12:04:34.275+0000 7f16f8af3700 -1 osd.4 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:34.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:34 smithi002 ceph-mon[211741]: osd.4 marked itself down and dead 2023-12-17T12:04:35.303 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:34 smithi119 bash[195153]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4 2023-12-17T12:04:35.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:35 smithi119 ceph-mon[177559]: pgmap v124: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:35.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:35 smithi119 ceph-mon[177559]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:04:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:35 smithi119 ceph-mon[177559]: failed to encode map e73 with expected crc 2023-12-17T12:04:35.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:35 smithi119 ceph-mon[177559]: osdmap e73: 6 total, 5 up, 6 in 2023-12-17T12:04:35.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:35 smithi002 ceph-mon[211741]: pgmap v124: 65 pgs: 65 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:35.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:35 smithi002 ceph-mon[211741]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:04:35.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:35 smithi002 ceph-mon[211741]: failed to encode map e73 with expected crc 2023-12-17T12:04:35.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:35 smithi002 ceph-mon[211741]: osdmap e73: 6 total, 5 up, 6 in 2023-12-17T12:04:36.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:36 smithi119 ceph-mon[177559]: osdmap e74: 6 total, 5 up, 6 in 2023-12-17T12:04:36.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:36 smithi119 ceph-mon[177559]: failed to encode map e74 with expected crc 2023-12-17T12:04:36.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:36 smithi119 ceph-mon[177559]: failed to encode map e74 with expected crc 2023-12-17T12:04:36.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:36 smithi002 ceph-mon[211741]: osdmap e74: 6 total, 5 up, 6 in 2023-12-17T12:04:36.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:36 smithi002 ceph-mon[211741]: failed to encode map e74 with expected crc 2023-12-17T12:04:36.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:36 smithi002 ceph-mon[211741]: failed to encode map e74 with expected crc 2023-12-17T12:04:36.804 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:36 smithi119 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.4.service: Succeeded. 2023-12-17T12:04:36.804 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:36 smithi119 systemd[1]: Stopped Ceph osd.4 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:04:37.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:36 smithi119 systemd[1]: Starting Ceph osd.4 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:37 smithi119 ceph-mon[177559]: pgmap v127: 65 pgs: 4 active+undersized+degraded, 8 peering, 3 stale+active+clean, 4 active+undersized, 46 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 13/381 objects degraded (3.412%) 2023-12-17T12:04:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:37 smithi119 ceph-mon[177559]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-17T12:04:37.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:37 smithi119 ceph-mon[177559]: Health check failed: Degraded data redundancy: 13/381 objects degraded (3.412%), 4 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:37.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:37 smithi002 ceph-mon[211741]: pgmap v127: 65 pgs: 4 active+undersized+degraded, 8 peering, 3 stale+active+clean, 4 active+undersized, 46 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 13/381 objects degraded (3.412%) 2023-12-17T12:04:37.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:37 smithi002 ceph-mon[211741]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-12-17T12:04:37.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:37 smithi002 ceph-mon[211741]: Health check failed: Degraded data redundancy: 13/381 objects degraded (3.412%), 4 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-17T12:04:38.408 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:37 smithi119 bash[195425]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-17T12:04:39.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:39 smithi119 ceph-mon[177559]: pgmap v128: 65 pgs: 6 active+undersized+degraded, 8 peering, 2 stale+active+clean, 7 active+undersized, 42 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 19/381 objects degraded (4.987%) 2023-12-17T12:04:39.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:39.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:39.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:39 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:39.159 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:38 smithi119 ceph-osd[195736]: -- 172.21.15.119:0/2272790707 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5562f15a76c0 con 0x5562f1576c00 2023-12-17T12:04:39.159 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:38 smithi119 bash[195699]: c392322b1e994ff25646869a9849ed770396820f4565b79bb0cca18f3a240dab 2023-12-17T12:04:39.159 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:38 smithi119 systemd[1]: Started Ceph osd.4 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:04:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:39 smithi002 ceph-mon[211741]: pgmap v128: 65 pgs: 6 active+undersized+degraded, 8 peering, 2 stale+active+clean, 7 active+undersized, 42 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 19/381 objects degraded (4.987%) 2023-12-17T12:04:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:39.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:39 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:39.908 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:39 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:04:39.412+0000 7f44ca367640 -1 Falling back to public interface 2023-12-17T12:04:40.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:40 smithi119 ceph-mon[177559]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-17T12:04:40.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:40 smithi002 ceph-mon[211741]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2023-12-17T12:04:41.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:41 smithi119 ceph-mon[177559]: pgmap v129: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:41.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:41 smithi002 ceph-mon[211741]: pgmap v129: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:42 smithi002 ceph-mon[211741]: pgmap v130: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:43.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:42 smithi119 ceph-mon[177559]: pgmap v130: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:43.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:43.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:43 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 64/381 objects degraded (16.798%), 16 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:43.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:43.976 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:44.084 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:43 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 64/381 objects degraded (16.798%), 16 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:44.084 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:44.084 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:44.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:44 smithi119 ceph-mon[177559]: pgmap v131: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:44.909 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:44 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:04:44.515+0000 7f44ca367640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-17T12:04:44.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:44 smithi002 ceph-mon[211741]: pgmap v131: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:45.407 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:45 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:04:45.082+0000 7f44ca367640 -1 osd.4 72 log_to_monitors true 2023-12-17T12:04:45.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:45 smithi002 ceph-mon[211741]: from='osd.4 [v2:172.21.15.119:6808/1258724394,v1:172.21.15.119:6809/1258724394]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T12:04:45.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:45 smithi002 ceph-mon[211741]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T12:04:46.095 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:45 smithi119 ceph-mon[177559]: from='osd.4 [v2:172.21.15.119:6808/1258724394,v1:172.21.15.119:6809/1258724394]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T12:04:46.096 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:45 smithi119 ceph-mon[177559]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T12:04:46.096 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:04:45 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:04:45.745+0000 7f44bafd7700 -1 osd.4 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: failed to encode map e75 with expected crc 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: osdmap e75: 6 total, 5 up, 6 in 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='osd.4 [v2:172.21.15.119:6808/1258724394,v1:172.21.15.119:6809/1258724394]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: pgmap v133: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:47.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:04:47.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:04:47.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:46 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T12:04:47.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: failed to encode map e75 with expected crc 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: osdmap e75: 6 total, 5 up, 6 in 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='osd.4 [v2:172.21.15.119:6808/1258724394,v1:172.21.15.119:6809/1258724394]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: pgmap v133: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 64/381 objects degraded (16.798%) 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:04:47.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:46 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: failed to encode map e76 with expected crc 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: osd.4 [v2:172.21.15.119:6808/1258724394,v1:172.21.15.119:6809/1258724394] boot 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: osdmap e76: 6 total, 6 up, 6 in 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: failed to encode map e76 with expected crc 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:04:48.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:04:48.159 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:47 smithi119 ceph-mon[177559]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-17T12:04:48.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:04:48.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: failed to encode map e76 with expected crc 2023-12-17T12:04:48.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: osd.4 [v2:172.21.15.119:6808/1258724394,v1:172.21.15.119:6809/1258724394] boot 2023-12-17T12:04:48.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: osdmap e76: 6 total, 6 up, 6 in 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: failed to encode map e76 with expected crc 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:04:48.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:47 smithi002 ceph-mon[211741]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-17T12:04:48.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 -- 172.21.15.2:0/3507655643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 msgr2=0x7f12780fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:48.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 --2- 172.21.15.2:0/3507655643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780fcc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1268004940 tx=0x7f1268009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:48.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 -- 172.21.15.2:0/3507655643 shutdown_connections 2023-12-17T12:04:48.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 --2- 172.21.15.2:0/3507655643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780fcc10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:48.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 --2- 172.21.15.2:0/3507655643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 0x7f1278102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:48.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 -- 172.21.15.2:0/3507655643 >> 172.21.15.2:0/3507655643 conn(0x7f12780f8790 msgr2=0x7f12780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:48.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 -- 172.21.15.2:0/3507655643 shutdown_connections 2023-12-17T12:04:48.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.845+0000 7f127f403700 1 -- 172.21.15.2:0/3507655643 wait complete. 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.846+0000 7f127f403700 1 Processor -- start 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.846+0000 7f127f403700 1 -- start start 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127f403700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 0x7f127806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127f403700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127f403700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1278070af0 con 0x7f12781035a0 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127f403700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1278070c60 con 0x7f1278102c00 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127c99e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127c99e700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45264/0 (socket says 172.21.15.2:45264) 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127c99e700 1 -- 172.21.15.2:0/2027571634 learned_addr learned my addr 172.21.15.2:0/2027571634 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127d19f700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 0x7f127806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127c99e700 1 -- 172.21.15.2:0/2027571634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 msgr2=0x7f127806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127c99e700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 0x7f127806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127c99e700 1 -- 172.21.15.2:0/2027571634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268005040 con 0x7f12781035a0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.847+0000 7f127d19f700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 0x7f127806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.848+0000 7f127c99e700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780704a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1268009360 tx=0x7f1268009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.848+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126800e040 con 0x7f12781035a0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.848+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1278119880 con 0x7f12781035a0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.848+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f126800bc50 con 0x7f12781035a0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.848+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f126801c630 con 0x7f12781035a0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.848+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1278119d60 con 0x7f12781035a0 2023-12-17T12:04:48.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.849+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12781050d0 con 0x7f12781035a0 2023-12-17T12:04:48.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.850+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f1268013420 con 0x7f12781035a0 2023-12-17T12:04:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.851+0000 7f126dffb700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f126406ce70 0x7f126406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.851+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f126808d7d0 con 0x7f12781035a0 2023-12-17T12:04:48.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.852+0000 7f127d19f700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f126406ce70 0x7f126406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:48.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.852+0000 7f127d19f700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f126406ce70 0x7f126406f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1274009fd0 tx=0x7f1274009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:48.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:48.857+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1268057690 con 0x7f12781035a0 2023-12-17T12:04:49.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.090+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1278071680 con 0x7f126406ce70 2023-12-17T12:04:49.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.092+0000 7f126dffb700 1 -- 172.21.15.2:0/2027571634 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1278071680 con 0x7f126406ce70 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f126406ce70 msgr2=0x7f126406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f126406ce70 0x7f126406f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1274009fd0 tx=0x7f1274009ee0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 msgr2=0x7f12780704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780704a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1268009360 tx=0x7f1268009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 shutdown_connections 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f126406ce70 0x7f126406f320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1278102c00 0x7f127806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 --2- 172.21.15.2:0/2027571634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12781035a0 0x7f12780704a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 >> 172.21.15.2:0/2027571634 conn(0x7f12780f8790 msgr2=0x7f12780fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 shutdown_connections 2023-12-17T12:04:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.094+0000 7f127f403700 1 -- 172.21.15.2:0/2027571634 wait complete. 2023-12-17T12:04:49.110 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:04:49.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:48 smithi119 ceph-mon[177559]: osdmap e77: 6 total, 6 up, 6 in 2023-12-17T12:04:49.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:48 smithi119 ceph-mon[177559]: failed to encode map e77 with expected crc 2023-12-17T12:04:49.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:48 smithi119 ceph-mon[177559]: failed to encode map e77 with expected crc 2023-12-17T12:04:49.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:48 smithi119 ceph-mon[177559]: pgmap v136: 65 pgs: 15 active+undersized+degraded, 15 active+undersized, 35 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 60/381 objects degraded (15.748%) 2023-12-17T12:04:49.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:48 smithi002 ceph-mon[211741]: osdmap e77: 6 total, 6 up, 6 in 2023-12-17T12:04:49.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:48 smithi002 ceph-mon[211741]: failed to encode map e77 with expected crc 2023-12-17T12:04:49.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:48 smithi002 ceph-mon[211741]: failed to encode map e77 with expected crc 2023-12-17T12:04:49.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:48 smithi002 ceph-mon[211741]: pgmap v136: 65 pgs: 15 active+undersized+degraded, 15 active+undersized, 35 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 60/381 objects degraded (15.748%) 2023-12-17T12:04:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.234+0000 7f79e6dde700 1 -- 172.21.15.2:0/3523142054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 msgr2=0x7f79e0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.234+0000 7f79e6dde700 1 --2- 172.21.15.2:0/3523142054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0102fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79d4004940 tx=0x7f79d4009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 -- 172.21.15.2:0/3523142054 shutdown_connections 2023-12-17T12:04:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 --2- 172.21.15.2:0/3523142054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 0x7f79e00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 --2- 172.21.15.2:0/3523142054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0102fd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 -- 172.21.15.2:0/3523142054 >> 172.21.15.2:0/3523142054 conn(0x7f79e00f8790 msgr2=0x7f79e00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 -- 172.21.15.2:0/3523142054 shutdown_connections 2023-12-17T12:04:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 -- 172.21.15.2:0/3523142054 wait complete. 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.235+0000 7f79e6dde700 1 Processor -- start 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e6dde700 1 -- start start 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e6dde700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e6dde700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 0x7f79e0115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e6dde700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e01163b0 con 0x7f79e0102c00 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e6dde700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e010f6e0 con 0x7f79e01035a0 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e4b7a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e4b7a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0115820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50678/0 (socket says 172.21.15.2:50678) 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.236+0000 7f79e4b7a700 1 -- 172.21.15.2:0/1780521364 learned_addr learned my addr 172.21.15.2:0/1780521364 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79dffff700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 0x7f79e0115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79e4b7a700 1 -- 172.21.15.2:0/1780521364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 msgr2=0x7f79e0115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79e4b7a700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 0x7f79e0115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79e4b7a700 1 -- 172.21.15.2:0/1780521364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4005040 con 0x7f79e0102c00 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79dffff700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 0x7f79e0115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79e4b7a700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0115820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009180 tx=0x7f79d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d400e040 con 0x7f79e0102c00 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79d4013420 con 0x7f79e0102c00 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d401c630 con 0x7f79e0102c00 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e010f960 con 0x7f79e0102c00 2023-12-17T12:04:49.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.237+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e010fea0 con 0x7f79e0102c00 2023-12-17T12:04:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.238+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e00fc390 con 0x7f79e0102c00 2023-12-17T12:04:49.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.239+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f79d40139e0 con 0x7f79e0102c00 2023-12-17T12:04:49.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.240+0000 7f79dd7fa700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f79d006ce60 0x7f79d006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:49.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.240+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f79d408d640 con 0x7f79e0102c00 2023-12-17T12:04:49.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.241+0000 7f79dffff700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f79d006ce60 0x7f79d006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:49.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.241+0000 7f79dffff700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f79d006ce60 0x7f79d006f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009fd0 tx=0x7f79cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:49.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.245+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f79d405b010 con 0x7f79e0102c00 2023-12-17T12:04:49.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.475+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79e0110e70 con 0x7f79d006ce60 2023-12-17T12:04:49.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.476+0000 7f79dd7fa700 1 -- 172.21.15.2:0/1780521364 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f79e0110e70 con 0x7f79d006ce60 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f79d006ce60 msgr2=0x7f79d006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f79d006ce60 0x7f79d006f310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009fd0 tx=0x7f79cc00b040 comp rx=0 tx=0).stop 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 msgr2=0x7f79e0115820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0115820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009180 tx=0x7f79d4009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 shutdown_connections 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f79d006ce60 0x7f79d006f310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79e0102c00 0x7f79e0115820 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 --2- 172.21.15.2:0/1780521364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e01035a0 0x7f79e0115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 >> 172.21.15.2:0/1780521364 conn(0x7f79e00f8790 msgr2=0x7f79e00fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 shutdown_connections 2023-12-17T12:04:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.479+0000 7f79e6dde700 1 -- 172.21.15.2:0/1780521364 wait complete. 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 -- 172.21.15.2:0/1677606035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 msgr2=0x7f4c90102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 --2- 172.21.15.2:0/1677606035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90102fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4c84004940 tx=0x7f4c84009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 -- 172.21.15.2:0/1677606035 shutdown_connections 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 --2- 172.21.15.2:0/1677606035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c901035a0 0x7f4c900fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 --2- 172.21.15.2:0/1677606035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90102fd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 -- 172.21.15.2:0/1677606035 >> 172.21.15.2:0/1677606035 conn(0x7f4c900f8790 msgr2=0x7f4c900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 -- 172.21.15.2:0/1677606035 shutdown_connections 2023-12-17T12:04:49.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.618+0000 7f4c971e4700 1 -- 172.21.15.2:0/1677606035 wait complete. 2023-12-17T12:04:49.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.619+0000 7f4c971e4700 1 Processor -- start 2023-12-17T12:04:49.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.619+0000 7f4c971e4700 1 -- start start 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c971e4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c971e4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c901035a0 0x7f4c90115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c971e4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c901163b0 con 0x7f4c90102c00 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c971e4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9010f6e0 con 0x7f4c901035a0 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c94f80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c94f80700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90115820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50694/0 (socket says 172.21.15.2:50694) 2023-12-17T12:04:49.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c94f80700 1 -- 172.21.15.2:0/3017773942 learned_addr learned my addr 172.21.15.2:0/3017773942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c94f80700 1 -- 172.21.15.2:0/3017773942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c901035a0 msgr2=0x7f4c90115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c94f80700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c901035a0 0x7f4c90115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.620+0000 7f4c94f80700 1 -- 172.21.15.2:0/3017773942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84005040 con 0x7f4c90102c00 2023-12-17T12:04:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.621+0000 7f4c94f80700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90115820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009360 tx=0x7f4c84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:49.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.621+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8400e040 con 0x7f4c90102c00 2023-12-17T12:04:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.621+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c84004290 con 0x7f4c90102c00 2023-12-17T12:04:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.621+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9010f960 con 0x7f4c90102c00 2023-12-17T12:04:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.621+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8401c630 con 0x7f4c90102c00 2023-12-17T12:04:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.621+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9010fea0 con 0x7f4c90102c00 2023-12-17T12:04:49.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.622+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900fc390 con 0x7f4c90102c00 2023-12-17T12:04:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.623+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f4c8400bc50 con 0x7f4c90102c00 2023-12-17T12:04:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.624+0000 7f4c8d7fa700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4c8006ce70 0x7f4c8006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.624+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4c8408d690 con 0x7f4c90102c00 2023-12-17T12:04:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.625+0000 7f4c8ffff700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4c8006ce70 0x7f4c8006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:49.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.625+0000 7f4c8ffff700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4c8006ce70 0x7f4c8006f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c90111050 tx=0x7f4c7c009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:49.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.629+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c8405b090 con 0x7f4c90102c00 2023-12-17T12:04:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.851+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c9004bbf0 con 0x7f4c8006ce70 2023-12-17T12:04:49.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.861+0000 7f4c8d7fa700 1 -- 172.21.15.2:0/3017773942 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4c9004bbf0 con 0x7f4c8006ce70 2023-12-17T12:04:49.863 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:04:49.863 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 72s ago 14m 16.0M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:04:49.863 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (2m) 72s ago 14m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:04:49.863 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (2m) 8s ago 13m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:04:49.863 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (4m) 72s ago 14m 79.6M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (9m) 72s ago 9m 6652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (9m) 72s ago 9m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (9m) 8s ago 9m 5124M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (9m) 8s ago 9m 16.4M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (6m) 72s ago 15m 520M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (6m) 8s ago 13m 453M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (3m) 72s ago 15m 66.4M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (3m) 8s ago 13m 54.0M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (5m) 72s ago 14m 8288k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (5m) 8s ago 13m 8602k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (2m) 72s ago 12m 120M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (111s) 72s ago 12m 125M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a68897527efb 2023-12-17T12:04:49.864 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (77s) 72s ago 12m 12.8M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 02b7236a4a7b 2023-12-17T12:04:49.865 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (43s) 8s ago 11m 131M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a0f481fd5b19 2023-12-17T12:04:49.865 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (11s) 8s ago 11m 12.5M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 c392322b1e99 2023-12-17T12:04:49.865 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (10m) 8s ago 10m 890M 2642M 17.2.7-125-g1f2f5510 60cc83a9c8f1 26fa57084f71 2023-12-17T12:04:49.865 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 72s ago 13m 59.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.863+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4c8006ce70 msgr2=0x7f4c8006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.863+0000 7f4c971e4700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4c8006ce70 0x7f4c8006f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c90111050 tx=0x7f4c7c009ce0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 msgr2=0x7f4c90115820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90115820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009360 tx=0x7f4c84009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 shutdown_connections 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f4c8006ce70 0x7f4c8006f320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c90102c00 0x7f4c90115820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 --2- 172.21.15.2:0/3017773942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c901035a0 0x7f4c90115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 >> 172.21.15.2:0/3017773942 conn(0x7f4c900f8790 msgr2=0x7f4c900fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 shutdown_connections 2023-12-17T12:04:49.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:49.864+0000 7f4c971e4700 1 -- 172.21.15.2:0/3017773942 wait complete. 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.002+0000 7f08b94d4700 1 -- 172.21.15.2:0/247919821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b41035a0 msgr2=0x7f08b40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.002+0000 7f08b94d4700 1 --2- 172.21.15.2:0/247919821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b41035a0 0x7f08b40fcc10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08a8004940 tx=0x7f08a8009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 -- 172.21.15.2:0/247919821 shutdown_connections 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 --2- 172.21.15.2:0/247919821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b41035a0 0x7f08b40fcc10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 --2- 172.21.15.2:0/247919821 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08b4102c00 0x7f08b4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 -- 172.21.15.2:0/247919821 >> 172.21.15.2:0/247919821 conn(0x7f08b40f8790 msgr2=0x7f08b40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:50.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 -- 172.21.15.2:0/247919821 shutdown_connections 2023-12-17T12:04:50.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 -- 172.21.15.2:0/247919821 wait complete. 2023-12-17T12:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.003+0000 7f08b94d4700 1 Processor -- start 2023-12-17T12:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b94d4700 1 -- start start 2023-12-17T12:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b94d4700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 0x7f08b4113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b94d4700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08b41035a0 0x7f08b4113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b94d4700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4114210 con 0x7f08b4102c00 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b94d4700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b410d500 con 0x7f08b41035a0 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 0x7f08b4113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b2ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 0x7f08b4113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50716/0 (socket says 172.21.15.2:50716) 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.004+0000 7f08b2ffd700 1 -- 172.21.15.2:0/1485216952 learned_addr learned my addr 172.21.15.2:0/1485216952 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b27fc700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08b41035a0 0x7f08b4113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b2ffd700 1 -- 172.21.15.2:0/1485216952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08b41035a0 msgr2=0x7f08b4113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b2ffd700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08b41035a0 0x7f08b4113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b2ffd700 1 -- 172.21.15.2:0/1485216952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8005040 con 0x7f08b4102c00 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b2ffd700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 0x7f08b4113680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08a4002a50 tx=0x7f08a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a4007cc0 con 0x7f08b4102c00 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f08a400f040 con 0x7f08b4102c00 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a4009540 con 0x7f08b4102c00 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b410d7e0 con 0x7f08b4102c00 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.005+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b410dd20 con 0x7f08b4102c00 2023-12-17T12:04:50.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.006+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b4113330 con 0x7f08b4102c00 2023-12-17T12:04:50.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.007+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f08a40096a0 con 0x7f08b4102c00 2023-12-17T12:04:50.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.008+0000 7f089b7fe700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f089c06ce70 0x7f089c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.008+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f08a408bfe0 con 0x7f08b4102c00 2023-12-17T12:04:50.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.009+0000 7f08b27fc700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f089c06ce70 0x7f089c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.009+0000 7f08b27fc700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f089c06ce70 0x7f089c06f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b020 tx=0x7f08a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:50.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.013+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f08a40599d0 con 0x7f08b4102c00 2023-12-17T12:04:50.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:49 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 60/381 objects degraded (15.748%), 15 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:50.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:49 smithi119 ceph-mon[177559]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:50.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:49 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 60/381 objects degraded (15.748%), 15 pgs degraded (PG_DEGRADED) 2023-12-17T12:04:50.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:49 smithi002 ceph-mon[211741]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.313+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f08b410ec20 con 0x7f08b4102c00 2023-12-17T12:04:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.314+0000 7f089b7fe700 1 -- 172.21.15.2:0/1485216952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+831 (secure 0 0 0) 0x7f08a4059560 con 0x7f08b4102c00 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:50.316 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 1, 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 5 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 5, 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 9 2023-12-17T12:04:50.317 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:04:50.318 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:04:50.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f089c06ce70 msgr2=0x7f089c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f089c06ce70 0x7f089c06f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f08a800b020 tx=0x7f08a8009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 msgr2=0x7f08b4113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 0x7f08b4113680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08a4002a50 tx=0x7f08a40046b0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 shutdown_connections 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f089c06ce70 0x7f089c06f320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08b4102c00 0x7f08b4113680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 --2- 172.21.15.2:0/1485216952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08b41035a0 0x7f08b4113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 >> 172.21.15.2:0/1485216952 conn(0x7f08b40f8790 msgr2=0x7f08b40fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.316+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 shutdown_connections 2023-12-17T12:04:50.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.317+0000 7f08b94d4700 1 -- 172.21.15.2:0/1485216952 wait complete. 2023-12-17T12:04:50.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.456+0000 7f6180423700 1 -- 172.21.15.2:0/1035234053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 msgr2=0x7f6178102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.456+0000 7f6180423700 1 --2- 172.21.15.2:0/1035234053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178102fd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6174004940 tx=0x7f6174009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.457+0000 7f6180423700 1 -- 172.21.15.2:0/1035234053 shutdown_connections 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.457+0000 7f6180423700 1 --2- 172.21.15.2:0/1035234053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 0x7f61780fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.457+0000 7f6180423700 1 --2- 172.21.15.2:0/1035234053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178102fd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.457+0000 7f6180423700 1 -- 172.21.15.2:0/1035234053 >> 172.21.15.2:0/1035234053 conn(0x7f61780f8790 msgr2=0x7f61780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.457+0000 7f6180423700 1 -- 172.21.15.2:0/1035234053 shutdown_connections 2023-12-17T12:04:50.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.457+0000 7f6180423700 1 -- 172.21.15.2:0/1035234053 wait complete. 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f6180423700 1 Processor -- start 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f6180423700 1 -- start start 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f6180423700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f6180423700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 0x7f6178115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f6180423700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61781163d0 con 0x7f6178102c00 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f6180423700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617810f700 con 0x7f61781035a0 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f617e1bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f617e1bf700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50738/0 (socket says 172.21.15.2:50738) 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.458+0000 7f617e1bf700 1 -- 172.21.15.2:0/526360762 learned_addr learned my addr 172.21.15.2:0/526360762 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f617d9be700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 0x7f6178115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f617e1bf700 1 -- 172.21.15.2:0/526360762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 msgr2=0x7f6178115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f617e1bf700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 0x7f6178115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f617e1bf700 1 -- 172.21.15.2:0/526360762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6174005040 con 0x7f6178102c00 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f617d9be700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 0x7f6178115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f617e1bf700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178115840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6174009360 tx=0x7f6174009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617400e040 con 0x7f6178102c00 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f617400bc50 con 0x7f6178102c00 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.459+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617810f980 con 0x7f6178102c00 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.460+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617401c630 con 0x7f6178102c00 2023-12-17T12:04:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.460+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617810fec0 con 0x7f6178102c00 2023-12-17T12:04:50.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.461+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61780fc390 con 0x7f6178102c00 2023-12-17T12:04:50.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.462+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f6174013420 con 0x7f6178102c00 2023-12-17T12:04:50.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.463+0000 7f616effd700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f616406ce70 0x7f616406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.463+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f617408d5c0 con 0x7f6178102c00 2023-12-17T12:04:50.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.463+0000 7f617d9be700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f616406ce70 0x7f616406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.464+0000 7f617d9be700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f616406ce70 0x7f616406f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6168009fd0 tx=0x7f616800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:50.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.467+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f617405afb0 con 0x7f6178102c00 2023-12-17T12:04:50.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.724+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6178110e20 con 0x7f6178102c00 2023-12-17T12:04:50.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.725+0000 7f616effd700 1 -- 172.21.15.2:0/526360762 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f617405ab40 con 0x7f6178102c00 2023-12-17T12:04:50.727 INFO:teuthology.orchestra.run.smithi002.stdout:e19 2023-12-17T12:04:50.727 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:04:50.727 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 19 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-12-17T11:54:56.518485+0000 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2023-12-17T12:02:11.885042+0000 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2023-12-17T12:04:50.728 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 60 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 47 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-17T12:04:50.729 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 2 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24315,1=24311} 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3] 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data enabled 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2023-12-17T12:04:50.730 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 1 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.atwfoy{0:24315} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.2:6828/12221605,v1:172.21.15.2:6829/12221605] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.mzkvrk{1:24311} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.119:6824/2104379829,v1:172.21.15.119:6825/2104379829] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi002.ercyvj{-1:14518} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.2:6826/3968194298,v1:172.21.15.2:6827/3968194298] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:50.731 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.cephfs.smithi119.qgnwfs{-1:24323} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.119:6826/1797418404,v1:172.21.15.119:6827/1797418404] compat {c=[1],r=[1],i=[7ff]}] 2023-12-17T12:04:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.727+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f616406ce70 msgr2=0x7f616406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.727+0000 7f6180423700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f616406ce70 0x7f616406f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6168009fd0 tx=0x7f616800b040 comp rx=0 tx=0).stop 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.727+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 msgr2=0x7f6178115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.727+0000 7f6180423700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178115840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6174009360 tx=0x7f6174009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 shutdown_connections 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f616406ce70 0x7f616406f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178102c00 0x7f6178115840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 --2- 172.21.15.2:0/526360762 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61781035a0 0x7f6178115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 >> 172.21.15.2:0/526360762 conn(0x7f61780f8790 msgr2=0x7f61780fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 shutdown_connections 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.728+0000 7f6180423700 1 -- 172.21.15.2:0/526360762 wait complete. 2023-12-17T12:04:50.733 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 19 2023-12-17T12:04:50.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 -- 172.21.15.2:0/2616196231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 msgr2=0x7f76440fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 --2- 172.21.15.2:0/2616196231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f76440fcc10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7638004940 tx=0x7f7638009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:50.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 -- 172.21.15.2:0/2616196231 shutdown_connections 2023-12-17T12:04:50.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 --2- 172.21.15.2:0/2616196231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f76440fcc10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 --2- 172.21.15.2:0/2616196231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102c00 0x7f7644102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 -- 172.21.15.2:0/2616196231 >> 172.21.15.2:0/2616196231 conn(0x7f76440f8790 msgr2=0x7f76440faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:50.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 -- 172.21.15.2:0/2616196231 shutdown_connections 2023-12-17T12:04:50.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.869+0000 7f7648bac700 1 -- 172.21.15.2:0/2616196231 wait complete. 2023-12-17T12:04:50.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.870+0000 7f7648bac700 1 Processor -- start 2023-12-17T12:04:50.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.871+0000 7f7648bac700 1 -- start start 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.871+0000 7f7648bac700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102c00 0x7f764406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.871+0000 7f7648bac700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f7644070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.871+0000 7f7648bac700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644070a80 con 0x7f76441035a0 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.871+0000 7f7648bac700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7644070bf0 con 0x7f7644102c00 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f7644070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f7644070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50768/0 (socket says 172.21.15.2:50768) 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 -- 172.21.15.2:0/3781609883 learned_addr learned my addr 172.21.15.2:0/3781609883 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f764259c700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102c00 0x7f764406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 -- 172.21.15.2:0/3781609883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102c00 msgr2=0x7f764406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102c00 0x7f764406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 -- 172.21.15.2:0/3781609883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7638005040 con 0x7f76441035a0 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7641d9b700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f7644070480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7638008d80 tx=0x7f7638009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7638021070 con 0x7f76441035a0 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f763801c400 con 0x7f76441035a0 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763800e070 con 0x7f76441035a0 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.872+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7644119810 con 0x7f76441035a0 2023-12-17T12:04:50.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.873+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7644119c10 con 0x7f76441035a0 2023-12-17T12:04:50.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.874+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76440fc390 con 0x7f76441035a0 2023-12-17T12:04:50.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.875+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f763801c950 con 0x7f76441035a0 2023-12-17T12:04:50.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.876+0000 7f7632ffd700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f762c06ce70 0x7f762c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:50.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.876+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f763808d400 con 0x7f76441035a0 2023-12-17T12:04:50.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.876+0000 7f764259c700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f762c06ce70 0x7f762c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:50.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.876+0000 7f764259c700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f762c06ce70 0x7f762c06f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7634004600 tx=0x7f763400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:50.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:50.880+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7638057360 con 0x7f76441035a0 2023-12-17T12:04:51.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.114+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76440fa950 con 0x7f762c06ce70 2023-12-17T12:04:51.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.115+0000 7f7632ffd700 1 -- 172.21.15.2:0/3781609883 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f76440fa950 con 0x7f762c06ce70 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "11/21 daemons upgraded", 2023-12-17T12:04:51.117 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Currently upgrading osd daemons", 2023-12-17T12:04:51.118 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": false 2023-12-17T12:04:51.118 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f762c06ce70 msgr2=0x7f762c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f762c06ce70 0x7f762c06f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7634004600 tx=0x7f763400b040 comp rx=0 tx=0).stop 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 msgr2=0x7f7644070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f7644070480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7638008d80 tx=0x7f7638009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 shutdown_connections 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f762c06ce70 0x7f762c06f320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7644102c00 0x7f764406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 --2- 172.21.15.2:0/3781609883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76441035a0 0x7f7644070480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 >> 172.21.15.2:0/3781609883 conn(0x7f76440f8790 msgr2=0x7f76440fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 shutdown_connections 2023-12-17T12:04:51.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.117+0000 7f7648bac700 1 -- 172.21.15.2:0/3781609883 wait complete. 2023-12-17T12:04:51.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:50 smithi119 ceph-mon[177559]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:51.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:50 smithi119 ceph-mon[177559]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:51.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:50 smithi119 ceph-mon[177559]: pgmap v137: 65 pgs: 7 active+undersized+degraded, 6 active+undersized, 52 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20/381 objects degraded (5.249%) 2023-12-17T12:04:51.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:50 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1485216952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:51.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:50 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/526360762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:51.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:50 smithi002 ceph-mon[211741]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:51.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:50 smithi002 ceph-mon[211741]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:51.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:50 smithi002 ceph-mon[211741]: pgmap v137: 65 pgs: 7 active+undersized+degraded, 6 active+undersized, 52 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20/381 objects degraded (5.249%) 2023-12-17T12:04:51.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:50 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1485216952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:04:51.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:50 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/526360762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 -- 172.21.15.2:0/2225755397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 msgr2=0x7fd8480fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 --2- 172.21.15.2:0/2225755397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd8480fcc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd838004940 tx=0x7fd838009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 -- 172.21.15.2:0/2225755397 shutdown_connections 2023-12-17T12:04:51.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 --2- 172.21.15.2:0/2225755397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd8480fcc10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 --2- 172.21.15.2:0/2225755397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 0x7fd848102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 -- 172.21.15.2:0/2225755397 >> 172.21.15.2:0/2225755397 conn(0x7fd8480f8790 msgr2=0x7fd8480faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 -- 172.21.15.2:0/2225755397 shutdown_connections 2023-12-17T12:04:51.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.257+0000 7fd85000d700 1 -- 172.21.15.2:0/2225755397 wait complete. 2023-12-17T12:04:51.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.258+0000 7fd85000d700 1 Processor -- start 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.258+0000 7fd85000d700 1 -- start start 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd85000d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 0x7fd8481157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd85000d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd848115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd85000d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848116340 con 0x7fd8481035a0 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd85000d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84810f670 con 0x7fd848102c00 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84d5a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd848115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84d5a8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd848115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50780/0 (socket says 172.21.15.2:50780) 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84d5a8700 1 -- 172.21.15.2:0/2837826362 learned_addr learned my addr 172.21.15.2:0/2837826362 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84dda9700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 0x7fd8481157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84d5a8700 1 -- 172.21.15.2:0/2837826362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 msgr2=0x7fd8481157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84d5a8700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 0x7fd8481157b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84d5a8700 1 -- 172.21.15.2:0/2837826362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd838005040 con 0x7fd8481035a0 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.259+0000 7fd84dda9700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 0x7fd8481157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:04:51.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.260+0000 7fd84d5a8700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd848115cf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd838009180 tx=0x7fd838009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:51.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.260+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83800e040 con 0x7fd8481035a0 2023-12-17T12:04:51.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.260+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd838004290 con 0x7fd8481035a0 2023-12-17T12:04:51.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.260+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84810f8f0 con 0x7fd8481035a0 2023-12-17T12:04:51.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.260+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83801c3f0 con 0x7fd8481035a0 2023-12-17T12:04:51.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.260+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84810fe30 con 0x7fd8481035a0 2023-12-17T12:04:51.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.261+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480fc390 con 0x7fd8481035a0 2023-12-17T12:04:51.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.262+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fd83800bc50 con 0x7fd8481035a0 2023-12-17T12:04:51.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.263+0000 7fd83e7fc700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd83406ce70 0x7fd83406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:51.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.263+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd83808d5b0 con 0x7fd8481035a0 2023-12-17T12:04:51.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.263+0000 7fd84dda9700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd83406ce70 0x7fd83406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:51.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.264+0000 7fd84dda9700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd83406ce70 0x7fd83406f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd844007fd0 tx=0x7fd844009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:51.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.267+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd83805af80 con 0x7fd8481035a0 2023-12-17T12:04:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.569+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd84810fa80 con 0x7fd8481035a0 2023-12-17T12:04:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.570+0000 7fd83e7fc700 1 -- 172.21.15.2:0/2837826362 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+758 (secure 0 0 0) 0x7fd84810fa80 con 0x7fd8481035a0 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 20/381 objects degraded (5.249%), 7 pgs degraded 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 20/381 objects degraded (5.249%), 7 pgs degraded 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2023-12-17T12:04:51.572 INFO:teuthology.orchestra.run.smithi002.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2023-12-17T12:04:51.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd83406ce70 msgr2=0x7fd83406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:51.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd83406ce70 0x7fd83406f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd844007fd0 tx=0x7fd844009f60 comp rx=0 tx=0).stop 2023-12-17T12:04:51.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 msgr2=0x7fd848115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd848115cf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd838009180 tx=0x7fd838009e30 comp rx=0 tx=0).stop 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 shutdown_connections 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fd83406ce70 0x7fd83406f320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd848102c00 0x7fd8481157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 --2- 172.21.15.2:0/2837826362 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8481035a0 0x7fd848115cf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 >> 172.21.15.2:0/2837826362 conn(0x7fd8480f8790 msgr2=0x7fd8480fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.572+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 shutdown_connections 2023-12-17T12:04:51.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:04:51.573+0000 7fd85000d700 1 -- 172.21.15.2:0/2837826362 wait complete. 2023-12-17T12:04:51.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:51 smithi002 ceph-mon[211741]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:51.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:51 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2837826362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:04:52.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:51 smithi119 ceph-mon[177559]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:52.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:51 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2837826362' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:04:53.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:52 smithi119 ceph-mon[177559]: pgmap v138: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:53.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:52 smithi002 ceph-mon[211741]: pgmap v138: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:54.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:53 smithi119 ceph-mon[177559]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/381 objects degraded (5.249%), 7 pgs degraded) 2023-12-17T12:04:54.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:53 smithi002 ceph-mon[211741]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/381 objects degraded (5.249%), 7 pgs degraded) 2023-12-17T12:04:55.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:54 smithi119 ceph-mon[177559]: pgmap v139: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:55.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:54 smithi002 ceph-mon[211741]: pgmap v139: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:57 smithi119 ceph-mon[177559]: pgmap v140: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:57 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:57.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:57 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:57 smithi002 ceph-mon[211741]: pgmap v140: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:57 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:57.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:57 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:04:58.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:58.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:04:59.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:04:59 smithi119 ceph-mon[177559]: pgmap v141: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:04:59.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:04:59 smithi002 ceph-mon[211741]: pgmap v141: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:01.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:01 smithi119 ceph-mon[177559]: pgmap v142: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:01.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:01 smithi002 ceph-mon[211741]: pgmap v142: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:02.638 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:02 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:05:02.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:02 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:05:03.636 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:03 smithi119 ceph-mon[177559]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:05:03.636 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:03 smithi119 ceph-mon[177559]: Upgrade: osd.5 is safe to restart 2023-12-17T12:05:03.637 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:03 smithi119 ceph-mon[177559]: pgmap v143: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:03.637 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:03 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:03.637 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:03 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T12:05:03.637 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:03 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:05:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:03 smithi002 ceph-mon[211741]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-17T12:05:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:03 smithi002 ceph-mon[211741]: Upgrade: osd.5 is safe to restart 2023-12-17T12:05:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:03 smithi002 ceph-mon[211741]: pgmap v143: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:03 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:03 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T12:05:03.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:03 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:05:04.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:04 smithi119 ceph-mon[177559]: Upgrade: Updating osd.5 2023-12-17T12:05:04.635 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:04 smithi119 ceph-mon[177559]: Deploying daemon osd.5 on smithi119 2023-12-17T12:05:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:04 smithi002 ceph-mon[211741]: Upgrade: Updating osd.5 2023-12-17T12:05:04.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:04 smithi002 ceph-mon[211741]: Deploying daemon osd.5 on smithi119 2023-12-17T12:05:05.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:05 smithi119 ceph-mon[177559]: pgmap v144: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:05.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:05 smithi002 ceph-mon[211741]: pgmap v144: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:06.174 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:05 smithi119 systemd[1]: Stopping Ceph osd.5 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:06.174 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:06 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[140280]: 2023-12-17T12:05:06.170+0000 7fe176c14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:06.174 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:06 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[140280]: 2023-12-17T12:05:06.170+0000 7fe176c14700 -1 osd.5 77 *** Got signal Terminated *** 2023-12-17T12:05:06.174 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:06 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[140280]: 2023-12-17T12:05:06.170+0000 7fe176c14700 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:06.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:06 smithi119 ceph-mon[177559]: osd.5 marked itself down and dead 2023-12-17T12:05:06.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:06 smithi119 ceph-mon[177559]: pgmap v145: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:06.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:06 smithi002 ceph-mon[211741]: osd.5 marked itself down and dead 2023-12-17T12:05:06.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:06 smithi002 ceph-mon[211741]: pgmap v145: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:07.369 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:07 smithi119 bash[201844]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5 2023-12-17T12:05:07.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:07 smithi119 ceph-mon[177559]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:05:07.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:07 smithi119 ceph-mon[177559]: osdmap e78: 6 total, 5 up, 6 in 2023-12-17T12:05:07.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:07 smithi002 ceph-mon[211741]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-17T12:05:07.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:07 smithi002 ceph-mon[211741]: osdmap e78: 6 total, 5 up, 6 in 2023-12-17T12:05:08.567 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:08 smithi119 ceph-mon[177559]: osdmap e79: 6 total, 5 up, 6 in 2023-12-17T12:05:08.567 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:08 smithi119 ceph-mon[177559]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:08.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:08 smithi002 ceph-mon[211741]: osdmap e79: 6 total, 5 up, 6 in 2023-12-17T12:05:08.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:08 smithi002 ceph-mon[211741]: pgmap v148: 65 pgs: 13 stale+active+clean, 52 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:08.852 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:08 smithi119 systemd[1]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.5.service: Succeeded. 2023-12-17T12:05:08.853 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:08 smithi119 systemd[1]: Stopped Ceph osd.5 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:05:09.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:08 smithi119 systemd[1]: Starting Ceph osd.5 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:10.290 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-17T12:05:10.290 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-17T12:05:10.290 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-17T12:05:10.290 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-17T12:05:10.291 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-17T12:05:10.291 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-17T12:05:10.291 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202114]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-17T12:05:10.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:10 smithi119 ceph-mon[177559]: Health check failed: Degraded data redundancy: 46/381 objects degraded (12.073%), 9 pgs degraded (PG_DEGRADED) 2023-12-17T12:05:10.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:10 smithi002 ceph-mon[211741]: Health check failed: Degraded data redundancy: 46/381 objects degraded (12.073%), 9 pgs degraded (PG_DEGRADED) 2023-12-17T12:05:11.361 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 ceph-osd[202404]: -- 172.21.15.119:0/2569778102 <== mon.1 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f981e416c0 con 0x55f981e11000 2023-12-17T12:05:11.362 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 bash[202366]: 5bcc9ec7f9bc2620c23b769088dcbb19e0267db62e6067a1137f22b1e42e7d63 2023-12-17T12:05:11.362 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:10 smithi119 systemd[1]: Started Ceph osd.5 for 1a404768-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:05:11.657 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:11 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:05:11.438+0000 7efd48ce4640 -1 Falling back to public interface 2023-12-17T12:05:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:11 smithi119 ceph-mon[177559]: pgmap v149: 65 pgs: 9 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 42 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:05:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:11 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:11 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:11.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:11 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:05:11.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:11 smithi002 ceph-mon[211741]: pgmap v149: 65 pgs: 9 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 42 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46/381 objects degraded (12.073%) 2023-12-17T12:05:11.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:11 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:11.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:11 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:11.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:11 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:05:13.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:13 smithi119 ceph-mon[177559]: pgmap v150: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:13 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:13.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:13 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:13 smithi002 ceph-mon[211741]: pgmap v150: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:13.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:14.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:14.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:14 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:14.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:14 smithi002 ceph-mon[211741]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:15.157 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:15.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:14 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:15.158 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:14 smithi119 ceph-mon[177559]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:15.907 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:15 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:05:15.713+0000 7efd48ce4640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-17T12:05:16.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:16.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:15 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:16.407 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:16 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:05:16.183+0000 7efd48ce4640 -1 osd.5 77 log_to_monitors true 2023-12-17T12:05:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:16.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:15 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:16 smithi002 ceph-mon[211741]: from='osd.5 [v2:172.21.15.119:6816/2475998087,v1:172.21.15.119:6817/2475998087]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T12:05:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:16 smithi002 ceph-mon[211741]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T12:05:17.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:16 smithi002 ceph-mon[211741]: pgmap v152: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:17.407 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:05:16 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:05:16.979+0000 7efd3694e700 -1 osd.5 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:05:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:16 smithi119 ceph-mon[177559]: from='osd.5 [v2:172.21.15.119:6816/2475998087,v1:172.21.15.119:6817/2475998087]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T12:05:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:16 smithi119 ceph-mon[177559]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T12:05:17.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:16 smithi119 ceph-mon[177559]: pgmap v152: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:18.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:17 smithi119 ceph-mon[177559]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T12:05:18.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:17 smithi119 ceph-mon[177559]: from='osd.5 [v2:172.21.15.119:6816/2475998087,v1:172.21.15.119:6817/2475998087]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:05:18.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:17 smithi119 ceph-mon[177559]: osdmap e80: 6 total, 5 up, 6 in 2023-12-17T12:05:18.154 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:17 smithi119 ceph-mon[177559]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:05:18.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:17 smithi002 ceph-mon[211741]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T12:05:18.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:17 smithi002 ceph-mon[211741]: from='osd.5 [v2:172.21.15.119:6816/2475998087,v1:172.21.15.119:6817/2475998087]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:05:18.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:17 smithi002 ceph-mon[211741]: osdmap e80: 6 total, 5 up, 6 in 2023-12-17T12:05:18.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:17 smithi002 ceph-mon[211741]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]: dispatch 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: osd.5 [v2:172.21.15.119:6816/2475998087,v1:172.21.15.119:6817/2475998087] boot 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: osdmap e81: 6 total, 6 up, 6 in 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: Health check update: Degraded data redundancy: 61/381 objects degraded (16.010%), 14 pgs degraded (PG_DEGRADED) 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:05:19.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: pgmap v155: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-17T12:05:19.409 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.410 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:18 smithi119 ceph-mon[177559]: osdmap e82: 6 total, 6 up, 6 in 2023-12-17T12:05:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-17T12:05:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: osd.5 [v2:172.21.15.119:6816/2475998087,v1:172.21.15.119:6817/2475998087] boot 2023-12-17T12:05:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: osdmap e81: 6 total, 6 up, 6 in 2023-12-17T12:05:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T12:05:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: Health check update: Degraded data redundancy: 61/381 objects degraded (16.010%), 14 pgs degraded (PG_DEGRADED) 2023-12-17T12:05:19.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: pgmap v155: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-17T12:05:19.476 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:05:19.477 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:05:19.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:19.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:18 smithi002 ceph-mon[211741]: osdmap e82: 6 total, 6 up, 6 in 2023-12-17T12:05:19.478 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:19 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[211718]: 2023-12-17T12:05:19.202+0000 7feaa4fa3700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-17T12:05:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:19 smithi119 ceph-mon[177559]: Upgrade: Setting container_image for all osd 2023-12-17T12:05:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:19 smithi119 ceph-mon[177559]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-17T12:05:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:19 smithi119 ceph-mon[177559]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-17T12:05:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:19 smithi119 ceph-mon[177559]: pgmap v156: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:19 smithi119 ceph-mon[177559]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-17T12:05:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:19 smithi002 ceph-mon[211741]: Upgrade: Setting container_image for all osd 2023-12-17T12:05:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:19 smithi002 ceph-mon[211741]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-17T12:05:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:19 smithi002 ceph-mon[211741]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-17T12:05:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:19 smithi002 ceph-mon[211741]: pgmap v156: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 61/381 objects degraded (16.010%) 2023-12-17T12:05:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:19 smithi002 ceph-mon[211741]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-17T12:05:21.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3977938663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa464102c00 msgr2=0x7fa464102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:21.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3977938663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa464102c00 0x7fa464102fd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa460004940 tx=0x7fa460009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:21.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3977938663 shutdown_connections 2023-12-17T12:05:21.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3977938663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4641035a0 0x7fa4640fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3977938663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa464102c00 0x7fa464102fd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3977938663 >> 172.21.15.2:0/3977938663 conn(0x7fa4640f8790 msgr2=0x7fa4640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:21.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3977938663 shutdown_connections 2023-12-17T12:05:21.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.728+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3977938663 wait complete. 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.729+0000 7fa46bf3d700 1 Processor -- start 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.729+0000 7fa46bf3d700 1 -- start start 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.729+0000 7fa46bf3d700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa464102c00 0x7fa46406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.729+0000 7fa46bf3d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 0x7fa464070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.729+0000 7fa46bf3d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4641114e0 con 0x7fa4641035a0 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.729+0000 7fa46bf3d700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464111650 con 0x7fa464102c00 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 0x7fa464070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 0x7fa464070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55968/0 (socket says 172.21.15.2:55968) 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 -- 172.21.15.2:0/3949131053 learned_addr learned my addr 172.21.15.2:0/3949131053 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:05:21.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa469cd9700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa464102c00 0x7fa46406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 -- 172.21.15.2:0/3949131053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa464102c00 msgr2=0x7fa46406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa464102c00 0x7fa46406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 -- 172.21.15.2:0/3949131053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460005040 con 0x7fa4641035a0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.730+0000 7fa4694d8700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 0x7fa464070480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c890 tx=0x7fa4540044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.731+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4540106f0 con 0x7fa4641035a0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.731+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa454010d00 con 0x7fa4641035a0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.731+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa454012ea0 con 0x7fa4641035a0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.731+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464070b10 con 0x7fa4641035a0 2023-12-17T12:05:21.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.731+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46411e1e0 con 0x7fa4641035a0 2023-12-17T12:05:21.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.732+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4640fff10 con 0x7fa4641035a0 2023-12-17T12:05:21.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.733+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fa454010850 con 0x7fa4641035a0 2023-12-17T12:05:21.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.734+0000 7fa45a7fc700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa45006ce70 0x7fa45006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:21.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.734+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa45408c220 con 0x7fa4641035a0 2023-12-17T12:05:21.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.734+0000 7fa469cd9700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa45006ce70 0x7fa45006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:21.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.735+0000 7fa469cd9700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa45006ce70 0x7fa45006f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa46000b3b0 tx=0x7fa460009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:21.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.739+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa454056220 con 0x7fa4641035a0 2023-12-17T12:05:21.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.969+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa464071680 con 0x7fa45006ce70 2023-12-17T12:05:21.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.970+0000 7fa45a7fc700 1 -- 172.21.15.2:0/3949131053 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7fa464071680 con 0x7fa45006ce70 2023-12-17T12:05:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa45006ce70 msgr2=0x7fa45006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa45006ce70 0x7fa45006f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa46000b3b0 tx=0x7fa460009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:21.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 msgr2=0x7fa464070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 0x7fa464070480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c890 tx=0x7fa4540044c0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 shutdown_connections 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa45006ce70 0x7fa45006f320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa464102c00 0x7fa46406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 --2- 172.21.15.2:0/3949131053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4641035a0 0x7fa464070480 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 >> 172.21.15.2:0/3949131053 conn(0x7fa4640f8790 msgr2=0x7fa4640fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 shutdown_connections 2023-12-17T12:05:21.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:21.973+0000 7fa46bf3d700 1 -- 172.21.15.2:0/3949131053 wait complete. 2023-12-17T12:05:21.990 INFO:teuthology.orchestra.run.smithi002.stdout:true 2023-12-17T12:05:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.113+0000 7f5f35c99700 1 -- 172.21.15.2:0/3763744885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 msgr2=0x7f5f300fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.113+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3763744885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f300fcc10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f24004940 tx=0x7f5f24009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 -- 172.21.15.2:0/3763744885 shutdown_connections 2023-12-17T12:05:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3763744885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f300fcc10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3763744885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 0x7f5f30102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 -- 172.21.15.2:0/3763744885 >> 172.21.15.2:0/3763744885 conn(0x7f5f300f8790 msgr2=0x7f5f300faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 -- 172.21.15.2:0/3763744885 shutdown_connections 2023-12-17T12:05:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 -- 172.21.15.2:0/3763744885 wait complete. 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.114+0000 7f5f35c99700 1 Processor -- start 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f35c99700 1 -- start start 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f35c99700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 0x7f5f30115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f35c99700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f30115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f35c99700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f301163c0 con 0x7f5f301035a0 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f35c99700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3010f6f0 con 0x7f5f30102c00 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f2effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f30115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f2effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f30115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55982/0 (socket says 172.21.15.2:55982) 2023-12-17T12:05:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.115+0000 7f5f2effd700 1 -- 172.21.15.2:0/3152317014 learned_addr learned my addr 172.21.15.2:0/3152317014 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:05:22.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f2f7fe700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 0x7f5f30115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:22.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f2effd700 1 -- 172.21.15.2:0/3152317014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 msgr2=0x7f5f30115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:22.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f2effd700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 0x7f5f30115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f2effd700 1 -- 172.21.15.2:0/3152317014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24005040 con 0x7f5f301035a0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f2f7fe700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 0x7f5f30115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f2effd700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f30115d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009360 tx=0x7f5f24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2400e040 con 0x7f5f301035a0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3010f970 con 0x7f5f301035a0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f2400bc50 con 0x7f5f301035a0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2401c630 con 0x7f5f301035a0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.116+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3010feb0 con 0x7f5f301035a0 2023-12-17T12:05:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.118+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f300fc390 con 0x7f5f301035a0 2023-12-17T12:05:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.118+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f5f24013420 con 0x7f5f301035a0 2023-12-17T12:05:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.119+0000 7f5f17fff700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5f1806ce70 0x7f5f1806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.119+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5f2408d840 con 0x7f5f301035a0 2023-12-17T12:05:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.120+0000 7f5f2f7fe700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5f1806ce70 0x7f5f1806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.120+0000 7f5f2f7fe700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5f1806ce70 0x7f5f1806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009fd0 tx=0x7f5f2000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:22.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.124+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5f2405b190 con 0x7f5f301035a0 2023-12-17T12:05:22.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.360+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f30115500 con 0x7f5f1806ce70 2023-12-17T12:05:22.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.362+0000 7f5f17fff700 1 -- 172.21.15.2:0/3152317014 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f5f30115500 con 0x7f5f1806ce70 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5f1806ce70 msgr2=0x7f5f1806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5f1806ce70 0x7f5f1806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5f20009fd0 tx=0x7f5f2000b040 comp rx=0 tx=0).stop 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 msgr2=0x7f5f30115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f30115d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009360 tx=0x7f5f24009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 shutdown_connections 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5f1806ce70 0x7f5f1806f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:22.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5f30102c00 0x7f5f30115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 --2- 172.21.15.2:0/3152317014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f301035a0 0x7f5f30115d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 >> 172.21.15.2:0/3152317014 conn(0x7f5f300f8790 msgr2=0x7f5f300fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 shutdown_connections 2023-12-17T12:05:22.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:22.364+0000 7f5f35c99700 1 -- 172.21.15.2:0/3152317014 wait complete. 2023-12-17T12:05:22.381 INFO:teuthology.orchestra.run.smithi002.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-17T12:05:22.389 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:21 smithi002 ceph-mon[211741]: pgmap v158: 65 pgs: 8 active+undersized+degraded, 10 active+undersized, 47 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 27/381 objects degraded (7.087%) 2023-12-17T12:05:22.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:21 smithi119 ceph-mon[177559]: pgmap v158: 65 pgs: 8 active+undersized+degraded, 10 active+undersized, 47 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 27/381 objects degraded (7.087%) 2023-12-17T12:05:22.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch ps' 2023-12-17T12:05:23.156 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:05:23.302 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:22 smithi002 ceph-mon[211741]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:23.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:22 smithi119 ceph-mon[177559]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:24.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.377+0000 7f6799989700 1 -- 172.21.15.2:0/1260633241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6794102c00 msgr2=0x7f6794102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.377+0000 7f6799989700 1 --2- 172.21.15.2:0/1260633241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6794102c00 0x7f6794102fd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6784004940 tx=0x7f6784009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 -- 172.21.15.2:0/1260633241 shutdown_connections 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 --2- 172.21.15.2:0/1260633241 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67941035a0 0x7f67940fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 --2- 172.21.15.2:0/1260633241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6794102c00 0x7f6794102fd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 -- 172.21.15.2:0/1260633241 >> 172.21.15.2:0/1260633241 conn(0x7f67940f8790 msgr2=0x7f67940faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 -- 172.21.15.2:0/1260633241 shutdown_connections 2023-12-17T12:05:24.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 -- 172.21.15.2:0/1260633241 wait complete. 2023-12-17T12:05:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.378+0000 7f6799989700 1 Processor -- start 2023-12-17T12:05:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f6799989700 1 -- start start 2023-12-17T12:05:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f6799989700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6794102c00 0x7f6794115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f6799989700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 0x7f6794115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f6799989700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67941163b0 con 0x7f67941035a0 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f6799989700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679410f6e0 con 0x7f6794102c00 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f67927fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 0x7f6794115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f67927fc700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 0x7f6794115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56000/0 (socket says 172.21.15.2:56000) 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f67927fc700 1 -- 172.21.15.2:0/4131576925 learned_addr learned my addr 172.21.15.2:0/4131576925 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.379+0000 7f6792ffd700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6794102c00 0x7f6794115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f67927fc700 1 -- 172.21.15.2:0/4131576925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6794102c00 msgr2=0x7f6794115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f67927fc700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6794102c00 0x7f6794115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f67927fc700 1 -- 172.21.15.2:0/4131576925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784005040 con 0x7f67941035a0 2023-12-17T12:05:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f67927fc700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 0x7f6794115d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6788002a50 tx=0x7f6788004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:24.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6788007cc0 con 0x7f67941035a0 2023-12-17T12:05:24.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f678800f040 con 0x7f67941035a0 2023-12-17T12:05:24.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f678800d920 con 0x7f67941035a0 2023-12-17T12:05:24.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679410f9c0 con 0x7f67941035a0 2023-12-17T12:05:24.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.380+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679410ff00 con 0x7f67941035a0 2023-12-17T12:05:24.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.382+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67940fc390 con 0x7f67941035a0 2023-12-17T12:05:24.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.382+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f6788009680 con 0x7f67941035a0 2023-12-17T12:05:24.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.383+0000 7f677b7fe700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f677c06ce70 0x7f677c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:24.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.383+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f678808bfa0 con 0x7f67941035a0 2023-12-17T12:05:24.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.384+0000 7f6792ffd700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f677c06ce70 0x7f677c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:24.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.384+0000 7f6792ffd700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f677c06ce70 0x7f677c06f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f67840043d0 tx=0x7f6784009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:24.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.388+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f67880598f0 con 0x7f67941035a0 2023-12-17T12:05:24.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:23 smithi119 ceph-mon[177559]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:24.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:23 smithi119 ceph-mon[177559]: pgmap v159: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:24.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:23 smithi119 ceph-mon[177559]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/381 objects degraded (7.087%), 8 pgs degraded) 2023-12-17T12:05:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:23 smithi002 ceph-mon[211741]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:23 smithi002 ceph-mon[211741]: pgmap v159: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:23 smithi002 ceph-mon[211741]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 27/381 objects degraded (7.087%), 8 pgs degraded) 2023-12-17T12:05:24.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.610+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f67941154f0 con 0x7f677c06ce70 2023-12-17T12:05:24.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.621+0000 7f677b7fe700 1 -- 172.21.15.2:0/4131576925 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f67941154f0 con 0x7f677c06ce70 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (5m) 107s ago 15m 16.0M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (3m) 107s ago 15m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (3m) 10s ago 14m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (5m) 107s ago 14m 79.6M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (10m) 107s ago 10m 6652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (10m) 107s ago 10m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (10m) 10s ago 10m 5124M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (10m) 10s ago 10m 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (7m) 107s ago 16m 520M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (6m) 10s ago 14m 453M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:05:24.623 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (4m) 107s ago 16m 66.4M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (3m) 10s ago 14m 54.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (6m) 107s ago 15m 8288k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (6m) 10s ago 14m 8376k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (3m) 107s ago 13m 120M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (2m) 107s ago 12m 125M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a68897527efb 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (112s) 107s ago 12m 12.8M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 02b7236a4a7b 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (77s) 10s ago 12m 140M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a0f481fd5b19 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (46s) 10s ago 11m 126M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 c392322b1e99 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (13s) 10s ago 11m 12.5M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 5bcc9ec7f9bc 2023-12-17T12:05:24.624 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (5m) 107s ago 14m 59.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:05:24.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.623+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f677c06ce70 msgr2=0x7f677c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.623+0000 7f6799989700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f677c06ce70 0x7f677c06f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f67840043d0 tx=0x7f6784009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.623+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 msgr2=0x7f6794115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.623+0000 7f6799989700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 0x7f6794115d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6788002a50 tx=0x7f6788004600 comp rx=0 tx=0).stop 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 shutdown_connections 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f677c06ce70 0x7f677c06f320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6794102c00 0x7f6794115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 --2- 172.21.15.2:0/4131576925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67941035a0 0x7f6794115d60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 >> 172.21.15.2:0/4131576925 conn(0x7f67940f8790 msgr2=0x7f67940fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 shutdown_connections 2023-12-17T12:05:24.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:24.624+0000 7f6799989700 1 -- 172.21.15.2:0/4131576925 wait complete. 2023-12-17T12:05:24.986 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch upgrade status' 2023-12-17T12:05:25.430 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:05:26.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:25 smithi002 ceph-mon[211741]: pgmap v160: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:26.226 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:25 smithi002 ceph-mon[211741]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:26.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:25 smithi119 ceph-mon[177559]: pgmap v160: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:26.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:25 smithi119 ceph-mon[177559]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.551+0000 7faa25e5c700 1 -- 172.21.15.2:0/492253857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20102c00 msgr2=0x7faa20102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.551+0000 7faa25e5c700 1 --2- 172.21.15.2:0/492253857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20102c00 0x7faa20102fd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faa10004940 tx=0x7faa10009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.551+0000 7faa25e5c700 1 -- 172.21.15.2:0/492253857 shutdown_connections 2023-12-17T12:05:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.551+0000 7faa25e5c700 1 --2- 172.21.15.2:0/492253857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa201035a0 0x7faa200fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.551+0000 7faa25e5c700 1 --2- 172.21.15.2:0/492253857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa20102c00 0x7faa20102fd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:26.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.551+0000 7faa25e5c700 1 -- 172.21.15.2:0/492253857 >> 172.21.15.2:0/492253857 conn(0x7faa200f8790 msgr2=0x7faa200faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:26.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.552+0000 7faa25e5c700 1 -- 172.21.15.2:0/492253857 shutdown_connections 2023-12-17T12:05:26.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.552+0000 7faa25e5c700 1 -- 172.21.15.2:0/492253857 wait complete. 2023-12-17T12:05:26.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.552+0000 7faa25e5c700 1 Processor -- start 2023-12-17T12:05:26.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa25e5c700 1 -- start start 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa25e5c700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa20102c00 0x7faa20115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa25e5c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 0x7faa20115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa25e5c700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa20116450 con 0x7faa201035a0 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa25e5c700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2010f6f0 con 0x7faa20102c00 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa1effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 0x7faa20115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa1effd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 0x7faa20115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56022/0 (socket says 172.21.15.2:56022) 2023-12-17T12:05:26.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa1effd700 1 -- 172.21.15.2:0/3097114237 learned_addr learned my addr 172.21.15.2:0/3097114237 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.553+0000 7faa1f7fe700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa20102c00 0x7faa20115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa1effd700 1 -- 172.21.15.2:0/3097114237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa20102c00 msgr2=0x7faa20115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa1effd700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa20102c00 0x7faa20115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa1effd700 1 -- 172.21.15.2:0/3097114237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10005040 con 0x7faa201035a0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa1effd700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 0x7faa20115d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa1400b790 tx=0x7faa14009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1400f6f0 con 0x7faa201035a0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa1400fd00 con 0x7faa201035a0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2010f9d0 con 0x7faa201035a0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa140103a0 con 0x7faa201035a0 2023-12-17T12:05:26.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.554+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2010ff10 con 0x7faa201035a0 2023-12-17T12:05:26.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.555+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa200fc390 con 0x7faa201035a0 2023-12-17T12:05:26.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.556+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7faa1400f850 con 0x7faa201035a0 2023-12-17T12:05:26.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.557+0000 7faa07fff700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7faa0806ce70 0x7faa0806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:26.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.557+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faa1408c0a0 con 0x7faa201035a0 2023-12-17T12:05:26.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.558+0000 7faa1f7fe700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7faa0806ce70 0x7faa0806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:26.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.558+0000 7faa1f7fe700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7faa0806ce70 0x7faa0806f320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faa100043d0 tx=0x7faa10009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:26.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.562+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faa14059a70 con 0x7faa201035a0 2023-12-17T12:05:26.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.792+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa2004bb80 con 0x7faa0806ce70 2023-12-17T12:05:26.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.794+0000 7faa07fff700 1 -- 172.21.15.2:0/3097114237 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7faa2004bb80 con 0x7faa0806ce70 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40", 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "in_progress": true, 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "services_complete": [ 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "osd", 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr", 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "mon" 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "progress": "12/21 daemons upgraded", 2023-12-17T12:05:26.796 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-17T12:05:26.797 INFO:teuthology.orchestra.run.smithi002.stdout: "is_paused": true 2023-12-17T12:05:26.797 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:05:26.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7faa0806ce70 msgr2=0x7faa0806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:26.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7faa0806ce70 0x7faa0806f320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faa100043d0 tx=0x7faa10009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:26.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 msgr2=0x7faa20115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:26.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 0x7faa20115d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa1400b790 tx=0x7faa14009220 comp rx=0 tx=0).stop 2023-12-17T12:05:26.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 shutdown_connections 2023-12-17T12:05:26.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7faa0806ce70 0x7faa0806f320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:26.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa20102c00 0x7faa20115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:26.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 --2- 172.21.15.2:0/3097114237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa201035a0 0x7faa20115d70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:26.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.796+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 >> 172.21.15.2:0/3097114237 conn(0x7faa200f8790 msgr2=0x7faa200fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:26.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.797+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 shutdown_connections 2023-12-17T12:05:26.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:26.797+0000 7faa25e5c700 1 -- 172.21.15.2:0/3097114237 wait complete. 2023-12-17T12:05:27.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph health detail' 2023-12-17T12:05:27.578 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 -- 172.21.15.2:0/3836131891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 msgr2=0x7fbf4c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 --2- 172.21.15.2:0/3836131891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c102fd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c004940 tx=0x7fbf3c009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 -- 172.21.15.2:0/3836131891 shutdown_connections 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 --2- 172.21.15.2:0/3836131891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4c1035a0 0x7fbf4c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 --2- 172.21.15.2:0/3836131891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c102fd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 -- 172.21.15.2:0/3836131891 >> 172.21.15.2:0/3836131891 conn(0x7fbf4c0f8790 msgr2=0x7fbf4c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:28.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 -- 172.21.15.2:0/3836131891 shutdown_connections 2023-12-17T12:05:28.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.635+0000 7fbf52884700 1 -- 172.21.15.2:0/3836131891 wait complete. 2023-12-17T12:05:28.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.636+0000 7fbf52884700 1 Processor -- start 2023-12-17T12:05:28.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.636+0000 7fbf52884700 1 -- start start 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.636+0000 7fbf52884700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf52884700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4c1035a0 0x7fbf4c115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf52884700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c1163d0 con 0x7fbf4c102c00 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf52884700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c10f700 con 0x7fbf4c1035a0 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56028/0 (socket says 172.21.15.2:56028) 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4bfff700 1 -- 172.21.15.2:0/2464489283 learned_addr learned my addr 172.21.15.2:0/2464489283 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4b7fe700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4c1035a0 0x7fbf4c115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4bfff700 1 -- 172.21.15.2:0/2464489283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4c1035a0 msgr2=0x7fbf4c115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:28.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4bfff700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4c1035a0 0x7fbf4c115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.637+0000 7fbf4bfff700 1 -- 172.21.15.2:0/2464489283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c005040 con 0x7fbf4c102c00 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.638+0000 7fbf4bfff700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c115840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009360 tx=0x7fbf3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.638+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c00e040 con 0x7fbf4c102c00 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.638+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf3c013420 con 0x7fbf4c102c00 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.638+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf3c01c610 con 0x7fbf4c102c00 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.638+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c10f980 con 0x7fbf4c102c00 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.638+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c10fe70 con 0x7fbf4c102c00 2023-12-17T12:05:28.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.639+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c0fc390 con 0x7fbf4c102c00 2023-12-17T12:05:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.640+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fbf3c013590 con 0x7fbf4c102c00 2023-12-17T12:05:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.641+0000 7fbf48ff9700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbf3406ce70 0x7fbf3406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.641+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbf3c08d580 con 0x7fbf4c102c00 2023-12-17T12:05:28.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.642+0000 7fbf4b7fe700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbf3406ce70 0x7fbf3406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:28.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.642+0000 7fbf4b7fe700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbf3406ce70 0x7fbf3406f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c111070 tx=0x7fbf4000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:28.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.646+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbf3c05afa0 con 0x7fbf4c102c00 2023-12-17T12:05:28.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:28 smithi119 ceph-mon[177559]: pgmap v161: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:28 smithi119 ceph-mon[177559]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:28.658 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:28 smithi002 ceph-mon[211741]: pgmap v161: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:28 smithi002 ceph-mon[211741]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:05:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:28.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:28.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.945+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbf4c110e20 con 0x7fbf4c102c00 2023-12-17T12:05:28.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.945+0000 7fbf48ff9700 1 -- 172.21.15.2:0/2464489283 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+451 (secure 0 0 0) 0x7fbf3c05ab30 con 0x7fbf4c102c00 2023-12-17T12:05:28.947 INFO:teuthology.orchestra.run.smithi002.stdout:HEALTH_ERR 1 filesystem with deprecated feature inline_data; Upgrade: failed due to an unexpected exception 2023-12-17T12:05:28.948 INFO:teuthology.orchestra.run.smithi002.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2023-12-17T12:05:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: fs cephfs has deprecated feature inline_data enabled. 2023-12-17T12:05:28.948 INFO:teuthology.orchestra.run.smithi002.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-17T12:05:28.948 INFO:teuthology.orchestra.run.smithi002.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbf3406ce70 msgr2=0x7fbf3406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbf3406ce70 0x7fbf3406f320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c111070 tx=0x7fbf4000b040 comp rx=0 tx=0).stop 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 msgr2=0x7fbf4c115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c115840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009360 tx=0x7fbf3c009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 shutdown_connections 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbf3406ce70 0x7fbf3406f320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf4c102c00 0x7fbf4c115840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:28.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 --2- 172.21.15.2:0/2464489283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf4c1035a0 0x7fbf4c115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 >> 172.21.15.2:0/2464489283 conn(0x7fbf4c0f8790 msgr2=0x7fbf4c0fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 shutdown_connections 2023-12-17T12:05:28.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:28.948+0000 7fbf52884700 1 -- 172.21.15.2:0/2464489283 wait complete. 2023-12-17T12:05:29.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph versions' 2023-12-17T12:05:29.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:29 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2464489283' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:05:29.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:29 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2464489283' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-17T12:05:29.860 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:05:30.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:30 smithi119 ceph-mon[177559]: pgmap v162: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:30.705 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:30 smithi002 ceph-mon[211741]: pgmap v162: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 -- 172.21.15.2:0/390091209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f4102c00 msgr2=0x7f77f4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 --2- 172.21.15.2:0/390091209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f4102c00 0x7f77f4102fd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f77e4004940 tx=0x7f77e4009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 -- 172.21.15.2:0/390091209 shutdown_connections 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 --2- 172.21.15.2:0/390091209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f41035a0 0x7f77f40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 --2- 172.21.15.2:0/390091209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f4102c00 0x7f77f4102fd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 -- 172.21.15.2:0/390091209 >> 172.21.15.2:0/390091209 conn(0x7f77f40f8790 msgr2=0x7f77f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 -- 172.21.15.2:0/390091209 shutdown_connections 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.949+0000 7f77fa573700 1 -- 172.21.15.2:0/390091209 wait complete. 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.950+0000 7f77fa573700 1 Processor -- start 2023-12-17T12:05:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.950+0000 7f77fa573700 1 -- start start 2023-12-17T12:05:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.950+0000 7f77fa573700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4102c00 0x7f77f4115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.950+0000 7f77fa573700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 0x7f77f4115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.950+0000 7f77fa573700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41163d0 con 0x7f77f41035a0 2023-12-17T12:05:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.950+0000 7f77fa573700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f410f700 con 0x7f77f4102c00 2023-12-17T12:05:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 0x7f77f4115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 0x7f77f4115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34726/0 (socket says 172.21.15.2:34726) 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 -- 172.21.15.2:0/3949277957 learned_addr learned my addr 172.21.15.2:0/3949277957 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f3fff700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4102c00 0x7f77f4115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 -- 172.21.15.2:0/3949277957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4102c00 msgr2=0x7f77f4115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4102c00 0x7f77f4115840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 -- 172.21.15.2:0/3949277957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4005040 con 0x7f77f41035a0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.951+0000 7f77f37fe700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 0x7f77f4115d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77e8002a50 tx=0x7f77e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.952+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e8007cc0 con 0x7f77f41035a0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.952+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77e800f040 con 0x7f77f41035a0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.952+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e800d920 con 0x7f77f41035a0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.952+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f410f9e0 con 0x7f77f41035a0 2023-12-17T12:05:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.952+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f410ff20 con 0x7f77f41035a0 2023-12-17T12:05:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.953+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f40fc390 con 0x7f77f41035a0 2023-12-17T12:05:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.954+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f77e8009680 con 0x7f77f41035a0 2023-12-17T12:05:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.955+0000 7f77f0ff9700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f77dc06ce70 0x7f77dc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:05:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.955+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f77e808bfa0 con 0x7f77f41035a0 2023-12-17T12:05:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.955+0000 7f77f3fff700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f77dc06ce70 0x7f77dc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:05:30.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.956+0000 7f77f3fff700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f77dc06ce70 0x7f77dc06f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77e40043d0 tx=0x7f77e4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:05:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:30.959+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f77e80598f0 con 0x7f77f41035a0 2023-12-17T12:05:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.259+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f77f404bb80 con 0x7f77f41035a0 2023-12-17T12:05:31.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.260+0000 7f77f0ff9700 1 -- 172.21.15.2:0/3949277957 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f77e8059480 con 0x7f77f41035a0 2023-12-17T12:05:31.261 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:05:31.261 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:05:31.261 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:05:31.261 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:05:31.261 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 6 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 10 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:05:31.262 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f77dc06ce70 msgr2=0x7f77dc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f77dc06ce70 0x7f77dc06f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77e40043d0 tx=0x7f77e4009e30 comp rx=0 tx=0).stop 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 msgr2=0x7f77f4115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 0x7f77f4115d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f77e8002a50 tx=0x7f77e8004600 comp rx=0 tx=0).stop 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 shutdown_connections 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f77dc06ce70 0x7f77dc06f320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4102c00 0x7f77f4115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 --2- 172.21.15.2:0/3949277957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f41035a0 0x7f77f4115d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 >> 172.21.15.2:0/3949277957 conn(0x7f77f40f8790 msgr2=0x7f77f40fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:05:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 shutdown_connections 2023-12-17T12:05:31.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:05:31.262+0000 7f77fa573700 1 -- 172.21.15.2:0/3949277957 wait complete. 2023-12-17T12:05:31.542 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:31 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3949277957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:31.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:31 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3949277957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:05:31.757 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-17T12:05:32.194 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:05:32.641 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:32 smithi002 ceph-mon[211741]: pgmap v163: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:32.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:32 smithi119 ceph-mon[177559]: pgmap v163: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:33.179 INFO:teuthology.orchestra.run.smithi002.stdout:wait for servicemap items w/ changing names to refresh 2023-12-17T12:05:33.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'sleep 60' 2023-12-17T12:05:33.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:33 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:33.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:33 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:05:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:05:34.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:34 smithi119 ceph-mon[177559]: pgmap v164: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:34.724 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:34 smithi002 ceph-mon[211741]: pgmap v164: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:36.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:36 smithi119 ceph-mon[177559]: pgmap v165: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:36.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:36 smithi002 ceph-mon[211741]: pgmap v165: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:38.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:38 smithi119 ceph-mon[177559]: pgmap v166: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:38.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:38 smithi002 ceph-mon[211741]: pgmap v166: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:39.725 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:39 smithi002 ceph-mon[211741]: pgmap v167: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:39.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:39 smithi119 ceph-mon[177559]: pgmap v167: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:41.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:41 smithi119 ceph-mon[177559]: pgmap v168: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:41.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:41 smithi002 ceph-mon[211741]: pgmap v168: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:42.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:42 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:42.975 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:42 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:44.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:44 smithi119 ceph-mon[177559]: pgmap v169: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:44 smithi002 ceph-mon[211741]: pgmap v169: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:46.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:46 smithi119 ceph-mon[177559]: pgmap v170: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:46.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:46 smithi002 ceph-mon[211741]: pgmap v170: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:48.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:48 smithi119 ceph-mon[177559]: pgmap v171: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:48.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:48 smithi002 ceph-mon[211741]: pgmap v171: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:50.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:50 smithi119 ceph-mon[177559]: pgmap v172: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:50.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:50 smithi002 ceph-mon[211741]: pgmap v172: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:52.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:52 smithi119 ceph-mon[177559]: pgmap v173: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:52.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:52 smithi002 ceph-mon[211741]: pgmap v173: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:54.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:54 smithi119 ceph-mon[177559]: pgmap v174: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:54.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:54 smithi002 ceph-mon[211741]: pgmap v174: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:56.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:56 smithi119 ceph-mon[177559]: pgmap v175: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:56.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:56 smithi002 ceph-mon[211741]: pgmap v175: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:58.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:58 smithi119 ceph-mon[177559]: pgmap v176: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:58.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:05:58 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:05:58.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:58 smithi002 ceph-mon[211741]: pgmap v176: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:05:58.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:05:58 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:00.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:00 smithi119 ceph-mon[177559]: pgmap v177: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:00.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:00 smithi002 ceph-mon[211741]: pgmap v177: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:02.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:02 smithi119 ceph-mon[177559]: pgmap v178: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:02.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:02 smithi002 ceph-mon[211741]: pgmap v178: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:04.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:04 smithi119 ceph-mon[177559]: pgmap v179: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:04.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:04 smithi002 ceph-mon[211741]: pgmap v179: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:06.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:06 smithi119 ceph-mon[177559]: pgmap v180: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:06.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:06 smithi002 ceph-mon[211741]: pgmap v180: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:08.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:08 smithi119 ceph-mon[177559]: pgmap v181: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:08.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:08 smithi002 ceph-mon[211741]: pgmap v181: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:10.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:10 smithi119 ceph-mon[177559]: pgmap v182: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:10.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:10 smithi002 ceph-mon[211741]: pgmap v182: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:12.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:12 smithi119 ceph-mon[177559]: pgmap v183: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:12.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:12 smithi002 ceph-mon[211741]: pgmap v183: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:13.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:13 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:13.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:13 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:14.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:14 smithi119 ceph-mon[177559]: pgmap v184: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:14.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:14 smithi002 ceph-mon[211741]: pgmap v184: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:16.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:16 smithi119 ceph-mon[177559]: pgmap v185: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:16.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:16 smithi002 ceph-mon[211741]: pgmap v185: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:18.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:18 smithi119 ceph-mon[177559]: pgmap v186: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:18.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:18 smithi002 ceph-mon[211741]: pgmap v186: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:19.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:19 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:06:19.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:19 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:06:20.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:20 smithi119 ceph-mon[177559]: pgmap v187: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:20.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:20 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:06:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:20 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:06:20.408 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:20 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:06:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:20 smithi002 ceph-mon[211741]: pgmap v187: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:20 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:06:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:20 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:06:20.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:20 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' 2023-12-17T12:06:22.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:22 smithi119 ceph-mon[177559]: pgmap v188: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:22.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:22 smithi002 ceph-mon[211741]: pgmap v188: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:24.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:24 smithi119 ceph-mon[177559]: pgmap v189: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:24.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:24 smithi002 ceph-mon[211741]: pgmap v189: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:26.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:26 smithi119 ceph-mon[177559]: pgmap v190: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:26.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:26 smithi002 ceph-mon[211741]: pgmap v190: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:28.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:28 smithi119 ceph-mon[177559]: pgmap v191: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:28.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:28 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:28 smithi002 ceph-mon[211741]: pgmap v191: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:28.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:28 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:30.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:30 smithi119 ceph-mon[177559]: pgmap v192: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:30.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:30 smithi002 ceph-mon[211741]: pgmap v192: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:32.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:32 smithi119 ceph-mon[177559]: pgmap v193: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:32.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:32 smithi002 ceph-mon[211741]: pgmap v193: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:34.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:34 smithi119 ceph-mon[177559]: pgmap v194: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:34.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:34 smithi002 ceph-mon[211741]: pgmap v194: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:35.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph orch ps' 2023-12-17T12:06:35.740 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:06:36.222 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:36 smithi002 ceph-mon[211741]: pgmap v195: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:36.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:36 smithi119 ceph-mon[177559]: pgmap v195: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 -- 172.21.15.2:0/1946192690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 msgr2=0x7ff8c80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 --2- 172.21.15.2:0/1946192690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80fcc10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc004940 tx=0x7ff8bc009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 -- 172.21.15.2:0/1946192690 shutdown_connections 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 --2- 172.21.15.2:0/1946192690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80fcc10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 --2- 172.21.15.2:0/1946192690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 0x7ff8c8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 -- 172.21.15.2:0/1946192690 >> 172.21.15.2:0/1946192690 conn(0x7ff8c80f8790 msgr2=0x7ff8c80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 -- 172.21.15.2:0/1946192690 shutdown_connections 2023-12-17T12:06:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.975+0000 7ff8cce33700 1 -- 172.21.15.2:0/1946192690 wait complete. 2023-12-17T12:06:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.976+0000 7ff8cce33700 1 Processor -- start 2023-12-17T12:06:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.976+0000 7ff8cce33700 1 -- start start 2023-12-17T12:06:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8cce33700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 0x7ff8c806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8cce33700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8cce33700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8070af0 con 0x7ff8c81035a0 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8cce33700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c8070c60 con 0x7ff8c8102c00 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c5d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45574/0 (socket says 172.21.15.2:45574) 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c5d9b700 1 -- 172.21.15.2:0/53719736 learned_addr learned my addr 172.21.15.2:0/53719736 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c659c700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 0x7ff8c806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c5d9b700 1 -- 172.21.15.2:0/53719736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 msgr2=0x7ff8c806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c5d9b700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 0x7ff8c806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c5d9b700 1 -- 172.21.15.2:0/53719736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc005040 con 0x7ff8c81035a0 2023-12-17T12:06:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.977+0000 7ff8c659c700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 0x7ff8c806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.978+0000 7ff8c5d9b700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80704a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009360 tx=0x7ff8bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.978+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc00e040 con 0x7ff8c81035a0 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.978+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c8119880 con 0x7ff8c81035a0 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.978+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8bc00bc50 con 0x7ff8c81035a0 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.978+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8bc01c630 con 0x7ff8c81035a0 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.978+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c8119d60 con 0x7ff8c81035a0 2023-12-17T12:06:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.979+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c81050d0 con 0x7ff8c81035a0 2023-12-17T12:06:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.980+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7ff8bc013420 con 0x7ff8c81035a0 2023-12-17T12:06:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.981+0000 7ff8b6ffd700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff8b006ce70 0x7ff8b006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.981+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff8bc08d7d0 con 0x7ff8c81035a0 2023-12-17T12:06:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.981+0000 7ff8c659c700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff8b006ce70 0x7ff8b006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.982+0000 7ff8c659c700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff8b006ce70 0x7ff8b006f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009fd0 tx=0x7ff8b8009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:36.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:36.986+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff8bc057690 con 0x7ff8c81035a0 2023-12-17T12:06:37.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.209+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 --> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8c804bc20 con 0x7ff8b006ce70 2023-12-17T12:06:37.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.220+0000 7ff8b6ffd700 1 -- 172.21.15.2:0/53719736 <== mgr.34104 v2:172.21.15.2:6800/40594865 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff8b8009970 con 0x7ff8b006ce70 2023-12-17T12:06:37.221 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:06:37.221 INFO:teuthology.orchestra.run.smithi002.stdout:alertmanager.smithi002 smithi002 *:9093,9094 running (6m) 3m ago 16m 16.0M - 0.25.0 c8568f914cd2 b3932cd35c0d 2023-12-17T12:06:37.221 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi002 smithi002 running (4m) 3m ago 16m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 b5e2f43d5c3f 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:crash.smithi119 smithi119 running (4m) 83s ago 15m 7852k - 19.0.0-119-ga62fda73 0b0a5e4a17a7 5b383be19e8f 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:grafana.smithi002 smithi002 *:3000 running (6m) 3m ago 15m 79.6M - 9.4.7 954c08fa6188 ab1409a49ca0 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.atwfoy smithi002 running (11m) 3m ago 11m 6652M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 abf156f8bdf3 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi002.ercyvj smithi002 running (11m) 3m ago 11m 15.9M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 f08360061001 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.mzkvrk smithi119 running (11m) 83s ago 11m 5124M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 22075da879da 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mds.cephfs.smithi119.qgnwfs smithi119 running (11m) 83s ago 11m 16.3M - 17.2.7-125-g1f2f5510 60cc83a9c8f1 60eddf4e366b 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi002.cqnuqs smithi002 *:8443,9283,8765 running (8m) 3m ago 17m 520M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 2e2ba0c93301 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.smithi119.nzblpy smithi119 *:8443,9283,8765 running (7m) 83s ago 15m 453M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4c923ad81b20 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi002 smithi002 running (5m) 3m ago 17m 66.4M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 82916f6a3663 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:mon.smithi119 smithi119 running (5m) 83s ago 15m 54.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 76eda4379105 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi002 smithi002 *:9100 running (7m) 3m ago 16m 8288k - 1.5.0 0da6a335fe13 f9ab541de18f 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:node-exporter.smithi119 smithi119 *:9100 running (7m) 83s ago 15m 8376k - 1.5.0 0da6a335fe13 e60969f3a051 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (4m) 3m ago 14m 120M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 645479c5215a 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi002 running (3m) 3m ago 14m 125M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a68897527efb 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi002 running (3m) 3m ago 13m 12.8M 1620M 19.0.0-119-ga62fda73 0b0a5e4a17a7 02b7236a4a7b 2023-12-17T12:06:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi119 running (2m) 83s ago 13m 140M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 a0f481fd5b19 2023-12-17T12:06:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi119 running (118s) 83s ago 13m 126M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 c392322b1e99 2023-12-17T12:06:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi119 running (86s) 83s ago 12m 12.5M 2642M 19.0.0-119-ga62fda73 0b0a5e4a17a7 5bcc9ec7f9bc 2023-12-17T12:06:37.223 INFO:teuthology.orchestra.run.smithi002.stdout:prometheus.smithi002 smithi002 *:9095 running (7m) 3m ago 15m 59.0M - 2.43.0 a07b618ecd1d 1c3bc6ce2246 2023-12-17T12:06:37.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff8b006ce70 msgr2=0x7ff8b006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff8b006ce70 0x7ff8b006f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009fd0 tx=0x7ff8b8009ee0 comp rx=0 tx=0).stop 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 msgr2=0x7ff8c80704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80704a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009360 tx=0x7ff8bc009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 shutdown_connections 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff8b006ce70 0x7ff8b006f320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8c8102c00 0x7ff8c806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 --2- 172.21.15.2:0/53719736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8c81035a0 0x7ff8c80704a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 >> 172.21.15.2:0/53719736 conn(0x7ff8c80f8790 msgr2=0x7ff8c80fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.222+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 shutdown_connections 2023-12-17T12:06:37.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:37.223+0000 7ff8cce33700 1 -- 172.21.15.2:0/53719736 wait complete. 2023-12-17T12:06:37.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph versions' 2023-12-17T12:06:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:06:38.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:38 smithi119 ceph-mon[177559]: pgmap v196: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:38.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:38 smithi119 ceph-mon[177559]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:06:38.422 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:38 smithi002 ceph-mon[211741]: pgmap v196: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:38.422 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:38 smithi002 ceph-mon[211741]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:06:39.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 -- 172.21.15.2:0/262440129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 msgr2=0x7f7be4065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 --2- 172.21.15.2:0/262440129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be4065800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4004940 tx=0x7f7bd4009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 -- 172.21.15.2:0/262440129 shutdown_connections 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 --2- 172.21.15.2:0/262440129 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be4065800 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 --2- 172.21.15.2:0/262440129 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be4102c20 0x7f7be4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 -- 172.21.15.2:0/262440129 >> 172.21.15.2:0/262440129 conn(0x7f7be40719b0 msgr2=0x7f7be4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 -- 172.21.15.2:0/262440129 shutdown_connections 2023-12-17T12:06:39.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.199+0000 7f7beb265700 1 -- 172.21.15.2:0/262440129 wait complete. 2023-12-17T12:06:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7beb265700 1 Processor -- start 2023-12-17T12:06:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7beb265700 1 -- start start 2023-12-17T12:06:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7beb265700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be40fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7beb265700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be4102c20 0x7f7be40fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7beb265700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40fc7c0 con 0x7f7be4065390 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7beb265700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be40fc930 con 0x7f7be4102c20 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.200+0000 7f7be9001700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be40fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be9001700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be40fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55714/0 (socket says 172.21.15.2:55714) 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be9001700 1 -- 172.21.15.2:0/3594668300 learned_addr learned my addr 172.21.15.2:0/3594668300 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be8800700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be4102c20 0x7f7be40fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be9001700 1 -- 172.21.15.2:0/3594668300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be4102c20 msgr2=0x7f7be40fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be9001700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be4102c20 0x7f7be40fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be9001700 1 -- 172.21.15.2:0/3594668300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4005040 con 0x7f7be4065390 2023-12-17T12:06:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7be9001700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be40fbbf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7be000b790 tx=0x7f7be0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:39.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be000f6f0 con 0x7f7be4065390 2023-12-17T12:06:39.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7be000fd00 con 0x7f7be4065390 2023-12-17T12:06:39.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.201+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be4119950 con 0x7f7be4065390 2023-12-17T12:06:39.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.202+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be00103a0 con 0x7f7be4065390 2023-12-17T12:06:39.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.202+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be4119e40 con 0x7f7be4065390 2023-12-17T12:06:39.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.203+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be40fff40 con 0x7f7be4065390 2023-12-17T12:06:39.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.204+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f7be000f850 con 0x7f7be4065390 2023-12-17T12:06:39.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.205+0000 7f7bd9ffb700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7bd006ce70 0x7f7bd006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:39.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.205+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7be008c1f0 con 0x7f7be4065390 2023-12-17T12:06:39.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.205+0000 7f7be8800700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7bd006ce70 0x7f7bd006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:39.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.205+0000 7f7be8800700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7bd006ce70 0x7f7bd006f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7be40fd5f0 tx=0x7f7bd4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:39.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.209+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7be00560b0 con 0x7f7be4065390 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.508+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7be404bbb0 con 0x7f7be4065390 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.509+0000 7f7bd9ffb700 1 -- 172.21.15.2:0/3594668300 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7f7be00596d0 con 0x7f7be4065390 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": { 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:06:39.510 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": { 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 2 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": { 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 6 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "overall": { 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 17.2.7-125-g1f2f5510 (1f2f55109dc1ed2dc2dda9de1db3c70923ba0dfd) quincy (stable)": 4, 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)": 10 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-12-17T12:06:39.511 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-12-17T12:06:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7bd006ce70 msgr2=0x7f7bd006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7bd006ce70 0x7f7bd006f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7be40fd5f0 tx=0x7f7bd4009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:39.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 msgr2=0x7f7be40fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be40fbbf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7be000b790 tx=0x7f7be0009250 comp rx=0 tx=0).stop 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 shutdown_connections 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f7bd006ce70 0x7f7bd006f320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7be4065390 0x7f7be40fbbf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 --2- 172.21.15.2:0/3594668300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7be4102c20 0x7f7be40fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 >> 172.21.15.2:0/3594668300 conn(0x7f7be40719b0 msgr2=0x7f7be40fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 shutdown_connections 2023-12-17T12:06:39.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:39.511+0000 7f7beb265700 1 -- 172.21.15.2:0/3594668300 wait complete. 2023-12-17T12:06:39.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-17T12:06:40.312 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/mon.smithi002/config 2023-12-17T12:06:40.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:40 smithi119 ceph-mon[177559]: pgmap v197: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:40.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:40 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3594668300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:06:40.449 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:40 smithi002 ceph-mon[211741]: pgmap v197: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:40.449 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:40 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3594668300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 -- 172.21.15.2:0/2820978852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 msgr2=0x7ff3380fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 --2- 172.21.15.2:0/2820978852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff3380fcc00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff32c004940 tx=0x7ff32c009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 -- 172.21.15.2:0/2820978852 shutdown_connections 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 --2- 172.21.15.2:0/2820978852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff3380fcc00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 --2- 172.21.15.2:0/2820978852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff338102bf0 0x7ff338102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 -- 172.21.15.2:0/2820978852 >> 172.21.15.2:0/2820978852 conn(0x7ff3380f87a0 msgr2=0x7ff3380fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 -- 172.21.15.2:0/2820978852 shutdown_connections 2023-12-17T12:06:41.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.414+0000 7ff33d03a700 1 -- 172.21.15.2:0/2820978852 wait complete. 2023-12-17T12:06:41.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.415+0000 7ff33d03a700 1 Processor -- start 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.415+0000 7ff33d03a700 1 -- start start 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33d03a700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff338102bf0 0x7ff338115880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33d03a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff338115dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33d03a700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338116410 con 0x7ff338103590 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33d03a700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33810f740 con 0x7ff338102bf0 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff338115dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33659c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff338115dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55726/0 (socket says 172.21.15.2:55726) 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33659c700 1 -- 172.21.15.2:0/700063303 learned_addr learned my addr 172.21.15.2:0/700063303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff336d9d700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff338102bf0 0x7ff338115880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33659c700 1 -- 172.21.15.2:0/700063303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff338102bf0 msgr2=0x7ff338115880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33659c700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff338102bf0 0x7ff338115880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:41.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.416+0000 7ff33659c700 1 -- 172.21.15.2:0/700063303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c005040 con 0x7ff338103590 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.417+0000 7ff33659c700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff338115dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009360 tx=0x7ff32c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.417+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32c00e040 con 0x7ff338103590 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.417+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff32c013420 con 0x7ff338103590 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.417+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32c01c610 con 0x7ff338103590 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.417+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33810f9c0 con 0x7ff338103590 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.417+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33810ff00 con 0x7ff338103590 2023-12-17T12:06:41.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.418+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3380fc3a0 con 0x7ff338103590 2023-12-17T12:06:41.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.419+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7ff32c013590 con 0x7ff338103590 2023-12-17T12:06:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.420+0000 7ff31f7fe700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff32006ce70 0x7ff32006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.420+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff32c08d5b0 con 0x7ff338103590 2023-12-17T12:06:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.420+0000 7ff336d9d700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff32006ce70 0x7ff32006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:41.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.421+0000 7ff336d9d700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff32006ce70 0x7ff32006f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff328004f40 tx=0x7ff32800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:41.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.425+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff32c05ae80 con 0x7ff338103590 2023-12-17T12:06:41.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.727+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff33804bb80 con 0x7ff338103590 2023-12-17T12:06:41.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.728+0000 7ff31f7fe700 1 -- 172.21.15.2:0/700063303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+725 (secure 0 0 0) 0x7ff32c05aa10 con 0x7ff338103590 2023-12-17T12:06:41.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff32006ce70 msgr2=0x7ff32006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:41.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff32006ce70 0x7ff32006f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff328004f40 tx=0x7ff32800b040 comp rx=0 tx=0).stop 2023-12-17T12:06:41.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 msgr2=0x7ff338115dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:41.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff338115dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009360 tx=0x7ff32c009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 shutdown_connections 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff32006ce70 0x7ff32006f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff338102bf0 0x7ff338115880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 --2- 172.21.15.2:0/700063303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff338103590 0x7ff338115dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 >> 172.21.15.2:0/700063303 conn(0x7ff3380f87a0 msgr2=0x7ff338070330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 shutdown_connections 2023-12-17T12:06:41.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:41.730+0000 7ff33d03a700 1 -- 172.21.15.2:0/700063303 wait complete. 2023-12-17T12:06:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:false 2023-12-17T12:06:42.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:42.091 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/cephadm.py", line 1351, in shell File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/cephadm.py", line 40, in _shell File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-17T12:06:42.170 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4a163fb9500945e0901e4d06f0d6095c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/cephadm.py", line 1351, in shell File "/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks/cephadm.py", line 40, in _shell File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-17T12:06:42.173 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-17T12:06:42.184 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-17T12:06:42.184 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T12:06:42.184 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T12:06:42.224 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:42 smithi002 ceph-mon[211741]: pgmap v198: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:42.225 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:42 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/700063303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:06:42.238 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-12-17T12:06:42.238 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T12:06:42.327 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:06:42.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:42 smithi119 ceph-mon[177559]: pgmap v198: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:42.407 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:42 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/700063303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-17T12:06:42.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 -- 172.21.15.2:0/53184515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e406ffe0 msgr2=0x7f73e40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:42.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/53184515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e406ffe0 0x7f73e40703b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f73e0004970 tx=0x7f73e0009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:42.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 -- 172.21.15.2:0/53184515 shutdown_connections 2023-12-17T12:06:42.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/53184515 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e40708f0 0x7f73e4108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/53184515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e406ffe0 0x7f73e40703b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 -- 172.21.15.2:0/53184515 >> 172.21.15.2:0/53184515 conn(0x7f73e40f85f0 msgr2=0x7f73e40faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 -- 172.21.15.2:0/53184515 shutdown_connections 2023-12-17T12:06:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.565+0000 7f73ec1ff700 1 -- 172.21.15.2:0/53184515 wait complete. 2023-12-17T12:06:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.566+0000 7f73ec1ff700 1 Processor -- start 2023-12-17T12:06:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.566+0000 7f73ec1ff700 1 -- start start 2023-12-17T12:06:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73ec1ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e406ffe0 0x7f73e41153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73ec1ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 0x7f73e4115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73ec1ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4115f70 con 0x7f73e40708f0 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73ec1ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e410f4d0 con 0x7f73e406ffe0 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e979a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 0x7f73e4115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e979a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 0x7f73e4115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55750/0 (socket says 172.21.15.2:55750) 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e979a700 1 -- 172.21.15.2:0/2866355817 learned_addr learned my addr 172.21.15.2:0/2866355817 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e9f9b700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e406ffe0 0x7f73e41153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e979a700 1 -- 172.21.15.2:0/2866355817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e406ffe0 msgr2=0x7f73e41153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e979a700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e406ffe0 0x7f73e41153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e979a700 1 -- 172.21.15.2:0/2866355817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0005040 con 0x7f73e40708f0 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.567+0000 7f73e9f9b700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e406ffe0 0x7f73e41153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.568+0000 7f73e979a700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 0x7f73e4115920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c8c0 tx=0x7f73d40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.568+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d400a980 con 0x7f73e40708f0 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.568+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73d400ce60 con 0x7f73e40708f0 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.568+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e410f7b0 con 0x7f73e40708f0 2023-12-17T12:06:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.568+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73d40113a0 con 0x7f73e40708f0 2023-12-17T12:06:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.568+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e410fcf0 con 0x7f73e40708f0 2023-12-17T12:06:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.569+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e4106470 con 0x7f73e40708f0 2023-12-17T12:06:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.570+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f73d4012400 con 0x7f73e40708f0 2023-12-17T12:06:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.571+0000 7f73da7fc700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73d006ce70 0x7f73d006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.571+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f73d408c480 con 0x7f73e40708f0 2023-12-17T12:06:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.571+0000 7f73e9f9b700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73d006ce70 0x7f73d006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.572+0000 7f73e9f9b700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73d006ce70 0x7f73d006f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009fd0 tx=0x7f73e0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.575+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f73d4056340 con 0x7f73e40708f0 2023-12-17T12:06:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.786+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73e4110a00 con 0x7f73e40708f0 2023-12-17T12:06:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.787+0000 7f73da7fc700 1 -- 172.21.15.2:0/2866355817 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16357 (secure 0 0 0) 0x7f73d4059960 con 0x7f73e40708f0 2023-12-17T12:06:42.789 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:06:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:48:50.417719+0000","modified":"2023-12-17T12:05:18.965815+0000","last_up_change":"2023-12-17T12:05:17.963682+0000","last_in_change":"2023-12-17T11:53:43.616013+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:52:56.580032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-17T11:54:55.230450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-17T11:54:56.027076+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2114bd7b-19fb-4504-8164-694ca3b767d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":52,"up_from":56,"up_thru":81,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6803","nonce":1023971356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6805","nonce":1023971356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6809","nonce":1023971356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6807","nonce":1023971356}]},"public_addr":"172.21.15.2:6803/1023971356","cluster_addr":"172.21.15.2:6805/1023971356","heartbeat_back_addr":"172.21.15.2:6809/1023971356","heartbeat_front_addr":"172.21.15.2:6807/1023971356","state":["exists","up"]},{"osd":1,"uuid":"4b728955-c4f6-4426-ae59-4614cbfea807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":57,"up_from":61,"up_thru":81,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6811","nonce":1573545903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6813","nonce":1573545903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6817","nonce":1573545903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6815","nonce":1573545903}]},"public_addr":"172.21.15.2:6811/1573545903","cluster_addr":"172.21.15.2:6813/1573545903","heartbeat_back_addr":"172.21.15.2:6817/1573545903","heartbeat_front_addr":"172.21.15.2:6815/1573545903","state":["exists","up"]},{"osd":2,"uuid":"a4f28cc1-78bc-4434-a7a0-ca4a373fc384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":62,"up_from":66,"up_thru":81,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6819","nonce":3504198593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6821","nonce":3504198593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6825","nonce":3504198593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6823","nonce":3504198593}]},"public_addr":"172.21.15.2:6819/3504198593","cluster_addr":"172.21.15.2:6821/3504198593","heartbeat_back_addr":"172.21.15.2:6825/3504198593","heartbeat_front_addr":"172.21.15.2:6823/3504198593","state":["exists","up"]},{"osd":3,"uuid":"b8f7021b-7c22-415a-9635-af30e6e6fc13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":67,"up_from":71,"up_thru":81,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6801","nonce":619765794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6803","nonce":619765794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6807","nonce":619765794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6805","nonce":619765794}]},"public_addr":"172.21.15.119:6801/619765794","cluster_addr":"172.21.15.119:6803/619765794","heartbeat_back_addr":"172.21.15.119:6807/619765794","heartbeat_front_addr":"172.21.15.119:6805/619765794","state":["exists","up"]},{"osd":4,"uuid":"d5ebbeab-3ba4-4e81-b453-d775808ac559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":72,"up_from":76,"up_thru":81,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6809","nonce":1258724394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6811","nonce":1258724394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6815","nonce":1258724394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6813","nonce":1258724394}]},"public_addr":"172.21.15.119:6809/1258724394","cluster_addr":"172.21.15.119:6811/1258724394","heartbeat_back_addr":"172.21.15.119:6815/1258724394","heartbeat_front_addr":"172.21.15.119:6813/1258724394","state":["exists","up"]},{"osd":5,"uuid":"dc8023ee-4370-4354-921e-5f7d71df5bc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":77,"up_from":81,"up_thru":81,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6817","nonce":2475998087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475998087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475998087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475998087}]},"public_addr":"172.21.15.119:6817/2475998087","cluster_addr":"172.21.15.119:6819/2475998087","heartbeat_back_addr":"172.21.15.119:6823/2475998087","heartbeat_front_addr":"172.21.15.119:6821/2475998087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:06.272236+0000","dead_epoch":52},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:30.215924+0000","dead_epoch":57},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:52.820296+0000","dead_epoch":62},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:14.743572+0000","dead_epoch":67},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:37.197272+0000","dead_epoch":72},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:54:00.536614+0000","dead_epoch":77}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6800/3359833978":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/3461314058":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/96945266":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/3091655634":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6826/696982378":"2023-12-18T11:55:09.500838+0000","172.21.15.2:6827/696982378":"2023-12-18T11:55:09.500838+0000","172.21.15.2:6801/3359833978":"2023-12-18T11:56:58.918639+0000","172.21.15.2:6800/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/599472466":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/2886179339":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2515016248":"2023-12-18T12:01:12.181677+0000","172.21.15.119:0/4235851367":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/1570438430":"2023-12-18T12:01:12.181677+0000","172.21.15.2:0/1129063553":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.119:0/583890725":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/582228833":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/2256843163":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/1516546273":"2023-12-18T12:01:12.181677+0000","172.21.15.119:0/2560519728":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/1642465919":"2023-12-18T11:49:24.084659+0000","172.21.15.119:0/4168511392":"2023-12-18T11:58:16.394162+0000","172.21.15.119:6829/3593601472":"2023-12-18T11:58:16.394162+0000","172.21.15.2:6800/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/4058365663":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/3688904349":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6801/2515016248":"2023-12-18T12:01:12.181677+0000","172.21.15.119:6828/3593601472":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/3009915854":"2023-12-18T11:49:51.668708+0000","172.21.15.119:0/1891654879":"2023-12-18T11:58:16.394162+0000","172.21.15.119:0/496324593":"2023-12-18T11:58:16.394162+0000","172.21.15.2:6801/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3796631798":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/1271749455":"2023-12-18T12:01:12.181677+0000","172.21.15.2:0/2893257583":"2023-12-18T12:01:12.181677+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:06:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.789+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73d006ce70 msgr2=0x7f73d006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.789+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73d006ce70 0x7f73d006f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009fd0 tx=0x7f73e0009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.789+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 msgr2=0x7f73e4115920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.789+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 0x7f73e4115920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f73d400c8c0 tx=0x7f73d40044c0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 shutdown_connections 2023-12-17T12:06:42.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f73d006ce70 0x7f73d006f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73e406ffe0 0x7f73e41153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 --2- 172.21.15.2:0/2866355817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73e40708f0 0x7f73e4115920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:42.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 >> 172.21.15.2:0/2866355817 conn(0x7f73e40f85f0 msgr2=0x7f73e41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:42.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 shutdown_connections 2023-12-17T12:06:42.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:42.790+0000 7f73ec1ff700 1 -- 172.21.15.2:0/2866355817 wait complete. 2023-12-17T12:06:42.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:52:56.580032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-17T11:54:55.230450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-17T11:54:56.027076+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:06:42.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T12:06:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.012+0000 7f54ae1ff700 1 -- 172.21.15.2:0/2802930471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a80708f0 msgr2=0x7f54a8108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.012+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/2802930471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a80708f0 0x7f54a8108e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f549c004970 tx=0x7f549c009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.012+0000 7f54ae1ff700 1 -- 172.21.15.2:0/2802930471 shutdown_connections 2023-12-17T12:06:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.012+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/2802930471 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a80708f0 0x7f54a8108e50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.012+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/2802930471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806ffe0 0x7f54a80703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.012+0000 7f54ae1ff700 1 -- 172.21.15.2:0/2802930471 >> 172.21.15.2:0/2802930471 conn(0x7f54a80f86d0 msgr2=0x7f54a80faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.013+0000 7f54ae1ff700 1 -- 172.21.15.2:0/2802930471 shutdown_connections 2023-12-17T12:06:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.013+0000 7f54ae1ff700 1 -- 172.21.15.2:0/2802930471 wait complete. 2023-12-17T12:06:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.013+0000 7f54ae1ff700 1 Processor -- start 2023-12-17T12:06:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.013+0000 7f54ae1ff700 1 -- start start 2023-12-17T12:06:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54ae1ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 0x7f54a81154e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54ae1ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a80708f0 0x7f54a8115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54ae1ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8116070 con 0x7f54a806ffe0 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54ae1ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a810f5b0 con 0x7f54a80708f0 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 0x7f54a81154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a77fe700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 0x7f54a81154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55764/0 (socket says 172.21.15.2:55764) 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a77fe700 1 -- 172.21.15.2:0/780428357 learned_addr learned my addr 172.21.15.2:0/780428357 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a6ffd700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a80708f0 0x7f54a8115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a77fe700 1 -- 172.21.15.2:0/780428357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a80708f0 msgr2=0x7f54a8115a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a77fe700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a80708f0 0x7f54a8115a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.014+0000 7f54a77fe700 1 -- 172.21.15.2:0/780428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c005040 con 0x7f54a806ffe0 2023-12-17T12:06:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.015+0000 7f54a77fe700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 0x7f54a81154e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f549800c8c0 tx=0x7f54980044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.015+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f549800a980 con 0x7f54a806ffe0 2023-12-17T12:06:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.015+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f549800ce60 con 0x7f54a806ffe0 2023-12-17T12:06:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.015+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54980113a0 con 0x7f54a806ffe0 2023-12-17T12:06:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.015+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a810f890 con 0x7f54a806ffe0 2023-12-17T12:06:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.015+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a810fd50 con 0x7f54a806ffe0 2023-12-17T12:06:43.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.016+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8106510 con 0x7f54a806ffe0 2023-12-17T12:06:43.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.017+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f5498012400 con 0x7f54a806ffe0 2023-12-17T12:06:43.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.018+0000 7f548ffff700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f549006ce70 0x7f549006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.018+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f549808c480 con 0x7f54a806ffe0 2023-12-17T12:06:43.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.018+0000 7f54a6ffd700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f549006ce70 0x7f549006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.019+0000 7f54a6ffd700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f549006ce70 0x7f549006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f549c009fd0 tx=0x7f549c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.022+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5498059dd0 con 0x7f54a806ffe0 2023-12-17T12:06:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.232+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54a8110ac0 con 0x7f54a806ffe0 2023-12-17T12:06:43.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.233+0000 7f548ffff700 1 -- 172.21.15.2:0/780428357 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5498059960 con 0x7f54a806ffe0 2023-12-17T12:06:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-12-17T12:06:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f549006ce70 msgr2=0x7f549006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f549006ce70 0x7f549006f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f549c009fd0 tx=0x7f549c009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 msgr2=0x7f54a81154e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 0x7f54a81154e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f549800c8c0 tx=0x7f54980044c0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 shutdown_connections 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f549006ce70 0x7f549006f320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f54a806ffe0 0x7f54a81154e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 --2- 172.21.15.2:0/780428357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a80708f0 0x7f54a8115a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.235+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 >> 172.21.15.2:0/780428357 conn(0x7f54a80f86d0 msgr2=0x7f54a8103690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.236+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 shutdown_connections 2023-12-17T12:06:43.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.236+0000 7f54ae1ff700 1 -- 172.21.15.2:0/780428357 wait complete. 2023-12-17T12:06:43.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-17T12:06:43.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 -- 172.21.15.2:0/1429565012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 msgr2=0x7ff474102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/1429565012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff474102f10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff470004940 tx=0x7ff470009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:43.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 -- 172.21.15.2:0/1429565012 shutdown_connections 2023-12-17T12:06:43.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/1429565012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4741034e0 0x7ff4740fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/1429565012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff474102f10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 -- 172.21.15.2:0/1429565012 >> 172.21.15.2:0/1429565012 conn(0x7ff4740f86d0 msgr2=0x7ff4740faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:43.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 -- 172.21.15.2:0/1429565012 shutdown_connections 2023-12-17T12:06:43.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.455+0000 7ff47c7ff700 1 -- 172.21.15.2:0/1429565012 wait complete. 2023-12-17T12:06:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.456+0000 7ff47c7ff700 1 Processor -- start 2023-12-17T12:06:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.456+0000 7ff47c7ff700 1 -- start start 2023-12-17T12:06:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47c7ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff4741133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47c7ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4741034e0 0x7ff474113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47c7ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474113f70 con 0x7ff474102b40 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47c7ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47410d490 con 0x7ff4741034e0 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47a59b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff4741133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47a59b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff4741133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55796/0 (socket says 172.21.15.2:55796) 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.457+0000 7ff47a59b700 1 -- 172.21.15.2:0/2035237085 learned_addr learned my addr 172.21.15.2:0/2035237085 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff47a59b700 1 -- 172.21.15.2:0/2035237085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4741034e0 msgr2=0x7ff474113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff47a59b700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4741034e0 0x7ff474113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff47a59b700 1 -- 172.21.15.2:0/2035237085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470005040 con 0x7ff474102b40 2023-12-17T12:06:43.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff47a59b700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff4741133e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff470009360 tx=0x7ff470009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47000e040 con 0x7ff474102b40 2023-12-17T12:06:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff47000bc50 con 0x7ff474102b40 2023-12-17T12:06:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47410d710 con 0x7ff474102b40 2023-12-17T12:06:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47001c630 con 0x7ff474102b40 2023-12-17T12:06:43.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.458+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47410dc50 con 0x7ff474102b40 2023-12-17T12:06:43.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.459+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4740ffe50 con 0x7ff474102b40 2023-12-17T12:06:43.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.461+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7ff470013420 con 0x7ff474102b40 2023-12-17T12:06:43.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.461+0000 7ff46affd700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff46006ce70 0x7ff46006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.461+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff47008d670 con 0x7ff474102b40 2023-12-17T12:06:43.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.462+0000 7ff479d9a700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff46006ce70 0x7ff46006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.462+0000 7ff479d9a700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff46006ce70 0x7ff46006f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff47410ec80 tx=0x7ff464009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:43.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.466+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff47005afc0 con 0x7ff474102b40 2023-12-17T12:06:43.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:43 smithi002 ceph-mon[211741]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:43.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:43 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2866355817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:06:43.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:43 smithi119 ceph-mon[177559]: from='mgr.34104 172.21.15.2:0/3874071448' entity='mgr.smithi002.cqnuqs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-17T12:06:43.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:43 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2866355817' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:06:43.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.677+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff474064730 con 0x7ff474102b40 2023-12-17T12:06:43.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.677+0000 7ff46affd700 1 -- 172.21.15.2:0/2035237085 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff47005ab50 con 0x7ff474102b40 2023-12-17T12:06:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-12-17T12:06:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff46006ce70 msgr2=0x7ff46006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff46006ce70 0x7ff46006f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff47410ec80 tx=0x7ff464009ce0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 msgr2=0x7ff4741133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff4741133e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff470009360 tx=0x7ff470009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 shutdown_connections 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff46006ce70 0x7ff46006f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff474102b40 0x7ff4741133e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 --2- 172.21.15.2:0/2035237085 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4741034e0 0x7ff474113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 >> 172.21.15.2:0/2035237085 conn(0x7ff4740f86d0 msgr2=0x7ff4740fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 shutdown_connections 2023-12-17T12:06:43.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.680+0000 7ff47c7ff700 1 -- 172.21.15.2:0/2035237085 wait complete. 2023-12-17T12:06:43.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-17T12:06:43.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.899+0000 7f63ed5ff700 1 -- 172.21.15.2:0/3278940766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e81034e0 msgr2=0x7f63e80fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.899+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/3278940766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e81034e0 0x7f63e80fcb50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f63dc004940 tx=0x7f63dc009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 -- 172.21.15.2:0/3278940766 shutdown_connections 2023-12-17T12:06:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/3278940766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e81034e0 0x7f63e80fcb50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/3278940766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e8102b40 0x7f63e8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 -- 172.21.15.2:0/3278940766 >> 172.21.15.2:0/3278940766 conn(0x7f63e80f86d0 msgr2=0x7f63e80faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 -- 172.21.15.2:0/3278940766 shutdown_connections 2023-12-17T12:06:43.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 -- 172.21.15.2:0/3278940766 wait complete. 2023-12-17T12:06:43.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.900+0000 7f63ed5ff700 1 Processor -- start 2023-12-17T12:06:43.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63ed5ff700 1 -- start start 2023-12-17T12:06:43.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63ed5ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 0x7f63e8115520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63ed5ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e81034e0 0x7f63e8115a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63ed5ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e81160b0 con 0x7f63e8102b40 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63ed5ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e810f5f0 con 0x7f63e81034e0 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63e6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 0x7f63e8115520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63e6ffd700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 0x7f63e8115520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55812/0 (socket says 172.21.15.2:55812) 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.901+0000 7f63e6ffd700 1 -- 172.21.15.2:0/801837208 learned_addr learned my addr 172.21.15.2:0/801837208 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63e67fc700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e81034e0 0x7f63e8115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63e6ffd700 1 -- 172.21.15.2:0/801837208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e81034e0 msgr2=0x7f63e8115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63e6ffd700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e81034e0 0x7f63e8115a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63e6ffd700 1 -- 172.21.15.2:0/801837208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc005040 con 0x7f63e8102b40 2023-12-17T12:06:43.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63e67fc700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e81034e0 0x7f63e8115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:06:43.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63e6ffd700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 0x7f63e8115520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63d800c8c0 tx=0x7f63d80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:43.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d800a980 con 0x7f63e8102b40 2023-12-17T12:06:43.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f63d800ce60 con 0x7f63e8102b40 2023-12-17T12:06:43.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d80113a0 con 0x7f63e8102b40 2023-12-17T12:06:43.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e810f8d0 con 0x7f63e8102b40 2023-12-17T12:06:43.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.902+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e810fe90 con 0x7f63e8102b40 2023-12-17T12:06:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.903+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8064730 con 0x7f63e8102b40 2023-12-17T12:06:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.904+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f63d8012400 con 0x7f63e8102b40 2023-12-17T12:06:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.905+0000 7f63cf7fe700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f63d006ce70 0x7f63d006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.905+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f63d808c380 con 0x7f63e8102b40 2023-12-17T12:06:43.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.906+0000 7f63e67fc700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f63d006ce70 0x7f63d006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:43.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.906+0000 7f63e67fc700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f63d006ce70 0x7f63d006f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00b3b0 tx=0x7f63dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:43.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:43.910+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f63d8059d50 con 0x7f63e8102b40 2023-12-17T12:06:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.118+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f63e8110160 con 0x7f63e8102b40 2023-12-17T12:06:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.119+0000 7f63cf7fe700 1 -- 172.21.15.2:0/801837208 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f63d80598e0 con 0x7f63e8102b40 2023-12-17T12:06:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f63d006ce70 msgr2=0x7f63d006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f63d006ce70 0x7f63d006f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00b3b0 tx=0x7f63dc009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 msgr2=0x7f63e8115520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 0x7f63e8115520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63d800c8c0 tx=0x7f63d80044c0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 shutdown_connections 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f63d006ce70 0x7f63d006f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63e8102b40 0x7f63e8115520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 --2- 172.21.15.2:0/801837208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63e81034e0 0x7f63e8115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 >> 172.21.15.2:0/801837208 conn(0x7f63e80f86d0 msgr2=0x7f63e80fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:44.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 shutdown_connections 2023-12-17T12:06:44.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.121+0000 7f63ed5ff700 1 -- 172.21.15.2:0/801837208 wait complete. 2023-12-17T12:06:44.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T12:06:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 -- 172.21.15.2:0/4113278760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 msgr2=0x7f5d64102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:44.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/4113278760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d64102f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5d60004940 tx=0x7f5d60009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 -- 172.21.15.2:0/4113278760 shutdown_connections 2023-12-17T12:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/4113278760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d641034e0 0x7f5d640fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/4113278760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d64102f10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 -- 172.21.15.2:0/4113278760 >> 172.21.15.2:0/4113278760 conn(0x7f5d640f86d0 msgr2=0x7f5d640faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 -- 172.21.15.2:0/4113278760 shutdown_connections 2023-12-17T12:06:44.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.341+0000 7f5d6bfff700 1 -- 172.21.15.2:0/4113278760 wait complete. 2023-12-17T12:06:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.342+0000 7f5d6bfff700 1 Processor -- start 2023-12-17T12:06:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.342+0000 7f5d6bfff700 1 -- start start 2023-12-17T12:06:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.342+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d641133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:44.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.342+0000 7f5d6bfff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d641034e0 0x7f5d64113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.342+0000 7f5d6bfff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d64113f50 con 0x7f5d64102b40 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.342+0000 7f5d6bfff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6410d4b0 con 0x7f5d641034e0 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d641133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d641133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55818/0 (socket says 172.21.15.2:55818) 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 -- 172.21.15.2:0/3888906939 learned_addr learned my addr 172.21.15.2:0/3888906939 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d6959a700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d641034e0 0x7f5d64113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 -- 172.21.15.2:0/3888906939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d641034e0 msgr2=0x7f5d64113900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d641034e0 0x7f5d64113900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 -- 172.21.15.2:0/3888906939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60005040 con 0x7f5d64102b40 2023-12-17T12:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d69d9b700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d641133c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009360 tx=0x7f5d60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6000e040 con 0x7f5d64102b40 2023-12-17T12:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d6000bc50 con 0x7f5d64102b40 2023-12-17T12:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6410d730 con 0x7f5d64102b40 2023-12-17T12:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.343+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d6001c630 con 0x7f5d64102b40 2023-12-17T12:06:44.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.344+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6410dc70 con 0x7f5d64102b40 2023-12-17T12:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.345+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d640ffe50 con 0x7f5d64102b40 2023-12-17T12:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.346+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f5d60013420 con 0x7f5d64102b40 2023-12-17T12:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.347+0000 7f5d5a7fc700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5d5006ce70 0x7f5d5006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.347+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5d6008d5a0 con 0x7f5d64102b40 2023-12-17T12:06:44.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.347+0000 7f5d6959a700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5d5006ce70 0x7f5d5006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:44.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.347+0000 7f5d6959a700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5d5006ce70 0x7f5d5006f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009fd0 tx=0x7f5d54009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:44.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.351+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5d600574e0 con 0x7f5d64102b40 2023-12-17T12:06:44.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:44 smithi002 ceph-mon[211741]: pgmap v199: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:44 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/780428357' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:06:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:44 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2035237085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-17T12:06:44.475 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:44 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/801837208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-17T12:06:44.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.578+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d64064730 con 0x7f5d64102b40 2023-12-17T12:06:44.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.579+0000 7f5d5a7fc700 1 -- 172.21.15.2:0/3888906939 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v82) v1 ==== 81+0+2155 (secure 0 0 0) 0x7f5d6005ab00 con 0x7f5d64102b40 2023-12-17T12:06:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3359833978 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3461314058 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/96945266 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3091655634 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6826/696982378 2023-12-18T11:55:09.500838+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6827/696982378 2023-12-18T11:55:09.500838+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3359833978 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/832159067 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/599472466 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2886179339 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2381631525 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2515016248 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/4235851367 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1570438430 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1129063553 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2381631525 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/583890725 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/582228833 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2256843163 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1516546273 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/2560519728 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1642465919 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/4168511392 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:6829/3593601472 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/444501898 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4058365663 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3688904349 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2515016248 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:6828/3593601472 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3009915854 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/1891654879 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/496324593 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/832159067 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3796631798 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/444501898 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1271749455 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2893257583 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5d5006ce70 msgr2=0x7f5d5006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5d5006ce70 0x7f5d5006f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009fd0 tx=0x7f5d54009f20 comp rx=0 tx=0).stop 2023-12-17T12:06:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 msgr2=0x7f5d641133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d641133c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009360 tx=0x7f5d60009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 shutdown_connections 2023-12-17T12:06:44.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5d5006ce70 0x7f5d5006f320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d64102b40 0x7f5d641133c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 --2- 172.21.15.2:0/3888906939 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d641034e0 0x7f5d64113900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 >> 172.21.15.2:0/3888906939 conn(0x7f5d640f86d0 msgr2=0x7f5d640fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 shutdown_connections 2023-12-17T12:06:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:44.581+0000 7f5d6bfff700 1 -- 172.21.15.2:0/3888906939 wait complete. 2023-12-17T12:06:44.586 INFO:teuthology.orchestra.run.smithi002.stderr:listed 37 entries 2023-12-17T12:06:44.601 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-17T12:06:44.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:44.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-17T12:06:44.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:44 smithi119 ceph-mon[177559]: pgmap v199: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:44.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:44 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/780428357' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:06:44.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:44 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2035237085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-17T12:06:44.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:44 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/801837208' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-17T12:06:44.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T12:06:44.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:44.706 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-17T12:06:44.795 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T12:06:44.795 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T12:06:44.913 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-12-17T12:06:44.913 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T12:06:45.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:06:45.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 -- 172.21.15.2:0/3084645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 msgr2=0x7f5a300703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 --2- 172.21.15.2:0/3084645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a300703b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a24004970 tx=0x7f5a24009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 -- 172.21.15.2:0/3084645615 shutdown_connections 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 --2- 172.21.15.2:0/3084645615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a300708f0 0x7f5a30108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 --2- 172.21.15.2:0/3084645615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a300703b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 -- 172.21.15.2:0/3084645615 >> 172.21.15.2:0/3084645615 conn(0x7f5a300f8630 msgr2=0x7f5a300faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 -- 172.21.15.2:0/3084645615 shutdown_connections 2023-12-17T12:06:45.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.221+0000 7f5a371ff700 1 -- 172.21.15.2:0/3084645615 wait complete. 2023-12-17T12:06:45.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.222+0000 7f5a371ff700 1 Processor -- start 2023-12-17T12:06:45.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.222+0000 7f5a371ff700 1 -- start start 2023-12-17T12:06:45.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.222+0000 7f5a371ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a301154d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:45.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.222+0000 7f5a371ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a300708f0 0x7f5a30115a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.222+0000 7f5a371ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30116060 con 0x7f5a3006ffe0 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.222+0000 7f5a371ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3010f5a0 con 0x7f5a300708f0 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a301154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a301154d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55832/0 (socket says 172.21.15.2:55832) 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 -- 172.21.15.2:0/1219862592 learned_addr learned my addr 172.21.15.2:0/1219862592 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a2ffff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a300708f0 0x7f5a30115a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 -- 172.21.15.2:0/1219862592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a300708f0 msgr2=0x7f5a30115a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a300708f0 0x7f5a30115a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 -- 172.21.15.2:0/1219862592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24005040 con 0x7f5a3006ffe0 2023-12-17T12:06:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a34f9b700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a301154d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a24004f50 tx=0x7f5a24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.223+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2400e040 con 0x7f5a3006ffe0 2023-12-17T12:06:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.224+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a24013420 con 0x7f5a3006ffe0 2023-12-17T12:06:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.224+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3010f820 con 0x7f5a3006ffe0 2023-12-17T12:06:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.224+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2401c630 con 0x7f5a3006ffe0 2023-12-17T12:06:45.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.224+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3010fd60 con 0x7f5a3006ffe0 2023-12-17T12:06:45.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.225+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a30106470 con 0x7f5a3006ffe0 2023-12-17T12:06:45.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.226+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f5a24013a00 con 0x7f5a3006ffe0 2023-12-17T12:06:45.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.227+0000 7f5a2d7fa700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5a2006ce70 0x7f5a2006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:45.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.227+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5a2408d560 con 0x7f5a3006ffe0 2023-12-17T12:06:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.228+0000 7f5a2ffff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5a2006ce70 0x7f5a2006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:45.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.228+0000 7f5a2ffff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5a2006ce70 0x7f5a2006f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a30110d70 tx=0x7f5a1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:45.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.232+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5a2405af30 con 0x7f5a3006ffe0 2023-12-17T12:06:45.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.443+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a30110ab0 con 0x7f5a3006ffe0 2023-12-17T12:06:45.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.445+0000 7f5a2d7fa700 1 -- 172.21.15.2:0/1219862592 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16357 (secure 0 0 0) 0x7f5a2405aac0 con 0x7f5a3006ffe0 2023-12-17T12:06:45.446 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-12-17T12:06:45.447 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"1a404768-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:48:50.417719+0000","modified":"2023-12-17T12:05:18.965815+0000","last_up_change":"2023-12-17T12:05:17.963682+0000","last_in_change":"2023-12-17T11:53:43.616013+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:52:56.580032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-17T11:54:55.230450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-17T11:54:56.027076+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2114bd7b-19fb-4504-8164-694ca3b767d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":52,"up_from":56,"up_thru":81,"down_at":53,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6803","nonce":1023971356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6805","nonce":1023971356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6809","nonce":1023971356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1023971356},{"type":"v1","addr":"172.21.15.2:6807","nonce":1023971356}]},"public_addr":"172.21.15.2:6803/1023971356","cluster_addr":"172.21.15.2:6805/1023971356","heartbeat_back_addr":"172.21.15.2:6809/1023971356","heartbeat_front_addr":"172.21.15.2:6807/1023971356","state":["exists","up"]},{"osd":1,"uuid":"4b728955-c4f6-4426-ae59-4614cbfea807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":57,"up_from":61,"up_thru":81,"down_at":58,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6811","nonce":1573545903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6813","nonce":1573545903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6817","nonce":1573545903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1573545903},{"type":"v1","addr":"172.21.15.2:6815","nonce":1573545903}]},"public_addr":"172.21.15.2:6811/1573545903","cluster_addr":"172.21.15.2:6813/1573545903","heartbeat_back_addr":"172.21.15.2:6817/1573545903","heartbeat_front_addr":"172.21.15.2:6815/1573545903","state":["exists","up"]},{"osd":2,"uuid":"a4f28cc1-78bc-4434-a7a0-ca4a373fc384","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":62,"up_from":66,"up_thru":81,"down_at":63,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6819","nonce":3504198593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6821","nonce":3504198593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6825","nonce":3504198593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":3504198593},{"type":"v1","addr":"172.21.15.2:6823","nonce":3504198593}]},"public_addr":"172.21.15.2:6819/3504198593","cluster_addr":"172.21.15.2:6821/3504198593","heartbeat_back_addr":"172.21.15.2:6825/3504198593","heartbeat_front_addr":"172.21.15.2:6823/3504198593","state":["exists","up"]},{"osd":3,"uuid":"b8f7021b-7c22-415a-9635-af30e6e6fc13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":67,"up_from":71,"up_thru":81,"down_at":68,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6801","nonce":619765794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6803","nonce":619765794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6807","nonce":619765794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":619765794},{"type":"v1","addr":"172.21.15.119:6805","nonce":619765794}]},"public_addr":"172.21.15.119:6801/619765794","cluster_addr":"172.21.15.119:6803/619765794","heartbeat_back_addr":"172.21.15.119:6807/619765794","heartbeat_front_addr":"172.21.15.119:6805/619765794","state":["exists","up"]},{"osd":4,"uuid":"d5ebbeab-3ba4-4e81-b453-d775808ac559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":72,"up_from":76,"up_thru":81,"down_at":73,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6809","nonce":1258724394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6811","nonce":1258724394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6815","nonce":1258724394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1258724394},{"type":"v1","addr":"172.21.15.119:6813","nonce":1258724394}]},"public_addr":"172.21.15.119:6809/1258724394","cluster_addr":"172.21.15.119:6811/1258724394","heartbeat_back_addr":"172.21.15.119:6815/1258724394","heartbeat_front_addr":"172.21.15.119:6813/1258724394","state":["exists","up"]},{"osd":5,"uuid":"dc8023ee-4370-4354-921e-5f7d71df5bc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":77,"up_from":81,"up_thru":81,"down_at":78,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6817","nonce":2475998087}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6819","nonce":2475998087}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6823","nonce":2475998087}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2475998087},{"type":"v1","addr":"172.21.15.119:6821","nonce":2475998087}]},"public_addr":"172.21.15.119:6817/2475998087","cluster_addr":"172.21.15.119:6819/2475998087","heartbeat_back_addr":"172.21.15.119:6823/2475998087","heartbeat_front_addr":"172.21.15.119:6821/2475998087","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:06.272236+0000","dead_epoch":52},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:30.215924+0000","dead_epoch":57},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:52:52.820296+0000","dead_epoch":62},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:14.743572+0000","dead_epoch":67},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:53:37.197272+0000","dead_epoch":72},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:54:00.536614+0000","dead_epoch":77}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6800/3359833978":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/3461314058":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/96945266":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/3091655634":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6826/696982378":"2023-12-18T11:55:09.500838+0000","172.21.15.2:6827/696982378":"2023-12-18T11:55:09.500838+0000","172.21.15.2:6801/3359833978":"2023-12-18T11:56:58.918639+0000","172.21.15.2:6800/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/599472466":"2023-12-18T11:49:24.084659+0000","172.21.15.2:0/2886179339":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.2:6800/2515016248":"2023-12-18T12:01:12.181677+0000","172.21.15.119:0/4235851367":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/1570438430":"2023-12-18T12:01:12.181677+0000","172.21.15.2:0/1129063553":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/2381631525":"2023-12-18T11:49:24.084659+0000","172.21.15.119:0/583890725":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/582228833":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/2256843163":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/1516546273":"2023-12-18T12:01:12.181677+0000","172.21.15.119:0/2560519728":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/1642465919":"2023-12-18T11:49:24.084659+0000","172.21.15.119:0/4168511392":"2023-12-18T11:58:16.394162+0000","172.21.15.119:6829/3593601472":"2023-12-18T11:58:16.394162+0000","172.21.15.2:6800/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/4058365663":"2023-12-18T11:56:58.918639+0000","172.21.15.2:0/3688904349":"2023-12-18T11:49:51.668708+0000","172.21.15.2:6801/2515016248":"2023-12-18T12:01:12.181677+0000","172.21.15.119:6828/3593601472":"2023-12-18T11:58:16.394162+0000","172.21.15.2:0/3009915854":"2023-12-18T11:49:51.668708+0000","172.21.15.119:0/1891654879":"2023-12-18T11:58:16.394162+0000","172.21.15.119:0/496324593":"2023-12-18T11:58:16.394162+0000","172.21.15.2:6801/832159067":"2023-12-18T11:50:59.977791+0000","172.21.15.2:0/3796631798":"2023-12-18T11:50:59.977791+0000","172.21.15.2:6801/444501898":"2023-12-18T11:49:51.668708+0000","172.21.15.2:0/1271749455":"2023-12-18T12:01:12.181677+0000","172.21.15.2:0/2893257583":"2023-12-18T12:01:12.181677+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5a2006ce70 msgr2=0x7f5a2006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5a2006ce70 0x7f5a2006f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a30110d70 tx=0x7f5a1c00b040 comp rx=0 tx=0).stop 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 msgr2=0x7f5a301154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a301154d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a24004f50 tx=0x7f5a24009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 shutdown_connections 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f5a2006ce70 0x7f5a2006f320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3006ffe0 0x7f5a301154d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 --2- 172.21.15.2:0/1219862592 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a300708f0 0x7f5a30115a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.447+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 >> 172.21.15.2:0/1219862592 conn(0x7f5a300f8630 msgr2=0x7f5a301035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.448+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 shutdown_connections 2023-12-17T12:06:45.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.448+0000 7f5a371ff700 1 -- 172.21.15.2:0/1219862592 wait complete. 2023-12-17T12:06:45.464 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:45 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/3888906939' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-17T12:06:45.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:52:56.580032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-17T11:54:55.230450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-17T11:54:56.027076+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:06:45.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T12:06:45.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:45 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/3888906939' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-17T12:06:45.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.668+0000 7ff923dff700 1 -- 172.21.15.2:0/4137719240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c102b40 msgr2=0x7ff91c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.668+0000 7ff923dff700 1 --2- 172.21.15.2:0/4137719240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c102b40 0x7ff91c102f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff918004940 tx=0x7ff918009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:45.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.668+0000 7ff923dff700 1 -- 172.21.15.2:0/4137719240 shutdown_connections 2023-12-17T12:06:45.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.668+0000 7ff923dff700 1 --2- 172.21.15.2:0/4137719240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c1034e0 0x7ff91c0fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.668+0000 7ff923dff700 1 --2- 172.21.15.2:0/4137719240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c102b40 0x7ff91c102f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.668+0000 7ff923dff700 1 -- 172.21.15.2:0/4137719240 >> 172.21.15.2:0/4137719240 conn(0x7ff91c0f86d0 msgr2=0x7ff91c0faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:45.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.669+0000 7ff923dff700 1 -- 172.21.15.2:0/4137719240 shutdown_connections 2023-12-17T12:06:45.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.669+0000 7ff923dff700 1 -- 172.21.15.2:0/4137719240 wait complete. 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.669+0000 7ff923dff700 1 Processor -- start 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.669+0000 7ff923dff700 1 -- start start 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff923dff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c102b40 0x7ff91c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff923dff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c1034e0 0x7ff91c113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff923dff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c113f50 con 0x7ff91c1034e0 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff923dff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c10d4b0 con 0x7ff91c102b40 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff92139a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c1034e0 0x7ff91c113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:45.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff921b9b700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c102b40 0x7ff91c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff92139a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c1034e0 0x7ff91c113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55856/0 (socket says 172.21.15.2:55856) 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff92139a700 1 -- 172.21.15.2:0/485271296 learned_addr learned my addr 172.21.15.2:0/485271296 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff921b9b700 1 -- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c1034e0 msgr2=0x7ff91c113900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.670+0000 7ff921b9b700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c1034e0 0x7ff91c113900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff921b9b700 1 -- 172.21.15.2:0/485271296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918005040 con 0x7ff91c102b40 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff921b9b700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c102b40 0x7ff91c1133c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff91800b3b0 tx=0x7ff918009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91800e040 con 0x7ff91c102b40 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c10d730 con 0x7ff91c102b40 2023-12-17T12:06:45.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff918013420 con 0x7ff91c102b40 2023-12-17T12:06:45.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91801c630 con 0x7ff91c102b40 2023-12-17T12:06:45.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.671+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c10dc70 con 0x7ff91c102b40 2023-12-17T12:06:45.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.672+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c0ffe50 con 0x7ff91c102b40 2023-12-17T12:06:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.673+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7ff918013970 con 0x7ff91c102b40 2023-12-17T12:06:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.674+0000 7ff9127fc700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff90806ce70 0x7ff90806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.674+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff91808d510 con 0x7ff91c102b40 2023-12-17T12:06:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.674+0000 7ff92139a700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff90806ce70 0x7ff90806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:45.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.675+0000 7ff92139a700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff90806ce70 0x7ff90806f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff91c10eca0 tx=0x7ff90c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:45.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.680+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff918057480 con 0x7ff91c102b40 2023-12-17T12:06:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.894+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff91c10ea80 con 0x7ff91c102b40 2023-12-17T12:06:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.895+0000 7ff9127fc700 1 -- 172.21.15.2:0/485271296 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff91805aaa0 con 0x7ff91c102b40 2023-12-17T12:06:45.897 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff90806ce70 msgr2=0x7ff90806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff90806ce70 0x7ff90806f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff91c10eca0 tx=0x7ff90c00b040 comp rx=0 tx=0).stop 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c102b40 msgr2=0x7ff91c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c102b40 0x7ff91c1133c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff91800b3b0 tx=0x7ff918009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 shutdown_connections 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7ff90806ce70 0x7ff90806f320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff91c102b40 0x7ff91c1133c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 --2- 172.21.15.2:0/485271296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff91c1034e0 0x7ff91c113900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 >> 172.21.15.2:0/485271296 conn(0x7ff91c0f86d0 msgr2=0x7ff91c0fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 shutdown_connections 2023-12-17T12:06:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:45.898+0000 7ff923dff700 1 -- 172.21.15.2:0/485271296 wait complete. 2023-12-17T12:06:45.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/3094496308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a941034e0 msgr2=0x7f1a940fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/3094496308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a941034e0 0x7f1a940fcb50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1a88004940 tx=0x7f1a88009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/3094496308 shutdown_connections 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/3094496308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a941034e0 0x7f1a940fcb50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/3094496308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a94102b40 0x7f1a94102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/3094496308 >> 172.21.15.2:0/3094496308 conn(0x7f1a940f86d0 msgr2=0x7f1a940faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/3094496308 shutdown_connections 2023-12-17T12:06:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.119+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/3094496308 wait complete. 2023-12-17T12:06:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.120+0000 7f1a9a5ff700 1 Processor -- start 2023-12-17T12:06:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.120+0000 7f1a9a5ff700 1 -- start start 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a9a5ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 0x7f1a9406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a9a5ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a941034e0 0x7f1a94070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a9a5ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940709c0 con 0x7f1a94102b40 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a9a5ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94070b00 con 0x7f1a941034e0 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 0x7f1a9406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 0x7f1a9406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55868/0 (socket says 172.21.15.2:55868) 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a93fff700 1 -- 172.21.15.2:0/1225922861 learned_addr learned my addr 172.21.15.2:0/1225922861 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a937fe700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a941034e0 0x7f1a94070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a93fff700 1 -- 172.21.15.2:0/1225922861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a941034e0 msgr2=0x7f1a94070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a93fff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a941034e0 0x7f1a94070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.121+0000 7f1a93fff700 1 -- 172.21.15.2:0/1225922861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88005040 con 0x7f1a94102b40 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.122+0000 7f1a93fff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 0x7f1a9406ff40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400b790 tx=0x7f1a84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.122+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a8400f6f0 con 0x7f1a94102b40 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.122+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a8400fd00 con 0x7f1a94102b40 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.122+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a94119810 con 0x7f1a94102b40 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.122+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a840103a0 con 0x7f1a94102b40 2023-12-17T12:06:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.122+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a94119bb0 con 0x7f1a94102b40 2023-12-17T12:06:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.123+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a940ffe50 con 0x7f1a94102b40 2023-12-17T12:06:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.124+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7f1a8400f850 con 0x7f1a94102b40 2023-12-17T12:06:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.125+0000 7f1a90ff9700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1a7c06ce70 0x7f1a7c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.125+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1a8408c100 con 0x7f1a94102b40 2023-12-17T12:06:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.125+0000 7f1a937fe700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1a7c06ce70 0x7f1a7c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.126+0000 7f1a937fe700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1a7c06ce70 0x7f1a7c06f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a94071730 tx=0x7f1a88009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.129+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1a84056040 con 0x7f1a94102b40 2023-12-17T12:06:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.339+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1a94064730 con 0x7f1a94102b40 2023-12-17T12:06:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.339+0000 7f1a90ff9700 1 -- 172.21.15.2:0/1225922861 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1a84059660 con 0x7f1a94102b40 2023-12-17T12:06:46.341 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-12-17T12:06:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1a7c06ce70 msgr2=0x7f1a7c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1a7c06ce70 0x7f1a7c06f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a94071730 tx=0x7f1a88009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 msgr2=0x7f1a9406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 0x7f1a9406ff40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400b790 tx=0x7f1a84009250 comp rx=0 tx=0).stop 2023-12-17T12:06:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 shutdown_connections 2023-12-17T12:06:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7f1a7c06ce70 0x7f1a7c06f320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a94102b40 0x7f1a9406ff40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 --2- 172.21.15.2:0/1225922861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a941034e0 0x7f1a94070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 >> 172.21.15.2:0/1225922861 conn(0x7f1a940f86d0 msgr2=0x7f1a940fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 shutdown_connections 2023-12-17T12:06:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.342+0000 7f1a9a5ff700 1 -- 172.21.15.2:0/1225922861 wait complete. 2023-12-17T12:06:46.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-17T12:06:46.423 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:46 smithi002 ceph-mon[211741]: pgmap v200: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:46.424 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:46 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1219862592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:06:46.424 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:46 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/485271296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:06:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 -- 172.21.15.2:0/1039743730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940102b40 msgr2=0x7fa940102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 --2- 172.21.15.2:0/1039743730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940102b40 0x7fa940102f10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa93c004940 tx=0x7fa93c009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 -- 172.21.15.2:0/1039743730 shutdown_connections 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 --2- 172.21.15.2:0/1039743730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9401034e0 0x7fa9400fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 --2- 172.21.15.2:0/1039743730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940102b40 0x7fa940102f10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 -- 172.21.15.2:0/1039743730 >> 172.21.15.2:0/1039743730 conn(0x7fa9400f86d0 msgr2=0x7fa9400faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 -- 172.21.15.2:0/1039743730 shutdown_connections 2023-12-17T12:06:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.562+0000 7fa947bff700 1 -- 172.21.15.2:0/1039743730 wait complete. 2023-12-17T12:06:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.563+0000 7fa947bff700 1 Processor -- start 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.563+0000 7fa947bff700 1 -- start start 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa947bff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa940102b40 0x7fa94006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa947bff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 0x7fa940070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa947bff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400709c0 con 0x7fa9401034e0 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa947bff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa940070b00 con 0x7fa940102b40 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94519a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 0x7fa940070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94519a700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 0x7fa940070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55884/0 (socket says 172.21.15.2:55884) 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94519a700 1 -- 172.21.15.2:0/2757468752 learned_addr learned my addr 172.21.15.2:0/2757468752 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94599b700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa940102b40 0x7fa94006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94519a700 1 -- 172.21.15.2:0/2757468752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa940102b40 msgr2=0x7fa94006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94519a700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa940102b40 0x7fa94006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.564+0000 7fa94519a700 1 -- 172.21.15.2:0/2757468752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c005040 con 0x7fa9401034e0 2023-12-17T12:06:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.565+0000 7fa94519a700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 0x7fa940070480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa930002a80 tx=0x7fa930004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.565+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa930004e80 con 0x7fa9401034e0 2023-12-17T12:06:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.565+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa93000f040 con 0x7fa9401034e0 2023-12-17T12:06:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.565+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa940119850 con 0x7fa9401034e0 2023-12-17T12:06:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.565+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa93000da00 con 0x7fa9401034e0 2023-12-17T12:06:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.565+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa940119ba0 con 0x7fa9401034e0 2023-12-17T12:06:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.566+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9400ffe50 con 0x7fa9401034e0 2023-12-17T12:06:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.567+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fa930007cc0 con 0x7fa9401034e0 2023-12-17T12:06:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.568+0000 7fa9367fc700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa92c06ce70 0x7fa92c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.568+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa93008b9b0 con 0x7fa9401034e0 2023-12-17T12:06:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.568+0000 7fa94599b700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa92c06ce70 0x7fa92c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.569+0000 7fa94599b700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa92c06ce70 0x7fa92c06f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0043d0 tx=0x7fa93c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.572+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa9300557f0 con 0x7fa9401034e0 2023-12-17T12:06:46.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:46 smithi119 ceph-mon[177559]: pgmap v200: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:46.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:46 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1219862592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:06:46.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:46 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/485271296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:06:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.783+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa940064730 con 0x7fa9401034e0 2023-12-17T12:06:46.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.784+0000 7fa9367fc700 1 -- 172.21.15.2:0/2757468752 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v82) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa930058e10 con 0x7fa9401034e0 2023-12-17T12:06:46.785 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa92c06ce70 msgr2=0x7fa92c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa92c06ce70 0x7fa92c06f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0043d0 tx=0x7fa93c009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 msgr2=0x7fa940070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 0x7fa940070480 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa930002a80 tx=0x7fa930004630 comp rx=0 tx=0).stop 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 shutdown_connections 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fa92c06ce70 0x7fa92c06f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa940102b40 0x7fa94006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.786+0000 7fa947bff700 1 --2- 172.21.15.2:0/2757468752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9401034e0 0x7fa940070480 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.787+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 >> 172.21.15.2:0/2757468752 conn(0x7fa9400f86d0 msgr2=0x7fa9400fa490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.787+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 shutdown_connections 2023-12-17T12:06:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:46.787+0000 7fa947bff700 1 -- 172.21.15.2:0/2757468752 wait complete. 2023-12-17T12:06:46.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T12:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/3340451261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 msgr2=0x7fbbc8102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/3340451261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8102f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc004940 tx=0x7fbbbc009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/3340451261 shutdown_connections 2023-12-17T12:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/3340451261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc81034e0 0x7fbbc80fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/3340451261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8102f10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/3340451261 >> 172.21.15.2:0/3340451261 conn(0x7fbbc80f86d0 msgr2=0x7fbbc80faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/3340451261 shutdown_connections 2023-12-17T12:06:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.006+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/3340451261 wait complete. 2023-12-17T12:06:47.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbcf1ff700 1 Processor -- start 2023-12-17T12:06:47.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbcf1ff700 1 -- start start 2023-12-17T12:06:47.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbcf1ff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8115530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:47.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbcf1ff700 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc81034e0 0x7fbbc8115a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbcf1ff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc81160c0 con 0x7fbbc8102b40 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbcf1ff700 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc810f600 con 0x7fbbc81034e0 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbccf9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8115530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbccf9b700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8115530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55908/0 (socket says 172.21.15.2:55908) 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.007+0000 7fbbccf9b700 1 -- 172.21.15.2:0/1789926305 learned_addr learned my addr 172.21.15.2:0/1789926305 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbc7fff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc81034e0 0x7fbbc8115a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbccf9b700 1 -- 172.21.15.2:0/1789926305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc81034e0 msgr2=0x7fbbc8115a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbccf9b700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc81034e0 0x7fbbc8115a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbccf9b700 1 -- 172.21.15.2:0/1789926305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4005040 con 0x7fbbc8102b40 2023-12-17T12:06:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbccf9b700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8115530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0040d0 tx=0x7fbbbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbbc021070 con 0x7fbbc8102b40 2023-12-17T12:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbbbc01c400 con 0x7fbbc8102b40 2023-12-17T12:06:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc005040 con 0x7fbbc8102b40 2023-12-17T12:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.008+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbbc00e070 con 0x7fbbc8102b40 2023-12-17T12:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.009+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc810fc30 con 0x7fbbc8102b40 2023-12-17T12:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.009+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8064730 con 0x7fbbc8102b40 2023-12-17T12:06:47.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.011+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 40) v1 ==== 90934+0+0 (secure 0 0 0) 0x7fbbbc01c9c0 con 0x7fbbc8102b40 2023-12-17T12:06:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.012+0000 7fbbc57fa700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbbb806ce70 0x7fbbb806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:06:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.012+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbbbc08d500 con 0x7fbbc8102b40 2023-12-17T12:06:47.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.012+0000 7fbbc7fff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbbb806ce70 0x7fbbb806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:06:47.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.013+0000 7fbbc7fff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbbb806ce70 0x7fbbb806f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8110dd0 tx=0x7fbbb4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:06:47.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.016+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbbbc05aed0 con 0x7fbbc8102b40 2023-12-17T12:06:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.248+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbc810f840 con 0x7fbbc8102b40 2023-12-17T12:06:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.248+0000 7fbbc57fa700 1 -- 172.21.15.2:0/1789926305 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v82) v1 ==== 81+0+2155 (secure 0 0 0) 0x7fbbbc05aa60 con 0x7fbbc8102b40 2023-12-17T12:06:47.250 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3359833978 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:47.250 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3461314058 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:47.250 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/96945266 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:47.250 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3091655634 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:47.250 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6826/696982378 2023-12-18T11:55:09.500838+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6827/696982378 2023-12-18T11:55:09.500838+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3359833978 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/832159067 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/599472466 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2886179339 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2381631525 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2515016248 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/4235851367 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1570438430 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1129063553 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2381631525 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/583890725 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/582228833 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2256843163 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1516546273 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/2560519728 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1642465919 2023-12-18T11:49:24.084659+0000 2023-12-17T12:06:47.252 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/4168511392 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:6829/3593601472 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/444501898 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/4058365663 2023-12-18T11:56:58.918639+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3688904349 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2515016248 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:6828/3593601472 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3009915854 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/1891654879 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.253 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.119:0/496324593 2023-12-18T11:58:16.394162+0000 2023-12-17T12:06:47.254 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/832159067 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:47.254 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3796631798 2023-12-18T11:50:59.977791+0000 2023-12-17T12:06:47.254 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/444501898 2023-12-18T11:49:51.668708+0000 2023-12-17T12:06:47.254 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1271749455 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:47.254 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2893257583 2023-12-18T12:01:12.181677+0000 2023-12-17T12:06:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.250+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbbb806ce70 msgr2=0x7fbbb806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.250+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbbb806ce70 0x7fbbb806f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8110dd0 tx=0x7fbbb4009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 msgr2=0x7fbbc8115530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:06:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8115530 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0040d0 tx=0x7fbbbc009e30 comp rx=0 tx=0).stop 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 shutdown_connections 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:6800/40594865,v1:172.21.15.2:6801/40594865] conn(0x7fbbb806ce70 0x7fbbb806f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbbc8102b40 0x7fbbc8115530 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 --2- 172.21.15.2:0/1789926305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc81034e0 0x7fbbc8115a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 >> 172.21.15.2:0/1789926305 conn(0x7fbbc80f86d0 msgr2=0x7fbbc8070280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 shutdown_connections 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-12-17T12:06:47.251+0000 7fbbcf1ff700 1 -- 172.21.15.2:0/1789926305 wait complete. 2023-12-17T12:06:47.256 INFO:teuthology.orchestra.run.smithi002.stderr:listed 37 entries 2023-12-17T12:06:47.271 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-17T12:06:47.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-17T12:06:47.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-12-17T12:06:47.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.368 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-17T12:06:47.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.463 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-12-17T12:06:47.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:47 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1225922861' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-17T12:06:47.474 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:47 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/2757468752' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-17T12:06:47.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-17T12:06:47.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-17T12:06:47.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:47 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1225922861' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-17T12:06:47.657 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:47 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/2757468752' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-17T12:06:47.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-12-17T12:06:47.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.825 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-12-17T12:06:47.872 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-17T12:06:47.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.874 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-17T12:06:47.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T12:06:47.947 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-12-17T12:06:48.060 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-17T12:06:48.071 INFO:tasks.cephadm:Teardown begin 2023-12-17T12:06:48.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:06:48.146 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:06:48.211 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:48 smithi119 ceph-mon[177559]: pgmap v201: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:48.211 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:48 smithi119 ceph-mon[177559]: from='client.? 172.21.15.2:0/1789926305' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-17T12:06:48.220 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-17T12:06:48.220 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-17T12:06:48.267 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-17T12:06:48.313 INFO:tasks.cephadm:Stopping all daemons... 2023-12-17T12:06:48.314 INFO:tasks.cephadm.mon.smithi002:Stopping mon.smithi002... 2023-12-17T12:06:48.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002 2023-12-17T12:06:48.394 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:48 smithi002 ceph-mon[211741]: pgmap v201: 65 pgs: 65 active+clean; 335 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-17T12:06:48.394 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:48 smithi002 ceph-mon[211741]: from='client.? 172.21.15.2:0/1789926305' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-17T12:06:48.658 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:48 smithi002 systemd[1]: Stopping Ceph mon.smithi002 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:48.659 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:48 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[211718]: 2023-12-17T12:06:48.643+0000 7feaa7fa9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi002 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:48.659 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:48 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002[211718]: 2023-12-17T12:06:48.643+0000 7feaa7fa9700 -1 mon.smithi002@0(leader) e3 *** Got Signal Terminated *** 2023-12-17T12:06:48.974 INFO:journalctl@ceph.mon.smithi002.smithi002.stdout:Dec 17 12:06:48 smithi002 bash[248520]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi002 2023-12-17T12:06:49.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi002.service' 2023-12-17T12:06:49.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:49.238 INFO:tasks.cephadm.mon.smithi002:Stopped mon.smithi002 2023-12-17T12:06:49.238 INFO:tasks.cephadm.mon.smithi119:Stopping mon.smithi119... 2023-12-17T12:06:49.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi119 2023-12-17T12:06:49.641 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:49 smithi119 systemd[1]: Stopping Ceph mon.smithi119 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:49.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:49 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119[177536]: 2023-12-17T12:06:49.638+0000 7f0b5b9cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi119 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:49.907 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:49 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119[177536]: 2023-12-17T12:06:49.638+0000 7f0b5b9cd700 -1 mon.smithi119@1(peon) e3 *** Got Signal Terminated *** 2023-12-17T12:06:49.908 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Dec 17 12:06:49 smithi119 bash[207940]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-mon-smithi119 2023-12-17T12:06:50.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@mon.smithi119.service' 2023-12-17T12:06:50.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:50.286 INFO:tasks.cephadm.mon.smithi119:Stopped mon.smithi119 2023-12-17T12:06:50.287 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-17T12:06:50.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.0 2023-12-17T12:06:50.644 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:06:50 smithi002 systemd[1]: Stopping Ceph osd.0 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:50.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:06:50 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:06:50.642+0000 7fb83d82c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:50.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:06:50 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:06:50.642+0000 7fb83d82c700 -1 osd.0 82 *** Got signal Terminated *** 2023-12-17T12:06:50.975 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:06:50 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0[225762]: 2023-12-17T12:06:50.642+0000 7fb83d82c700 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:06:56.475 INFO:journalctl@ceph.osd.0.smithi002.stdout:Dec 17 12:06:56 smithi002 bash[248675]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-0 2023-12-17T12:06:57.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.0.service' 2023-12-17T12:06:58.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:58.089 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-17T12:06:58.089 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-17T12:06:58.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.1 2023-12-17T12:06:58.443 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:06:58 smithi002 systemd[1]: Stopping Ceph osd.1 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:58.725 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:06:58 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:06:58.441+0000 7f4ff330c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:58.725 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:06:58 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:06:58.441+0000 7f4ff330c700 -1 osd.1 82 *** Got signal Terminated *** 2023-12-17T12:06:58.725 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:06:58 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1[233013]: 2023-12-17T12:06:58.441+0000 7f4ff330c700 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:07:04.475 INFO:journalctl@ceph.osd.1.smithi002.stdout:Dec 17 12:07:04 smithi002 bash[248938]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-1 2023-12-17T12:07:05.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.1.service' 2023-12-17T12:07:05.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:07:05.919 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-17T12:07:05.919 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-17T12:07:05.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.2 2023-12-17T12:07:06.225 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:07:06 smithi002 systemd[1]: Stopping Ceph osd.2 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:07:06.724 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:07:06 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:07:06.260+0000 7fc687480700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:07:06.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:07:06 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:07:06.260+0000 7fc687480700 -1 osd.2 82 *** Got signal Terminated *** 2023-12-17T12:07:06.725 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:07:06 smithi002 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2[239509]: 2023-12-17T12:07:06.260+0000 7fc687480700 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:07:12.224 INFO:journalctl@ceph.osd.2.smithi002.stdout:Dec 17 12:07:12 smithi002 bash[249203]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-2 2023-12-17T12:07:13.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.2.service' 2023-12-17T12:07:13.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:07:13.822 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-17T12:07:13.822 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-17T12:07:13.822 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.3 2023-12-17T12:07:14.157 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:07:13 smithi119 systemd[1]: Stopping Ceph osd.3 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:07:14.657 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:07:14 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:07:14.201+0000 7f59f75f1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:07:14.657 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:07:14 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:07:14.201+0000 7f59f75f1700 -1 osd.3 82 *** Got signal Terminated *** 2023-12-17T12:07:14.657 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:07:14 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3[189585]: 2023-12-17T12:07:14.201+0000 7f59f75f1700 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:07:18.407 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:18 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:18.045+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:18.408 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:17 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:17.911+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:19.407 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:18 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:18.996+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:19.408 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:18 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:18.913+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:20.157 INFO:journalctl@ceph.osd.3.smithi119.stdout:Dec 17 12:07:19 smithi119 bash[208085]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-3 2023-12-17T12:07:20.158 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:19 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:19.947+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:20.158 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:19 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:19.926+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:21.362 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:20 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:20.972+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:21.362 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:20 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:20.968+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:21.381 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.3.service' 2023-12-17T12:07:21.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:07:21.471 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-17T12:07:21.471 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-17T12:07:21.471 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.4 2023-12-17T12:07:21.657 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:21 smithi119 systemd[1]: Stopping Ceph osd.4 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:07:22.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:21 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:21.814+0000 7f44c01df700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:07:22.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:21 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:21.814+0000 7f44c01df700 -1 osd.4 82 *** Got signal Terminated *** 2023-12-17T12:07:22.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:21 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:21.814+0000 7f44c01df700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:07:22.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:21 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:21.933+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:22.158 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:21 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:21.921+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:23.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:22 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:22.941+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:23.158 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:22 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:22.885+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:24.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:23 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:23.986+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:24.158 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:23 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:23.848+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:25.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:25 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:25.027+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:25.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:24 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:24.832+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:26.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:25 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:25.818+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:26.157 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:26 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4[195713]: 2023-12-17T12:07:26.068+0000 7f44bc7da700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:54.308790+0000 front 2023-12-17T12:06:54.308805+0000 (oldest deadline 2023-12-17T12:07:17.208679+0000) 2023-12-17T12:07:27.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:26 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:26.859+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:27.657 INFO:journalctl@ceph.osd.4.smithi119.stdout:Dec 17 12:07:27 smithi119 bash[208349]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-4 2023-12-17T12:07:28.125 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:27 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:27.856+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:28.942 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.4.service' 2023-12-17T12:07:29.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:07:29.032 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-17T12:07:29.032 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-17T12:07:29.032 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.5 2023-12-17T12:07:29.094 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:28 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:28.827+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:29.094 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:28 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:28.827+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2023-12-17T12:07:02.705767+0000 front 2023-12-17T12:07:02.705859+0000 (oldest deadline 2023-12-17T12:07:28.005531+0000) 2023-12-17T12:07:29.373 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:29 smithi119 systemd[1]: Stopping Ceph osd.5 for 1a404768-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:07:29.374 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:29 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:29.371+0000 7efd3eb5c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:07:29.657 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:29 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:29.371+0000 7efd3eb5c700 -1 osd.5 82 *** Got signal Terminated *** 2023-12-17T12:07:29.657 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:29 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:29.371+0000 7efd3eb5c700 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:07:30.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:29 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:29.793+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:30.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:29 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:29.793+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2023-12-17T12:07:02.705767+0000 front 2023-12-17T12:07:02.705859+0000 (oldest deadline 2023-12-17T12:07:28.005531+0000) 2023-12-17T12:07:31.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:30 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:30.745+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:31.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:30 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:30.745+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2023-12-17T12:07:02.705767+0000 front 2023-12-17T12:07:02.705859+0000 (oldest deadline 2023-12-17T12:07:28.005531+0000) 2023-12-17T12:07:32.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:31 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:31.734+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:32.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:31 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:31.734+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2023-12-17T12:07:02.705767+0000 front 2023-12-17T12:07:02.705859+0000 (oldest deadline 2023-12-17T12:07:28.005531+0000) 2023-12-17T12:07:33.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:32 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:32.711+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:33.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:32 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:32.711+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2023-12-17T12:07:02.705767+0000 front 2023-12-17T12:07:02.705859+0000 (oldest deadline 2023-12-17T12:07:28.005531+0000) 2023-12-17T12:07:33.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:32 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:32.711+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6822 osd.2 since back 2023-12-17T12:07:08.006181+0000 front 2023-12-17T12:07:08.006223+0000 (oldest deadline 2023-12-17T12:07:32.105970+0000) 2023-12-17T12:07:34.157 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:33 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:33.759+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2023-12-17T12:06:55.104761+0000 front 2023-12-17T12:06:55.104876+0000 (oldest deadline 2023-12-17T12:07:17.404684+0000) 2023-12-17T12:07:34.158 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:33 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:33.759+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6814 osd.1 since back 2023-12-17T12:07:02.705767+0000 front 2023-12-17T12:07:02.705859+0000 (oldest deadline 2023-12-17T12:07:28.005531+0000) 2023-12-17T12:07:34.158 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:33 smithi119 ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5[202381]: 2023-12-17T12:07:33.759+0000 7efd38151700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.2:6822 osd.2 since back 2023-12-17T12:07:08.006181+0000 front 2023-12-17T12:07:08.006223+0000 (oldest deadline 2023-12-17T12:07:32.105970+0000) 2023-12-17T12:07:35.407 INFO:journalctl@ceph.osd.5.smithi119.stdout:Dec 17 12:07:35 smithi119 bash[208624]: ceph-1a404768-9cd2-11ee-95a5-87774f69a715-osd-5 2023-12-17T12:07:36.553 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1a404768-9cd2-11ee-95a5-87774f69a715@osd.5.service' 2023-12-17T12:07:36.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:07:36.643 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-17T12:07:36.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-17T12:08:00.232 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-17T12:08:12.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:08:13.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:08:13.083 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-17T12:08:13.085 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/remote/smithi002/crash 2023-12-17T12:08:13.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/crash -- . 2023-12-17T12:08:13.157 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-17T12:08:13.158 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2023-12-17T12:08:13.161 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/remote/smithi119/crash 2023-12-17T12:08:13.162 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/crash -- . 2023-12-17T12:08:13.229 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-17T12:08:13.230 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2023-12-17T12:08:13.232 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-17T12:08:13.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-17T12:08:13.312 INFO:teuthology.orchestra.run.smithi002.stderr:grep: /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-17T12:08:13.317 INFO:tasks.cephadm:Compressing logs... 2023-12-17T12:08:13.317 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-17T12:08:13.322 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-17T12:08:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-17T12:08:13.387 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-17T12:08:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi002.ercyvj.log 2023-12-17T12:08:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-17T12:08:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi002.ercyvj.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-17T12:08:13.392 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-17T12:08:13.392 INFO:teuthology.orchestra.run.smithi119.stderr:: No such file or directory 2023-12-17T12:08:13.392 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-17T12:08:13.393 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi119.qgnwfs.log 2023-12-17T12:08:13.393 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mon.smithi002.log 2023-12-17T12:08:13.394 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-17T12:08:13.395 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-17T12:08:13.395 INFO:teuthology.orchestra.run.smithi119.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-17T12:08:13.395 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi119.qgnwfs.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi119.mzkvrk.log 2023-12-17T12:08:13.396 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mon.smithi002.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi002.atwfoy.log 2023-12-17T12:08:13.397 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mon.smithi119.log 2023-12-17T12:08:13.397 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mgr.smithi002.cqnuqs.log 2023-12-17T12:08:13.398 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi119.mzkvrk.log: 94.2% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi119.qgnwfs.log.gz 2023-12-17T12:08:13.399 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-17T12:08:13.399 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mon.smithi119.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-17T12:08:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi002.atwfoy.log: /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mgr.smithi002.cqnuqs.log: 91.4% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi002.ercyvj.log.gz 2023-12-17T12:08:13.402 INFO:teuthology.orchestra.run.smithi002.stderr: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-17T12:08:13.402 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-17T12:08:13.402 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mgr.smithi119.nzblpy.log 2023-12-17T12:08:13.407 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.5.log: /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mgr.smithi119.nzblpy.log: 90.9% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-17T12:08:13.408 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.1.log: 90.9% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-17T12:08:13.441 INFO:teuthology.orchestra.run.smithi119.stderr: 88.3% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mgr.smithi119.nzblpy.log.gz 2023-12-17T12:08:13.661 INFO:teuthology.orchestra.run.smithi119.stderr: 92.4% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mon.smithi119.log.gz 2023-12-17T12:08:13.733 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mgr.smithi002.cqnuqs.log.gz 2023-12-17T12:08:14.052 INFO:teuthology.orchestra.run.smithi002.stderr: 90.6% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mon.smithi002.log.gz 2023-12-17T12:08:17.355 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-17T12:08:17.528 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-17T12:08:18.338 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-17T12:08:18.641 INFO:teuthology.orchestra.run.smithi119.stderr: 93.5% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-17T12:08:18.849 INFO:teuthology.orchestra.run.smithi002.stderr: 93.5% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-17T12:08:19.310 INFO:teuthology.orchestra.run.smithi119.stderr: 93.4% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-17T12:08:53.790 INFO:teuthology.orchestra.run.smithi119.stderr: 93.0% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi119.mzkvrk.log.gz 2023-12-17T12:08:53.793 INFO:teuthology.orchestra.run.smithi119.stderr: 2023-12-17T12:08:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m40.427s 2023-12-17T12:08:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m51.817s 2023-12-17T12:08:53.794 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m4.216s 2023-12-17T12:09:10.133 INFO:teuthology.orchestra.run.smithi002.stderr: 93.0% -- replaced with /var/log/ceph/1a404768-9cd2-11ee-95a5-87774f69a715/ceph-mds.cephfs.smithi002.atwfoy.log.gz 2023-12-17T12:09:10.137 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-12-17T12:09:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m56.776s 2023-12-17T12:09:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:user 1m7.139s 2023-12-17T12:09:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m5.050s 2023-12-17T12:09:10.138 INFO:tasks.cephadm:Archiving logs... 2023-12-17T12:09:10.138 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/remote/smithi002/log 2023-12-17T12:09:10.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-17T12:09:18.928 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/remote/smithi119/log 2023-12-17T12:09:18.929 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-17T12:09:26.421 INFO:tasks.cephadm:Removing cluster... 2023-12-17T12:09:26.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 --force 2023-12-17T12:09:27.448 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 --force 2023-12-17T12:09:28.386 INFO:tasks.cephadm:Removing cephadm ... 2023-12-17T12:09:28.386 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-17T12:09:28.438 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-17T12:09:28.485 INFO:tasks.cephadm:Teardown complete 2023-12-17T12:09:28.486 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-17T12:09:28.496 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-17T12:09:28.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-17T12:09:28.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-17T12:09:28.623 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-17T12:09:28.633 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-17T12:09:28.633 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T12:09:28.638 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T12:09:28.679 INFO:teuthology.orchestra.run.smithi002.stderr:bash: ntpq: command not found 2023-12-17T12:09:28.682 INFO:teuthology.orchestra.run.smithi119.stderr:bash: ntpq: command not found 2023-12-17T12:09:28.687 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T12:09:28.687 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2023-12-17T12:09:28.687 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 81 +1529us[+1531us] +/- 70ms 2023-12-17T12:09:28.688 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv02.front.sepia.ceph.com 3 7 377 16 +308us[ +324us] +/- 51ms 2023-12-17T12:09:28.688 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -1766us[-1766us] +/- 91ms 2023-12-17T12:09:28.688 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T12:09:28.689 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T12:09:28.689 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2023-12-17T12:09:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +1360us[+1360us] +/- 71ms 2023-12-17T12:09:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 +143us[ +152us] +/- 52ms 2023-12-17T12:09:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -1925us[-1916us] +/- 91ms 2023-12-17T12:09:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T12:09:28.691 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-17T12:09:28.701 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-17T12:09:28.701 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-17T12:09:28.711 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-17T12:09:28.889 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-17T12:09:29.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T12:09:29.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:09:29.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T12:09:29.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:09:29.213 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-17T12:09:29.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-17T12:09:29.234 INFO:teuthology.task.internal:Duration was 2214.966475 seconds 2023-12-17T12:09:29.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-17T12:09:29.244 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-17T12:09:29.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-17T12:09:29.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-17T12:09:29.365 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T12:09:29.366 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T12:09:29.691 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-17T12:09:29.691 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2023-12-17T12:09:29.691 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-17T12:09:29.754 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-12-17T12:09:29.754 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-17T12:09:29.815 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-17T12:09:29.815 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-17T12:09:29.820 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-17T12:09:29.925 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-17T12:09:29.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-17T12:09:29.930 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-17T12:09:30.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-17T12:09:30.122 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-17T12:09:30.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-17T12:09:30.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-17T12:09:30.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-17T12:09:30.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:09:30.280 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:09:30.345 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2023-12-17T12:09:30.348 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-12-17T12:09:30.383 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:09:30.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:09:30.427 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:09:30.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:09:30.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-17T12:09:30.483 INFO:teuthology.task.internal:Transferring archived files... 2023-12-17T12:09:30.483 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/remote/smithi002 2023-12-17T12:09:30.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-17T12:09:30.571 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152/remote/smithi119 2023-12-17T12:09:30.571 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-17T12:09:30.654 INFO:teuthology.task.internal:Removing archive directory... 2023-12-17T12:09:30.655 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-17T12:09:30.659 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-17T12:09:30.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-17T12:09:30.718 INFO:teuthology.task.internal:Not uploading archives. 2023-12-17T12:09:30.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-17T12:09:30.729 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-17T12:09:30.730 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-17T12:09:30.734 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-17T12:09:30.776 INFO:teuthology.orchestra.run.smithi002.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 12:09 /home/ubuntu/cephtest 2023-12-17T12:09:30.781 INFO:teuthology.orchestra.run.smithi119.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 12:09 /home/ubuntu/cephtest 2023-12-17T12:09:30.784 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-17T12:09:30.795 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-17T12:09:30.858 INFO:teuthology.nuke:Checking targets against current locks 2023-12-17T12:09:30.885 DEBUG:teuthology.nuke:shortname: smithi002 2023-12-17T12:09:30.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:09:30.910 DEBUG:teuthology.nuke:shortname: smithi119 2023-12-17T12:09:30.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:09:30.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:18.402672', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsycvUbnia+XXkIfKBuYRX380QKBeNgeLZxMSxt62N5c2Kn+KDHDLLIu4x9R8LprchiOyf1iPWYew6dSbS2Uq8='} 2023-12-17T12:09:30.938 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495152', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:18.400272', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzhAPDhDoCLugXeLkhhliGd0SSmb8SNsKmCliskRa2edTROP4W8MGmkcnE/kwnX+V5hleGkgbcPK4OtJ9wGwC4='} 2023-12-17T12:09:30.956 INFO:teuthology.orchestra.console.smithi002:Power off 2023-12-17T12:09:30.957 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:09:30.979 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-12-17T12:09:30.979 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:09:30.995 INFO:teuthology.orchestra.console.smithi119:Power off 2023-12-17T12:09:30.995 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:09:31.005 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-17T12:09:31.017 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2023-12-17T12:09:31.017 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:09:31.039 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-17T12:09:35.006 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:09:35.040 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:09:35.115 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-12-17T12:09:35.148 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2023-12-17T12:09:39.120 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:09:39.149 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:09:39.231 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-12-17T12:09:39.258 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2023-12-17T12:09:39.333 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-12-17T12:09:39.359 INFO:teuthology.orchestra.console.smithi119:Power off completed 2023-12-17T12:09:39.465 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2214.9664747714996 failure_reason: 'Command failed on smithi002 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1a404768-9cd2-11ee-95a5-87774f69a715 -e sha1=a62fda73efba5520d409bb5a21bd8373289dda5d -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default host.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c host.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4a163fb9500945e0901e4d06f0d6095c status: fail success: false 2023-12-17T12:09:39.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:09:39.549 INFO:teuthology.run:FAIL